It is preferable to set expectations regarding inspections and site access with the builder up front. If possible, have the right to conduct inspections at each stage included in your build contract.