Don't do PVS check if the building is definitely not inside the base.