Fix #54: Also properly check owner surrounding the building position.