Eliminate checks for walls not in player's world