Don't push player away from despawned players.