Don't hide players who are already in the game when we switch to maps with less players.