Fix players staying in scoreboard after leaving