Set players scoreboard back to default when removed.