Undoing when removing a player will sort them again