Remove players from teams when removing from scoreboard