Fix game end TP bugs caused by a5cd846

Remove players from team before teleporting them back to lobby or
rallypoint.