Don't set arena number when moving to spectator.