Teleport player on arena leave properly