Allow moving to spec without joining the queue. (e.g. for afk managers)