Make sure player is actually queued before unqueueing them