Remove the iterator from the queue