early exit if there are no items in the priority queue holding the timeouts