Make sure thread wake does not get lost when multi-threaded collecting