Also restrict logging of small sleeps