Handle 0 ms timeouts properly.