If we do not own the accept lock, reduce timeout for platform wait.

This way multiple workers won't stall when passing the accept lock
around for at maximum 100 ms (time spent in epoll/kqueue waits).