Don't spin if we exhaust the async worker pool.
Fix exhaustion code when using multiple sockets.