Don't spin if we exhaust the async worker pool.