Don't add workers to the pool until the socket is ready