Fix worker wait condition to wait for worker servers.