Wait for workers to shutdown