Wait for local workers to exit