Don't kill the old unicorn until the new workers are up