Get the yarn app to exit nicely