I will need to take a better look then... but the test cases were meant to run on isolation. Unless `:application.stop` is async (i.e. when it returns, the application may not have stopped completely yet, which I don't think is the case. :)