Make sure we always run the tests against a freshInstall