Ensure we cleanup the tmp dir

Even if the tests fails.