Swap the failure app during the test case properly.