Run tests against appliance after upgrade