Clean-up the added PPA while running install tests.