Clean up the PE tarballs as well as the VMs