Make provisioning VM destruction optional

Since sometimes we want it around for inspection