Better handle errors in unprovisioning

* Throw a better error
* Don't catch nonexistent specific error