I think there is no cleanup to do. The `delete extension` REST call will have an error response.