When a user removes a feature, actually remove it.