Delete some of the configuration for an unused gem