Remove some gems until needed