Remove all the rulesets that we dont need.