Config: Add functionality to remove non-existant options