Remove folders from the settings panel