Handle exceptions when saving config files and alert the user