Save all config changes on exit so nothing gets lost