Close file handlers for Config::Properties where necessary