Keep backups of old config files