Remove an old config file