Remove config files that should have never been there