Remove subtitutions of config files as well