Remove config from tracked files.