Remove leftover config files