Bug 1074579 - Runner should purge unused config files. r=dustin