Remove Configfile script outputs

It turns out I had a use-after-free bug whose side-effect was that I
wasn't unlink()ing my temporary files.  I'm a bit worried that
valgrind didn't catch this, I'm not entirely sure why...