Avoid installed config files in the revert tests.

Patch from @rdunklau.