Write temporary test configs to test/tmp and ignore this directory from git.