Fix writing config files with fresh PRs