Don't overwrite existing config files

Addresses #1094. Also, there was no :written_file notification for
Capfile even though there was for all other config files.
Merge pull request #1189 from Kriechi/do-not-overwrite

Don't overwrite existing config files