Ignore Vim's swap files when looking for a patch