Clean up .gitignore a bit

I've never seen a vim swap file that has an extension other than .swp,
and if someone does manage to commit one into the repository, they will
be exterminated anyway. ;)