Remove swap and backup vim dirs, and turn off swp files
Remove backups too, becuase we're already removing swp files