You should add something to your .gitignore file to not push up all of your backup files. Linux creates backup files with a tilde ~ at the end of the file name. We don't need all those files up on Heroku.
add:
*~

* is a wildcard that will match anything, with the tilde on the end it will match all files with a tilde and not push them to Heroku.