Add a .gitignore file to stop following elpa and other unnecessary files