Change .gitignore to leave out build files for the latex source
Finally sorted out the latex/gitignore