Change gitignore to be whitelist instead

Since this could exist alongside web projects and other stuff, we
want to only track the stuff that's relevant to this project.