updating .gitignore and adding generate-data file
seems to keep memory low but doesn't seem very efficient
adding indexes, seems to work