First go at removal of duplicates
Duplicates found before entry added to DB
Added to .gitignore
Added code which computes collocations in a random sample of the full collections of emails