added the corpus creation code.

It uses a csv version of the full dataset