Wrote tokenized fcn. #25
Added comments.
Merge pull request #27 from swglad/corpi_builder

Wrote tokenized fcn.