knowitall/nlptools — pull request #28 by jgilme1 (2013-10-24 18:03:11+00:00)
Title: Added Token/Tokenizer and PostaggedToken/PosTagger Serialization

The serialization scheme is
The@0 DT NP-DT \t big@4 JJ NP-JJ
---------
Token
---------------
PostaggedToken
---------------------------
ChunkedToken