Split Tokenizer off from CorpusReader, MetaReader, SentenceReader.
Updated import_corpus to match new Readers.
Minor updates to core.py
Added lyra format to TermiteCore.
Set lyra content-type to application/json.
Modified corpus views to include Lyra option.
Added lyra view to all corpus api pages.
Added g2 statistics.
Updated corpus api
Added symlink to webpy admin application.
Added TermG2 and TermSentenceG2 to corpus api.
Updated all views to include lyra format.
Stopped counting co-occurrence of a word with itself.
Renamed TopicTopTerms and TopicTopDocs to TopTerms and TopDocs respectively.
Removed transposed matrices since they're identical in the new row-oriented output format.
Updated NSF dataset to use the raw text (instead of tokenized text).
Updated Makefile and demo to use nsf146k instead of nsf127992.
Changed timeout and flush calls.
Empty line terminates StreamingSentenceSplitter.
Merge branch 'master' of github.com:uwdata/termite-data-server