Added untested code to allow LineSentence objects to iterate over file objects as well as over file specified by name. This allows iterating over compressed files.
Added test cases for LineSentence class
Merge pull request #134 from RadixSeven/word2vec_compr

Word2vec compr
remove unused TODO.txt
Merge branch 'develop' of github.com:piskvorky/gensim into develop
upgrade ez_setup.py
add min/max char count of tokens in simple_preprocess as parameters
Change total_words count from an iteration over all vocab items to a simple addition.  This speeds things up a lot when processing billions of total words.
Merge pull request #139 from holopoj/develop

word2vec: Change total_words count from a function to a count
update readme docs
Merge branch 'develop' of github.com:piskvorky/gensim into develop
deprecate the light flag in pattern lemmatizer
minor logging improvements
re #144: fix leaking threads in RMI
re #144: fix threads in distributed LSI
Merge branch 'pyro_threads' into develop
update CHANGELOG
Fixing example code overflow in documentation
Merge pull request #145 from dfm/patch-1

Fixing example code overflow in documentation
minor word2vec doc change