update
ensure i doesnt go over code length
remove train call from loop
get rid of bottleneck on training (tokenization is a lot faster with document iterator
add token pre processor
get rid of specific path for output loading (sorry guys!)
make local update savers cluster aware
tsne data compression (dont need data in memory after probs created
tsne data compression (dont need data in memory after probs created
disable adagrad by default on word2vec fix bug in line iterator
add hooks for tsne
make data processing a little less data intensive
put vocab logic all in one place
add visualization layer via d3 for tsne, also fix some element() calls
make document iterator more robust, check for empty files
handle directory case
handle directory case
input stream creator for stream work
serializable vectorizer
input stream creator for stream work