initial commit
removed sqlalchemy
increased efficiency by precomputing log counts
removed changes for debugging
cleanup.  using words as keys since python interns them
speedups and refactoring: keeping a list of pair scores, not sorting
changed to sentence-based test
added comments, logging
fixed bug in printing output
fix to previous commit
fixed bug in filtering out pair scores.  was != instead of "is"
refactored a bit
re-enabled the fall-back for when current_batch_scores is empty
see previous
removed filtering of nonfinite scores
refactored to compute pair scores in one place instead of two.
added functionality to create clusters on only the most frequent N words
fixed bug (when paircount is 0, was yielding the same class twice), also refactored some things a bit
removed pdb
added command line arguments for batch size and max vocab