Update README.md
Merge branch 'master' of github.com:schwa-lab/gigacluster
Stream only uses .dr
Slots for better memory performance.
Faster inspect_doc by indexing docrep byte offsets
Added RE to use only certain years in Streams.
First cut of two-stage matching.
Replaced iter_pairs() with itertools.product(). Added sentence thresholds. (#1)
More accurate (and broad) punctuation regexp
Subsequence matching.
Merge branch 'master' of github.com:schwa-lab/gigacluster
Removed score, as it is always 1 or 0 by definition.
Added token index columns, using arguments rather than stdin. #3.
Script to find sentence pairs where one contains all the other's content
words
Update README.md
Bulk clustering. Do not match against primary pivot stream. #4
Merge branch 'master' of github.com:schwa-lab/gigacluster
Log to stderr
Workaround for Token.norm/raw oddness. Actually adding matches to the list. Fixed odd variable substitution.
Added Makefile.