refactored scoreDuplicates so that we don't have huge intermediate objects, related to #222 and #187
simpler results handler
fixed up deduplication of scored pairs
deduplicate scored_pairs as we go
clean up collector
Revert "clean up collector"

This reverts commit e6d801422c8a6943ba31201f21faf0b550dfaa54.
Revert "deduplicate scored_pairs as we go"

This reverts commit 39deb3e33da16f73de6dc11b8a1ad3fa85bd5413.
just do it all at once with unique
handle mac os x
move imoprts for mac os x fix to backport
make it clearer that test depend upon extension built inplace
switch from Queues to Simple Queues
remove uniquing from core
redundant free blocking
redundant free blocking scheme, closes #202
performance tweaks
added explanations for much of the weird mysql wizardry, put important set group_concat_max_len statement back
removed extra group_concat_max_len setting
simplify mysql steps
simplify mysql steps