add hash-based duplicate checking
Fix crash-on-exit issue
Fix web stuff for py3k, add web-based hash queries