init 0.2.5 - scaleable NDD
added near dup descr and moved tokenization to utils
tokenizer shared by fingerprint and shingles
initial work on fingerprinting, IR techniques applied to tokenizer
added fingerprinting code
added fingerprinting code