Add support thresholded lookups. Add tokenized version of put. Now always tokenize before inserting or looking up. Update test cases.