Tokenizer package as used by Hippo.