Pre-segment sequences by alphabets, numbers, and symbols
Modify traits for FreqTrie::BaseIterator
Extract perform_fit() and perform_segment()
Inline the methods of TokenIterator