Python text file tokenizers supporting multiple start states, lexical tracking, and lookahead.