Setting up the lexer for a two-step process of tokenization. First step will sort out likely token groups, the second will evaluate their worthiness (or lack thereof)