Implemented lexer for analyzing lexical grammrs suitable for generating table-driven DFA lexers. Scaffolding for lexical grammar parser.