Written the lexical analyzer for EBNF. Outputs a stream of tokens that need to be constructed into a expression tree. EBNF syntax errors are reported though an exception. Next tasks if the tokenizer