Recognize and END-OF-FILE token.   Setup tokenization framework, as well as validation framework for tokens.
Added String tokenization