Create lexer.h

This file contains data structures and associated functions required for lexical analysis. Code is well commented for readability.