a fuller skeleton of the lexer