Add new lexer code to ensure eatTokens() works as expected.
Add test to ensure new lexer can eat tokens with token type verification.
Add new lexer code to ensure it can eat tokens with type verification.