Added unit tests to detect some possible lex errors.