Extended unit tests of class LexerEngine

The unit tests for the class LexerEngine cover test cases TC1..TC26 (all
passing).