Class AbstractLexer: removal of the coarse-grained STM.

Updated tests.