Fixed a severe bug in the normalization: If a token reaches to the end
of the text, it was not recognized.

Added some accessors to the TokenMergeContainer.

Added asserts to the testcase with three identical tokenizations.