- NEW    : Generate tokenizer class and tools.

git-svn-id: https://svn.sven-drieling.de/repos/trunk/playground/compiler@168 9adaec3a-5a83-11de-93c2-a12fd72c8969