Minor changes in tokenizer and utf-8 streams

 to allow for other languages (at least with Latin-like scripts)
(tested with Russian, French, Spanish, Portuguese, German, English)
Merge pull request #5 from Breakend/master

Minor changes in tokenizer and utf-8 streams