Improved tokenization;

Hi @luisgustavoneves,
I have made a few (hopefully) improvements to your code.

Improved handling of Unicode;
Added test of medium portuguese language text;