Tokenize text internally. (commit may contain bugs!) untested