Made tokenizer a bit more friendly for the after-analyzers.

This makes the TokenizerResult a list of unicode strings instead of a TokenizerResult for each unicode string. This allows us to keep the unicode strings from the same tokenizer together.