Pluggable tokenizer

Loads and uses a pluggable tokenizer. Comes with a sane default tokenizer.

@willkg r?
This could use a docstring about what it does. I think I'd take the docstring for the tokenize method and move it up to the SplitTokenizer class.