Pluggable tokenizer

Loads and uses a pluggable tokenizer. Comes with a sane default tokenizer.