A simple and configurable state-machine based tokenizer.