sferik/buftok — pull request #2 by martinemde (2013-11-21 02:38:13+00:00)
Title: Split delimiter alternate

I split into two classes so the original case can still be faster.

I used @eagletmt's code (for the most part) for the multi char tokenizer.

Benchmark is about as good as I can get it.