sferik/twitter — pull request #484 by eagletmt (2013-11-20 12:17:08+00:00)
Title: Replace buftok due to incorrect delimiter handling

The issue is the same as described in #481.

Instead of tweaking data to cope with buftok's bug, I implemented a similar Twitter::Streaming::BufferedTokenizer and add specs for it.
You can see the buftok's bug by replacing `described_class` with `BufferedTokenizer` in spec/twitter/streaming/buffered_tokenizer_spec.rb.