sferik/buftok — pull request #7 by martinemde (2014-10-24 21:12:04+00:00)
Title: Adds #size to BufferedTokenizer

Allow external monitoring of the input buffer size if size constraint is necessary.

Fixes #6