GitHub repository: sferik/buftok
Primary language: Ruby
Description: BufferedTokenizer extracts token delimited entities from a sequence of arbitrary inputs