youtokentome (rubygems): High performance unsupervised text tokenization for Ruby
Keywords: bpe|byte-pair-encoding|npl|tokenization|unsupervised-learning|word-segmentation