GitHub repository: yutanakamura-tky/sentencepiece
Primary language: C++
Description: Unsupervised text tokenizer for Neural Network-based text generation.