GitHub repository: lilt/sentencepiece
Primary language: C++
Description: Unsupervised text tokenizer for Neural Network-based text generation.