GitHub repository: nagyist/google-sentencepiece
Primary language: C++
Description: Unsupervised text tokenizer for Neural Network-based text generation.