google/sentencepiece: Unsupervised text tokenizer for Neural Network-based text generation.
Category: nlp
Language: C++
Topics: natural-language-processing, neural-machine-translation, tokeniser, word-segmentation