GitHub repository: tetherto/tokenizers-cpp
Description: Universal cross-platform tokenizers binding to HF and sentencepiece