GitHub repository: JetBrains-Research/YouTokenToMe
Primary language: C++
Description: Unsupervised text tokenizer focused on computational efficiency