GitHub repository: microsoft/Tokenizer
Primary language: C#
Description: Typescript and .NET implementation of BPE tokenizer for OpenAI LLMs.