GitHub repository: kokizzu/tokenizer
Primary language: Go
Description: Pure Go implementation of OpenAI's tiktoken tokenizer