GitHub repository: weave-labs/tokenizer
Primary language: Go
Description: A library for encoding and decoding text into tokens based on popular models