GitHub repository: tryAGI/Tiktoken
Primary language: C#
Created: 2023-06-09T03:49:44Z
Description: This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.