GitHub repository: Ajwebdevs/SHERLAN200k
Primary language: C++
Created: 2024-09-20T06:16:20Z
Description: Sherlan200k is a hybrid tokenization framework designed to produce a comprehensive vocabulary of 200,000 tokens.