GitHub repository: transitive-bullshit/compare-tokenizers
Primary language: TypeScript
Created: 2023-02-20T01:28:47Z
Description: A test suite comparing Node.js BPE tokenizers for use with AI models.