Hugging Face model: toksuite/tiktoken-gpt-4o
Author: toksuite
Created: 2025-09-10 15:41:56
Last modified: 2025-12-25 07:46:10
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 35
Tags: transformers, safetensors, llama, toksuite, tokenization, gpt-4o, multilingual, research, robustness, bpe, text-generation, en, tr, it, fa, zh, arxiv:2512.20757, license:mit, text-generation-inference, endpoints_compatible, region:us
Card metadata:
license: mit
language: en, tr, it, fa, zh
tags: toksuite, tokenization, gpt-4o, multilingual, research, robustness, bpe
pipeline_tag: text-generation
library_name: transformers