Model: toksuite/supertoken_models-llama_tokenmonster-englishcode-32000-consistent-v1
Author: toksuite
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, toksuite, tokenization, tokenmonster, subword, research, robustness, text-generation, en, tr, it, fa, zh, arxiv:2512.20757, license:mit, text-generation-inference, endpoints_compatible, region:us
Card metadata: license: mit
language: en, tr, it, fa, zh
tags: toksuite, tokenization, tokenmonster, subword, research, robustness
pipeline_tag: text-generation
library_name: transformers
Likes: 0 | All-time downloads: 419
Created: 2025-09-03 19:51:52