Hugging Face model: ArinUmut/pan-turkic-tokenizer
Author: ArinUmut
Created: 2026-05-05 19:05:55
Last modified: 2026-05-05 19:51:26
Library: transformers
Likes: 1 | Downloads: 0
Tags: transformers, tokenizer, sentencepiece, bpe, turkic, multilingual, tr, kk, ky, uz, ug, ba, tt, az, crh, tk, license:apache-2.0, endpoints_compatible, region:us
Card metadata:
language: tr, kk, ky, uz, ug, ba, tt, az, crh, tk
license: apache-2.0
tags: tokenizer, sentencepiece, bpe, turkic, multilingual
library_name: transformers