Hugging Face model: stukenov/sozkz-morphbpe-256k-kk-v1
Author: stukenov
Created: 2026-04-29 18:12:11
Last modified: 2026-04-29 18:12:27
Pipeline: token-classification
Library: tokenizers
Likes: 1 | Downloads: 0
Tags: tokenizers, tokenizer, bpe, morpheme-aware, kazakh, agglutinative, byte-level-bpe, token-classification, kk, dataset:stukenov/ekitil-corpus-annotated-kk-v1, arxiv:2404.01954, license:mit, region:us
Card metadata:
language: kk
license: mit
tags: tokenizer, bpe, morpheme-aware, kazakh, agglutinative, byte-level-bpe
datasets: stukenov/ekitil-corpus-annotated-kk-v1
pipeline_tag: token-classification
library_name: tokenizers
vocab_size: 256000