Hugging Face model: hafeez007/balochi-tokenizers
Author: hafeez007
Created: 2026-06-07 14:33:10
Last modified: 2026-06-07 14:33:16
Pipeline: text-generation
Library: sentencepiece
Likes: 0 | Downloads: 0
Tags: sentencepiece, tokenizer, wordpiece, bpe, balochi, southern-balochi, low-resource-nlp, perso-arabic, nlp, gemma, bert, roberta, text-generation, bal, en, dataset:balochiml/balochi-dedup-corpus, license:apache-2.0, region:us
Card metadata:
language: bal, en
license: apache-2.0
tags: tokenizer, sentencepiece, wordpiece, bpe, balochi, southern-balochi, low-resource-nlp, perso-arabic, nlp, gemma, bert, roberta
datasets: balochiml/balochi-dedup-corpus
metrics: fertility, compression_ratio
pipeline_tag: text-generation
library_name: sentencepiece