Hugging Face model: elshadrahimov/miLLi-1.0
Author: elshadrahimov
Created: 2025-12-27 15:04:08
Last modified: 2026-07-31 11:33:43
Library: transformers
Likes: 0 | Downloads: 0
Tags: transformers, tokenizer, azerbaijani, nlp, morphology, hybrid, bpe, phonological-restoration, byte-level-fallback, open-vocabulary, az, dataset:uonlp/CulturaX, dataset:tatoeba, dataset:lgi2p/finefreq, arxiv:1810.04805, arxiv:2410.21276, arxiv:2508.14292, arxiv:2502.00894, arxiv:2512.15586, arxiv:2512.09701, license:apache-2.0, endpoints_compatible, region:us
Card metadata:
language: az
tags: tokenizer, azerbaijani, nlp, morphology, hybrid, bpe, phonological-restoration, byte-level-fallback, open-vocabulary
license: apache-2.0
datasets: uonlp/CulturaX, tatoeba, lgi2p/finefreq
metrics: token_word_ratio, morphological_boundary_accuracy, root_consistency_rate, vocabulary_sparsity_index, tokens_per_character, latency
library_name: transformers