Hugging Face model: transhumanist-already-exists/ayayay-tokenizer
Author: transhumanist-already-exists
Created: 2025-06-08 09:28:05
Last modified: 2025-06-09 23:50:24
Library: transformers
Likes: 5 | Downloads: 0
Tags: transformers, aya-tokenizer, ukraine, corpus-linguistics, uk, crh, en, fr, de, es, it, pt, ja, ko, zh, ar, el, fa, pl, id, cs, he, hi, nl, ro, ru, tr, vi, dataset:lang-uk/malyuk, dataset:QIRIM/crh_monocorpus, base_model:CohereLabs/aya-expanse-32b, base_model:finetune:CohereLabs/aya-expanse-32b, region:us
Base model relation: finetune
Base models: id: CohereLabs/aya-expanse-32b
Card metadata:
inference: no
library_name: transformers
base_model: CohereLabs/aya-expanse-32b
language: uk, crh, en, fr, de, es, it, pt, ja, ko, zh, ar, el, fa, pl, id, cs, he, hi, nl, ro, ru, tr, vi
datasets: lang-uk/malyuk, QIRIM/crh_monocorpus
multilinguality: multililingual
tags: aya-tokenizer, ukraine, corpus-linguistics
pretty_name: “ayayay - ukrainized aya tokenizer”