Model: transhumanist-already-exists/ayayay-tokenizer
Author: transhumanist-already-exists
Library: transformers
Tags: transformers, aya-tokenizer, ukraine, corpus-linguistics, uk, crh, en, fr, de, es, it, pt, ja, ko, zh, ar, el, fa, pl, id, cs, he, hi, nl, ro, ru, tr, vi, dataset:lang-uk/malyuk, dataset:QIRIM/crh_monocorpus, base_model:CohereLabs/aya-expanse-32b, base_model:finetune:CohereLabs/aya-expanse-32b, region:us
Base models (finetune): id: CohereLabs/aya-expanse-32b
Card metadata: inference: no
library_name: transformers
base_model: CohereLabs/aya-expanse-32b
language: uk, crh, en, fr, de, es, it, pt, ja, ko, zh, ar, el, fa, pl, id, cs, he, hi, nl, ro, ru, tr, vi
datasets: lang-uk/malyuk, QIRIM/crh_monocorpus
multilinguality: multililingual
tags: aya-tokenizer, ukraine, corpus-linguistics
pretty_name: “ayayay - ukrainized aya tokenizer”
Likes: 5 | All-time downloads: 0
Created: 2025-06-08 09:28:05