Hugging Face model: openeurollm/tokenizer-128k
Author: openeurollm
Created: 2026-02-20 16:55:37
Last modified: 2026-02-20 18:51:45
Likes: 0 | Downloads: 0
Tags: tokenizer, sentencepiece, bpe, multilingual, european-languages, bg, bs, ca, cs, cy, da, de, el, en, es, et, eu, fi, fr, ga, gl, hr, hu, is, it, lb, lt, lv, mk, mt, nl, no, pl, pt, ro, ru, sk, sl, sq, sr, sv, tr, uk, license:apache-2.0, region:us
Card metadata:
language: bg, bs, ca, cs, cy, da, de, el, en, es, et, eu, fi, fr, ga, gl, hr, hu, is, it, lb, lt, lv, mk, mt, nl, no, pl, pt, ro, ru, sk, sl, sq, sr, sv, tr, uk
tags: tokenizer, sentencepiece, bpe, multilingual, european-languages
license: apache-2.0