Hugging Face model: openeurollm/tokenizer-256k-v2
Author: openeurollm
Created: 2026-06-27 11:11:05
Last modified: 2026-06-27 16:22:28
Library: sentencepiece
Likes: 0 | Downloads: 0
Tags: sentencepiece, tokenizer, bpe, multilingual, openeurollm, bg, bs, ca, cs, da, de, el, en, es, et, eu, fi, fr, ga, gl, hr, hu, is, it, ka, lt, lv, mk, mt, nl, no, pl, pt, ro, sk, sl, sq, sr, sv, tr, uk, license:apache-2.0, region:us
Card metadata:
license: apache-2.0
library_name: sentencepiece
language: bg, bs, ca, cs, da, de, el, en, es, et, eu, fi, fr, ga, gl, hr, hu, is, it, ka, lt, lv, mk, mt, nl, no, pl, pt, ro, sk, sl, sq, sr, sv, tr, uk
tags: tokenizer, sentencepiece, bpe, multilingual, openeurollm