Hugging Face model: flexitok/maddition_AllL_2000_minimal
Author: flexitok
Created: 2026-05-07 00:13:01
Last modified: 2026-05-07 00:13:02
Likes: 0 | Downloads: 0
Tags: tokenizer, bpe, flexitok, fineweb2, arb, ces, cmn, dan, deu, ell, fra, eng, hun, ind, ita, jpn, nld, pol, por, rus, spa, swe, tur, vie, dig, license:mit, region:us
Card metadata:
license: mit
language: arb, ces, cmn, dan, deu, ell, fra, eng, hun, ind, ita, jpn, nld, pol, por, rus, spa, swe, tur, vie, dig
tags: tokenizer, bpe, flexitok, fineweb2