Hugging Face model: flexitok/bpe_ltr_cmn_Hani_16000_v2
Author: flexitok
Created: 2026-04-15 16:56:29
Last modified: 2026-04-16 18:54:38
Likes: 0 | Downloads: 0
Tags: tokenizer, bpe, flexitok, fineweb2, cmn, license:mit, region:us
Card metadata:
license: mit
language: cmn
tags: tokenizer, bpe, flexitok, fineweb2