Hugging Face model: flexitok/bpe_ltr_jpn_Jpan_8000_v3
Author: flexitok
Created: 2026-04-28 22:32:22
Last modified: 2026-08-03 21:31:06
Likes: 0 | Downloads: 0
Tags: tokenizer, bpe, flexitok, fineweb2, jpn, license:mit, region:us
Card metadata:
license: mit
language: jpn
tags: tokenizer, bpe, flexitok, fineweb2