Hugging Face model: toklens/maddition_ita_Latn_lambda_voc_5_lambda_tok_.5_lambda_seg_1_2000_minimal
Author: toklens
Created: 2026-05-27 20:45:42
Last modified: 2026-05-27 20:51:22
Likes: 1 | Downloads: 0
Tags: tokenizer, rbpe, flexitok, fineweb2, ita, license:mit, region:us
Card metadata:
license: mit
language: ita
tags: tokenizer, rbpe, flexitok, fineweb2