Hugging Face model: flexitok/unigram_deu_Latn_128000
Author: flexitok
Created: 2026-02-23 03:19:30
Last modified: 2026-02-23 03:19:31
Likes: 0 | Downloads: 0
Tags: tokenizer, unigram, flexitok, fineweb2, deu, license:mit, region:us
Card metadata:
license: mit
language: deu
tags: tokenizer, unigram, flexitok, fineweb2