Model: yakul259/english-unigram-tokenizer-60k
Author: yakul259
Library: tokenizers
Tags: tokenizers, tokenizer, unigram, NLP, wikitext, en, dataset:wikitext, license:mit, region:us
Card metadata: language: en
tags: tokenizer, unigram, NLP, wikitext
license: mit
datasets: wikitext
library_name: tokenizers
Likes: 0 | All-time downloads: 0
Created: 2025-08-14 15:40:13