Hugging Face model: yakul259/english-unigram-tokenizer-60k
Author: yakul259
Created: 2025-08-14 15:40:13
Last modified: 2025-08-14 15:43:18
Library: tokenizers
Likes: 0 | Downloads: 0
Tags: tokenizers, tokenizer, unigram, NLP, wikitext, en, dataset:wikitext, license:mit, region:us
Card metadata:
language: en
tags: tokenizer, unigram, NLP, wikitext
license: mit
datasets: wikitext
library_name: tokenizers