Hugging Face model: yakul259/english-bpe-tokenizer-60k
Author: yakul259
Created: 2025-08-14 18:43:28
Last modified: 2025-08-14 18:49:36
Library: tokenizers
Likes: 0 | Downloads: 0
Tags: tokenizers, tokenizer, bpe, NLP, wikitext, en, dataset:wikitext, license:mit, region:us
Card metadata:
language: en
tags: tokenizer, bpe, NLP, wikitext
license: mit
datasets: wikitext
library_name: tokenizers