Hugging Face model: gorkemergune/my-tokenizer
Author: gorkemergune
Created: 2026-07-19 15:51:53
Last modified: 2026-07-19 16:09:18
Pipeline: text-generation
Library: tokenizers
Likes: 0 | Downloads: 0
Tags: tokenizers, tokenizer, bpe, byte-level-bpe, text, text-generation, en, license:mit, region:us
Card metadata:
license: mit
library_name: tokenizers
language: en
tags: tokenizer, bpe, byte-level-bpe, text
pipeline_tag: text-generation