Hugging Face model: Toivo0/turkish-news-tokenizer
Author: Toivo0
Created: 2026-07-21 14:12:43
Last modified: 2026-07-21 14:23:52
Likes: 0 | Downloads: 0
Tags: tokenizer, bpe, byte-level-bpe, turkish, tr, dataset:wikimedia/wikipedia, license:cc-by-sa-4.0, region:us
Card metadata:
language: tr
license: cc-by-sa-4.0
tags: tokenizer, bpe, byte-level-bpe, turkish
datasets: wikimedia/wikipedia