Hugging Face model: yavuz-ai/oghuz-tokenizer
Author: yavuz-ai
Created: 2026-07-12 18:12:50
Last modified: 2026-07-12 18:12:50
Library: transformers
Likes: 0 | Downloads: 0
Tags: transformers, tokenizer, turkish, azerbaijani, turkmen, oghuz, bpe, tr, az, tk, dataset:HuggingFaceFW/fineweb-2, dataset:HuggingFaceFW/fineweb-edu, dataset:HuggingFaceTB/finemath, dataset:bigcode/the-stack-smol, license:apache-2.0, endpoints_compatible, region:us
Card metadata:
license: apache-2.0
language: tr, az, tk
library_name: transformers
datasets: HuggingFaceFW/fineweb-2, HuggingFaceFW/fineweb-edu, HuggingFaceTB/finemath, bigcode/the-stack-smol
tags: tokenizer, turkish, azerbaijani, turkmen, oghuz, bpe