Hugging Face model: TatarNLPWorld/TatarTokenizer
Author: TatarNLPWorld
Created: 2026-03-10 20:52:52
Last modified: 2026-03-10 21:04:52
Likes: 0 | Downloads: 0
Tags: tokenizer, tatar-language, wordpiece, unigram, bpe, bbpe, huggingface, tt, license:mit, region:us
Card metadata:
license: mit
language: tt
tags: tokenizer, tatar-language, wordpiece, unigram, bpe, bbpe, huggingface
metrics: unknown_rate, compression_ratio, word_coverage, tokens_per_second