Hugging Face model: ZombitX64/Thaitokenizer
Author: ZombitX64
Created: 2025-07-04 05:26:49
Last modified: 2025-08-22 06:03:31
Library: tokenizers
Likes: 0 | Downloads: 0
Tags: tokenizers, thai, tokenizer, nlp, subword, th, dataset:ZombitX64/Thai-corpus-word, license:apache-2.0, region:us
Card metadata:
language: th
license: apache-2.0
tags: thai, tokenizer, nlp, subword
model_type: unigram
library_name: tokenizers
pretty_name: Advanced Thai Tokenizer V3
datasets: ZombitX64/Thai-corpus-word
metrics: accuracy, character