Hugging Face Space: shwethd/kannada-tokenizer-50k
Author: shwethd
SDK: gradio
title: Kannada Tokenizer 50k
license: mit
short_description: Kannada BPE Tokenizer: 50K vocab, 4.48 compression