Hugging Face Space: sudhakar272/Odia5KTokenizer
Author: sudhakar272
SDK: gradio
title: Odia Tokenizer 5k
license: mit
short_description: Tokenizer specific to odia language with 5000 tokens