Hugging Face Space: amlanr66/OdiaBPETokenizer
Author: amlanr66
SDK: gradio
title: OdiaBPETokenizer
short_description: Tokenize Odia text using 5000 tokens created using BPE