Hugging Face Space: srijani2/bengali_tokenizer
Author: srijani2
SDK: gradio
title: Bengali Tokenizer
short_description: It's a Bengali BPE Tokenizer holds more than 6k vocab size.