Hugging Face Space: rshg/HindiBPETokenizer
Author: rshg
SDK: gradio
title: HindiBPETokenizer
short_description: A Byte Pair Encoding (BPE) tokenizer for Hindi lanaguage