Hugging Face Space: saneshashank/hindi_bpe_tokenizer
Author: saneshashank
SDK: gradio
title: Hindi Bpe Tokenizer
short_description: this is a simple Hindi BPE tokenizer for learning and demo