Hugging Face Space: Dhruv3690/BPE_Tokenizer_Indian_Language
Author: Dhruv3690
SDK: streamlit
title: BPE Tokenizer Indian Language
license: apache-2.0
short_description: A Byte Pair Encoding (BPE) tokenizer for an Indian language