Hugging Face Space: kishkath/bpe-tokenizer
Author: kishkath
SDK: gradio
title: Bpe Tokenizer
license: apache-2.0
short_description: Telugu BPE tokenizer with vocabulary of 4800 words.