Hugging Face Space: dhruv78/bpe-tokenizer-hindi
Author: dhruv78
SDK: gradio
title: Bpe Tokenizer Hindi
short_description: Hindi BPE Tokenizer: 4500 vocab, 8.45x compression