Hugging Face Space: aayushraina/bye-hindi
Author: aayushraina
SDK: gradio
language: hi
title: Hindi BPE Tokenizer
description: A Hindi BPE tokenizer for efficient text compression and processing.
color: blue
tags: hindi
tokenizer
bpe
subword
text-processing
pipeline_tag: text2text-generation
inference: yes
license: mit
spaces: aayushraina/bpe-hindi