Hugging Face Space: Abhiya/Punjabi_tokenizer
Author: Abhiya
SDK: gradio
title: Punjabi Tokenizer
short_description: this is byte pair tokenizer on Indian language Punjabi