Hugging Face's logo

mshojaei77
/
PersianBPETokenizer

Text Generation
Transformers
Persian
Tokenizer
persian
bpet
Inference Endpoints
Model card Files Community
1
New discussion

I think hazm still performs better than this tokenizer
#1 opened about 2 months ago by Waisullah