Persian Language Models and Adapters
Collection
Persian language models, tokenizers, adapters, and inference-ready derivatives. • 14 items • Updated
How to use PersianML/persian-unigram-tokenizer with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("PersianML/persian-unigram-tokenizer", device_map="auto")