metadata
language:
- he
pipeline_tag: fill-mask
datasets:
- HeNLP/HeDC4
Hebrew Language Model
State-of-the-art Longformer language model for Hebrew.
How to use
from transformers import AutoModelForMaskedLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained('HeNLP/LongHeRo')
model = AutoModelForMaskedLM.from_pretrained('HeNLP/LongHeRo')