Update checkpoint for transformers>=4.29

#5
by ArthurZ HF staff - opened
Language Technology Research Group at the University of Helsinki org

Following the merge of a PR in transformers it appeared that this model was not properly converted. This PR will fix the inference and was tested using the following script:

>>> from transformers import MarianModel, MarianMTModel
>>> tokenizer = AutoTokenizer.from_pretrained('Helsinki-NLP/opus-mt-tc-big-en-ar')
>>> inputs = tokenizer("Hey! Let's learn together", return_tensors="pt", padding=True)
>>> model = MarianMTModel.from_pretrained('Helsinki-NLP/opus-mt-tc-big-en-ar')
>>> print(tokenizer.batch_decode(model.generate(**inputs)))
['<pad> ู„ู†ุชุนู„ู‘ู… ู…ุนุงู‹</s>']

Great, LGTM!

lysandre changed pull request status to merged

Sign up or log in to comment