unable to load the model

#1
by Ratar37003 - opened

OSError: Unable to load vocabulary from file. Please check that the provided vocabulary is accessible and not corrupted.

Alibaba-NLP org

The provided dictionary file is fine.

>>>import transformers
>>> from transformers import AutoTokenizer
>>> model_name_or_path = "gte-multilingual-reranker-base"
>>> tokenizer = AutoTokenizer.from_pretrained(model_name_or_path)
>>> tokenizer("hello world")
{'input_ids': [0, 33600, 31, 8999, 2], 'attention_mask': [1, 1, 1, 1, 1]}
>>> transformers.__version__
'4.39.2'

Sign up or log in to comment