Model not found when using OVModelForCausalLM

#17
by thirdrock - opened

Replaced the AutoModelForCausalLM with OpenVINO version but get an error.
Is there an openvino version of the model? I'd like to use it with A770 ARC GPU card.

#model = transformers.AutoModelForCausalLM.from_pretrained(model_name)
model = OVModelForCausalLM.from_pretrained(model_name)

huggingface_hub.utils._errors.EntryNotFoundError: 404 Client Error. (Request ID: Root=1-657e2464-5778feb97ec352105b0cf955;f4748a83-5530-4c34-b855-97c390fdde9a)

Entry Not Found for url: https://huggingface.co/Intel/neural-chat-7b-v3-1/resolve/main/openvino_model.bin.

Sign up or log in to comment