mistralai

/

Mixtral-8x7B-Instruct-v0.1

like 3.85k

Hi everyone,
I ran into this error while loading the model to my gcp instance. The codes I used is below
''''
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "mistralai/Mixtral-8x7B-Instruct-v0.1"
tokenizer = AutoTokenizer.from_pretrained(model_id)

model = AutoModelForCausalLM.from_pretrained(model_id, device_map="auto")
''''
anyone has any tips? I tried to log in using the token.
The error didn't occur when I load other models such as bert.

Thanks