Model load fails with AutoModelForCausalLM.from_pretrained(model_id)

#15
by GauravH - opened

Getting a (KeyError: 'mixtral') while loading the pretrained model using AutoModelForCausalLM

model = AutoModelForCausalLM.from_pretrained(model_id)

Is anyone else facing the same issue? Please let me know how to address this.

mixtral_load_error.png

updating the transformers_version to 4.36.0 fixed this issue. Thanks.

GauravH changed discussion status to closed

You might need to upgrade your transformers version

You might need to upgrade your transformers version

Yeah, we answered at the same time!

Sign up or log in to comment