KeyError: 'mixtral'

by MohamedBerrimi - opened Dec 15, 2023

Dec 15, 2023

Thank you for this amazing work :)
I am trying to use this model with transformers,
----> 6 model = HQQModelForCausalLM.from_quantized(model_id)
KeyError: 'mixtral'

mobicham

Mobius Labs GmbH org Dec 15, 2023

Hi, thank you very much!
Try pip install transformers --upgrade

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment