Image-Text-to-Text
Transformers
Safetensors
English
idefics2
pretraining
multimodal
vision
Inference Endpoints
5 papers

NameError: name 'awq_ext' is not defined

#29
by abhijeet06793 - opened

Getting - NameError: name 'awq_ext' is not defined error while running below code - model = AutoModelForVision2Seq.from_pretrained(MODEL_ID, quantization_config=quantization_config, device_map=DEVICE)

Can someone please explain how to fix this ?

Attaching screenshot as well -
image.png

HuggingFaceM4 org

Hi @abhijeet06793
this sounds like an autoawq installation issue.
can you double check it is properly installed for you?
parsing https://github.com/casper-hansen/AutoAWQ might be helpful

HuggingFaceM4 org

closing this, feel free to re-open if you still have issues!

VictorSanh changed discussion status to closed

Sign up or log in to comment