Hugging Face's logo

Qwen
/
Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text
Transformers
Safetensors
English
qwen2_vl
multimodal
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card Files Community
6

"autoawq" problem

#6
by fundayil - opened
Discussion
fundayil

The solution to the "autoawq" loading error may be to delete awq from the model name. correct model:model = Qwen2VLForConditionalGeneration.from_pretrained( "Qwen/Qwen2-VL-7B-Instruct",
torch_dtype="auto",
device_map="auto"

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment