Hugging Face's logo

Qwen
/
Qwen2-57B-A14B-Instruct-GPTQ-Int4

Text Generation
Transformers
Safetensors
English
qwen2_moe
chat
conversational
Inference Endpoints
4-bit precision
gptq
Model card Files Community
1
New discussion

vLLM: AttributeError: 'MergedColumnParallelLinear' object has no attribute 'weight'. Did you mean: 'qweight'?

6
#1 opened 5 months ago by geekwish