Qwen2.5-32B

ExLlamav2 8 bpw quant of https://huggingface.co/Qwen/Qwen2.5-32B

Downloads last month
5
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for altomek/Qwen2.5-32B-8bpw-EXL2

Base model

Qwen/Qwen2.5-32B
Quantized
(74)
this model