Karsh-CAI
/

Qwen2.5-32B-AGI-Q6_K-GGUF

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (0)

This quantization of the model hallucinates and talks to itself when you do even a simple Hello :) it ignores what you say in OpenWebui.

#2 opened 5 months ago by

Can you or someone please quantize a Qwen2.5-32B-AGI-Q8_K-GGUF

#1 opened 5 months ago by