Hugging Face's logo

DisOOM
/
Qwen1.5-22B-Chat-Merge-GGUF

Text Generation
Transformers
GGUF
PyTorch
qwen2
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Inference Endpoints
text-generation-inference
Model card Files Community
Edit model card

I got broken models when use the k quantize so there's no k quantized models(sad)

Downloads last month
167
GGUF
Model size
22B params
Architecture
qwen2
Inference API
Text Generation
Examples
Input a message to start chatting with DisOOM/Qwen1.5-22B-Chat-Merge-GGUF.
Inference API (serverless) has been turned off for this model.