Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
bartowski
/
Qwen1.5-32B-Chat-GGUF
like
0
Text Generation
GGUF
English
chat
Inference Endpoints
conversational
License:
tongyi-qianwen
Model card
Files
Files and versions
Community
Deploy
Use this model
main
Qwen1.5-32B-Chat-GGUF
1 contributor
History:
2 commits
bartowski
Llamacpp quants
369aa45
verified
7 months ago
Qwen1.5-32B-Chat-fp16.gguf
Llamacpp quants
7 months ago
.gitattributes
Safe
2.73 kB
Llamacpp quants
7 months ago
Qwen1.5-32B-Chat-IQ3_M.gguf
Safe
14.7 GB
LFS
Llamacpp quants
7 months ago
Qwen1.5-32B-Chat-IQ3_S.gguf
Safe
14.3 GB
LFS
Llamacpp quants
7 months ago
Qwen1.5-32B-Chat-IQ4_NL.gguf
Safe
18.7 GB
LFS
Llamacpp quants
7 months ago
Qwen1.5-32B-Chat-IQ4_XS.gguf
Safe
17.7 GB
LFS
Llamacpp quants
7 months ago
Qwen1.5-32B-Chat-Q2_K.gguf
Safe
12.2 GB
LFS
Llamacpp quants
7 months ago
Qwen1.5-32B-Chat-Q3_K_L.gguf
Safe
17.1 GB
LFS
Llamacpp quants
7 months ago
Qwen1.5-32B-Chat-Q3_K_M.gguf
Safe
15.8 GB
LFS
Llamacpp quants
7 months ago
Qwen1.5-32B-Chat-Q3_K_S.gguf
Safe
14.3 GB
LFS
Llamacpp quants
7 months ago
Qwen1.5-32B-Chat-Q4_0.gguf
Safe
18.5 GB
LFS
Llamacpp quants
7 months ago
Qwen1.5-32B-Chat-Q4_K_M.gguf
Safe
19.7 GB
LFS
Llamacpp quants
7 months ago
Qwen1.5-32B-Chat-Q4_K_S.gguf
Safe
18.6 GB
LFS
Llamacpp quants
7 months ago
Qwen1.5-32B-Chat-Q5_0.gguf
Safe
22.5 GB
LFS
Llamacpp quants
7 months ago
Qwen1.5-32B-Chat-Q5_K_M.gguf
Safe
23.1 GB
LFS
Llamacpp quants
7 months ago
Qwen1.5-32B-Chat-Q5_K_S.gguf
Safe
22.5 GB
LFS
Llamacpp quants
7 months ago
Qwen1.5-32B-Chat-Q6_K.gguf
Safe
26.7 GB
LFS
Llamacpp quants
7 months ago
Qwen1.5-32B-Chat-Q8_0.gguf
Safe
34.6 GB
LFS
Llamacpp quants
7 months ago
README.md
Safe
3.9 kB
Llamacpp quants
7 months ago