Hugging Face's logo

grapevine-AI
/
Qwen2.5-32B-Instruct-GGUF

GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
grapevine-AI commited on
Commit
3941696
·
verified ·
1 Parent(s): b7ff0fa

Upload 2 files

Browse files
Files changed (3) hide show
  1. .gitattributes +2 -0
  2. Qwen2.5-32B-Instruct-IQ4_XS.gguf +3 -0
  3. Qwen2.5-32B-Instruct-Q4_K_M.gguf +3 -0
.gitattributes CHANGED
@@ -36,3 +36,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
  Qwen2.5-32B-Instruct-BF16-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
38
  Qwen2.5-32B-Instruct-BF16-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
  Qwen2.5-32B-Instruct-BF16-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
38
  Qwen2.5-32B-Instruct-BF16-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Qwen2.5-32B-Instruct-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Qwen2.5-32B-Instruct-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89abf31ae32479eb9ae18d601fde4cb0f16b84755f7432647cc4b3c071c68f1e
3
+ size 17693154112
Qwen2.5-32B-Instruct-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00a2b03cea5ffdf35b9ee68a19ae2c8b49826a8da35b4f30969fee0adfdef729
3
+ size 19851336512