Hugging Face's logo

unsloth
/
QwQ-32B-Preview-GGUF

Text Generation
Transformers
GGUF
English
chat
qwen2
qwen
Inference Endpoints
conversational
Model card Files Community
danielhanchen commited on
Commit
5c83b16
•
1 Parent(s): 03c7745

Upload folder using huggingface_hub

Browse files
Files changed (7) hide show
  1. .gitattributes +6 -0
  2. QwQ-32B-Preview-Q2_K.gguf +3 -0
  3. QwQ-32B-Preview-Q3_K_M.gguf +3 -0
  4. QwQ-32B-Preview-Q4_K_M.gguf +3 -0
  5. QwQ-32B-Preview-Q5_K_M.gguf +3 -0
  6. QwQ-32B-Preview-Q6_K.gguf +3 -0
  7. QwQ-32B-Preview-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ QwQ-32B-Preview-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ QwQ-32B-Preview-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ QwQ-32B-Preview-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ QwQ-32B-Preview-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ QwQ-32B-Preview-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
41
+ QwQ-32B-Preview-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
QwQ-32B-Preview-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a621bf422d8bba48dab0073066c9f00d4f5fc01332429bd01ed8f8e1be2a9f9
3
+ size 12313098368
QwQ-32B-Preview-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef7f67d06cddd67be0cfb996f69140e32263c084309bba9f367cdc51c879a3fc
3
+ size 15935047808
QwQ-32B-Preview-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e6a0b4c99bf502352546c8e72d90ede2b6f4ae93a74fd6ed8cdc288c0150c4b
3
+ size 19851335808
QwQ-32B-Preview-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d989da2b0d813cd12cf856d5718eb760f2cd66461937308c5df31b13d5d8cab1
3
+ size 23262156928
QwQ-32B-Preview-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4edf4930e0441dfb5bc97ba830cccde8c4541367ce2a98167b2be2fda6935237
3
+ size 26886154368
QwQ-32B-Preview-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4a1167730afb6360386203550411b6fea87b81d06bac4fbb357bc456d46bd128
3
+ size 34820884608