Hugging Face's logo

second-state
/
Qwen1.5-7B-Chat-GGUF

Text Generation
Transformers
GGUF
English
qwen2
chat
text-generation-inference
Inference Endpoints
conversational
Model card Files Community
Xin Liu commited on
Commit
e771bcc
•
1 Parent(s): a55f8de

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (13) hide show
  1. .gitattributes +1 -0
  2. Qwen1.5-7B-Chat-Q2_K.gguf +3 -0
  3. Qwen1.5-7B-Chat-Q3_K_L.gguf +3 -0
  4. Qwen1.5-7B-Chat-Q3_K_M.gguf +3 -0
  5. Qwen1.5-7B-Chat-Q3_K_S.gguf +3 -0
  6. Qwen1.5-7B-Chat-Q4_0.gguf +3 -0
  7. Qwen1.5-7B-Chat-Q4_K_M.gguf +3 -0
  8. Qwen1.5-7B-Chat-Q4_K_S.gguf +3 -0
  9. Qwen1.5-7B-Chat-Q5_0.gguf +3 -0
  10. Qwen1.5-7B-Chat-Q5_K_M.gguf +3 -0
  11. Qwen1.5-7B-Chat-Q5_K_S.gguf +3 -0
  12. Qwen1.5-7B-Chat-Q6_K.gguf +3 -0
  13. Qwen1.5-7B-Chat-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
Qwen1.5-7B-Chat-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d153cc949f2b992c0cc272678bedb194d90172ba08a0627e865c46a7370c1c85
3
+ size 3103825056
Qwen1.5-7B-Chat-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34ecf5a738236092050068809223a5cfa03a28dbcc47f0d3c88c587f1452c972
3
+ size 4217965728
Qwen1.5-7B-Chat-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dce923b0f9b4883497988162f8e17cc0f4b8e0b76f19499e7c6ffa1024fdb86b
3
+ size 3918859424
Qwen1.5-7B-Chat-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf52c653940961c848c90ac3f8cd29295318db7f945e85db91e879baf7f500fe
3
+ size 3569159328
Qwen1.5-7B-Chat-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:47a52972e2abb3be08f7f9cf3db7ca577552c0f31e2aaa0fd37e299e41d13e56
3
+ size 4511906976
Qwen1.5-7B-Chat-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43f3ee9f8d5f33dc207126126db62e68720b2f9dc568d4d373f9a318c67bef35
3
+ size 4767104160
Qwen1.5-7B-Chat-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38e3de55723706d5df3db3fbe38dbf6af7191e4e91c09bd373d8960af4a0c64a
3
+ size 4542839968
Qwen1.5-7B-Chat-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa6857dd16f88530b4f07c33db1a999a021b83ad5978b35efc7e6c699dab6107
3
+ size 5399198880
Qwen1.5-7B-Chat-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:447c202f9bd5504c082b97db15ab14e4ad041a7c9dd7931db3d1688fa0f127c3
3
+ size 5530664096
Qwen1.5-7B-Chat-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6da5594db9f4d7ae0b69368865569ae05fa96c776abfbca4c4de0921cffec3f8
3
+ size 5399198880
Qwen1.5-7B-Chat-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:92f330b80278a4f23b132df039343cc5f34b4534b59bd88eb89b14f408360763
3
+ size 6341946528
Qwen1.5-7B-Chat-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4d3df3afcfd4728405700f61df1b1cc8ac3bdf9e498b53fa3003ea92f91c32b
3
+ size 8211795104