Hugging Face's logo

second-state
/
Qwen1.5-0.5B-Chat-GGUF

Text Generation
Transformers
GGUF
English
qwen2
chat
Inference Endpoints
conversational
Model card Files Community
Xin Liu commited on
Commit
231c43c
•
1 Parent(s): 88b6182

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (13) hide show
  1. .gitattributes +1 -0
  2. Qwen1.5-0.5B-Chat-Q2_K.gguf +3 -0
  3. Qwen1.5-0.5B-Chat-Q3_K_L.gguf +3 -0
  4. Qwen1.5-0.5B-Chat-Q3_K_M.gguf +3 -0
  5. Qwen1.5-0.5B-Chat-Q3_K_S.gguf +3 -0
  6. Qwen1.5-0.5B-Chat-Q4_0.gguf +3 -0
  7. Qwen1.5-0.5B-Chat-Q4_K_M.gguf +3 -0
  8. Qwen1.5-0.5B-Chat-Q4_K_S.gguf +3 -0
  9. Qwen1.5-0.5B-Chat-Q5_0.gguf +3 -0
  10. Qwen1.5-0.5B-Chat-Q5_K_M.gguf +3 -0
  11. Qwen1.5-0.5B-Chat-Q5_K_S.gguf +3 -0
  12. Qwen1.5-0.5B-Chat-Q6_K.gguf +3 -0
  13. Qwen1.5-0.5B-Chat-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
Qwen1.5-0.5B-Chat-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6eaf101326aa8e06d17d8c020ac814d099efac4cd0a6622c8d0831a1921747eb
3
+ size 298412832
Qwen1.5-0.5B-Chat-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f14eb5e4898fdf46c2c8d7f70572d17fd17423c347864ad0ec311290a3992e0
3
+ size 364201760
Qwen1.5-0.5B-Chat-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1d269de3e3bb8a4901412332dc4d469cc769ad853983c778aa6e0950809cce1
3
+ size 349882144
Qwen1.5-0.5B-Chat-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20145f2c2ee32f9e722a7b764f9f1caf824df83366bbaf301151cff5e62adee3
3
+ size 333383456
Qwen1.5-0.5B-Chat-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be284d488a5e8d4aef8f4296274d105211ed54c7f1f687d59fbdba88383a0c51
3
+ size 394990368
Qwen1.5-0.5B-Chat-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5451f76778c30547a9a3aae398e1de68de20364c96af314287c7364f6fd73147
3
+ size 407155488
Qwen1.5-0.5B-Chat-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e842ac0e1b54deae4a378c495718407695fe44ed7a9c651189f50aa0602884f
3
+ size 396596000
Qwen1.5-0.5B-Chat-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c1fc80de8547211ec385e4258f922561f210ab45eae3b61d3cee472f7401905
3
+ size 452973344
Qwen1.5-0.5B-Chat-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f08eca70958c85fe0d25ad3cba9a543cb03ae0a1167ac2ef25ef5f1b1a5d276
3
+ size 459240224
Qwen1.5-0.5B-Chat-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:178fa6a29541b0e0f5c6bf5739898fa0fbb17711f14bff9121391dbcc240b7e2
3
+ size 452973344
Qwen1.5-0.5B-Chat-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25b045e4eb65fef5a30932e5b5a81e2fb63c2eb38aaf2898f54c6718a91e8dcf
3
+ size 514580256
Qwen1.5-0.5B-Chat-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba08f27dfe3abc3ec293c84e1a402bba3060d71c5be269c34169d61b00f3e0fa
3
+ size 664602400