Hugging Face's logo

second-state
/
Qwen1.5-1.8B-Chat-GGUF

Text Generation
Transformers
GGUF
English
qwen2
chat
Inference Endpoints
text-generation-inference
Model card Files Community
Xin Liu commited on
Commit
58aa51a
•
1 Parent(s): 58090d2

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (11) hide show
  1. Qwen1.5-1.8B-Chat-Q2_K.gguf +3 -0
  2. Qwen1.5-1.8B-Chat-Q3_K_L.gguf +3 -0
  3. Qwen1.5-1.8B-Chat-Q3_K_M.gguf +3 -0
  4. Qwen1.5-1.8B-Chat-Q3_K_S.gguf +3 -0
  5. Qwen1.5-1.8B-Chat-Q4_0.gguf +3 -0
  6. Qwen1.5-1.8B-Chat-Q4_K_M.gguf +3 -0
  7. Qwen1.5-1.8B-Chat-Q4_K_S.gguf +3 -0
  8. Qwen1.5-1.8B-Chat-Q5_0.gguf +3 -0
  9. Qwen1.5-1.8B-Chat-Q5_K_S.gguf +3 -0
  10. Qwen1.5-1.8B-Chat-Q6_K.gguf +3 -0
  11. Qwen1.5-1.8B-Chat-Q8_0.gguf +3 -0
Qwen1.5-1.8B-Chat-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3cfc6923f43e9613e28fdc585dba7196ed35581aa2ebbfcf3abffcde59eca860
3
+ size 863477536
Qwen1.5-1.8B-Chat-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a14461a626d9411c088ea5c37dca0559d4ebf29a302eadcb7c700a679efd9b5a
3
+ size 1056200480
Qwen1.5-1.8B-Chat-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2420464054b347ccbf44a140682c2bae71bd7d3408feb4e77a20b391e291dcbc
3
+ size 1015879456
Qwen1.5-1.8B-Chat-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da7ecf851f3ecd88917f6e333ee7a5e5b41f5d71877ce2d6cedecbc28d750c1f
3
+ size 970479392
Qwen1.5-1.8B-Chat-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d12bb0d69a0d07242d142a078f71358190cc6029b5d2a93817073bc1ab143cc
3
+ size 1120235296
Qwen1.5-1.8B-Chat-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2be0bf71a9d0b09eac001e8aea448b86e2f7390238cabceaf3cab6312870a1e6
3
+ size 1217752864
Qwen1.5-1.8B-Chat-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0642ff9f603335199b857a19e905c3626f039d16bfb80e9234d5247d9ea4a33
3
+ size 1158262560
Qwen1.5-1.8B-Chat-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c7284cc4dafd61429f3a580fb341d45b882b63dbd972216814f1c3ff3fba1d2
3
+ size 1310912288
Qwen1.5-1.8B-Chat-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f61db44de87156477ecbee06755c9f6a1bad3f84a2c6488a07d228c89454c86
3
+ size 1327820576
Qwen1.5-1.8B-Chat-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d366c88977d603b13826f569ef7a40bc88c362febab326ea5499f7e0bc0ef9b
3
+ size 1579026208
Qwen1.5-1.8B-Chat-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bba91e7f6aa7debb28aca9c36f032e5908275657c96a63461ae964cbaefec612
3
+ size 1958303520