Hugging Face's logo

second-state
/
Qwen1.5-4B-Chat-GGUF

Text Generation
Transformers
GGUF
English
qwen2
chat
text-generation-inference
Inference Endpoints
Model card Files Community
Xin Liu commited on
Commit
d6c972b
•
1 Parent(s): bf7cf8a

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (13) hide show
  1. .gitattributes +1 -0
  2. Qwen1.5-4B-Chat-Q2_K.gguf +3 -0
  3. Qwen1.5-4B-Chat-Q3_K_L.gguf +3 -0
  4. Qwen1.5-4B-Chat-Q3_K_M.gguf +3 -0
  5. Qwen1.5-4B-Chat-Q3_K_S.gguf +3 -0
  6. Qwen1.5-4B-Chat-Q4_0.gguf +3 -0
  7. Qwen1.5-4B-Chat-Q4_K_M.gguf +3 -0
  8. Qwen1.5-4B-Chat-Q4_K_S.gguf +3 -0
  9. Qwen1.5-4B-Chat-Q5_0.gguf +3 -0
  10. Qwen1.5-4B-Chat-Q5_K_M.gguf +3 -0
  11. Qwen1.5-4B-Chat-Q5_K_S.gguf +3 -0
  12. Qwen1.5-4B-Chat-Q6_K.gguf +3 -0
  13. Qwen1.5-4B-Chat-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
Qwen1.5-4B-Chat-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c28627bf7a840d9a094c8c9cecc6fc5d62ad927cd04b62653931d91a12d57bde
3
+ size 1620632608
Qwen1.5-4B-Chat-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:597df628a380c1d1fbf2b8ac2e12db29b9ff906bb9d83efbbb22db29c3ee6239
3
+ size 2174798368
Qwen1.5-4B-Chat-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d939712dd6f1c0dfc7e023d37a5d48326051617e4c607f196ae0513078a1822
3
+ size 2026850848
Qwen1.5-4B-Chat-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5501324e8aa4dd623b4f27eaf38c72ec1aa8984e0f7c25336a930f98ab8e1db3
3
+ size 1857153568
Qwen1.5-4B-Chat-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3826c9a08ae4b37b8c076031052db8f50150e46e5210c83471fe3c08b41b8f77
3
+ size 2330085408
Qwen1.5-4B-Chat-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c4900818f8419cf6a071309059275deb8466898f8f16693f955ba5dab52cf67
3
+ size 2455115808
Qwen1.5-4B-Chat-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5db00ef89021ea33c13313c3292b1a63c62ca471dd4ac8a1868013ff28ecf313
3
+ size 2344421408
Qwen1.5-4B-Chat-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f67ce7f191685c9e206ab9ce5cc58f34e05e194bc36aa27751b90257a59132c
3
+ size 2775197728
Qwen1.5-4B-Chat-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96aba89e7251b9724fdacfdaec8ec1be36e25a4d6ff3fb5072dd59aa7738df8a
3
+ size 2839607328
Qwen1.5-4B-Chat-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59f1d9f356c7beec20fbe4c634a7fc9077e22093cfc011b35779366f1a5943d7
3
+ size 2775197728
Qwen1.5-4B-Chat-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:656172e925f4579416de2c7cb7e08edfc27701235f357ca34d0db18ce0eecf69
3
+ size 3248129568
Qwen1.5-4B-Chat-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5bb921eb87e9892abb77cc350d69fd77fff1e98b1bd8c6f2f0aa3e12b3ddb70d
3
+ size 4204735008