Hugging Face's logo

second-state
/
OpenChat-3.5-GGUF

Text Generation
Transformers
GGUF
mistral
openchat
text-generation-inference
Model card Files Community
Xin Liu commited on
Commit
3721a1f
•
1 Parent(s): 38d020e

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (12) hide show
  1. openchat_3.5-Q2_K.gguf +3 -0
  2. openchat_3.5-Q3_K_L.gguf +3 -0
  3. openchat_3.5-Q3_K_M.gguf +3 -0
  4. openchat_3.5-Q3_K_S.gguf +3 -0
  5. openchat_3.5-Q4_0.gguf +3 -0
  6. openchat_3.5-Q4_K_M.gguf +3 -0
  7. openchat_3.5-Q4_K_S.gguf +3 -0
  8. openchat_3.5-Q5_0.gguf +3 -0
  9. openchat_3.5-Q5_K_M.gguf +3 -0
  10. openchat_3.5-Q5_K_S.gguf +3 -0
  11. openchat_3.5-Q6_K.gguf +3 -0
  12. openchat_3.5-Q8_0.gguf +3 -0
openchat_3.5-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2176c14ff38a2c8161acec418ca8ffdbf7e973cf985ed3bc8b403b92919373d4
3
+ size 2719251648
openchat_3.5-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1dd4eb92693e0af42a0c7afdef7f19591cf3270ae395a2681eb028e7ce2509a8
3
+ size 3822034944
openchat_3.5-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4bbe83e03ae403920405d448007d754a37893e4ce595a056fe80515576e084dd
3
+ size 3518996480
openchat_3.5-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31494676038d8caeefa92cf4b76a44af702f156a74efc5261548e1f8448cf937
3
+ size 3164577792
openchat_3.5-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12c68c3c6293e5bcdab2025153a1439d7391c832bc789af4aa00478e1cf6428f
3
+ size 4108928064
openchat_3.5-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d57d81a2eed62f34408cb0db03818a51e7ca49cab2ea63d68f0bb1ee0d25bf15
3
+ size 4368450624
openchat_3.5-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70de5c4800c172f4bdfa3158243dda533de0c0f314c688d4c38e10180953aad8
3
+ size 4140385344
openchat_3.5-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ef65c6363d7aa99db0156db7e5f8cdc4bc2f424be9d551ecc260c9d5d77c898
3
+ size 4997728320
openchat_3.5-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cea9e09a3e1d0fa779224710a543a07d92af46a64090af7a32001b94faf66a92
3
+ size 5131421760
openchat_3.5-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a72a7a30612df0378f4bfb30dc30f58922cb85b04c1aa2a21f5c3d01b3494819
3
+ size 4997728320
openchat_3.5-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:905d216a9f9d1b653668ae4fae0222a48d1a576d4043228cdf0ae2e24785d610
3
+ size 5942078592
openchat_3.5-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:787cc439ae6c90ffe3fcb977c3b0f84c5978f3cbb8e55f67973d349839c218b9
3
+ size 7695875072