Hugging Face's logo

second-state
/
OpenChat-3.5-0106-GGUF

Text Generation
Transformers
GGUF
mistral
openchat
text-generation-inference
Model card Files Community
Xin Liu commited on
Commit
cd72d30
•
1 Parent(s): 146c8f4

Add new gguf models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (9) hide show
  1. openchat-3.5-0106-Q2_K.gguf +3 -0
  2. openchat-3.5-0106-Q3_K_L.gguf +3 -0
  3. openchat-3.5-0106-Q3_K_M.gguf +3 -0
  4. openchat-3.5-0106-Q3_K_S.gguf +3 -0
  5. openchat-3.5-0106-Q4_0.gguf +3 -0
  6. openchat-3.5-0106-Q4_K_M.gguf +3 -0
  7. openchat-3.5-0106-Q4_K_S.gguf +3 -0
  8. openchat-3.5-0106-Q5_0.gguf +3 -0
  9. openchat-3.5-0106-Q5_K_S.gguf +3 -0
openchat-3.5-0106-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d05ba84d27537ea743a02bf495dbd330b9108a5faebe0f7856f9f6089b11bb2
3
+ size 3084043840
openchat-3.5-0106-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c149328081b766f47d8c81693b46c2f85c5c1054664074e19969081bafcb9ea
3
+ size 3822971264
openchat-3.5-0106-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95660abeb88ccf9c2deacc40b5970ac03965ba2bb02bd3e2ca878ee433e22d2d
3
+ size 3519932800
openchat-3.5-0106-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:211ae33290d876a04c5af590222932d1f083053705b52aa93b703ab83d418f5f
3
+ size 3165514112
openchat-3.5-0106-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99496a3e5b53d47b936c774b129803e8e3d644790bf4fef9914056908d9264e1
3
+ size 4109864384
openchat-3.5-0106-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c10316cc03ed73641f92cb84e846cf040ac68bda2a847936d14154cde3a31975
3
+ size 4369386944
openchat-3.5-0106-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93fd680c91ef2482a4a98642134faf9e4d9e39d3ed1c8ea536e1f76a85dfe3fe
3
+ size 4141321664
openchat-3.5-0106-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f1e96b1ec09e253f608cb462602e7e681262be57608a1b19f2c29eb2a6ff61d
3
+ size 4998664640
openchat-3.5-0106-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b623af60b210d21af1f30d3ca47034fc4d471e09b80e6fd0ff2464cdf5495b8
3
+ size 4998664640