Add q4_0 and q4 quantized models for large and xl
Browse files- model_q4_0.gguf +3 -0
- model_q4k.gguf +3 -0
- model_xl_q4_0.gguf +3 -0
- model_xl_q4k.gguf +3 -0
model_q4_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:533e3c69748a36cfdc6b0dcfe60f9e0a7f9fdc2ac051061fcfdc9cce7f16b9a5
|
| 3 |
+
size 440970016
|
model_q4k.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0740feba8491ea3c1e103ebdc976f2a084aff17eaf3888927a72ef2146f4a5fa
|
| 3 |
+
size 440970016
|
model_xl_q4_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:367a739be997705f9476b8a9bd0eeb2c93959beff18428d0b12b4ef3dd8488d2
|
| 3 |
+
size 1603830176
|
model_xl_q4k.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cc476ae9488e44635bc60d409420ce09354ce246abaeb918e77262580583fd63
|
| 3 |
+
size 1603837216
|