Vihang D
commited on
Commit
·
205741c
1
Parent(s):
96ecafb
Add quantized models for 400bt open llama preview model
Browse files- ggml-model-q4_0.bin +3 -0
- ggml-model-q4_1.bin +3 -0
- ggml-model-q5_0.bin +3 -0
- ggml-model-q5_1.bin +3 -0
- ggml-model-q8_0.bin +3 -0
ggml-model-q4_0.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:447da3b93beeac0bf154e21aacba3f573a4ef00e0d9b53fd01a8ff466de21f57
|
| 3 |
+
size 4212883584
|
ggml-model-q4_1.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ef36bc74efa710fade4ce8dbb5bfb9ba35eecbf9b091c34b383c4e09629cd89c
|
| 3 |
+
size 5055152256
|
ggml-model-q5_0.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0496f002f91883cd210127d986fcd50ae210dccafdb549859de479680c8452e8
|
| 3 |
+
size 4634017920
|
ggml-model-q5_1.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fc71611354f666d24b0972f8fd2f12fa8d85c21f0ca0156c53746ff4da7d89b2
|
| 3 |
+
size 5055152256
|
ggml-model-q8_0.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3055c7bceefc1a68eb4c1ca03b1fb91e57d9f68206a3a2a87ea7697377ef4e62
|
| 3 |
+
size 7581958272
|