Andrew Konstantinov commited on
Commit
ce099b7
1 Parent(s): d591f95

Add major quantizations

Browse files
ggml-model-q4_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:920bf3e4afcc52f0471a0d4bc4c33c306b51ea2017abda4e609b7136718c155d
3
+ size 8136770688
ggml-model-q4_1.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9ce467111ff5d1e008fb794cc2588f135f606de40ff138159c0c7ee691aa98d
3
+ size 9763701888
ggml-model-q5_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a30dd27911db99549b869290c2f4810e27a9c9e85419d3697a6e585ac00fb87e
3
+ size 8950236288
ggml-model-q5_1.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a30dd27911db99549b869290c2f4810e27a9c9e85419d3697a6e585ac00fb87e
3
- size 8950236288
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9a95067d0ce237d3c963aee41f3b08f77642b30076edf39ff4c5890b8d561ce
3
+ size 9763701888