Hugging Face's logo

rustformers
/
mpt-7b-ggml

Text Generation
Transformers
English
mpt
llm-rs
ggml
text-generation-inference
Model card Files Community
5
LLukas22 commited on
Commit
9118467
•
1 Parent(s): 5317f6e

Added quantized files

Browse files
Files changed (8) hide show
  1. mpt-7b-chat-q4_0-ggjt.bin +3 -0
  2. mpt-7b-chat-q4_0.bin +3 -0
  3. mpt-7b-instruct-q4_0-ggjt.bin +3 -0
  4. mpt-7b-instruct-q4_0.bin +3 -0
  5. mpt-7b-q4_0-ggjt.bin +3 -0
  6. mpt-7b-q4_0.bin +3 -0
  7. mpt-7b-storywriter-q4_0-ggjt.bin +3 -0
  8. mpt-7b-storywriter-q4_0.bin +3 -0
mpt-7b-chat-q4_0-ggjt.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3868ad9d7769b6e6ec73c0813c48f5bfc5d7dc3a380d0be723f4ea68997b9ba
3
+ size 4157432192
mpt-7b-chat-q4_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6b35e8d4ac937957aabdf82b278c4bf2bf2f39ee80d3d64cdaea033e7cefa23
3
+ size 4157229078
mpt-7b-instruct-q4_0-ggjt.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df98d4922c5b4e567b677fea23ed22d623ffe9b71e06217db217579596a7c390
3
+ size 4157432192
mpt-7b-instruct-q4_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aec41313b71f794d818d9f9632405d24295ddf42d2a665476846a471e2da3ca9
3
+ size 4157229056
mpt-7b-q4_0-ggjt.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c0b699ae214a444e4131df5f41e30848c03adb329fdbdfe53f59ee90677040b
3
+ size 4157432192
mpt-7b-q4_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b2cc6a72aefb961afef15375cceeea83433f88099f6608ede96a8258e44a9ed
3
+ size 4157229056
mpt-7b-storywriter-q4_0-ggjt.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f168958f2e823231e214abce60b2aad3b578be24f4f4c1e71824b9152f198bdf
3
+ size 4157432160
mpt-7b-storywriter-q4_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abeb6b586b0c08fd006d460438308e015382ca33e29909f426eb949ec0ac415c
3
+ size 4157229056