rustformers
/

mpt-7b-ggml

Text Generation

text-generation-inference

Model card Files Files and versions Community

LLukas22 commited on May 18, 2023

Commit

5d5ce7b

•

1 Parent(s): c708961

Update README.md

Files changed (1) hide show

README.md +4 -4

README.md CHANGED Viewed

@@ -42,10 +42,10 @@ If these implementations are complete i will add instructions on how to run the
 ###  Rust & Python:
 #### TBD See above!
- ### Via GGML
- The `GGML` example only supports the ggml container type!
- ##### Installation
 ```
 git clone https://github.com/ggerganov/ggml
@@ -55,7 +55,7 @@ cmake ..
 make -j4 mpt
 ```
-#### Run inference
 ```
 ./bin/mpt -m path/to/model.bin -p "The meaning of life is"

 ###  Rust & Python:
 #### TBD See above!
+### Via GGML
+The `GGML` example only supports the ggml container type!
+##### Installation
 ```
 git clone https://github.com/ggerganov/ggml
 make -j4 mpt
 ```
+##### Run inference
 ```
 ./bin/mpt -m path/to/model.bin -p "The meaning of life is"