apepkuss79
commited on
Commit
•
1b61eae
1
Parent(s):
b4a3b17
Update README.md
Browse files
README.md
CHANGED
@@ -50,13 +50,13 @@ quantized_by: Second State Inc.
|
|
50 |
|
51 |
- Tool use
|
52 |
|
53 |
-
|
54 |
-
|
55 |
llama-api-server.wasm \
|
56 |
--prompt-template mistral-tool \
|
57 |
--ctx-size 32000 \
|
58 |
--model-name Mistral-7B-Instruct-v0.3
|
59 |
-
|
60 |
|
61 |
- Run as LlamaEdge command app
|
62 |
|
|
|
50 |
|
51 |
- Tool use
|
52 |
|
53 |
+
```bash
|
54 |
+
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Mistral-7B-Instruct-v0.3-Q5_K_M.gguf \
|
55 |
llama-api-server.wasm \
|
56 |
--prompt-template mistral-tool \
|
57 |
--ctx-size 32000 \
|
58 |
--model-name Mistral-7B-Instruct-v0.3
|
59 |
+
```
|
60 |
|
61 |
- Run as LlamaEdge command app
|
62 |
|