Update README.md
Browse files
README.md
CHANGED
@@ -14,34 +14,19 @@ language:
|
|
14 |
|
15 |
# Vitalik-ETH-Llama2-7B-Chat-GGUF
|
16 |
|
17 |
-
## Run with
|
18 |
|
19 |
-
|
20 |
|
21 |
-
|
22 |
|
23 |
-
|
24 |
|
25 |
-
|
26 |
|
27 |
-
```text
|
28 |
-
<s>[INST] <<SYS>>
|
29 |
-
{{ system_prompt }}
|
30 |
-
<</SYS>>
|
31 |
|
32 |
-
|
33 |
-
```
|
34 |
|
35 |
-
-
|
36 |
|
37 |
-
-
|
38 |
-
|
39 |
-
```bash
|
40 |
-
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Vitalik-ETH-Llama2-7B-Chat-Q5_K_M.gguf llama-api-server.wasm -p llama-2-chat
|
41 |
-
```
|
42 |
-
|
43 |
-
- Run as LlamaEdge command app
|
44 |
-
|
45 |
-
```bash
|
46 |
-
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Vitalik-ETH-Llama2-7B-Chat-Q5_K_M.gguf llama-chat.wasm -p llama-2-chat
|
47 |
-
```
|
|
|
14 |
|
15 |
# Vitalik-ETH-Llama2-7B-Chat-GGUF
|
16 |
|
17 |
+
## Run with Gaianet
|
18 |
|
19 |
+
**Prompt template:**
|
20 |
|
21 |
+
prompt template: `llama-2-chat`
|
22 |
|
23 |
+
**Context size:**
|
24 |
|
25 |
+
chat_ctx_size: `4096`
|
26 |
|
|
|
|
|
|
|
|
|
27 |
|
28 |
+
**Run with GaiaNet:**
|
|
|
29 |
|
30 |
+
- Quick start: https://docs.gaianet.ai/node-guide/quick-start
|
31 |
|
32 |
+
- Customize your node: https://docs.gaianet.ai/node-guide/customize
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|