alabulei commited on
Commit
c333b80
1 Parent(s): 764f8c3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -23
README.md CHANGED
@@ -14,34 +14,19 @@ language:
14
 
15
  # Vitalik-ETH-Llama2-7B-Chat-GGUF
16
 
17
- ## Run with LlamaEdge
18
 
19
- - LlamaEdge version: coming soon
20
 
21
- - Prompt template
22
 
23
- - Prompt type: `llama-2-chat`
24
 
25
- - Prompt string
26
 
27
- ```text
28
- <s>[INST] <<SYS>>
29
- {{ system_prompt }}
30
- <</SYS>>
31
 
32
- {{ user_msg_1 }} [/INST] {{ model_answer_1 }} </s><s>[INST] {{ user_msg_2 }} [/INST]
33
- ```
34
 
35
- - Context size: `4096`
36
 
37
- - Run as LlamaEdge service
38
-
39
- ```bash
40
- wasmedge --dir .:. --nn-preload default:GGML:AUTO:Vitalik-ETH-Llama2-7B-Chat-Q5_K_M.gguf llama-api-server.wasm -p llama-2-chat
41
- ```
42
-
43
- - Run as LlamaEdge command app
44
-
45
- ```bash
46
- wasmedge --dir .:. --nn-preload default:GGML:AUTO:Vitalik-ETH-Llama2-7B-Chat-Q5_K_M.gguf llama-chat.wasm -p llama-2-chat
47
- ```
 
14
 
15
  # Vitalik-ETH-Llama2-7B-Chat-GGUF
16
 
17
+ ## Run with Gaianet
18
 
19
+ **Prompt template:**
20
 
21
+ prompt template: `llama-2-chat`
22
 
23
+ **Context size:**
24
 
25
+ chat_ctx_size: `4096`
26
 
 
 
 
 
27
 
28
+ **Run with GaiaNet:**
 
29
 
30
+ - Quick start: https://docs.gaianet.ai/node-guide/quick-start
31
 
32
+ - Customize your node: https://docs.gaianet.ai/node-guide/customize