rollercoasterX commited on
Commit
2213461
·
verified ·
1 Parent(s): e168d9e

Change the llama-cli flags

Browse files

Explanation:
-cnv : conversation mode
--chat-template : apply the chatglm4 chat template
-p : when in conversation mode the prompt becomes the system prompt

Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -34,7 +34,7 @@ cmake --build build -- -j
34
  After installation, you can start the GLM-Edge Chat model using the following command:
35
 
36
  ```shell
37
- llama-cli -m <path>/model.gguf -p "<|user|>\nhi<|assistant|>\n" -ngl 999
38
  ```
39
 
40
  In the command-line interface, you can interact with the model by entering your requests, and the model will provide the
 
34
  After installation, you can start the GLM-Edge Chat model using the following command:
35
 
36
  ```shell
37
+ llama-cli -m <path>/model.gguf -cnv --chat-template chatglm4 -p "You are a helpful AI assistant." -ngl 999
38
  ```
39
 
40
  In the command-line interface, you can interact with the model by entering your requests, and the model will provide the