rollercoasterX
commited on
Change the llama-cli flags
Browse filesExplanation:
-cnv : conversation mode
--chat-template : apply the chatglm4 chat template
-p : when in conversation mode the prompt becomes the system prompt
README.md
CHANGED
@@ -34,7 +34,7 @@ cmake --build build -- -j
|
|
34 |
After installation, you can start the GLM-Edge Chat model using the following command:
|
35 |
|
36 |
```shell
|
37 |
-
llama-cli -m <path>/model.gguf -p "
|
38 |
```
|
39 |
|
40 |
In the command-line interface, you can interact with the model by entering your requests, and the model will provide the
|
|
|
34 |
After installation, you can start the GLM-Edge Chat model using the following command:
|
35 |
|
36 |
```shell
|
37 |
+
llama-cli -m <path>/model.gguf -cnv --chat-template chatglm4 -p "You are a helpful AI assistant." -ngl 999
|
38 |
```
|
39 |
|
40 |
In the command-line interface, you can interact with the model by entering your requests, and the model will provide the
|