-cml / --chatml has been discontinued in llama.cpp
#2
by
algorithm
- opened
README.md
CHANGED
@@ -38,7 +38,7 @@ huggingface-cli download Qwen/Qwen2-7B-Instruct-GGUF qwen2-7b-instruct-q8_0.gguf
|
|
38 |
|
39 |
We demonstrate how to use `llama.cpp` to run Qwen2:
|
40 |
```shell
|
41 |
-
./main -m qwen2-7b-instruct-q8_0.gguf -n 512 --color -i -
|
42 |
```
|
43 |
|
44 |
## Citation
|
|
|
38 |
|
39 |
We demonstrate how to use `llama.cpp` to run Qwen2:
|
40 |
```shell
|
41 |
+
./main -m qwen2-7b-instruct-q8_0.gguf -n 512 --color -i --interactive-first --in-prefix '<|im_start|>user\n' --in-suffix '<|im_end|>\n<|im_start|>assistant\n' --reverse-prompt '<|im_end|>' -p '<|im_start|>system\nYou are a helpful assistant<|im_end|>'
|
42 |
```
|
43 |
|
44 |
## Citation
|