Lyte commited on
Commit
b95c7bb
1 Parent(s): a6f60a6

tested the llama-cli and just fixed for a better conversation

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -32,5 +32,5 @@ rm -r RWKV-6-World-1.6B-GGUF
32
 
33
  * Now to run the model, you can use the following command:
34
  ```
35
- !./llama-cli -m ./model/RWKV-6-World-1.6B-GGUF-Q4_K_M.gguf --in-prefix "\nUser:" --in-suffix "\nAssistant:" --interactive-first -c 1024 -t 0.7 --top-k 40 --top-p 0.95 -n 64 -p "Assistant: Hello, what can i help you with today?\n" -r "User"
36
  ```
 
32
 
33
  * Now to run the model, you can use the following command:
34
  ```
35
+ ./llama-cli -m ./model/RWKV-6-World-1.6B-GGUF-Q4_K_M.gguf --in-suffix "Assistant:" --interactive-first -c 1024 -t 0.7 --top-k 50 --top-p 0.95 -n 128 -p "Assistant: Hello, what can i help you with today?\nUser:" -r "User:"
36
  ```