TheBloke commited on
Commit
781b8ad
·
1 Parent(s): 15d3d15

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -122,13 +122,13 @@ Refer to the Provided Files table below to see what files use which methods, and
122
  I use the following command line; adjust for your tastes and needs:
123
 
124
  ```
125
- ./main -t 10 -ngl 32 -m openassistant-llama2-13b-orca-8k-3319.ggmlv3.q4_0.bin --color -c 4096 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "<|system|>You are a story writing assistant</s><|prompter|>write a story about llamas</s><|assistant|>"
126
  ```
127
  Change `-t 10` to the number of physical CPU cores you have. For example if your system has 8 cores/16 threads, use `-t 8`.
128
 
129
  Change `-ngl 32` to the number of layers to offload to GPU. Remove it if you don't have GPU acceleration.
130
 
131
- If you want to have a chat-style conversation, replace the `-p <PROMPT>` argument with `-i -ins`
132
 
133
  ## How to run in `text-generation-webui`
134
 
 
122
  I use the following command line; adjust for your tastes and needs:
123
 
124
  ```
125
+ ./main -t 10 -ngl 32 -m openassistant-llama2-13b-orca-8k-3319.ggmlv3.q4_0.bin --color -c 8192 --rope-freq-base 10000 --rope-freq-scale 0.5 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "<|system|>You are a story writing assistant</s><|prompter|>write a story about llamas</s><|assistant|>"
126
  ```
127
  Change `-t 10` to the number of physical CPU cores you have. For example if your system has 8 cores/16 threads, use `-t 8`.
128
 
129
  Change `-ngl 32` to the number of layers to offload to GPU. Remove it if you don't have GPU acceleration.
130
 
131
+ Change `-c 8192` if you want a different context value, in which case you should also update `--rope-freq-base` and `--rope-freq-scale` as well. If you set it to 4096 or below you should be able to remove `--rope-freq-base` and `--rope-freq-scale`.
132
 
133
  ## How to run in `text-generation-webui`
134