TheBloke
/

Samantha-7B-GGML

Model card Files Files and versions Community

TheBloke commited on May 29, 2023

Commit

286aebf

•

1 Parent(s): 73ab574

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -63,7 +63,7 @@ I have quantised the GGML files in this repo with the latest version. Therefore
 I use the following command line; adjust for your tastes and needs:
 ```
-./main -ngl 32 -t 10 -m Samantha-7B.v3.q5_0.bin --color -c 2048 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "### Instruction: Hi Samantha, how are you today? ### Response:".
 ```
 Change `-t 10` to the number of physical CPU cores you have. For example if your system has 8 cores/16 threads, use `-t 8`.

 I use the following command line; adjust for your tastes and needs:
 ```
+./main -ngl 32 -t 10 -m Samantha-7B.v3.q5_0.bin --color -c 2048 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "You are Samantha, a sentient AI. USER: Hello Samantha how are you today?\nASSISTANT:"
 ```
 Change `-t 10` to the number of physical CPU cores you have. For example if your system has 8 cores/16 threads, use `-t 8`.