andersonbcdefg
commited on
Commit
•
40763d6
1
Parent(s):
eeed786
Update README.md
Browse files
README.md
CHANGED
@@ -14,7 +14,7 @@ from huggingface_hub import snapshot_download
|
|
14 |
snapshot_download(repo_id="TaylorAI/Llama2-7B-SFT-LIMA-ct2", local_dir="Llama2_TaylorAI")
|
15 |
```
|
16 |
|
17 |
-
Then, you can perform inference as follows. Note that the model was trained with the separator
|
18 |
and the model's response, so to get the expected result, you'll want to append this to your prompt. The model was also trained to finish its
|
19 |
output with the suffix `@@@`, so you can stop generating tokens once you reach this suffix, or use it to split the completion and keep the
|
20 |
relevant part. All of this is shown in the example below.
|
|
|
14 |
snapshot_download(repo_id="TaylorAI/Llama2-7B-SFT-LIMA-ct2", local_dir="Llama2_TaylorAI")
|
15 |
```
|
16 |
|
17 |
+
Then, you can perform inference as follows. Note that the model was trained with the separator `\n\n###\n\n` between the prompt/instruction
|
18 |
and the model's response, so to get the expected result, you'll want to append this to your prompt. The model was also trained to finish its
|
19 |
output with the suffix `@@@`, so you can stop generating tokens once you reach this suffix, or use it to split the completion and keep the
|
20 |
relevant part. All of this is shown in the example below.
|