nbeerbower
commited on
Commit
•
bfa0fbc
1
Parent(s):
f5d5149
Update README.md
Browse files
README.md
CHANGED
@@ -25,6 +25,6 @@ Allades finetunes abliterated Llama 3.1 with 5 datasets to improve creative writ
|
|
25 |
|
26 |
## Training
|
27 |
|
28 |
-
ORPO tuned for 1 epoch with 2x RTX 3090 (sponsored by [Schneewolf Labs](https://schneewolflabs.com)).
|
29 |
|
30 |
Data was prepared with [Llama 3.1 Instruct](https://www.llama.com/docs/model-cards-and-prompt-formats/llama3_1/).
|
|
|
25 |
|
26 |
## Training
|
27 |
|
28 |
+
[ORPO tuned](https://mlabonne.github.io/blog/posts/2024-04-19_Fine_tune_Llama_3_with_ORPO.html) for 1 epoch with 2x RTX 3090 (sponsored by [Schneewolf Labs](https://schneewolflabs.com)).
|
29 |
|
30 |
Data was prepared with [Llama 3.1 Instruct](https://www.llama.com/docs/model-cards-and-prompt-formats/llama3_1/).
|