Update README.md
Browse files
README.md
CHANGED
|
@@ -16,6 +16,10 @@ language:
|
|
| 16 |
library_name: diffusers
|
| 17 |
---
|
| 18 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
# ogno-monarch-jaskier-merge-7b
|
| 20 |
|
| 21 |
ogno-monarch-jaskier-merge-7b is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|
|
|
|
| 16 |
library_name: diffusers
|
| 17 |
---
|
| 18 |
|
| 19 |
+
# DPO Fine-tuned version
|
| 20 |
+
|
| 21 |
+
I DPO finetuned this model later to obtain a slightly better model (open llm leaderboard benchmark performance) https://huggingface.co/eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO
|
| 22 |
+
|
| 23 |
# ogno-monarch-jaskier-merge-7b
|
| 24 |
|
| 25 |
ogno-monarch-jaskier-merge-7b is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|