Update README.md
Browse files
README.md
CHANGED
|
@@ -1,11 +1,12 @@
|
|
| 1 |
-
---
|
| 2 |
-
library_name: transformers
|
| 3 |
-
|
| 4 |
-
|
|
|
|
| 5 |
|
| 6 |
## Description
|
| 7 |
|
| 8 |
-
mistral-7b-sft-beta model finetuned by hybrid WPO (GPT-4-turbo + on-policy sampling + Ultrafeedback). Details in [WPO: Enhancing RLHF with Weighted Preference Optimization](https://arxiv.org/abs/2406.11827).
|
| 9 |
|
| 10 |
## License
|
| 11 |
This model is licensed under the Zoom software license and is permitted for use only for noncommercial, educational, or academic research purposes.
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: transformers
|
| 3 |
+
datasets:
|
| 4 |
+
- wzhouad/zephyr-ultrafeedback-hybrid
|
| 5 |
+
---
|
| 6 |
|
| 7 |
## Description
|
| 8 |
|
| 9 |
+
mistral-7b-sft-beta model finetuned by hybrid WPO (GPT-4-turbo + on-policy sampling + Ultrafeedback). Details in [WPO: Enhancing RLHF with Weighted Preference Optimization](https://arxiv.org/abs/2406.11827). The training data is [wzhouad/zephyr-ultrafeedback-hybrid](https://huggingface.co/datasets/wzhouad/zephyr-ultrafeedback-hybrid).
|
| 10 |
|
| 11 |
## License
|
| 12 |
This model is licensed under the Zoom software license and is permitted for use only for noncommercial, educational, or academic research purposes.
|