Update README.md
Browse files
README.md
CHANGED
|
@@ -4,4 +4,7 @@ language:
|
|
| 4 |
- en
|
| 5 |
pipeline_tag: text-generation
|
| 6 |
dtype: bfloat16
|
| 7 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
- en
|
| 5 |
pipeline_tag: text-generation
|
| 6 |
dtype: bfloat16
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
I fine-tuned the zyh3826/GML-Mistral-merged-v1 model with DPO using Intel's dataset for neural-chat-7b-v3-1.
|
| 10 |
+
Fine-tuning took about an hour on Google Colab A-1000 GPU with 40GB VRAM.
|