Update README.md

README.md

@@ -1,22 +1,49 @@
 ---
-language:
-- en
-license: apache-2.0
-tags:
-- text-generation-inference
-- transformers
-- unsloth
-- mistral
-- trl
-base_model: unsloth/mistral-7b-v0.2-bnb-4bit
+license: "apache-2.0"
 ---
 
-# Uploaded  model
+*This model was trained as part of a series of experiments testing the performance of pure DPO vs SFT vs ORPO, all supported by Unsloth/Huggingface TRL.*
 
-- **Developed by:** G-reen
-- **License:** apache-2.0
-- **Finetuned from model :** unsloth/mistral-7b-v0.2-bnb-4bit
+Note: This model failed to train because the LR was too high (was stopped early, at 300 steps). Do not use!
 
-This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
+**Benchmarks**
 
-[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
+TBA
+
+**Training Details**
+
+Model: https://huggingface.co/unsloth/mistral-7b-v0.2-bnb-4bit
+
+Dataset: https://huggingface.co/datasets/argilla/dpo-mix-7k 
+
+Rank: 8 
+
+Alpha: 16 
+
+Learning rate: 5e-4
+
+Beta: 0.1 
+
+Batch size: 8 
+
+Epochs: 1
+
+Learning rate scheduler: Linear
+
+Prompt Format: ChatML
+```
+<|im_start|>system
+You are a helpful assistant.<|im_end|>
+<|im_start|>user
+Why is the sky blue?<|im_end|>
+<|im_start|>assistant
+```
+
+
+**WanDB Reports**
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/65a5c0e82823ba72ed2cee7d/hICdKQjk2mkRODyhyUfVV.png)
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/65a5c0e82823ba72ed2cee7d/CZobUkPWirguxOoE_hll0.png)
+
+[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)