G-reen commited on
Commit
70fb7e8
1 Parent(s): 8525261

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +45 -17
README.md CHANGED
@@ -1,23 +1,51 @@
1
  ---
2
- language:
3
- - en
4
- license: apache-2.0
5
- tags:
6
- - text-generation-inference
7
- - transformers
8
- - unsloth
9
- - mistral
10
- - trl
11
- - orpo
12
- base_model: unsloth/mistral-7b-v0.2-bnb-4bit
13
  ---
14
 
15
- # Uploaded model
16
 
17
- - **Developed by:** G-reen
18
- - **License:** apache-2.0
19
- - **Finetuned from model :** unsloth/mistral-7b-v0.2-bnb-4bit
20
 
21
- This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
22
 
23
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: "apache-2.0"
 
 
 
 
 
 
 
 
 
 
3
  ---
4
 
5
+ *This model was trained as part of a series of experiments testing the performance of pure DPO vs SFT vs ORPO, all supported by Unsloth/Huggingface TRL.*
6
 
7
+ **Benchmarks**
 
 
8
 
9
+ TBA
10
 
11
+ **Training Details**
12
+
13
+ Duration: ~9 hours on one Kaggle T4 with Unsloth
14
+
15
+ Model: https://huggingface.co/unsloth/mistral-7b-v0.2-bnb-4bit
16
+
17
+ Dataset: https://huggingface.co/datasets/argilla/dpo-mix-7k
18
+
19
+ Rank: 8
20
+
21
+ Alpha: 16
22
+
23
+ Learning rate: 5e-6
24
+
25
+ Beta: 0.1
26
+
27
+ Batch size: 8
28
+
29
+ Epochs: 1
30
+
31
+ Learning rate scheduler: Linear
32
+
33
+ Prompt Format: ChatML
34
+ ```
35
+ <|im_start|>system
36
+ You are a helpful assistant.<|im_end|>
37
+ <|im_start|>user
38
+ Why is the sky blue?<|im_end|>
39
+ <|im_start|>assistant
40
+ ```
41
+
42
+
43
+ **WanDB Reports**
44
+
45
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65a5c0e82823ba72ed2cee7d/Mn02CupOCn_PkcGF4wu3P.png)
46
+
47
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65a5c0e82823ba72ed2cee7d/6fbVBnvDgS9UelUEsu6K9.png)
48
+
49
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65a5c0e82823ba72ed2cee7d/9RKY1qgr5pcJGQMWz_-QF.png)
50
+
51
+ [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)