cloudyu commited on
Commit
a542d33
1 Parent(s): 918f189

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -15,3 +15,20 @@ TRL supports the DPO Trainer for training language models from preference data,
15
 
16
  Metrics
17
  [Metrics](https://huggingface.co/cloudyu/4bit_quant_TomGrc_FusionNet_34Bx2_MoE_v0.1_DPO/blob/main/4bit.vs.16.jpg)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
 
16
  Metrics
17
  [Metrics](https://huggingface.co/cloudyu/4bit_quant_TomGrc_FusionNet_34Bx2_MoE_v0.1_DPO/blob/main/4bit.vs.16.jpg)
18
+
19
+ Metrics
20
+ [Metrics](https://huggingface.co/cloudyu/4bit_quant_TomGrc_FusionNet_34Bx2_MoE_v0.1_DPO/blob/main/4bit.vs.16.jpg)
21
+
22
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
23
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_cloudyu__TomGrc_FusionNet_34Bx2_MoE_v0.1_DPO_f16)
24
+
25
+ | Metric |Value|
26
+ |---------------------------------|----:|
27
+ |Avg. |77.91|
28
+ |AI2 Reasoning Challenge (25-Shot)|74.06|
29
+ |HellaSwag (10-Shot) |86.74|
30
+ |MMLU (5-Shot) |76.65|
31
+ |TruthfulQA (0-shot) |72.24|
32
+ |Winogrande (5-shot) |83.35|
33
+ |GSM8k (5-shot) |74.45|
34
+