seyf1elislam commited on
Commit
77a9def
1 Parent(s): 5cfa89c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -67,6 +67,18 @@ Replicate the configuration utilized in the [froggeric/WestLake-10.7B-v2](https:
67
  # Quantized versions :
68
  - [**GGUF**](https://huggingface.co/seyf1elislam/WestKunai-Hermes-10.7b-test-GGUF)
69
 
 
 
 
 
 
 
 
 
 
 
 
 
70
  ## Merge Details
71
 
72
 
 
67
  # Quantized versions :
68
  - [**GGUF**](https://huggingface.co/seyf1elislam/WestKunai-Hermes-10.7b-test-GGUF)
69
 
70
+ # comparison
71
+ | Metric | diff |Current(10.7b)|Origin(7b)|
72
+ |---------------------------------|----:|----:|----:|
73
+ |Avg. |<span style="color:red">-3.76</span>|69.75|73.51|
74
+ |AI2 Reasoning Challenge (25-Shot)|<span style="color:red">-3.07</span>|68.09|71.16|
75
+ |HellaSwag (10-Shot) |<span style="color:red">-0.66</span>|87.10|87.76|
76
+ |MMLU (5-Shot) |<span style="color:red">-0.34</span>|64.43|64.77|
77
+ |TruthfulQA (0-shot) |<span style="color:red">-0.97</span>|64.28|65.25|
78
+ |Winogrande (5-shot) |<span style="color:red">-0.31</span>|82.72|83.03|
79
+ |GSM8k (5-shot) |<span style="color:red">-17.21</span>|51.86|69.07|
80
+
81
+
82
  ## Merge Details
83
 
84