Adding Evaluation Results

#1
Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -6,4 +6,17 @@ language:
6
  - en
7
  library_name: transformers
8
  ---
9
- This is a model fine tuned on an orca dataset and a multi language code dataset. It is one of my first projects, but I am happy with how it works. It took about 6 hours on 2 RTX 4090 GPUs. I used Axolotl to train this (HI IF YOURE SEEING THIS!!!).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  - en
7
  library_name: transformers
8
  ---
9
+ This is a model fine tuned on an orca dataset and a multi language code dataset. It is one of my first projects, but I am happy with how it works. It took about 6 hours on 2 RTX 4090 GPUs. I used Axolotl to train this (HI IF YOURE SEEING THIS!!!).
10
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
11
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_ashercn97__giraffe-7b)
12
+
13
+ | Metric | Value |
14
+ |-----------------------|---------------------------|
15
+ | Avg. | 39.73 |
16
+ | ARC (25-shot) | 47.18 |
17
+ | HellaSwag (10-shot) | 75.53 |
18
+ | MMLU (5-shot) | 38.89 |
19
+ | TruthfulQA (0-shot) | 38.48 |
20
+ | Winogrande (5-shot) | 68.98 |
21
+ | GSM8K (5-shot) | 2.65 |
22
+ | DROP (3-shot) | 6.39 |