louisbrulenaudet commited on
Commit
1667b95
1 Parent(s): 79e733d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -3
README.md CHANGED
@@ -11,9 +11,31 @@ license: apache-2.0
11
  language:
12
  - en
13
  library_name: transformers
14
- metrics:
15
- - accuracy
16
  pipeline_tag: text-generation
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
17
  ---
18
  <center><img src='https://i.imgur.com/0xFTuAX.png' width='450px'></center>
19
 
@@ -27,7 +49,7 @@ Pearl-7B-slerp is a merge of the following models using [LazyMergekit](https://c
27
 
28
  The evaluation was performed using the HuggingFace Open LLM Leaderboard.
29
 
30
- | Model | Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K | #Params (B) |
31
  |-------------------------------------------|------------|-------|-----------|-------|------------|------------|-------|--------------|
32
  | **louisbrulenaudet/Pearl-7B-slerp** |**72.75** | 68.00 | 87.16 | 64.04 | 62.35 | 81.29 |**73.62**| 7.24 |
33
  | mistralai/Mixtral-8x7B-Instruct-v0.1 | 72.62 | 70.22 | 87.63 | 71.16 | 64.58 | 81.37 | 60.73 | 46.7 |
 
11
  language:
12
  - en
13
  library_name: transformers
 
 
14
  pipeline_tag: text-generation
15
+ model-index:
16
+ - name: Pearl-7B-slerp
17
+ results:
18
+ - task:
19
+ type: text-generation
20
+ metrics:
21
+ - name: ARC
22
+ type: ARC
23
+ value: 68.00
24
+ - name: GSM8K
25
+ type: GSM8K
26
+ value: 73.62
27
+ - name: Winogrande
28
+ type: Winogrande
29
+ value: 68.00
30
+ - name: TruthfulQA
31
+ type: TruthfulQA
32
+ value: 62.35
33
+ - name: HellaSwag
34
+ type: HellaSwag
35
+ value: 87.16
36
+ source:
37
+ name: Open LLM Leaderboard
38
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
39
  ---
40
  <center><img src='https://i.imgur.com/0xFTuAX.png' width='450px'></center>
41
 
 
49
 
50
  The evaluation was performed using the HuggingFace Open LLM Leaderboard.
51
 
52
+ | Model | Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K | Params (B) |
53
  |-------------------------------------------|------------|-------|-----------|-------|------------|------------|-------|--------------|
54
  | **louisbrulenaudet/Pearl-7B-slerp** |**72.75** | 68.00 | 87.16 | 64.04 | 62.35 | 81.29 |**73.62**| 7.24 |
55
  | mistralai/Mixtral-8x7B-Instruct-v0.1 | 72.62 | 70.22 | 87.63 | 71.16 | 64.58 | 81.37 | 60.73 | 46.7 |