Kukedlc commited on
Commit
69c5dc1
•
1 Parent(s): 0f2cb78

Adding Evaluation Results (#1)

Browse files

- Adding Evaluation Results (de6e191270142dd35c547db9a205490b68a8ccd8)

Files changed (1) hide show
  1. README.md +101 -2
README.md CHANGED
@@ -1,4 +1,5 @@
1
  ---
 
2
  tags:
3
  - merge
4
  - mergekit
@@ -14,7 +15,6 @@ base_model:
14
  - Kukedlc/Neural4gsm8k
15
  - Eric111/Mayo
16
  - Kukedlc/NeuralSirKrishna-7b
17
- license: apache-2.0
18
  model-index:
19
  - name: NeuralSirKrishna-7b
20
  results:
@@ -32,6 +32,92 @@ model-index:
32
  - type: acc
33
  value: 75.21
34
  name: accuracy
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
35
  ---
36
 
37
  <div style="font-size: 42px; text-align: center;">🤖 NeuralMaths-Experiment-7b 🤖</div>
@@ -104,4 +190,17 @@ pipeline = transformers.pipeline(
104
 
105
  outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
106
  print(outputs[0]["generated_text"])
107
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: apache-2.0
3
  tags:
4
  - merge
5
  - mergekit
 
15
  - Kukedlc/Neural4gsm8k
16
  - Eric111/Mayo
17
  - Kukedlc/NeuralSirKrishna-7b
 
18
  model-index:
19
  - name: NeuralSirKrishna-7b
20
  results:
 
32
  - type: acc
33
  value: 75.21
34
  name: accuracy
35
+ - type: acc
36
+ value: 75.21
37
+ name: accuracy
38
+ - task:
39
+ type: text-generation
40
+ name: Text Generation
41
+ dataset:
42
+ name: AI2 Reasoning Challenge (25-Shot)
43
+ type: ai2_arc
44
+ config: ARC-Challenge
45
+ split: test
46
+ args:
47
+ num_few_shot: 25
48
+ metrics:
49
+ - type: acc_norm
50
+ value: 69.71
51
+ name: normalized accuracy
52
+ source:
53
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Kukedlc/NeuralMaths-Experiment-7b
54
+ name: Open LLM Leaderboard
55
+ - task:
56
+ type: text-generation
57
+ name: Text Generation
58
+ dataset:
59
+ name: HellaSwag (10-Shot)
60
+ type: hellaswag
61
+ split: validation
62
+ args:
63
+ num_few_shot: 10
64
+ metrics:
65
+ - type: acc_norm
66
+ value: 87.48
67
+ name: normalized accuracy
68
+ source:
69
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Kukedlc/NeuralMaths-Experiment-7b
70
+ name: Open LLM Leaderboard
71
+ - task:
72
+ type: text-generation
73
+ name: Text Generation
74
+ dataset:
75
+ name: MMLU (5-Shot)
76
+ type: cais/mmlu
77
+ config: all
78
+ split: test
79
+ args:
80
+ num_few_shot: 5
81
+ metrics:
82
+ - type: acc
83
+ value: 65.01
84
+ name: accuracy
85
+ source:
86
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Kukedlc/NeuralMaths-Experiment-7b
87
+ name: Open LLM Leaderboard
88
+ - task:
89
+ type: text-generation
90
+ name: Text Generation
91
+ dataset:
92
+ name: TruthfulQA (0-shot)
93
+ type: truthful_qa
94
+ config: multiple_choice
95
+ split: validation
96
+ args:
97
+ num_few_shot: 0
98
+ metrics:
99
+ - type: mc2
100
+ value: 63.83
101
+ source:
102
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Kukedlc/NeuralMaths-Experiment-7b
103
+ name: Open LLM Leaderboard
104
+ - task:
105
+ type: text-generation
106
+ name: Text Generation
107
+ dataset:
108
+ name: Winogrande (5-shot)
109
+ type: winogrande
110
+ config: winogrande_xl
111
+ split: validation
112
+ args:
113
+ num_few_shot: 5
114
+ metrics:
115
+ - type: acc
116
+ value: 82.48
117
+ name: accuracy
118
+ source:
119
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Kukedlc/NeuralMaths-Experiment-7b
120
+ name: Open LLM Leaderboard
121
  ---
122
 
123
  <div style="font-size: 42px; text-align: center;">🤖 NeuralMaths-Experiment-7b 🤖</div>
 
190
 
191
  outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
192
  print(outputs[0]["generated_text"])
193
+ ```
194
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
195
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Kukedlc__NeuralMaths-Experiment-7b)
196
+
197
+ | Metric |Value|
198
+ |---------------------------------|----:|
199
+ |Avg. |73.95|
200
+ |AI2 Reasoning Challenge (25-Shot)|69.71|
201
+ |HellaSwag (10-Shot) |87.48|
202
+ |MMLU (5-Shot) |65.01|
203
+ |TruthfulQA (0-shot) |63.83|
204
+ |Winogrande (5-shot) |82.48|
205
+ |GSM8k (5-shot) |75.21|
206
+