Adding Evaluation Results

#2
Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -19,4 +19,17 @@ We initiailized training with pythia-1.3b weights, a precursor to the [pythia-1.
19
 
20
  Detailed evaluations coming soon :)
21
 
22
- **Note**: Commit `3bcdc4e` replaced the weights with a model trained on proof-pile v1.1, as opposed to previous commits which were trained on v1.0. Commit `9695b51` updated the tokenizer to have bos, eos, and unk tokens.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
 
20
  Detailed evaluations coming soon :)
21
 
22
+ **Note**: Commit `3bcdc4e` replaced the weights with a model trained on proof-pile v1.1, as opposed to previous commits which were trained on v1.0. Commit `9695b51` updated the tokenizer to have bos, eos, and unk tokens.
23
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
24
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_hoskinson-center__proofGPT-v0.1)
25
+
26
+ | Metric | Value |
27
+ |-----------------------|---------------------------|
28
+ | Avg. | 25.99 |
29
+ | ARC (25-shot) | 22.87 |
30
+ | HellaSwag (10-shot) | 28.66 |
31
+ | MMLU (5-shot) | 25.96 |
32
+ | TruthfulQA (0-shot) | 51.64 |
33
+ | Winogrande (5-shot) | 50.43 |
34
+ | GSM8K (5-shot) | 0.08 |
35
+ | DROP (3-shot) | 2.29 |