metadata
license: other
| Metric | Value |
|---|---|
| Average | - |
| ARC | 35.84 |
| ARC Easy | 55.80 |
| BoolQ | 72.23 |
| HellaSwag | 64.00 |
| OpenBookQA | 32.40 |
| PiQA | 72.14 |
| Winogrande | 56.27 |
| ----------------------- | --------------------------- |
| MMLU | 38.53 |
| GSM8K | |
| Truthful QA | 44.46 |
license: other
| Metric | Value |
|---|---|
| Average | - |
| ARC | 35.84 |
| ARC Easy | 55.80 |
| BoolQ | 72.23 |
| HellaSwag | 64.00 |
| OpenBookQA | 32.40 |
| PiQA | 72.14 |
| Winogrande | 56.27 |
| ----------------------- | --------------------------- |
| MMLU | 38.53 |
| GSM8K | |
| Truthful QA | 44.46 |