File size: 922 Bytes
26d4600 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|-------------|------:|------|-----:|--------|-----:|---|-----:|
|openbookqa | 1|none | 0|acc |0.3080|± |0.0207|
| | |none | 0|acc_norm|0.4360|± |0.0222|
|arc_challenge| 1|none | 0|acc |0.4505|± |0.0145|
| | |none | 0|acc_norm|0.4727|± |0.0146|
|arc_easy | 1|none | 0|acc |0.7660|± |0.0087|
| | |none | 0|acc_norm|0.7479|± |0.0089|
|winogrande | 1|none | 0|acc |0.6851|± |0.0131|
|hellaswag | 1|none | 0|acc |0.5746|± |0.0049|
| | |none | 0|acc_norm|0.7630|± |0.0042|
|piqa | 1|none | 0|acc |0.7775|± |0.0097|
| | |none | 0|acc_norm|0.7911|± |0.0095|
|boolq | 2|none | 0|acc |0.7786|± |0.0073|
|