File size: 922 Bytes
f43c1aa |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|-------------|------:|------|-----:|--------|-----:|---|-----:|
|openbookqa | 1|none | 0|acc |0.2880|± |0.0203|
| | |none | 0|acc_norm|0.3880|± |0.0218|
|arc_challenge| 1|none | 0|acc |0.4070|± |0.0144|
| | |none | 0|acc_norm|0.4394|± |0.0145|
|arc_easy | 1|none | 0|acc |0.7551|± |0.0088|
| | |none | 0|acc_norm|0.7327|± |0.0091|
|winogrande | 1|none | 0|acc |0.6598|± |0.0133|
|hellaswag | 1|none | 0|acc |0.5534|± |0.0050|
| | |none | 0|acc_norm|0.7392|± |0.0044|
|piqa | 1|none | 0|acc |0.7557|± |0.0100|
| | |none | 0|acc_norm|0.7715|± |0.0098|
|boolq | 2|none | 0|acc |0.7404|± |0.0077|
|