metadata
library_name: transformers
license: apache-2.0
datasets:
- lmqg/qag_itquad
language:
- it
| Tasks | Metric | Value | Stderr | |
|---|---|---|---|---|
| hellaswag_it | acc | 0.4439 | ± | 0.0052 |
| acc_norm | 0.5962 | ± | 0.0051 | |
| arc_it | acc | 0.1257 | ± | 0.0097 |
| acc_norm | 0.4414 | ± | 0.0145 |
library_name: transformers
license: apache-2.0
datasets:
- lmqg/qag_itquad
language:
- it
| Tasks | Metric | Value | Stderr | |
|---|---|---|---|---|
| hellaswag_it | acc | 0.4439 | ± | 0.0052 |
| acc_norm | 0.5962 | ± | 0.0051 | |
| arc_it | acc | 0.1257 | ± | 0.0097 |
| acc_norm | 0.4414 | ± | 0.0145 |