---
library_name: transformers
license: apache-2.0
datasets:
- lmqg/qag_itquad
language:
- it
---

|   Tasks    | Metric |Value |   |Stderr|
|------------|--------|-----:|---|-----:|
|hellaswag_it|acc     |0.4439|±  |0.0052|
|            |acc_norm|0.5962|±  |0.0051|
|arc_it      |acc     |0.1257|±  |0.0097|
|            |acc_norm|0.4414|±  |0.0145|