---
license: gpl-3.0
---
hf-causal (pretrained=ccore/opt-125-smart-test), limit: None, provide_description: False, num_fewshot: 0, batch_size: None
|   Task   |Version| Metric |Value |   |Stderr|
|----------|------:|--------|-----:|---|-----:|
|openbookqa|      0|acc     |0.1560|±  |0.0162|
|          |       |acc_norm|0.3420|±  |0.0212|
|piqa      |      0|acc     |0.6197|±  |0.0113|
|          |       |acc_norm|0.6023|±  |0.0114|
prompt format:  

[INSTRUCTION] what's the capital of Brasil? ?  

[RESPONSE]
The capital of Brazil is Brasilia


datasets: OpenOrca, Wizard dataset, custom papers data .