Wandb run: https://wandb.ai/eleutherai/pythia-rlhf/runs/7f9c9lrm

Eval Results
|    Tasks     |Version|Filter|  Metric  | Value |   |Stderr|
|--------------|-------|------|----------|------:|---|-----:|
|arc_challenge |Yaml   |none  |acc       | 0.2201|±  |0.0121|
|              |       |none  |acc_norm  | 0.2568|±  |0.0128|
|arc_easy      |Yaml   |none  |acc       | 0.5253|±  |0.0102|
|              |       |none  |acc_norm  | 0.4558|±  |0.0102|
|lambada_openai|Yaml   |none  |perplexity|11.3766|±  |0.3623|
|              |       |none  |acc       | 0.4844|±  |0.0070|
|logiqa        |Yaml   |none  |acc       | 0.2120|±  |0.0160|
|              |       |none  |acc_norm  | 0.2780|±  |0.0176|
|piqa          |Yaml   |none  |acc       | 0.6817|±  |0.0109|
|              |       |none  |acc_norm  | 0.6828|±  |0.0109|
|sciq          |Yaml   |none  |acc       | 0.8130|±  |0.0123|
|              |       |none  |acc_norm  | 0.7090|±  |0.0144|
|winogrande    |Yaml   |none  |acc       | 0.5375|±  |0.0140|
|wsc           |Yaml   |none  |acc       | 0.3654|±  |0.0474|