usvsnsp/pythia-410m-ppo

Wandb run: https://wandb.ai/eleutherai/pythia-rlhf/runs/7f9c9lrm

Eval Results

Tasks	Version	Filter	Metric	Value		Stderr
arc_challenge	Yaml	none	acc	0.2201	±	0.0121
		none	acc_norm	0.2568	±	0.0128
arc_easy	Yaml	none	acc	0.5253	±	0.0102
		none	acc_norm	0.4558	±	0.0102
lambada_openai	Yaml	none	perplexity	11.3766	±	0.3623
		none	acc	0.4844	±	0.0070
logiqa	Yaml	none	acc	0.2120	±	0.0160
		none	acc_norm	0.2780	±	0.0176
piqa	Yaml	none	acc	0.6817	±	0.0109
		none	acc_norm	0.6828	±	0.0109
sciq	Yaml	none	acc	0.8130	±	0.0123
		none	acc_norm	0.7090	±	0.0144
winogrande	Yaml	none	acc	0.5375	±	0.0140
wsc	Yaml	none	acc	0.3654	±	0.0474