yongzx
/

pythia-410m-sft-hh

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

pythia-410m-sft-hh / README.md

yongzx's picture

Update README.md (#2)

c67fb50 10 months ago

|

raw history blame contribute delete

No virus

1.04 kB

	Wandb Runs: https://wandb.ai/eleutherai/pythia-rlhf/runs/644tyaq0?workspace=user-yongzx

	Model Evals:
	\| Task \|Version\|Filter\| Metric \|Value \| \|Stderr\|
	\|-------------\|-------\|------\|--------\|-----:\|---\|-----:\|
	\|arc_challenge\|Yaml \|none \|acc \|0.2287\|± \|0.0123\|
	\| \| \|none \|acc_norm\|0.2619\|± \|0.0128\|
	\|arc_easy \|Yaml \|none \|acc \|0.5248\|± \|0.0102\|
	\| \| \|none \|acc_norm\|0.4533\|± \|0.0102\|
	\|logiqa \|Yaml \|none \|acc \|0.2089\|± \|0.0159\|
	\| \| \|none \|acc_norm\|0.2765\|± \|0.0175\|
	\|piqa \|Yaml \|none \|acc \|0.6855\|± \|0.0108\|
	\| \| \|none \|acc_norm\|0.6823\|± \|0.0109\|
	\|sciq \|Yaml \|none \|acc \|0.8050\|± \|0.0125\|
	\| \| \|none \|acc_norm\|0.7080\|± \|0.0144\|
	\|winogrande \|Yaml \|none \|acc \|0.5335\|± \|0.0140\|
	\|wsc \|Yaml \|none \|acc \|0.3654\|± \|0.0474\|
	\|lambada_openai\|Yaml \|none \|perplexity\|9.8265\|± \|0.3139\|
	\| \| \|none \|acc \|0.5135\|± \|0.0070\|