lomahony
/

pythia-70m-helpful-sft-epoch2

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

No model card

New: Create and edit this model card directly on the website!

Contribute a Model Card

Downloads last month: 1

Safetensors

Model size

70.4M params

Tensor type

BF16

·

Collection including lomahony/pythia-70m-helpful-sft-epoch2

pythia-helpful-epoch2

Pythia-2.8b supervised finetuned and DPO finetuned with the helpful subset of Anthropic-hh-rlhf dataset for a second epoch. • 6 items • Updated Mar 12