Hugging Face model: lblaoke/opt-350m-hh-rlhf-dpo-trl-v5
Author: lblaoke
Created: 2025-05-12 00:59:57
Last modified: 2025-05-12 01:08:51
Likes: 0 | Downloads: 10
Tags: safetensors, opt, dataset:Dahoas/full-hh-rlhf, base_model:lblaoke/opt-350m-hh-rlhf-chosen-sft-trl-v5, base_model:finetune:lblaoke/opt-350m-hh-rlhf-chosen-sft-trl-v5, region:us
Base model relation: finetune
Base models: id: lblaoke/opt-350m-hh-rlhf-chosen-sft-trl-v5
Card metadata:
datasets: Dahoas/full-hh-rlhf
base_model: lblaoke/opt-350m-hh-rlhf-chosen-sft-trl-v5