Model: Holarissun/dpo_anthropic_hh_gamma10.0_beta0.1_subset20000_modelmistral7b-sft_maxsteps1250_bz32_lr1e-05
Author: Holarissun
Library: peft
Tags: peft, safetensors, trl, dpo, generated_from_trainer, region:us
Card metadata: library_name: peft
tags: trl, dpo, generated_from_trainer
base_model: ckpts_SFT/SFT_mistral7b_hh-rlhf-gpt3_epoch1-subset10000
model-index: name: dpo_anthropic_hh_gamma10.0_beta0.1_subset20000_modelmistral7b-sft_maxsteps1250_bz32_lr1e-05
Likes: 0 | All-time downloads: 50
Created: 2024-04-10 21:25:39