Model: Asap7772/Qwen3-4B-second-stage-DPO-lr-1e-7-beta-0.1-loss-sigmoid-rpo-1.0-ckpt-135
Author: Asap7772
Tags: safetensors, qwen3, trl, dpo, rlhf, alignment, base_model:Asap7772/qwen3-4b-impabs-warmstart-sft-1e-5-1epoch-0828, base_model:finetune:Asap7772/qwen3-4b-impabs-warmstart-sft-1e-5-1epoch-0828, license:apache-2.0, region:us
Base models (finetune): id: Asap7772/qwen3-4b-impabs-warmstart-sft-1e-5-1epoch-0828
Card metadata: license: apache-2.0
base_model: Asap7772/qwen3-4b-impabs-warmstart-sft-1e-5-1epoch-0828
tags: trl, dpo, rlhf, alignment
Likes: 0 | All-time downloads: 40
Created: 2025-09-16 22:15:12