Hugging Face model: AIPlans/Qwen3-0.6B-IPO
Author: AIPlans
Created: 2025-12-11 10:13:25
Last modified: 2025-12-12 09:23:24
Pipeline: reinforcement-learning
Library: transformers
Likes: 1 | Downloads: 2
Tags: transformers, safetensors, qwen3, text-generation, reinforcement-learning, ipo, rlhf, alignment, qwen, en, dataset:Jennny/helpsteer2-helpfulness-preference, dataset:nvidia/HelpSteer2, arxiv:2310.12036, base_model:Qwen/Qwen3-0.6B-Base, base_model:finetune:Qwen/Qwen3-0.6B-Base, license:mit, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: Qwen/Qwen3-0.6B-Base
Card metadata:
model_name: qwen3-0.6b-IPO-hs2
base_model: Qwen/Qwen3-0.6B-Base
datasets: Jennny/helpsteer2-helpfulness-preference, nvidia/HelpSteer2
language: en
library_name: transformers
license: mit
tags: reinforcement-learning, ipo, rlhf, alignment, qwen