Hugging Face model: chenyongxi/Qwen2.5-1.5B-SFT-DPO-InfinityPreference
Author: chenyongxi
Created: 2026-04-03 00:24:46
Last modified: 2026-04-03 00:25:13
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 9
Tags: transformers, safetensors, qwen2, text-generation, generated_from_trainer, trl, dpo, conversational, dataset:BAAI/Infinity-Preference, arxiv:2305.18290, text-generation-inference, endpoints_compatible, region:us
Card metadata:
datasets: BAAI/Infinity-Preference
library_name: transformers
model_name: Qwen2.5-1.5B-DPO-1.5B
tags: generated_from_trainer, trl, dpo
licence: license