Hugging Face model: Wellwisher12/dpo-qwen-adapter
Author: Wellwisher12
Created: 2026-07-29 13:22:10
Last modified: 2026-07-29 19:36:47
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 0
Tags: transformers, safetensors, dpo, qlora, ultrafeedback, qwen, preference-alignment, peft, trl, text-generation, en, arxiv:2305.18290, base_model:Qwen/Qwen2.5-3B-Instruct, base_model:finetune:Qwen/Qwen2.5-3B-Instruct, license:mit, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: Qwen/Qwen2.5-3B-Instruct
Card metadata:
language: en
license: mit
base_model: Qwen/Qwen2.5-3B-Instruct
tags: dpo, qlora, ultrafeedback, qwen, preference-alignment, peft, trl, text-generation
pipeline_tag: text-generation
library_name: transformers