Hugging Face model: MInAlA/Qwen3-4B-Instruct-2507-DPO-merged
Author: MInAlA
Created: 2026-04-01 15:25:49
Last modified: 2026-04-05 07:06:34
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 845
Tags: transformers, safetensors, qwen3, text-generation, trl, dpo, conversational, dataset:argilla/ultrafeedback-binarized-preferences, base_model:Qwen/Qwen3-4B-Instruct-2507, base_model:finetune:Qwen/Qwen3-4B-Instruct-2507, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: Qwen/Qwen3-4B-Instruct-2507
Card metadata:
library_name: transformers
tags: trl, dpo
datasets: argilla/ultrafeedback-binarized-preferences
base_model: Qwen/Qwen3-4B-Instruct-2507