Hugging Face model: taba0207/qwen3-4b-sft-dpo-structeval_v2
Author: taba0207
Created: 2026-02-27 00:52:57
Last modified: 2026-02-27 00:53:04
Pipeline: text-generation
Library: peft
Likes: 0 | Downloads: 1
Tags: peft, safetensors, dpo, unsloth, qwen, alignment, text-generation, conversational, en, dataset:u-10bei/dpo-dataset-qwen-cot, license:apache-2.0, region:us
Card metadata:
base_model: unsloth/qwen3-4b-instruct-2507-unsloth-bnb-4bit
datasets: u-10bei/dpo-dataset-qwen-cot
language: en
license: apache-2.0
library_name: peft
pipeline_tag: text-generation
tags: dpo, unsloth, qwen, alignment