Hugging Face model: choco800/dpo-qwen-cot-merged-v2
Author: choco800
Created: 2026-02-08 11:59:21
Last modified: 2026-02-08 14:33:09
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 5
Tags: transformers, safetensors, qwen3, text-generation, dpo, unsloth, qwen, alignment, qlora, conversational, en, dataset:u-10bei/dpo-dataset-qwen-cot, dataset:u-10bei/structured_data_with_cot_dataset_512_v2, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Card metadata:
DPO-base_model: choco800/Qwen3-4B-Instruct-2507-v8
STF-base_model: Qwen/Qwen3-4B-Instruct-2507
datasets: u-10bei/dpo-dataset-qwen-cot, u-10bei/structured_data_with_cot_dataset_512_v2
language: en
license: apache-2.0
library_name: transformers
pipeline_tag: text-generation
tags: dpo, unsloth, qwen, alignment, qlora