Hugging Face model: kiratan/dpo-qwen-cot-merged
Author: kiratan
Created: 2026-02-03 09:34:31
Last modified: 2026-02-03 10:12:01
Library: peft
Likes: 0 | Downloads: 2
Tags: peft, safetensors, qwen3, dpo, lora, base_model:Qwen/Qwen3-4B-Instruct-2507, base_model:adapter:Qwen/Qwen3-4B-Instruct-2507, license:apache-2.0, 4-bit, bitsandbytes, region:us
Base model relation: adapter
Base models: id: Qwen/Qwen3-4B-Instruct-2507
Card metadata:
license: apache-2.0
base_model: Qwen/Qwen3-4B-Instruct-2507
tags: qwen3, dpo, lora
library_name: peft