Hugging Face model: ikedabent/dpo-qwen-cot-merged-v3
Author: ikedabent
Created: 2026-02-07 21:20:37
Last modified: 2026-02-07 21:21:00
Library: peft
Likes: 0 | Downloads: 2
Tags: peft, safetensors, arxiv:1910.09700, region:us
Card metadata:
base_model: unsloth/qwen3-4b-instruct-2507-unsloth-bnb-4bit
library_name: peft