Model: Tandogan/MNLP_M2_dpo_model
Author: Tandogan
Tags: safetensors, qwen3, dpo, unsloth, trl, qwen, instruction-tuning, preference-modeling, mnlp, dataset:Tandogan/sft_dataset_final_train, dataset:Tandogan/MNLP_M2_dpo_dataset, base_model:Qwen/Qwen3-0.6B-Base, base_model:finetune:Qwen/Qwen3-0.6B-Base, license:apache-2.0, region:us
Base models (finetune): id: Qwen/Qwen3-0.6B-Base
Card metadata: license: apache-2.0
tags: dpo, unsloth, trl, qwen, instruction-tuning, preference-modeling, mnlp
datasets: Tandogan/sft_dataset_final_train, Tandogan/MNLP_M2_dpo_dataset
base_model: Qwen/Qwen3-0.6B-Base
inference: no
Likes: 0 | All-time downloads: 14
Created: 2025-05-25 09:27:01