Hugging Face model: Tandogan/MNLP_M2_dpo_model
Author: Tandogan
Created: 2025-05-25 09:27:01
Last modified: 2025-05-27 14:46:57
Likes: 0 | Downloads: 6
Tags: safetensors, qwen3, dpo, unsloth, trl, qwen, instruction-tuning, preference-modeling, mnlp, dataset:Tandogan/sft_dataset_final_train, dataset:Tandogan/MNLP_M2_dpo_dataset, base_model:Qwen/Qwen3-0.6B-Base, base_model:finetune:Qwen/Qwen3-0.6B-Base, license:apache-2.0, region:us
Base model relation: finetune
Base models: id: Qwen/Qwen3-0.6B-Base
Card metadata:
license: apache-2.0
tags: dpo, unsloth, trl, qwen, instruction-tuning, preference-modeling, mnlp
datasets: Tandogan/sft_dataset_final_train, Tandogan/MNLP_M2_dpo_dataset
base_model: Qwen/Qwen3-0.6B-Base
inference: no