Model: hZzy/qwen2.5-0.5b-expo-DPO-25-3
Author: hZzy
Tags: safetensors, qwen2, alignment-handbook, ndcg, trl, expo, generated_from_trainer, dataset:hZzy/train_pairwise_strong_new, base_model:hZzy/qwen2.5-0.5b-sft-25-1, base_model:finetune:hZzy/qwen2.5-0.5b-sft-25-1, license:apache-2.0, region:us
Base models (finetune): id: hZzy/qwen2.5-0.5b-sft-25-1
Card metadata: license: apache-2.0
base_model: hZzy/qwen2.5-0.5b-sft-25-1
tags: alignment-handbook, ndcg, trl, expo, generated_from_trainer, trl, expo, generated_from_trainer
datasets: hZzy/train_pairwise_strong_new
model-index: name: qwen2.5-0.5b-expo-DPO-25-3
Likes: 0 | All-time downloads: 9
Created: 2025-03-05 04:01:41