Model: ogulcanakca/qwen2.5-3b-instruct-dpo-orca
Author: ogulcanakca
Pipeline: text-generation
Library: peft
Tags: peft, safetensors, dpo, lora, transformers, trl, qwen2, instruction-following, text-generation, instruction, chat, conversational, en, dataset:Intel/orca_dpo_pairs, dataset:databricks/databricks-dolly-15k, base_model:Qwen/Qwen2.5-3B-Instruct, base_model:adapter:Qwen/Qwen2.5-3B-Instruct, license:apache-2.0, model-index, region:us
Base models (adapter): id: Qwen/Qwen2.5-3B-Instruct
Card metadata: language: en
license: apache-2.0
base_model: Qwen/Qwen2.5-3B-Instruct
library_name: peft
pipeline_tag: text-generation
tags: dpo, lora, transformers, trl, qwen2, dpo, instruction-following, text-generation, instruction, chat
datasets: Intel/orca_dpo_pairs, databricks/databricks-dolly-15k
metrics: LLM-as-a-Judge, Head-to-Head Preference, Usefulness, GEval, ROUGE, BLEU
model-index: name: qwen2.5-3b-instruct-dpo-orca
results: task: type: text-generation
name: Instruction Following
dataset: name: databricks/databricks-dolly-15k
type: databricks/databricks-dolly-15k
config: default
split: train
args: categories_excluded: open_qa, closed_qa
num_samples: 200
metrics: name: Usefulness
type: win_rate
value: 0.719
verified: no, name: Head-to-Head Preference
type: custom_metric
value: 0.93
verified: no
Likes: 0 | All-time downloads: 74
Created: 2025-10-22 06:48:09