Hugging Face model: ogulcanakca/qwen2.5-3b-instruct-dpo-orca
Author: ogulcanakca
Created: 2025-10-22 06:48:09
Last modified: 2025-10-23 11:25:21
Pipeline: text-generation
Library: peft
Likes: 0 | Downloads: 6
Tags: peft, safetensors, dpo, lora, transformers, trl, qwen2, instruction-following, text-generation, instruction, chat, conversational, en, dataset:Intel/orca_dpo_pairs, dataset:databricks/databricks-dolly-15k, base_model:Qwen/Qwen2.5-3B-Instruct, base_model:adapter:Qwen/Qwen2.5-3B-Instruct, license:apache-2.0, model-index, region:us
Base model relation: adapter
Base models: id: Qwen/Qwen2.5-3B-Instruct
Card metadata:
language: en
license: apache-2.0
base_model: Qwen/Qwen2.5-3B-Instruct
library_name: peft
pipeline_tag: text-generation
tags: dpo, lora, transformers, trl, qwen2, dpo, instruction-following, text-generation, instruction, chat
datasets: Intel/orca_dpo_pairs, databricks/databricks-dolly-15k
metrics: LLM-as-a-Judge, Head-to-Head Preference, Usefulness, GEval, ROUGE, BLEU