Hugging Face model: debsubhra/llama2-7b-dpo-orca-mini
Author: debsubhra
Created: 2026-03-30 19:10:36
Last modified: 2026-06-25 11:59:45
Pipeline: text-generation
Library: peft
Likes: 0 | Downloads: 3
Tags: peft, safetensors, llama, llama-2, qlora, dpo, trl, lora, 4-bit, bitsandbytes, preference-alignment, text-generation, en, dataset:Intel/orca_dpo_pairs, dataset:debsubhra/orca-dpo-mini-500, arxiv:2305.18290, base_model:NousResearch/Llama-2-7b-chat-hf, base_model:adapter:NousResearch/Llama-2-7b-chat-hf, license:llama2, region:us
Base model relation: adapter
Base models: id: NousResearch/Llama-2-7b-chat-hf
Card metadata:
license: llama2
base_model: NousResearch/Llama-2-7b-chat-hf
library_name: peft
pipeline_tag: text-generation
language: en
tags: llama, llama-2, qlora, dpo, trl, peft, lora, 4-bit, bitsandbytes, preference-alignment
datasets: Intel/orca_dpo_pairs, debsubhra/orca-dpo-mini-500