Hugging Face model: 1rvinn/dpo-llama31-8b-general
Author: 1rvinn
Created: 2026-07-31 08:48:39
Last modified: 2026-07-31 08:55:57
Pipeline: text-generation
Library: peft
Likes: 2 | Downloads: 23
Tags: peft, safetensors, dpo, safety, alignment, guardrails, lora, red-teaming, trl, text-generation, conversational, arxiv:2305.18290, base_model:meta-llama/Llama-3.1-8B-Instruct, base_model:adapter:meta-llama/Llama-3.1-8B-Instruct, license:llama3.1, region:us
Base model relation: adapter
Base models: id: meta-llama/Llama-3.1-8B-Instruct
Card metadata:
license: llama3.1
base_model: meta-llama/Llama-3.1-8B-Instruct
base_model_relation: adapter
library_name: peft
pipeline_tag: text-generation
tags: dpo, safety, alignment, guardrails, lora, red-teaming, trl