Hugging Face model: djroytburg/dpo_self_preference_llama_aware
Author: djroytburg
Created: 2025-08-26 17:36:24
Last modified: 2025-08-26 17:36:53
Library: transformers
Likes: 0 | Downloads: 0
Tags: transformers, safetensors, text-generation-inference, unsloth, llama, trl, en, license:apache-2.0, endpoints_compatible, region:us
Card metadata:
base_model: unsloth/llama-3.1-8b-instruct-unsloth-bnb-4bit
tags: text-generation-inference, transformers, unsloth, llama, trl
license: apache-2.0
language: en