Hugging Face model: psp-dada/Llama-3-8B-Base-SFT-Uni-DPO-v2-GPT-4
Author: psp-dada
Created: 2026-02-11 18:02:20
Last modified: 2026-02-22 02:59:58
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 8
Tags: transformers, safetensors, llama, text-generation, bf16, RLHF, DPO, en, dataset:psp-dada/Uni-DPO, arxiv:2506.10054, base_model:princeton-nlp/Llama-3-Base-8B-SFT, base_model:finetune:princeton-nlp/Llama-3-Base-8B-SFT, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: princeton-nlp/Llama-3-Base-8B-SFT
Card metadata:
license: apache-2.0
datasets: psp-dada/Uni-DPO
language: en
base_model: princeton-nlp/Llama-3-Base-8B-SFT
pipeline_tag: text-generation
library_name: transformers
tags: bf16, llama, RLHF, DPO