Hugging Face model: psp-dada/Llama-3-8B-Instruct-Uni-DPO-v2-ArmoRM
Author: psp-dada
Created: 2026-02-11 18:03:21
Last modified: 2026-02-22 02:59:32
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 6
Tags: transformers, safetensors, llama, text-generation, bf16, RLHF, DPO, en, dataset:psp-dada/Uni-DPO, arxiv:2506.10054, base_model:meta-llama/Meta-Llama-3-8B-Instruct, base_model:finetune:meta-llama/Meta-Llama-3-8B-Instruct, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: meta-llama/Meta-Llama-3-8B-Instruct
Card metadata:
license: apache-2.0
datasets: psp-dada/Uni-DPO
language: en
base_model: meta-llama/Meta-Llama-3-8B-Instruct
pipeline_tag: text-generation
library_name: transformers
tags: bf16, llama, RLHF, DPO