Hugging Face model: NhaiDao/DPO_llama3_2_1B_128_5k
Author: NhaiDao
Created: 2025-05-18 15:28:19
Last modified: 2025-05-18 16:15:44
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 23
Tags: transformers, pytorch, llama, text-generation, unsloth, trl, dpo, conversational, arxiv:1910.09700, text-generation-inference, endpoints_compatible, region:us
Card metadata:
library_name: transformers
tags: unsloth, trl, dpo