Hugging Face model: NhaiDao/DPO_llama3_2_1B_32_5k
Author: NhaiDao
Created: 2025-05-18 15:19:36
Last modified: 2025-05-18 15:20:01
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 20
Tags: transformers, pytorch, llama, text-generation, unsloth, trl, dpo, conversational, arxiv:1910.09700, text-generation-inference, endpoints_compatible, region:us
Card metadata:
library_name: transformers
tags: unsloth, trl, dpo