Hugging Face model: NhaiDao/DPO_llama3_2_1B_32_005_5k
Author: NhaiDao
Created: 2025-05-18 16:13:01
Last modified: 2025-05-18 16:14:15
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 9
Tags: transformers, pytorch, llama, text-generation, unsloth, trl, dpo, conversational, arxiv:1910.09700, text-generation-inference, endpoints_compatible, region:us
Card metadata:
library_name: transformers
tags: unsloth, trl, dpo