Hugging Face model: NhaiDao/DPO_llama3_2_1B_16_5k
Author: NhaiDao
Created: 2025-05-18 09:59:07
Last modified: 2025-05-18 09:59:29
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 8
Tags: transformers, pytorch, llama, text-generation, unsloth, trl, dpo, conversational, arxiv:1910.09700, text-generation-inference, endpoints_compatible, region:us
Card metadata:
library_name: transformers
tags: unsloth, trl, dpo