Hugging Face model: treasure4l/Llama3.2_3B_DPO
Author: treasure4l
Created: 2025-01-24 03:27:09
Last modified: 2025-01-24 17:14:42
Library: peft
Likes: 0 | Downloads: 2
Tags: peft, safetensors, dataset:gz25/JGTV_Pref_DS, arxiv:1910.09700, region:us
Card metadata:
base_model: unsloth/llama-3.2-3b-bnb-4bit
library_name: peft
datasets: gz25/JGTV_Pref_DS