Hugging Face model: treasure4l/Llama3.2-Instruct-DPO
Author: treasure4l
Created: 2025-01-14 13:32:29
Last modified: 2025-01-14 14:54:38
Likes: 0 | Downloads: 0
Tags: safetensors, dataset:trl-lib/ultrafeedback_binarized, arxiv:1910.09700, region:us
Card metadata:
base_model: unsloth/llama-3.2-3b-instruct-bnb-4bit
datasets: trl-lib/ultrafeedback_binarized