Model: treasure4l/Llama3.2-Instruct-DPO
Author: treasure4l
Tags: safetensors, dataset:trl-lib/ultrafeedback_binarized, arxiv:1910.09700, region:us
Card metadata: base_model: unsloth/llama-3.2-3b-instruct-bnb-4bit
datasets: trl-lib/ultrafeedback_binarized
Likes: 0 | All-time downloads: 0
Created: 2025-01-14 13:32:29