Model: abhisheksagar/llama-3.2-3b-dpo-PairRM-preference
Author: abhisheksagar
Library: peft
Tags: peft, safetensors, arxiv:1910.09700, region:us
Card metadata: base_model: meta-llama/Llama-3.2-3B-instruct
library_name: peft
Likes: 0 | All-time downloads: 3
Created: 2025-04-16 04:31:49