Hugging Face model: abhisheksagar/llama-3.2-3b-dpo-PairRM-preference
Author: abhisheksagar
Created: 2025-04-16 04:31:49
Last modified: 2025-04-16 04:32:11
Library: peft
Likes: 0 | Downloads: 2
Tags: peft, safetensors, arxiv:1910.09700, region:us
Card metadata:
base_model: meta-llama/Llama-3.2-3B-instruct
library_name: peft