Model: 5456es/implicit_reward_Llama-3.2-3B-Instruct_prune_0.5-sigmoid
Author: 5456es
Tags: safetensors, llama, dpo, preference-learning, implicit, pruned, license:apache-2.0, region:us
Card metadata: license: apache-2.0
base_model: Llama-3.2-3B-Instruct
tags: dpo, preference-learning, implicit, pruned
Likes: 0 | All-time downloads: 96
Created: 2025-09-08 04:25:17