Hugging Face model: 5456es/selective_dpo_Qwen2.5-0.5B-Instruct_prune_0.5-sigmoid
Author: 5456es
Created: 2025-09-07 05:20:12
Last modified: 2025-09-15 06:34:39
Likes: 0 | Downloads: 13
Tags: safetensors, qwen2, dpo, preference-learning, selective, pruned, license:apache-2.0, region:us
Card metadata:
license: apache-2.0
base_model: Qwen2.5-0.5B-Instruct
tags: dpo, preference-learning, selective, pruned