Hugging Face model: HumorR1/rm-qwen25vl-3b-20k
Author: HumorR1
Created: 2026-04-30 01:12:01
Last modified: 2026-04-30 04:45:12
Library: peft
Likes: 0 | Downloads: 0
Tags: peft, safetensors, reward-model, bradley-terry, rlhf, vision-language, new-yorker, humor, en, dataset:yguooo/newyorker_caption_ranking, base_model:Qwen/Qwen2.5-VL-3B-Instruct, base_model:adapter:Qwen/Qwen2.5-VL-3B-Instruct, license:apache-2.0, region:us
Base model relation: adapter
Base models: id: Qwen/Qwen2.5-VL-3B-Instruct
Card metadata:
license: apache-2.0
base_model: Qwen/Qwen2.5-VL-3B-Instruct
library_name: peft
tags: reward-model, bradley-terry, rlhf, vision-language, new-yorker, humor
datasets: yguooo/newyorker_caption_ranking
language: en
metrics: preference_accuracy: 0.696, reward_margin: 0.96, bt_loss: 0.604