Instructions to use ddz16/Qwen3-VL-8B-GRPO with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ddz16/Qwen3-VL-8B-GRPO with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("ddz16/Qwen3-VL-8B-GRPO") model = AutoModelForMultimodalLM.from_pretrained("ddz16/Qwen3-VL-8B-GRPO", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Qwen3-VL-8B-GRPO: GRPO baseline
This repository contains the Qwen3-VL-8B weights fine-tuned with GRPO, released as a baseline for the paper Learning Spatiotemporal Sensitivity in Video LLMs via Counterfactual Reinforcement Learning.
Overview
This checkpoint is a Group Relative Policy Optimization (GRPO) baseline fine-tuned on top of Qwen3-VL for video question answering, released as a reference RL baseline for the CRPO paper.
Video large language models (Video LLMs) often answer video questions through shortcuts such as single-frame cues and language priors rather than by tracking spatiotemporal dynamics. The CRPO paper studies this problem and compares against multiple RL baselines, of which this checkpoint is one.
Resources
- Paper: Learning Spatiotemporal Sensitivity in Video LLMs via Counterfactual Reinforcement Learning
- Project Page: https://ddz16.github.io/crpo.github.io/
- GitHub Repository: https://github.com/ddz16/CRPO
- CRPO model (same size): ddz16/Qwen3-VL-8B-CRPO
Evaluation
The model is evaluated on DyBench, a paired counterfactual video benchmark with 3,014 videos covering reversible dynamics, moving direction, and event sequence, together with standard video-QA benchmarks (Video-MME, TempCompass, MVBench, TimeBlind). See the paper for full numbers and comparison with CRPO.
- Downloads last month
- 15