Instructions to use ddz16/Qwen3-VL-8B-TGRPO with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ddz16/Qwen3-VL-8B-TGRPO with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("ddz16/Qwen3-VL-8B-TGRPO") model = AutoModelForMultimodalLM.from_pretrained("ddz16/Qwen3-VL-8B-TGRPO", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Qwen3-VL-8B-TGRPO: TGRPO baseline
This repository contains the Qwen3-VL-8B weights fine-tuned with TGRPO, released as a baseline for the paper Learning Spatiotemporal Sensitivity in Video LLMs via Counterfactual Reinforcement Learning.
Overview
This checkpoint is fine-tuned on top of Qwen3-VL with TGRPO (Temporal GRPO), one of the RL baselines compared in the CRPO paper.
Video large language models (Video LLMs) often answer video questions through shortcuts such as single-frame cues and language priors rather than by tracking spatiotemporal dynamics. The CRPO paper studies this problem and compares against multiple RL baselines, of which this checkpoint is one.
Resources
- Paper: Learning Spatiotemporal Sensitivity in Video LLMs via Counterfactual Reinforcement Learning
- Project Page: https://ddz16.github.io/crpo.github.io/
- GitHub Repository: https://github.com/ddz16/CRPO
- CRPO model (same size): ddz16/Qwen3-VL-8B-CRPO
Evaluation
The model is evaluated on DyBench, a paired counterfactual video benchmark with 3,014 videos covering reversible dynamics, moving direction, and event sequence, together with standard video-QA benchmarks (Video-MME, TempCompass, MVBench, TimeBlind). See the paper for full numbers and comparison with CRPO.
- Downloads last month
- 15