Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thought
Authors: name: Yi Peng; name: Chris; name: Xiaokun Wang; name: Yichen Wei; name: Jiangbo Pei; name: Weijie Qiu; name: Ai Jian; name: Yunzhuo Hao; name: Jiachun Pan; name: Tianyidan Xie; name: Li Ge; name: Rongxian Zhuang; name: Xuchen Song; name: Yang Liu; name: Yahui Zhou
Published: 2025-04-08 01:19:20

Abstract: We introduce Skywork R1V, a multimodal reasoning model extending the an
R1-series Large language models (LLM) to visual modalities via an efficient
multimodal transfer method. Leveraging a lightweight visual projector, Skywork
R1V facilitates seamless multimodal adaptation without necessitating retraining
of either the foundational language model or the vision encoder. To strengthen
visual-text alignment, we propose a hybrid optimization strategy that combines
Iterative Supervised Fine-Tuning (SFT) with Group Relative Policy Optimization
(GRPO), significantly enhancing cross-modal integration efficiency.
Additionally, we introduce an adaptive-length Chain-of-Thought distillation
approach for reasoning data generation. This approach dynamically optimizes
reasoning chain lengths, thereby enhancing inference efficiency and preventing
excessive reasoning overthinking. Empirical evaluations demonstrate that
Skywork R1V, with only 38B parameters, delivers competitive performance,
achieving a score of 69.0 on the MMMU benchmark and 67.5 on MathVista.
Meanwhile, it maintains robust textual reasoning performance, evidenced by
impressive scores of 72.0 on AIME and 94.0 on MATH500. The Skywork R1V model
weights have been publicly released to promote openness and reproducibility.