MobileVLM V2: Faster and Stronger Baseline for Vision Language Model
Authors: name: Xiangxiang Chu; name: Limeng Qiao; name: Xinyu Zhang; name: Shuang Xu; name: Fei Wei; name: Yang Yang; name: Xiaofei Sun; name: Yiming Hu; name: Xinyang Lin; name: Bo Zhang; name: Chunhua Shen
Published: 2024-02-06 07:16:36

Abstract: We introduce MobileVLM V2, a family of significantly improved vision language
models upon MobileVLM, which proves that a delicate orchestration of novel
architectural design, an improved training scheme tailored for mobile VLMs, and
rich high-quality dataset curation can substantially benefit VLMs' performance.
Specifically, MobileVLM V2 1.7B achieves better or on-par performance on
standard VLM benchmarks compared with much larger VLMs at the 3B scale.
Notably, our 3B model outperforms a large variety of VLMs at the 7B+ scale. Our
models will be released at https://github.com/Meituan-AutoML/MobileVLM .