OpenFlamingo: An Open-Source Framework for Training Large Autoregressive
  Vision-Language Models
Authors: name: Anas Awadalla; name: Irena Gao; name: Josh Gardner; name: Jack Hessel; name: Yusuf Hanafy; name: Wanrong Zhu; name: Kalyani Marathe; name: Yonatan Bitton; name: Samir Gadre; name: Shiori Sagawa; name: Jenia Jitsev; name: Simon Kornblith; name: Pang Wei Koh; name: Gabriel Ilharco; name: Mitchell Wortsman; name: Ludwig Schmidt
Published: 2023-08-02 19:10:23

Abstract: We introduce OpenFlamingo, a family of autoregressive vision-language models
ranging from 3B to 9B parameters. OpenFlamingo is an ongoing effort to produce
an open-source replication of DeepMind's Flamingo models. On seven
vision-language datasets, OpenFlamingo models average between 80 - 89% of
corresponding Flamingo performance. This technical report describes our models,
training data, hyperparameters, and evaluation suite. We share our models and
code at https://github.com/mlfoundations/open_flamingo.