[1] A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clark, et al., "Learning Transferable Visual Models from Natural Language Supervision," in Proc. ICML, 2021.
[2] Y. Li, F. Liang, L. Zhao, Y. Cui, W. Ouyang, J. Shao, F. Yu, and J. Yan, "Supervisionexists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm," arXiv:2110.05208, 2021.
[3] N. Mu, A. Kirillov, D. Wagner, and S. Xie, "Slip: Self-supervision Meets Language-image Pre-training," arXiv:2112.12750, 2021.
[4] J. Li, D. Li, C. Xiong, and S. Hoi, "BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation," arXiv:2201.12086, 2022.
[5] L. Yao, R. Huang, L. Hou, G. Lu, M. Niu, H. Xu, X. Liang, Z. Li, X. Jiang, and C. Xu, "FILIP: Fine-grained Interactive Language-Image Pre-Training," arXiv:2111.07783, 2021.
[6] A. Singh, R. Hu, V. Goswami, G. Couairon, W. Galuba, M. Rohrbach, and D. Kiela, “FLAVA: A Foundational Language And Vision Alignment Model,” arXiv:2112.04482, 2021.
[7] J. Yu, Z. Wang, V. Vasudevan, L. Yeung, M. Seyedhosseini, and Y. Wu, "CoCa: Contrastive Captioners are Image-Text Foundation Models," arXiv:2205.01917, 2022.
[8] S. Reed et al., "A Generalist Agent," arXiv:2205.06175, 2022.
[9] T. B. Brown et al., "Language Models are Few-Shot Learners," arXiv:2005.14165, 2020.
[10] K. Sohn, D. Berthelot, N. Carlini, Z. Zhang, H. Zhang, C. A. Raffel, E. D. Cubuk, A. Kurakin, and C.-L. Li, "Fixmatch: Simplifying Semi-supervised Learning with Consistency and Confidence," in NeurIPS, 2020.
[11] M. Jia, L. Tang, B.-C. Chen, C. Cardie, S. Belongie, B. Hariharan, and S.-N. Lim, "Visual Prompt Tuning," in Proc. ECCV, 2022.
[12] T. Huang, J. Chu, and F. Wei, "Unsupervised Prompt Learning for Vision-Language Models," arXiv:2204.03649, 2022.
[13] C. Jia, Y. Yang, Y. Xia, Y.-T. Chen, Z. Parekh, H. Pham, Q. V. Le, Y. Sung, Z. Li, and T. Duerig, "Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision," in Proc. ICML, 2021.
[14] H. Tan and M. Bansal, “Lxmert: Learning Cross-modality Encoder Representations from Transformers,” arXiv:1908.07490, 2019.
[15] Y.-C. Chen, L. Li, L. Yu, A. El Kholy, F. Ahmed, Z. Gan, Y. Cheng, and J. Liu, “Uniter: Universal Image-text Representation Learning,” in Proc. ECCV, 2020.
[16] X. Li, X. Yin, C. Li, P. Zhang, X. Hu, L. Zhang, L. Wang, H. Hu, L. Dong, F. Wei, et al., "Oscar: Object-semantics Aligned Pre-training for Vision-language Tasks," in Proc. ECCV, 2020.
[17] W. Kim, B. Son, and I. Kim, “Vilt: Vision-and-language Transformer without Convolution or Region Supervision,” in Proc. ICML, 2021.
[18] J. Li, R. R. Selvaraju, A. D. Gotmare, S. Joty, C. Xiong, and S. Hoi, "Align before Fuse: Vision and Language Representation Learning with Momentum Distillation," arXiv:2107.07651, 2021.
[19] J. Yang, J. Duan, S. Tran, Y. Xu, S. Chanda, L. Chen, B. Zeng, T. Chilimbi, and J. Huang, "Vision-Language Pre-Training with Triple Contrastive Learning," in Proc. CVPR, 2022.
[20] S. Goel, H. Bansal, S. Bhatia, R. A. Rossi, V. Vinay, and A. Grover, "CyCLIP: Cyclic Contrastive Language-Image Pretraining," arXiv:2205.14459, 2022.
[21] L. Yao, R. Huang, L. Hou, G. Lu, M. Niu, H. Xu, X. Liang, Z. Li, X. Jiang, and C. Xu, “Filip: Fine-grained Interactive Language-image Pre-training,” arXiv:2111.07783, 2021.
[22] A. Fürst, E. Rumetshofer, V. Tran, H. Ramsauer, F. Tang, J. Lehner, D. Kreil, M. Kopp, G. Klambauer, A. Bitto-Nemling, et al., "Cloob: Modern Hopfield Networks with Infoloob Outperform Clip," arXiv:2110.11316, 2021.
[23] Y. Gao, J. Liu, Z. Xu, J. Zhang, K. Li, and C. Shen, “PyramidCLIP: Hierarchical Feature Alignment for Vision-language Model Pretraining,” arXiv:2204.14095, 2022.