Before revision:  We propose Weakly-supervised VisualBERT with the key idea of conducting " mask-and-predict " pre-training on language-only and image-only corpora . Additionally, we introduce the object tags detected by an object recognition model as anchor points to bridge two modalities.
After revision:  We propose Weakly-supervised VisualBERT with the key idea of conducting " mask-and-predict " pre-training on language-only and image-only corpora and introduce the object tags detected by an object recognition model as anchor points to bridge two modalities.