 We propose Weakly-supervised VisualBERT with the key idea of conducting " mask-and-predict " pre-training on language-only and image-only corpora . Additionally, we introduce the object tags detected by an object recognition model as anchor points to bridge two modalities.
<coherence>  We propose Weakly-supervised VisualBERT with the key idea of conducting " mask-and-predict " pre-training on language-only and image-only corpora . Additionally, we introduce the object tags detected by an object recognition model as anchor points to bridge two modalities.
 We propose Weakly-supervised VisualBERT with the key idea of conducting " mask-and-predict " pre-training on language-only and image-only corpora and introduce the object tags detected by an object recognition model as anchor points to bridge two modalities.