 We propose Weakly-supervised VisualBERT with the key idea of conducting " mask-and-predict " pre-training on language-only and image-only corpora .
<fluency>  We propose Weakly-supervised VisualBERT with the key idea of conducting " mask-and-predict " pre-training on language-only and image-only corpora .
 We propose Weakly-supervised VisualBERT with the key idea of conducting " mask-and-predict '' pre-training on language-only and image-only corpora .