 We propose Weakly-supervised VisualBERT with the key idea of conducting " mask-and-predict " pre-training on language-only and image-only corpora .
<meaning-changed>  We propose Weakly-supervised VisualBERT with the key idea of conducting " mask-and-predict " pre-training on language-only and image-only corpora .
 We propose Weakly-supervised VisualBERT with the key idea of conducting " mask-and-predict " pre-training on text-only and image-only corpora .