Before revision:  We propose Weakly-supervised VisualBERT with the key idea of conducting " mask-and-predict " pre-training on language-only and image-only corpora .
After revision:  We propose Weakly-supervised VisualBERT with the key idea of conducting " mask-and-predict '' pre-training on language-only and image-only corpora .