Before revision:  Pre-trained on two large image-text alignment datasets(Conceptual Captions and SBU), ERNIE-ViL learns better and more robust joint representations.
After revision:  After pre-training on large scale image-text alignment datasets(Conceptual Captions and SBU), ERNIE-ViL learns better and more robust joint representations.