 Pre-trained on two large image-text alignment datasets(Conceptual Captions and SBU), ERNIE-ViL learns better and more robust joint representations.
<clarity>  Pre-trained on two large image-text alignment datasets(Conceptual Captions and SBU), ERNIE-ViL learns better and more robust joint representations.
 After pre-training on large scale image-text alignment datasets(Conceptual Captions and SBU), ERNIE-ViL learns better and more robust joint representations.