Before revision:  Pre-trained on two large image-text alignment datasets(Conceptual Captions and SBU), ERNIE-ViL learns better and more robust joint representations. It achieves state-of-the-art performance on 5 vision-language downstream tasksafter fine-tuning ERNIE-ViL.
After revision:  Pre-trained on two large image-text alignment datasets(Conceptual Captions and SBU), ERNIE-ViL on 5 vision-language downstream tasksafter fine-tuning ERNIE-ViL.