Before revision: We propose a knowledge-enhanced approach, ERNIE-ViL,  to learn joint representations of vision and language . ERNIE-ViL tries to construct the detailed semantic connections (objects, attributes of objects and relationships between objects in visual scenes ) across vision and language, which are essential to vision-language cross-modal tasks.
After revision: We propose a knowledge-enhanced approach, ERNIE-ViL, which incorporates structured knowledge obtained from scene graphs to learn joint representations of vision and language . ERNIE-ViL tries to construct the detailed semantic connections (objects, attributes of objects and relationships between objects in visual scenes ) across vision and language, which are essential to vision-language cross-modal tasks.