Before revision:  Incorporating knowledge from scene graphs , ERNIE-ViL constructs Scene Graph Prediction tasks, i.e., Object Prediction, Attribute Prediction and Relationship Prediction  in the pre-training phase.
After revision:  Incorporating knowledge from scene graphs , ERNIE-ViL constructs Scene Graph Prediction tasks, i.e., Object Prediction, Attribute Prediction and Relationship Prediction tasks in the pre-training phase.