Before revision:  We pretrain ERNIE-DOC to explicitly learn the relationship among segments with an additional document-aware segment reordering objective.
After revision:  We pretrain ERNIE-Doc to explicitly learn the relationship among segments with an additional document-aware segment reordering objective.