 In this paper, we propose ERNIE-DOC , a document-level language pretraining model based on Recurrence Transformers.
<fluency>  In this paper, we propose ERNIE-DOC , a document-level language pretraining model based on Recurrence Transformers.
 In this paper, we propose ERNIE-Doc , a document-level language pretraining model based on Recurrence Transformers.