 ERNIE-DOC achieves SOTA language modeling result of  16.8 ppl on WikiText-103 and outperforms competitive pretraining models  on most language understanding tasks  such as text classification , question answeringby a large margin .
<fluency>  ERNIE-DOC achieves SOTA language modeling result of  16.8 ppl on WikiText-103 and outperforms competitive pretraining models  on most language understanding tasks  such as text classification , question answeringby a large margin .
 ERNIE-DOC achieves SOTA language modeling result of 16.8 ppl on WikiText-103 and outperforms competitive pretraining models on most language understanding tasks , such as text classification , question answeringby a large margin .