Before revision:  Two well-designed techniques, namely the retrospective feed mechanism and the enhanced recurrence mechanism enable ERNIE-DOC with much longer effective context length  to capture the contextual information of a whole document.
After revision:  Two well-designed techniques, namely the retrospective feed mechanism and the enhanced recurrence mechanism , enable ERNIE-Doc, which has a much longer effective context length to capture the contextual information of a whole document.