Before revision:  The proposed DUal Multi-head Co-Attention (DUMA ) has been shown simple but effective and is capable of generally promoting pre-trained Language Models .
After revision:  The proposed DUal Multi-head Co-Attention (DUMA ) has been shown simple but effective and is capable of generally promoting PrLMs .