Before revision:  However, the self-attention network design is questioned as suboptimal in recent studies, due to its veiled validity and high redundancy .
After revision:  However, the self-attention based models, which are broadly chosen as the fundamental architecture of PrLMs .