Before revision:  We find that the proposed approach, which only uses hand-crafted and learnable attentions, is comparable with the full self-attention  .
After revision:  We find that the proposed approach, which only uses hand-crafted and learnable attentions, is comparable with the full self-attention yet requires 20\% less time in both training and inference .