Before revision:  The results show that AMBERT outperforms the existing best performing models in almost all cases, particularly the improvements are significant for Chinese  .
After revision:  The results show that AMBERT outperforms the existing best performing models in almost all cases, particularly the improvements are significant for Chinese . We also develop a method to improve the efficiency of AMBERT in inference, which still performs better than BERT with the same computational cost as BERT .