Before revision:  On the AISHELL dev/test sets, the proposed method achieves state-of-the-art Transformer results with 5.8\%/6.3\% word error rates .
After revision:  On the AISHELL dev/test sets, the proposed method achieves state-of-the-art end-to-end Transformer based model performance on Switchboard and AMI .