Question: By how much does their method outperform the multi-head attention model?
Answer: Their average improvement in Character Error Rate over the best MHA model was 0.33 percent points.