Before revision:  With this approach, we built a multilingual speech-to-text translation model with pretrained audio encoder ( wav2vec ) and multilingual text decoder (mBART), which achieves new state-of-the-art on CoVoST 2 ST benchmark 1 for English into 15 languages as well as 6 Romance languages into English with on average + 2.8 BLEU and + 3.9 BLEU , respectively.
After revision:  With this approach, we built a multilingual speech-to-text translation model with pretrained audio encoder ( wav2vec ) and multilingual text decoder (mBART), which achieves new state-of-the-art on CoVoST 2 ST benchmark 1 for English into 15 languages as well as 6 Romance languages into English with on average + 4.4 BLEU on average for 13 En-X directions and + 3.9 BLEU , respectively.