Before revision:  With this approach, we built a multilingual speech-to-text translation model with pretrained audio encoder ( wav2vec ) and multilingual text decoder (mBART), which achieves new state-of-the-art on CoVoST 2 ST benchmark 1 for English into 15 languages as well as 6 Romance languages into English with on average + 2.8 BLEU and + 3.9 BLEU , respectively.
After revision:  With this approach, we built a multilingual speech-to-text translation model with pretrained audio encoder ( wav2vec 2.0 for acoustic modeling, and mBART for multilingual text generation, our approach advanced the new state-of-the-art on CoVoST 2 ST benchmark 1 for English into 15 languages as well as 6 Romance languages into English with on average + 2.8 BLEU and + 3.9 BLEU , respectively.