Before revision:  Compared with current state-of-the-art models on ST , our technique achieves  + 1.4 BLEUimprovement without using transcriptions , and + 1.2 BLEU using transcriptions. The pre-training  of MAM with arbitrary acoustic signals also boosts the downstream speech-related tasks .
After revision:  Compared with current state-of-the-art models on ST , our technique achieves + 1.4 BLEUimprovement without using transcriptions , and + 2.3 BLEU with MAM pre-training of MAM with arbitrary acoustic signals also boosts the downstream speech-related tasks .