Before revision:  The pre-training  of MAM with arbitrary acoustic signals also boosts the downstream speech-related tasks .
After revision:  The pre-training of MAM with arbitrary acoustic signals also has an average improvement with +1.6 BLEU for those languages. Compared with ASR multi-task learning solution, which replies on transcription during training, our pre-trained MAM model, which does not use transcription, achieves similar accuracy .