Before revision:  We then apply the proposed self-supervised pre-training  to existing generation models BART and T5 for domain adaptation.
After revision:  We then apply self-supervised pre-training to existing generation models BART and T5 for domain adaptation.