Before revision:  We then apply the proposed self-supervised pre-training  to existing generation models BART and T5 for domain adaptation.
After revision:  We then apply the proposed self-supervised pre-training on this dataset to existing generation models BART and T5 for domain adaptation.