Before revision:  We first leverage the lead bias in news articles to pretrain the model on large-scale corpora. Then , we finetune TED on target domains through theme modeling and a denoising autoencoder to enhance the quality of  summaries.
After revision:  We first leverage the lead bias in news articles to pretrain the model on millions of unlabeled corpora. Next , we finetune TED on target domains through theme modeling and a denoising autoencoder to enhance the quality of summaries.