Before revision:  For the large scale dataset pre-training, ProphetNet achieves new state-of-the-art results on Gigaword and comparable results on CNN/DailyMail using only about 1/5 pre-training epochs of the previous model .
After revision:  For the large scale dataset pre-training, ProphetNet achieves new state-of-the-art results on all these datasets compared to the models using the same scale pre-training epochs of the previous model .