Before revision:  BertSumAbs increases ROUGE on average by 4.6 and 5.9 points respectively over previous best score achieved by Pointer-Generator network .
After revision:  BertSumAbs increases ROUGE on average by 4.6 and 5.9 points respectively over previous best score achieved by Phrase-Based Attentional Transformer and CopyNet .