BERT (Devlin et al., 2018) , a pre-trained Transformer (Vaswani et al., 2017) model, has achieved ground-breaking performance on multiple NLP tasks. In this paper, we describe BERTSUM, a simple variant of BERT, for extractive summarization. Our system is the state of the art on the CNN/Dailymail dataset, outperforming the previous best-performed system by 1.65 on ROUGE-L. The codes to reproduce our results are available at https: //github.com/nlpyang/BertSum
REF proposes a modified BERT for extractive summarization and achieve the state-of-the-art result in extractive document summarization task.
Fine-tune BERT for Extractive Summarization
ArXiv
ArXiv
Computer Science