Before revision: ROUGE is the de facto criterion for summarization research. However, its two major drawbackslimit the research and application of automated summarization systems .
After revision: Canonical automatic summary evaluation metrics, such as ROUGE, suffer from two drawbacks .