# FrameSum: Leveraging Framing Theory and Deep Learning for Enhanced News Text Summarization
## 4 Ablation Study  
To investigate the role of each key component in the frame-aware summarization model, we conducted an ablation study. Table 8 shows the ROUGE metrics of the model under different configurations on the CNN/Daily Mail dataset. After removing the frame embedding (-w/o frame emb. ), the ROUGE scores of the model decrease significantly, indicating that frame label information helps the model grasp the theme of the article. Further removing the frame features (-w/o frame feat.) on this basis leads to a further decline in model performance, suggesting that frame-related semantic features can provide important clues for summary generation. \begin{table}
\begin{tabular}{c c c} \hline \hline
**Model** & \multicolumn{2}{c}{**Summary Content**} \\ \hline Original News & (PEOPLE.com)—[PERSON] wants to move on after her accident. The actress is not pressing charges against the 84-year-old driver who struck her as she was jogging Wednesday in Santa Monica, Calif., her rep tells PEOPLE. The actress, 35, suffered minor injuries and went home to recover, her rep said at the time. The driver, meanwhile, was cited for failing to yield to a pedestrian in a crosswalk. (PEOPLE.com)—[PERSON] wants to move on after her accident. The actress is not pressing charges against the 84-year-old driver who struck her as she was jogging Wednesday in Santa Monica, Calif., her rep tells PEOPLE. The actress, 35, suffered minor injuries and went home to recover, her rep said at the time. \\ LexRank & [PERSON] was struck by an 84-year-old driver while jogging in Santa Monica. She suffered minor injuries and is not pressing charges. The driver was cited for failing to yield to a pedestrian. \\ TextRank & [PERSON] was hit by a driver while jogging in Santa Monica. She suffered not pressing charges. The driver was cited for failing to yield to a pedestrian. \\ PG & minor injuries and is not pressing charges. The driver was cited for failing to yield to a pedestrian in a crosswalk. \\ T5 & [PERSON] was hit by an 84-year-old driver while jogging in Santa Monica. She suffered minor injuries and is not pressing charges. The driver was cited for failing to yield to a pedestrian. \\ FT & suffered minor injuries and is not pressing charges. The driver was cited for failing to yield to a pedestrian in a crosswalk. \\ GPT-2 & Wednesday. She suffered minor injuries and went home to recover. The actress is not pressing charges, but the driver was cited for failing to yield to a pedestrian in a crosswalk. \\ Llama3 & Inner injuries but is not pressing charges. The driver was cited for failing to yield to a pedestrian in a crosswalk. \\ Qwen & Actress [PERSON], 35, was struck by an 84-year-old driver while jogging in Santa Monica. She suffered minor injuries and is not pressing charges. The driver was cited for failing to yield to a pedestrian in a crosswalk. \\ FrameSum & [PERSON], 35, was hit by an 84-year-old driver while jogging in Santa Monica. She suffered minor injuries but is not pressing charges. The driver was cited for failing to yield to a pedestrian. \\ Reference Summary &
\begin{tabular}{c} Actress [PERSON], 35, was struck by an 84-year-old driver while jogging in Santa Monica. She suffered minor injuries but is not pressing charges. The driver was cited for failing to yield to a pedestrian in a crosswalk. \\ \end{tabular}
\end{table} 
Table 7: Case study of generated summaries by different models. \begin{table}
\begin{tabular}{c c c c} \hline \hline
**Model** & **ROUGE-1** & **ROUGE-2** & **ROUGE-L** \\ \hline FrameSum & 44.82 & 19.24. & 39.56 \\ -w/o frame emb. & 44.23 & 18.79 & 38.91 \\ -w/o frame feat. & 43.11 & 18.07 & 38.85 \\ -w/o cov. loss & 41.57 & 17.62 & 37.40 \\ -w/o frame rel. loss & 41.96 & 18.23 & 39.17 \\ \hline \hline \end{tabular}
\end{table} 
Table 8: Ablation study results. Additionally, we examined the impact of different loss functions. Removing the coverage loss (-w/o cov. loss) results in a decrease in ROUGE scores, indicating that coverage loss helps improve the information coverage of summaries.