Automatic Data Retrieval for Cross Lingual Summarization (2023)

Abstract: Cross-lingual summarization involves the sum marization of text written in one language to a different one. There is a body of research addressing cross-lingual summarization from English to other European languages. In this work, we aim to perform cross-lingual summarization from English to Hindi. We propose pairing up the coverage of newsworthy events in textual and video format can prove to be helpful for data acquisition for cross lingual summarization. We analyze the data and propose methods to match articles to video descriptions that serve as document and summary pairs. We also outline filtering methods over reasonable thresholds to ensure the correctness of the summaries. Further, we make available 28,583 mono and cross-lingual article-summary pairs* . We also build and analyze multiple baselines on the collected data and report error analysis.

## introduction in the field of natural language processing (nlp), advancements in human language understanding and processing have often required extensive data. cross-lingual summarization, a recent focus in nlp, has seen the emergence of well-known datasets like crosssumm @xcite and pmindiasum @xcite . in the context of indian languages, recent datasets such as xl-sum @xcite , massivesumm @xcite , and pmindiasum @xcite promote research in lowresource language setting. generating human-annotated datasets is a laborintensive and costly endeavor @xcite . to address the scarcity of resources for lowresource languages, some efforts involve scraping news websites and use source document prefixes or headlines as summaries. however, this approach en-en en-hi hi-hi has two main shortcomings: 1) it often lacks diversity in information since all article-summary pairs originate from a single domain, and 2) many source documents lack comprehensive coverage of specific events or incidents. in this work, we present the data collection and alignment approach aimed at enhancing both mono and cross-lingual summarization for indian languages. our core hypothesis is that news events can serve as a basis for aligning diverse sources of coverage in the context of summarization. specifically, we concentrate on textual summarization and propose that by pairing up youtube descriptions with corresponding news article coverage of different events from a multitude of sources, we can create a substantial summarization dataset comprising of 28,583 pairs. we have experimented with state-of-the-art multilingual summarization models and performed error analysis to assess the effectiveness of the pretrained models for both mono and cross-lingual summarization. in the subsequent sections, we outline related work, our data collection methodology, the process of matching summarization pairs, and the subsequent filtering to derive the final dataset for our work in 1. furthermore, we describe the training of various baseline models using the collected data and present our research findings. significant progress has been made in the field of english language summarization, in stark contrast to the relatively limited efforts focused on indian languages in the context of summarization and related natural language generation (nlg) tasks @xcite , including headline generation. nevertheless, recent times have witnessed a surge in active research in this domain, notably marked by the release of datasets like xl-sum @xcite , massivesumm @xcite , and others. these multilingual datasets comprise pairs of articles and summaries extracted from publicly available news sources, encompassing a range of indian languages, including hindi, gujarati, bengali, and more. furthermore, the indicnlg suite @xcite has contributed by providing datasets designed for various indic language nlg tasks, such as sentence summarization and headline generation. despite these promising developments, there is still a need for continued effort in this area to attain performance levels in indian language summarization that is on par with their english language counterpart. ## data creation there are three steps for data preparation -data collection, pair matching and lastly, pair filtering. ## experiments and results we fine-tune on three pretrained models namely indicbart, mbart and mt5-base. the dataset splits are detailed in the document summary janata dal (united) chief nitish kumar resigned from the post of chief minister on tuesday, 9 august, ending his alliance with the bharatiya janata party (bjp) in the state. kumar, in a meeting held with party leaders in patna, said that the bjp is conspiring to break the jd(u), sources said. following kumar's submission of his resignation to governor phagu chauhan, the duo of kumar and rashtriya janata dal (rjd) leader tejashwi yadav staked a claim to the government. amid the political turmoil, here are the top developments from bihar: nitish kumar & rjd leader tejashwi yadav left for the residence of rabri devi in patna. kumar resigned from his position as chief minister on august 9. the massive fire that engulfed assam's baghjan oil well two weeks after a blowout in the oil field in tinsukia district has spread to nearby villages. at least 30 houses have been damaged so far, and locals have reported loss of flora and fauna as well. two people have also been killed in the massive fire the baghjan oil well has been blowing out since 27 may. what started as an oil spill and gas leak due to the failure of pressure control systems, has now turned into a massive fire. the fire rapidly spread to nearby villages and set ablaze several houses and other properties. close to 30-35 houses near the baghjan oil field have been destroyed in the fire, which is visible 4-5 km away from the site. the baghjan oil well located near the dibru saikhowa national park in assam has been blowing out since 27 may. what started as an oil spill and gas leak due to the failure of pressure control systems, has now turned into a massive fire. after being denied bail multiple times, the bombay high court granted bail to aryan khan, arbaaz merchantt and munmun dhamecha in the mumbai cruise drugs case on thursday, 28 october. the court said it will release a detailed order on friday, 29 october. the three of them were arrested by the narcotics control bureau (ncb) following a raid onboard a luxury cruise on 2 october. they were sent to judicial custody on 8 october. here are the arguments made by ncb and aryan khan in court on thursday. मु ं बई ��स मामले म� आय� न खान (aryan khan) को आ�खरकार बड़ी राहत �मली है . बॉ�बे हाईकोट� ने आय� न को जमानत दे द� है . �पछले तीन �दन� से जमानत या�चका पर सु नवाई चल रही थी. आय� न खान के अलावा अरबाज मज� ट और मु नमु न धमे चा को भी हाईकोट� ने जमानत द� है . इन तीन� को एक साथ एनसीबी ने �गर�तार �कया था. with the beginning of the new year, team india is all set to play their first game against sri lanka. the sri lankan cricket team will be visiting india for the shortest format accompanied by a three-series match. the first game will be played in the iconic wankhede stadium in mumbai. this will be the first time that hardik pandya will be leading the team in the absence of virat kohli, kl rahul, and rohit sharma. hardik pandya is expected to begin his full-time t20 captaincy tenure on a bold note in india vs sri lanka t20i 2023. the three-match series against sri lanka will begin on tuesday, 3 january 2023. the followers of indian cricket have gotten a vision of hardik's captaincy from his victory in the rain-hit t20 series in new zealand. now, let's know the timings, venue, and live streaming details like when and where to watch india vs sri lanka t20i match? ## conclusions in this study, we have developed a mono and crosslingual summarization dataset for english-hindi language pairs by leveraging a variety of news events and their corresponding youtube descriptions. our experimentation with multilingual models revealed that mbart consistently outperforms the indicbart and mt5 models. our error analysis indicates significant opportunities for the development of more effective multilingual models for low-resource languages.