Fact-Checking, Fake News, Propaganda, and Media Bias: Truth Seeking in the Post-Truth Era (2020)

Abstract: The rise of social media has democratized content creation and has made it easy for everybody to share and spread information online. On the positive side, this has given rise to citizen journalism, thus enabling much faster dissemination of information compared to what was possible with newspapers, radio, and TV. On the negative side, stripping traditional media from their gate-keeping role has left the public unprotected against the spread of misinformation, which could now travel at breaking-news speed over the same democratic channel. This has given rise to the proliferation of false information specifically created to affect individual people’s beliefs, and ultimately to influence major events such as political elections. There are strong indications that false information was weaponized at an unprecedented scale during Brexit and the 2016 U.S. presidential elections. “Fake news,” which can be defined as fabricated information that mimics news media content in form but not in organizational process or intent, became the Word of the Year for 2017, according to Collins Dictionary. Thus, limiting the spread of “fake news” and its impact has become a major focus for computer scientists, journalists, social media companies, and regulatory authorities. The tutorial will offer an overview of the broad and emerging research area of disinformation, with focus on the latest developments and research directions.

## reading list we recommend several surveys. @xcite , which adopted a data mining perspective on "fake news" and focused on social media. another survey @xcite focused on rumor detection in social media. the survey by @xcite took a fact-checking perspective on "fake news" and related problems. the survey by @xcite covering truth discovery in general. lazer et al. (2018) offers a general overview and discussion on the science of "fake news", while @xcite focuses on the process of proliferation of true and false news online. other recent surveys focus on stance detection (küc ¸ük and can, 2020), on propaganda @xcite , on social bots @xcite , on false information @xcite and on bias on the web (baeza-yates, 2018). see also the list of references at the end. ## type of tutorial the tutorial is both introductory, covering a number of topics related to fact-checking, propaganda and disinformation, but it is also cutting-edge, covering some latest developments in these areas. ## prerequisites prior knowledge of natural language processing, machine learning, and deep learning would be needed in order to understand large parts of the contents of this tutorial. at qcri, he leads the tanbih project, 2 developed in collaboration with mit, which aims to limit the effect of "fake news", propaganda and media bias by making users aware of what they are reading. the project was featured by over 100 news outlets, including forbes, boston globe, aljazeera, mit technology review, science daily, popular science, fast company, the register, wired, and engadget, among others. as part of the project, he co-organized several shared tasks on fact-checking and propaganda detection at semeval and clef, as well as a related nlp4if workshop. he is president of acl siglex, a secretary of acl sigslav, and a member of the eacl advisory board. he is also member of the editorial board of tacl, cs&l, nle, ai @xcite frontiers in ai, as well as of the language science press book series on phraseology and multiword expressions. he co-authored a morgan & claypool book on semantic relations between nominals, two books on computer algorithms, and many research papers in top-tier conferences and journals. he received the young researcher award at ranlp'2011, and he was the first to receive the bulgarian president's john atanasoff award, named after the inventor of the first automatic electronic digital computer. 2 tanbih project: http://tanbih.qcri.org 6.2 giovanni da san martino giovanni da san martino is a senior assistant professor at the university of padova, italy. his research interests are at the intersection of machine learning and natural language processing. he has been researching for 10+ years on these topics, publishing more than 60 publications in top-tier conferences and journals. he received his phd from the university of bologna, he was a research fellow at the university of padova and a scientist at qatar computing research institute. he has worked on several nlp tasks including paraphrase recognition, stance detection and community question answering. currently, he is actively involved in researching on disinformation and propaganda detection. as part of this research he has been co-organiser of the checkthat! labs at clef 2018-2020, the nlp4if 2019-2020 workshops on "censorship, disinformation, and propaganda", the 2019 hack the news datathon and the semeval-2020 task 11 on "detection of propaganda techniques in news articles." ramy baly, mitra mohtarami, james glass, lluís màrquez, alessandro moschitti, and preslav nakov. 2018b. integrating stance detection and fact checking in a unified corpus. in proceedings of the 2018 conference of the north american chapter of the association for computational linguistics: human language technologies, naacl-hlt '18, pages 21-27, new orleans, louisiana, usa. alberto barrón-cedeño, giovanni da san martino, israa jaradat, and preslav nakov. 2019. proppy: organizing the news based on their propagandistic content. information processing & management, 56(5):1849 -1864. alberto barrón-cedeño, tamer elsayed, reem suwaileh, lluís màrquez, pepa atanasova, wajdi zaghouani, spas kyuchukov, giovanni da san martino, and preslav nakov. 2018. overview of the clef-2018 checkthat! lab on automatic identification and verification of political claims, task 2: factuality. in clef 2018 working notes. working notes of clef 2018 -conference and labs of the evaluation forum, ceur workshop proceedings, avignon, france. ceur-ws.org. alberto barrón-cedeño, giovanni da san martino, israa jaradat, and preslav nakov. 2019. proppy: a system to unmask propaganda in online news. in proceedings of the thirty-third aaai conference on artificial intelligence, aaai'19, pages 9847-9848, honolulu, hi, usa. alberto barrón-cedeño, tamer elsayed, preslav nakov, giovanni da san martino, maram hasanain, reem suwaileh, and fatima haouari. 2020. check-that! at clef 2020: enabling the automatic identification and verification of claims in social media. in advances in information retrieval, ecir '20, pages 499-507, lisbon, portugal. alberto barrón-cedeño, tamer elsayed, preslav nakov, giovanni da san martino, maram hasanain, reem suwaileh, fatima haouari, nikolay babulkov, bayan hamdan, alex nikolov, shaden shaar, and zien sheikh ali. 2020. overview of checkthat! 2020 -automatic identification and verification of claims in social media. in proceedings of the 11th international conference of the clef association: experimental ir meets multilinguality, multimodality, and interaction, clef '2020, thessaloniki, greece. anya belz. 2019. fully automatic journalism: we need to talk about nonfake news generation. in proceedings of the first conference on truth and trust online, tto '19, london, united kingdom. gillian bolsover and philip howard. 2017. computational propaganda and political big data: moving toward a more critical research agenda. big data, 5(4):273-276. zhan bu, zhengyou xia, and jiandong wang. 2013. a sock puppet detection algorithm on virtual spaces. know.-based syst., 37:366-377. ceren budak, sharad goel, and justin m rao. 2016. fair and balanced? quantifying media bias through crowdsourced content analysis. public opinion quarterly, 80(s1):250-271. kevin r. canini, bongwon suh, and peter l. pirolli. 2011. finding credible information sources in social networks based on content and social structure. in proceedings of the ieee international conference on privacy, security, risk, and trust, and the ieee international conference on social computing, socialcom/passat '11, pages 1-8, boston, massachusetts, usa. carlos castillo, marcelo mendoza, and barbara poblete. 2011. information credibility on twitter. in proceedings of the 20th international conference on world wide web, www '11, page 675-684, hyderabad, india. carlos castillo, marcelo mendoza, and barbara poblete. 2013. predicting information credibility in time-sensitive social media. internet research, 23(5):560-588. abhijnan chakraborty, bhargavi paranjape, kakarla kakarla, and niloy ganguly. 2016. stop clickbait: detecting and preventing clickbaits in online news media. in proceedings of the 2016 ieee/acm international conference on advances in social networks analysis and mining, asonam '16, pages 9-16, san francisco, california, usa. cheng chen, kui wu, venkatesh srinivasan, and xudong zhang. 2013. battling the internet water army: detection of hidden paid posters. in proceedings of the 2013 ieee/acm international conference on advances in social networks analysis and mining, asonam '13, pages 116-120, niagara, canada. sihao chen, daniel khashabi, wenpeng yin, chris callison-burch, and dan roth. 2019a. seeing things from a different angle:discovering diverse perspectives about claims. in proceedings of the 2019 conference of the north american chapter of the association for computational linguistics: human language technologies, naacl-hlt '19, pages 542-557, minneapolis, minnesota, usa. wenhu chen, hongmin wang, jianshu chen, yunkai zhang, hong wang, shiyang li, xiyou zhou, and william yang wang. 2019b. tabfact: a largescale dataset for table-based fact verification. arxiv preprint 1909.02164. matteo cinelli, walter quattrociocchi, alessandro galeazzi, carlo michele valensise, emanuele brugnoli, ana lucia schmidt, paola zola, fabiana zollo, and antonio scala. 2020. the covid-19 social media infodemic. arxiv preprint 2003.05004. michael conover, jacob ratkiewicz, matthew r francisco, bruno gonc ¸alves, filippo menczer, and alessandro flammini. 2011. political polarization