From the Stage to the Audience: Propaganda on R eddit (2021)

Abstract: Political discussions revolve around ideological conflicts that often split the audience into two opposing parties. Both parties try to win the argument by bringing forward information. However, often this information is misleading, and its dissemination employs propaganda techniques. In this work, we analyze the impact of propaganda on six major political forums on Reddit that target a diverse audience in two countries, the US and the UK. We focus on three research questions: who is posting propaganda? how does propaganda differ across the political spectrum? and how is propaganda received on political forums?

## introduction propaganda, translated from latin as "things that must be disseminated", represents information intended to persuade an audience to accept a particular idea or cause by using specific strategies or stirring up emotions. our work is the first study that leverages a high quality annotated dataset of propaganda techniques @xcite to understand the impact of propaganda on online conversations. in this paper, we perform an in-depth and longterm analysis of propaganda on online forums. we focus on six subreddits from two english speaking countries, the us and the uk, for one year. we select a popular subreddit for political news with no party affiliation and two subreddits dedicated to each country's dominant parties. in the us, the two main parties are the democrat and the republican party. the democrat party is center-left; however, it contains several factions with ideologies varying from the center to the left. the republican party is a center-right party and has shifted in recent years towards national conservatism. in the uk, the most popular parties are the labour party and the conservative party. similarly to the us, these parties represent the center-left and the center-right. the labour party has social democratic and socialist factions, while the conservative party has many factions, such as one-nation conservatism, liberal conservatism, or social conservatism. in recent years, both countries passed through significant political turmoil, such as donald trump's election in the us and the referendum on leaving the eu in the uk. however, a recent opinion piece in the washington post highlights an essential difference between the political discourse in the two countries. the journalist believes that the division between the left and the right in america is driven by the different interpretations the two parties give to the words "rights", "liberty" or "freedom", which have a strong moral imperative. this difference is not present in the uk, hence political parties there might find it easier to reach common grounds. our contribution to the study of propaganda in online discussions is in investigating the following research questions: i) who is posting propaganda? ii) how does propaganda differ across the political spectrum or different countries? and iii) how is propaganda received on political forums? we believe we are the first to investigate these important questions in forums with different political leaning. for the first question, we find that media sources' political bias is a strong indicator of the tendency of using propaganda and that a smaller community of users is disproportionately spreading propagandistic articles. regarding the second question, we find that forums dedicated to less popular parties in a country are more likely to post biased news and that cultural differences might dictate which propaganda techniques are employed. finally, we find that if a submission or comment has more propaganda content, it might receive more user engagement, measured either as the number of comments or as upvotes and downvotes. propaganda detection. previous works on propaganda have focused on proposing datasets to foster further research, including document-level annotations @xcite and fragment level annotations @xcite . efforts for constructing annotated datasets have also been made in other european languages different from english @xcite . automatic propaganda detection approaches are almost always proposed alongside new corpora. @xcite defines a four-class text classification task that detects propaganda, satire, hoaxes, and real news, while @xcite uses a binary classification to detect propaganda and nonpropaganda articles. @xcite perform fine-grained analysis of texts by detecting all fragments that contain propaganda techniques, as well as their type. in @xcite , the authors quantify the influence of trolls on twitter that contribute to the propaganda spread during political elections in online communities. studies on the use of propaganda have also helped understand how terrorist organizations share their ideology and attract new members @xcite . @xcite reviews the state of the art of computational propaganda detection from both an nlp and a network analysis perspective, arguing on the need to combine these communities' efforts. ## propaganda techniques propaganda is a communication technique primarily used to influence public opinion towards an a-priory established agenda. according to the institute for propaganda analysis, propaganda had its definition pinned in 1938 as being "the expression of an opinion or an action by individuals or groups deliberately designed to influence the opinions or the actions of other individuals or groups with reference to predetermined ends" (for propaganda @xcite . in the past century, spreading propaganda required controlling traditional journalism media, such as newsprint, tv, and radio stations. it represented a form of communication that only large institutions and governments could afford. with the recent rise of the internet and its use as online mass media, "computational propaganda" appeared @xcite as a social and technical phenomenon that made propaganda campaigns easily accessible to a wide variety of small organizations and individuals that targeted audiences of unprecedented size. recent striking examples include the propaganda allegedly set to influence the 2016 us presidential elections @xcite and the 2016 brexit referendum @xcite . while the definition of propaganda has reached consensus in the literature, the complete list of techniques considered propagandist are still under discussion, wikipedia foot_0 mentioning 68 of them. we adhere to the hypothesis previously made by @xcite that argues that propaganda is a communication technique that does not depend on the document topic and its topic-specific vocabulary and for which representations based on writing style, readability, and stylistic features generalize better than word-level based representations. @xcite chooses to investigate a curated list of eighteen propaganda techniques found in journalistic articles that can be judged intrinsically, without the need to retrieve supporting information from external resources. many of these techniques are also fallacies since propagandists use arguments that are sometimes convincing and not necessarily valid. a fallacy is an argument where the evidence does not support the claim that is put forward. the other techniques employ emotional language or use rhetorical, psychological, and disinformation strategies to present an idea. we leverage the list of eighteen propaganda techniques proposed by @xcite . ## reddit dataset we select six subreddits: politics, democrats, republican, ukpolitics, labouruk, and tories. politics is a subreddit for "current and explicitly political u.s. news.". the subreddit does not claim any political affiliation. the democrats subreddit description contains "we are here to get democrats elected up and down the ballot.", and it is a partisan subreddit. republican is "a partisan subreddit" and the place where "republicans discuss issues with other republicans", hence it is a subreddit for people supporting the us republican party. ukpolitics is a forum for "political news and debate concerning the united kingdom" and does not claim any political affiliation. labouruk is a subreddit that discusses breaking news concerning the british labour party. finally, tories is a subreddit for news concerning the conservative party in the uk, also known as the tories. when there are several subreddits on the same topic (for example, britishpolitics is also a subreddit for politics in the united kingdom), we select the subreddit with the largest number of members. we note that reddit does not ask for or encourages users to share personal data, such as their locations. statistics on reddit users are available only through data gathered from independent polls and surveys. for example, we know that the us and uk are the bestrepresented countries among the reddit users. in the light of the surveys, we hypothesize that there are many users from the us and uk that engage in political subreddits. we take all content posted for a period of one year, january 2019 to december 2019, from the pushshift dataset @xcite . on reddit, a discussion is started by a submission, e.g. a news article or a piece of text, and users will engage by writing comments. a comment is described by author, body (the content of the comment), and score (computed as upvotes minus downvotes) among others. we remove comments tagged as "[deleted]" or "[removed]", which are comments removed by the moderators or the users themselves. a submission has several properties, including content (often linked via a url), number of comments, score (upvotes minus downvotes), and author. for simplicity, we refer to the submission and the article linked in the submission using the term submission. we retrieve the external articles by following the link in the submission. we filter out the submissions whose corresponding articles were not found by the crawler, either because cookie permissions cannot be given automatically or because the link is no longer valid. we also filter out the submissions linking to articles with less than 200 words. we want to focus on journalistic like content, a piece of text large enough to develop well an idea. overall, we keep around 43 -71% of the original submissions, depending on the subreddit. an overview of our dataset is given in to further understand the subreddits' dynamics, we report the overlap between the users commenting or posting a submission in the forums over the period we study. in the us related forums, there are 736k unique users, out of which 730k unique users in politics, 8.5k in democrats, and 7.7k in republican. we have that 75% of users in democrats and 57% of users in republican also post in politics, while only 5% of users posting in republican also post in democrats. in the uk forums, we have 46k unique users, out of which 44k post in ukpolitics, 3.3k in labouruk, and 1k in tories. the overlap between the forums shows a more balanced dynamics, with 61% of the labouruk users and 63% of the tories users also posting in ukpolitics, and 23% of the tories users posting in labouruk. ## methodology the dataset introduced in @xcite consists of news articles manually annotated with propaganda techniques. the propaganda techniques are in order of frequence of instances: loaded language (2547), name-calling (1294), repetition (767), exaggeration or minimization (571), doubt (562), appeal to fear and prejudice (367), flag-waving (330), causal oversimplification (233), slogans (172), appeal to authority (169), black and white fallacy (134), thought-terminating cliches (95), whataboutism (76), reductio ad hitlerum (66), red herring (48), bandwagon (17), labeling, obfuscation or intentional vagueness (17), straw men (15). the annotations are fined-grained, with each propaganda instance being labeled at the token level. one technique might span more than one sentence. we define two classification tasks based on the propaganda dataset described in section 4: i) propaganda identification, which predicts if a sentence contains any propaganda techniques and ii) propaganda technique identification, which given a sentence containing propaganda, predicts the type of technique. for each task, we test the following classifiers: a random classifier which predicts a class uniformly at random, a suite of transformer classifier bert @xcite , roberta @xcite and xlnet @xcite , and an ensemble classifier that makes a prediction based on the most confident label given by one of the three classifiers (bert, roberta or xlnet). finally, we add the multi granularity model proposed in @xcite , mgn relu. to fine-tune the transformer models, we add a final linear layer. we use a sequence length of 210, a learning rate of 0.01, a mini-batch of size 16, anneal factor of 0.5, patience of 2, and the maximum number of epochs to 20. to deal with dataset imbalance in both tasks, we weight the loss function samples according to the class weight. the first task, propaganda identification, is a binary classification task, with classes propaganda and nonpropaganda. we present the results in the second task allowed us to understand if we have enough instances of each propaganda technique to classify them. we ran an experimental study, and we observed that bandwagon, obfuscation, red herring, straw men, and thoughtterminating cliches were never recognized in the test set by our classifiers. given this, we removed them from the annotations, and we kept the remaining techniques for the first and second tasks. we present the results in ## propaganda on reddit in this section, we focus on several research questions around propaganda on online forums. rq1. who is posting propaganda? in the context of political forum discussions, this question targets two different groups: media outlets and social media users. the initial publishers are the media outlets, but users handpick what news to share on political forums. to study what media outlets are present and in which measure they are responsible for the propaganda content, we look at the groups defined in section 5, least propaganda submissions, and most propaganda submissions. we compute the top-level domain for each submission in the two groups, which corresponds to the media outlet. we give each media outlet a label measuring its political leaning, according to mediabiasfactcheck: center, left-center, right-center, left, right, questionable, and others. the center label is interpreted as having no or little political bias, left-center and right-center have a slight bias, left and right have a moderate bias, while the questionable label has a strong bias. the others label is given to sites that are not found in our dataset. mediabiasfactcheck computes a media source's political bias taking into account bias by story selection, bias by omission, or bias by labeling, among others. in one follow-up question that we ask is how many of these users are bots. the presence of bots could explain why in one group there are fewer users posting articles. while there are several lists of reddit bots, none of them is complete. given this, we employ rest-sleep-and-comment (rsc) @xcite , a generative method that can distinguish human from bot posting activity. the method receives in input the intervals between two consecutive posts of a user, and these intervals are then compared with the aggregated distributions of intervals of all the users. the authors provide an initial training set of normal users and bots consisting of 37 bots and 999 users, to which we add 94 extra bots to make the model more robust. rsc has an average f 1-score of 77.3 in cross-validation. the model requires at least 800 consecutive timestamps at which a user has written a comment. we retrieve from our subreddits all the users that posted a submission, and we keep the users for which we could retrieve the required number of timestamps. we note that the timestamps for a user are retrieved such that they represent consecutive chronological posts. hence we do not restrict the subreddits in which the user might have posted. we find 748 possible bots on politics, 91 on democrats, 21 on republican, 135 on ukpolitics, 23 on labouruk and 9 on tories. we investigate if these suspicious users posted a larger percentage of most propaganda articles in comparison with least propaganda articles. we find that this is the case on all subreddits, except republican. however, the results are not statistically significant (@xmath0.05) and the differences are close, as seen in a second question is if the propaganda techniques employed differ according to the subreddits' political leaning or according to the country. we annotate using our propaganda technique identification classifier the sentences we previously labeled as propaganda to test this. we restrict ourselves to articles in the group most propaganda, using the intuition that if many sentences in the same article raise flags in the classifier, it is more likely that the article contains propaganda. for each subreddit, we rank the propaganda techniques by their frequency. we find that the relative ranking of techniques does not differ much between subreddits from the same country. the top 5 most frequent techniques are in the us loaded language, name-calling, exaggeration or minimization, flag waving, doubt, while in the uk based subreddits we have loaded language, name calling, doubt, appeal to fear or prejudice, exaggeration or minimization. given the low accuracy of our technique classifier, we cannot make any definitive claims. however, such differ-ences between the subreddits discussing politics in the two countries are plausible when considering the cultural differences. for example, americans might be more susceptible to flag-waving, the technique of using patriotic feelings to justify an action. in 2017, 67% of americans believed that the us is the leader of the free world according to a survey by the public broadcasting service. ## conclusion in this work, we perform an extensive analysis of propaganda on online forums. we study for one year six subreddits from two english-speaking countries, the us and the uk. we find several interesting patterns that can be leveraged by reddit users and moderators to create better online discussions. we have found trends that we believe were not observed before in the literature. for example: i) the parties which represent a minority in a country might tend to use more propaganda; ii) political bias (either towards the right or the left) might be an indication of propaganda; iii) users that post more biased content form smaller communities; iv) differences in the use of propaganda techniques across countries might be rooted in cultural differences; v) submissions and comments having more propaganda content tend to receive more engagement in the form of number of comments, upvotes or downvotes. we note that while we have thoroughly tested all our hypotheses, our work is based on the automatic labelling of submissions and comments, with all the imprecision of such a method. we believe that understanding how propaganda affects us is of utmost importance for ensuring we live in democratic societies.