Content takedowns and activist organizing: Impact of social media content moderation on activists and organizing

Policy & InternetEarly View RESEARCH ARTICLE Content takedowns and activist organizing: Impact of social media content moderation on activists and organizing Diane Jackson, Corresponding Author Diane Jackson [email protected] orcid.org/0000-0001-9789-3914 Brian Lamb School of Communication, Purdue University, West Lafayette, Indiana, USA Correspondence Diane Jackson, 100 North University Street Beering Hall Room 2114, West Lafayette, IN 47907, USA Email: [email protected]Search for more papers by this author Diane Jackson, Corresponding Author Diane Jackson [email protected] orcid.org/0000-0001-9789-3914 Brian Lamb School of Communication, Purdue University, West Lafayette, Indiana, USA Correspondence Diane Jackson, 100 North University Street Beering Hall Room 2114, West Lafayette, IN 47907, USA Email: [email protected]Search for more papers by this author First published: 26 October 2023 https://doi.org/10.1002/poi3.372Citations: 1Read the full textAboutPDF ToolsRequest permissionExport citationAdd to favoritesTrack citation ShareShare Give accessShare full text accessShare full-text accessPlease review our Terms and Conditions of Use and check box below to share full-text version of article.I have read and accept the Wiley Online Library Terms and Conditions of UseShareable LinkUse the link below to share a full-text version of this article with your friends and colleagues. Learn more.Copy URL Share a linkShare onEmailFacebookTwitterLinkedInRedditWechat REFERENCES Alaimo, K. (2015). How the Facebook arabic page “We are all Khaled said” helped promote the Egyptian Revolution. Social Media + Society, 1(2), 205630511560485. https://doi.org/10.1177/2056305115604854 10.1177/2056305115604854 Web of Science®Google Scholar Alakhunova, N., Diallo, O., Martin del Campo, I., & Tallarico, W. (2015). Defining marginalization: An assessment tool. The Elliott School of International Affairs. Google Scholar Alimardani, M. (2022, June 2). How Instagram is failing protesters in Iran. Slate. https://slate.com/technology/2022/06/instagram-meta-iran-protests-exceptions.html Google Scholar Alimardani, M., & Elswah, M. (2021). Digital orientalism: #SaveSheikhJarrah and Arabic content moderation. POMEPS Studies 43: Digital Activism and Authoritarian Adaptation in the Middle East. Google Scholar Allyn, B. (2020, June 7). TikTok pivots from dance moves to a racial justice movement. NPR. https://www.npr.org/2020/06/07/871065917/tiktok-pivots-from-dance-moves-to-a-racial-justice-movement Google Scholar Amidi, F. (2022, November 2). Hashtags, a viral song and memes empower Iran's protesters. BBC News. https://www.bbc.com/news/world-middle-east-63456599 Google Scholar Ananny, M., & Gillespie, T. (2016). Public platforms: Beyond the cycle of shocks and exceptions (Vol. 22). The Platform Society. Google Scholar Anderson, M., Toor, S., Olmstead, K., Rainie, L., & Smith, A. (2018, July 11). Public attitudes toward political engagement on social media. Pew Research Center. https://www.pewresearch.org/internet/2018/07/11/public-attitudes-toward-political-engagement-on-social-media/ Google Scholar Asher-Schapiro, A. (2022, November 12). FEATURE—How Musk's Twitter takeover could endanger vulnerable users. Reuters. https://www.reuters.com/article/usa-tech-twitter/feature-how-musks-twitter-takeover-could-endanger-vulnerable-users-idINL8N3250CW Google Scholar Biddle, S. (2022, April 13). Facebook's Ukraine–Russia moderation rules prompt cries of double standard. The Intercept. https://theintercept.com/2022/04/13/facebook-ukraine-russia-moderation-double-standard/ Google Scholar Biddle, S., Ribeiro, P. V., & Dias, T. (2020, March 16). Invisible censorship: TikTok told moderators to suppress posts by “ugly” people and the poor to attract new users. The Intercept. https://theintercept.com/2020/03/16/tiktok-app-moderators-users-discrimination/ Google Scholar Binns, R., Veale, M., Van Kleek, M., & Shadbolt, N. (2017). Like trainer, like bot? Inheritance of bias in algorithmic content moderation. In G. Ciampaglia, A. Mashhadi, & T. Yasseri (Eds.), Proceedings of the 9th International Conference on Social Informatics. Springer. https://doi.org/10.1007/978-3-319-67256-4_32 10.1007/978-3-319-67256-4_32 Google Scholar Bone, T. (2021). How content moderation may expose social media companies to greater defamation liability. Washington University Law Review Archive, 98(3). Google Scholar Booth, R. B., Tombaugh, E., Kiesa, A., Lundberg, K., & Cohen, A. (2020, October 20). Young people turn to online political engagement during COVID-19. Circle. https://circle.tufts.edu/latest-research/young-people-turn-online-political-engagement-during-covid-19 Google Scholar Botella, E. (2019, December 4). TikTok admits it suppressed videos by disabled, queer, and fat creators. Slate. https://slate.com/technology/2019/12/tiktok-disabled-users-videos-suppressed.html Google Scholar Buolamwini, J., & Gebru, T. (2018). Gender shades: Intersectional accuracy disparities in commercial gender classification. Proceedings of Machine Learning Research, 81, 1–15. Google Scholar Butcher, M. (2022, October 5). As Iran throttles its internet, activists fight to get online. TechCrunch. https://techcrunch.com/2022/10/05/iran-internet-protests-censorship/ Google Scholar Cammaerts, B. (2015). Social media and activism. In R. Mansell & P. Hwa (Eds.), The international encyclopedia of digital communication and society (pp. 1027–1034). Wiley-Blackwell. 10.1002/9781118767771.wbiedcs083 Google Scholar Casilli, A. A., & Tubaro, P. (2012). Social media censorship in times of political unrest—A social simulation experiment with the UK riots. Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique, 115, 5–20. https://doi.org/10.1177/0759106312445697 10.1177/0759106312445697 Google Scholar Center for Countering Digital Hate. (2022). Deadly by design: TikTok pushes harmful content promoting eating disorders into users' feeds. https://counterhate.com/wp-content/uploads/2022/12/CCDH-Deadly-by-Design_120922.pdf Google Scholar Chen, Y., Zhou, Y., Zhu, S., & Xu, H. (2012). Detecting offensive language in social media to protect adolescent online safety. 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Conference on Social Computing (pp. 71–80). https://doi.org/10.1109/SocialCom-PASSAT.2012.55 10.1109/SocialCom-PASSAT.2012.55 Google Scholar CNN Special Report. (2023, February 21). How Iran used a network of secret torture centers to crush an uprising. CNN's International Investigative Unit and Visuals Team. https://www.cnn.com/interactive/2023/02/middleeast/iran-torture-jails-black-sites-mahsa-amini-protests-cmd-intl/ Google Scholar Dagres, H. (2021, December 15). Iranians on #socialmedia. Atlantic Council. https://www.atlanticcouncil.org/in-depth-research-reports/report/iranians-on-socialmedia/#social-media-numbers-and-uses Google Scholar Dinar, C. (2021, June 21). The state of content moderation for the LGBTIQA+ community and the role of the EU Digital Services Act. Heinrich Boell Foundation. https://us.boell.org/en/2021/06/21/state-content-moderation-lgbtiqa-community-and-role-eu-digital-services-act-1 Google Scholar Duarte, N., Llanso, E., & Loup, A. (2017). Mixed messages? The limits of automated social media content analysis. Center for Democracy and Technology. https://apo.org.au/sites/default/files/resource-files/2017-11/apo-nid240471.pdf Google Scholar Fatafta, M. (2022, October 9). Meta's clampdown on Palestine speech is far from ‘unintentional’. +972 Magazine. https://www.972mag.com/meta-arabic-palestine-censorship/ Google Scholar Feder, L., Jackson, D., & Eddington, S. (2023). We need to wake our world up: Collegiate athlete organizing for social change. Communication & Sport, 1–21. https://doi.org/10.1177/2167479523120386 10.1177/2167479523120386 Google Scholar France-Presse, A. (2022, November 6). Fresh protests erupt in Iran's universities and Kurdish region. The Guardian. https://www.theguardian.com/world/2022/nov/06/iran-fresh-protests-universities-kurdish-region Google Scholar Gearhart, S., & Zhang, W. (2015). “Was it something I said?” “No, it was something you posted!” A study of the Spiral of Silence Theory in social media contexts. Cyberpsychology, Behavior and Social Networking, 18(4), 208–213. https://doi.org/10.1089/cyber.2014.0443 10.1089/cyber.2014.0443 PubMedWeb of Science®Google Scholar Gerrard, Y. (2018). Beyond the hashtag: Circumventing content moderation on social media. New Media & Society, 20(12), 4492–4511. https://doi.org/10.1177/1461444818776611 10.1177/1461444818776611 Web of Science®Google Scholar Gillespie, T. (2018). Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media. Yale University Press. Google Scholar Gillespie, T. (2020). Content moderation, AI, and the question of scale. Big Data & Society, 7(2), 1–5. https://doi.org/10.1177/2053951720943234 10.1177/2053951720943234 Web of Science®Google Scholar Golovchenko, Y. (2022). Fighting propaganda with censorship: A study of the Ukrainian ban on Russian social media. The Journal of Politics, 84(2), 639–654. https://doi.org/10.1086/716949 10.1086/716949 Web of Science®Google Scholar Gorwa, R., Binns, R., & Katzenbach, C. (2020). Algorithmic content moderation: Technical and political challenges in the automation of platform governance. Big Data & Society, 7, 1527–1544. https://doi.org/10.1177/2053951719897945 10.1177/2053951719897945 Web of Science®Google Scholar Harwell, D., & Romm, T. (2019, September 15). TikTok's Beijing roots fuel censorship suspicion as it builds a huge U.S. audience. The Washington Post. https://www.washingtonpost.com/technology/2019/09/15/tiktoks-beijing-roots-fuel-censorship-suspicion-it-builds-huge-us-audience/ Google Scholar Heaney, M. T. (2022). Who are Black Lives Matter activists? Nche realization in a multimovement environment. Perspectives on Politics, 20(4), 1362–1385. https://doi.org/10.1017/51537592722001281 10.1017/S1537592722001281 Web of Science®Google Scholar Hern, A. (2019, September 25). Revealed: How Tiktok censors videos that do not please Beijing. The Guardian. https://www.theguardian.com/technology/2019/sep/25/revealed-how-tiktok-censors-videos-that-do-not-please-beijing Google Scholar Höppner, S. (2022, October 5). Iran: Are social media platforms censoring dissent? Deutsche Welle. https://www.dw.com/en/iran-are-social-media-platforms-censoring-dissent/a-63347228 Google Scholar Howard University School of Law. (2023, January 6). A brief history of Civil Rights in the United States: The Black Lives Matter movement. Vernon E. Jordan Law Library. https://library.law.howard.edu/civilrightshistory/BLM#:~:text=Black%20Lives%20Matter%20began%20with,Eric%20Garner%20in%20New%20York Google Scholar Instagram Help Center. (2023). Why certain posts on Instagram are not appearing in explore and hashtag pages. Meta. https://help.instagram.com/613868662393739 Google Scholar Iran International. (2022, September 23). Hashtag against death of hijab victim breaks historic record. https://www.iranintl.com/en/202209239501 Google Scholar Janfaza, R. (2020, June 4). TikTok serves as hub for #blacklivesmatter activism. CNN. https://www.cnn.com/2020/06/04/politics/tik-tok-black-lives-matter/index.html Google Scholar Kahne, J., & Bowyer, B. (2017). Educating for democracy in a partisan age: Confronting the challenges of motivated reasoning and misinformation. American Educational Research Journal, 54(1), 3–34. https://doi.org/10.3102/0002831216679817 10.3102/0002831216679817 Web of Science®Google Scholar Kenyon, P. (2023, April 2). Six months after the death of 22-year-old Mahsa Amini, Iranians are still protesting. NPR. https://www.npr.org/2023/04/02/1167645484/six-months-after-the-death-of-22-year-old-mahsa-amini-iranians-are-still-protest Google Scholar Kluch, Y. (2022). “It's our duty to utilize the platform that we have”: Motivations for activism among U.S. collegiate athletes. In R. Magrath (Ed.), Athlete activism: Contemporary perspectives. Routledge. https://doi.org/10.4324/9781003140290 Google Scholar Knight, W. (2022, November 4). Elon Musk has fired Twitter's ‘Ethical AI’ team. Wired. https://www.wired.com/story/twitter-ethical-ai-team/ Google Scholar Knight Foundation & Gallup Inc. (2020). Free expression, harmful speech, and censorship in a digital world. https://knightfoundation.org/wp-content/uploads/2020/06/KnightFoundation_Panel6-Techlash2_rprt_061220-v2_es-1.pdf Google Scholar Köver, C., & Reuter, M. (2019, December 2). Tiktok curbed reach for people with disabilities. Neopolitik.org. https://netzpolitik.org/2019/discrimination-tiktok-curbed-reach-for-people-with-disabilities/ Google Scholar Kumar, R. (2022, December 6). Not quite the Arap Spring: How protestors are using social media in innovative ways. Reuters Institute for the Study of Journalism University of Oxford. https://reutersinstitute.politics.ox.ac.uk/news/not-quite-arab-spring-how-protestors-are-using-social-media-innovative-ways Google Scholar Langvardt, K. (2018). Regulating online content moderation. The Georgetown Law Journal, 106(5), 1353–1388. https://doi.org/10.2139/ssrn.3024739 10.2139/ssrn.3024739 Web of Science®Google Scholar Liu, J., & Zhao, J. (2021). More than plain text: Censorship deletion in the Chinese social media. Journal of the Association for Information Science and Technology, 72, 18–31. https://doi.org/10.1002/asi.24390 10.1002/asi.24390 Web of Science®Google Scholar Marcondes, F. S., Gala, D., Durães, D., Moreira, F., Almeida, J. J., Baldi, V., & Novais, P. (2021). A profile on Twitter shadowban: An AI ethics position paper on free-speech. In H. Yin (Ed.), Intelligent data engineering and automated learning—IDEAL 2021 [Conference paper] lecture notes in computer science book series (Vol. 13113). Springer. https://doi.org/10.1007/978-3-030-91608-4_39 10.1007/978-3-030-91608-4_39 Google Scholar McClain, C. (2021, May 4). 70% of U.S. social media users never or rarely post or share about political, social issues. Pew Research Center. https://www.pewresearch.org/fact-tank/2021/05/04/70-of-u-s-social-media-users-never-or-rarely-post-or-share-about-political-social-issues/ Google Scholar McCluskey, M. (2020, July 22). These TikTok creators say they're still being suppressed for posting Black Lives Matter content. Time. https://time.com/5863350/tiktok-black-creators/ Google Scholar Middlebrook, C. (2020). The grey area: Instagram, shadowbanning, and the erasure of marginalized communities. https://doi.org/10.2139/ssrn.3539721 10.2139/ssrn.3539721 Google Scholar Morrow, G., Swire-Thompson, B., Polny, J. M., Kopec, M., & Wihbey, J. P. (2022). The emerging science of content labeling: Contextualizing social media content moderation. Journal of the Association for Information Science and Technology, 73, 1365–1386. https://doi.org/10.1002/asi.24637 10.1002/asi.24637 Web of Science®Google Scholar Nicholas, G. (2022, April 28). Shadowbanning is big tech's big problem. The Atlantic. https://www.theatlantic.com/technology/archive/2022/04/social-media-shadowbans-tiktok-twitter/629702/ Google Scholar Osmundsen, M., Bor, A., Vahlstrup, P. B., Bechmann, A., & Petersen, M. B. (2021). Partisan polarization is the primary psychological motivation behind political fake news sharing on Twitter. American Political Science Review, 115(3), 999–1015. https://doi.org/10.1017/S0003055421000290 10.1017/S0003055421000290 Web of Science®Google Scholar Pappas, V., & Chikumbu, K. (2020, June 1). A message to our Black community. TikTok. https://newsroom.tiktok.com/en-us/a-message-to-our-black-community Google Scholar Poell, T. (2014). Social media activism and state censorship. In D. Trottier & C. Fuchs (Eds.), Social media, politics and the state: Protests, revolutions, riots, crime and policing in the age of Facebook, Twitter and YouTube (pp. 189–206). Routledge. Google Scholar Polglase, K., & Mezzofiore, G. (2022, December 19). Iran's government accesses the social media accounts of those it detains. Tech companies appear ill-equipped to stop it. CNN Business. https://www.cnn.com/2022/12/19/business/iran-social-media-accounts-intl-cmd/index.html Google Scholar Rauchberg, J. S. (2022). #Shadowbanned: Queer, trans, and disabled creator responses to algorithmic oppression on TikTok. In P. Pain (Ed.), LGBTQ digital cultures: A global perspective (pp. 196–209). Routledge. https://doi.org/10.4324/9781003196457-15 10.4324/9781003196457-15 Google Scholar Roy, E. (2017). Social media, censorship and scrutinization in the United States and India [Doctoral dissertation, Ohio University]. ProQuest. Google Scholar Ryan, M., & Stahl, B. C. (2020). Artificial intelligence ethics guidelines for developers and users: Clarifying their content and normative implications. Journal of Information, Communication and Ethics in Society, 19, 61–86. https://doi.org/10.1108/JICES-12-2019-0138 10.1108/JICES-12-2019-0138 Google Scholar Sandoval-Almazan, R., & Ramon Gil-Garcia, J. (2014). Towards cyberactivism 2.0? Understanding the use of social media and other information technologies for political activism and social movements. Government Information Quarterly, 31(3), 365–378. https://doi.org/10.1016/j.giq.2013.10.016 10.1016/j.giq.2013.10.016 Web of Science®Google Scholar Silverman, C. (2020, June 19). Black Lives Matter activists say they're being silenced by Facebook. BuzzFeed News. https://www.buzzfeednews.com/article/craigsilverman/facebook-silencing-black-lives-matter-activists Google Scholar Sinnreich, A. (2018). Four crises in algorithmic governance. Annual Review of Law and Ethics, 19, 473–533. Google Scholar Smith, S., Haimson, O. L., Fitzsimmons, C., & Echarte Brown, N. (2021, September 27). Censorship of marginalized communities on Instagram. https://www.saltyworld.net/wp-content/uploads/woocommerce_uploads/2021/09/Salty-AlgorithmicBiasReport2021_FINAL-ehe6xj.pdf Google Scholar Tai, Y., & Fu, K. (2020). Specificity, conflict, and focal point: A systematic investigation into social media censorship in China. Journal of Communication, 70, 842–867. https://doi.org/10.1093/joc/jqaa032 10.1093/joc/jqaa032 Web of Science®Google Scholar Tilly, C., Castañeda, E., & Wood, L. J. (2019). Social movements, 1768–2018. Routledge. 10.4324/9780429297632 Google Scholar Twitter Help Center. (2023). Our range of enforcement guidelines. Twitter. https://help.twitter.com/en/rules-and-policies/enforcement-options Google Scholar Vengattil, M., & Culliford, E. (2022, March 10). EXCLUSIVE—Facebook and Instagram to temporarily allow calls for violence against Russians. Reuters. https://www.reuters.com/article/ukraine-crisis-meta-platforms-idCNL3N2VD40U Google Scholar West, S. M. (2018). Censored, suspended, shadowbanned: User interpretations of content moderation on social media platforms. New Media & Society, 20(11), 4366–4383. https://doi.org/10.1177/1461444818773059 10.1177/1461444818773059 Web of Science®Google Scholar Citing Literature Early ViewOnline Version of Record before inclusion in an issue ReferencesRelatedInformation