Exploratory Analysis of COVID -19 Related Tweets in N orth A merica to Inform Public Health Institutes (2020)

Abstract: Social media is a rich source where we can learn about people’s reactions to social issues. As COVID-19 has significantly impacted on people’s lives, it is essential to capture how people react to public health interventions and understand their concerns. In this paper, we aim to investigate people’s reactions and concerns about COVID-19 in North America, especially focusing on Canada. We analyze COVID-19 related tweets using topic modeling and aspect-based sentiment analysis, and interpret the results with public health experts. We compare timeline of topics discussed with timing of implementation of public health interventions for COVID-19. We also examine people’s sentiment about COVID-19 related issues. We discuss how the results can be helpful for public health agencies when designing a policy for new interventions. Our work shows how Natural Language Processing (NLP) techniques could be applied to public health questions with domain expert involvement.

## introduction globally, more than 10 million people have been diagnosed with covid-19 infection and 500,000 people have died as of june 29, 2020. since there is no vaccine or effective treatment, governments across the world implemented wide-ranging nonpharmaceutical interventions such as hand hygiene, face masks, contact tracing, isolation and quarantine, and physical (social) distancing through banning mass gatherings and lockdowns to reduce the transmission of sars-cov-2. similar to previous infectious disease outbreaks such as ebola, people are using social media to share news, information, opinions and emotions. thus, social media is an important source to learn about people's reactions and concerns, and this information can be beneficial for public health institutes when designing interventions. understanding both people's reactions to covid-19 and where their concerns lie helps to tailor public health strategy and ultimately create better informed interventions. in this paper, we investigate twitter user's reactions to covid-19 in north america, especially focusing on canada. we analyze covid-19 related tweets using topic modeling and aspect-based sentiment analysis (absa) using human-in-theloop, and interpret the results with public health experts. we first discover topics in covid-19 related tweets using a widely used topic modeling approach, latent dirichlet allocation (lda) @xcite . to assess changes in topics of discussion over time, we compare timelines of topic distributions and timing of implementation of public health interventions for covid-19. furthermore, we examine the sentiment of tweets about covid-19 related aspects such as social distancing and masks, by using absa based on domain specific aspect and opinion terms. we also discuss how the results can inform public health interventions. our work shows how natural language processing (nlp) techniques could be applied to public health questions with domain expert involvement. ## related work topic modeling and sentiment analysis have been widely used to identify issues and people's opinions in public health. in this paper, we will only introduce a few examples relevant to covid-19. @xcite applied topic modeling to identify patterns of media-directed health communications and discuss the role of the media during the covid-19 pandemic in china. @xcite also identified topics related to covid-19 on tweets posted by u.s. governors and presidential cabinet members. @xcite used topic modeling and sentiment analysis to provide topic and trend analysis as # representative words interpretation t1 social, distancing, outside, park, walk, quarantinelife, stayhome social and physical distancing, including spending time outside during quarantine. t2 china, travel, canada, russia, flights, trade, border air travel and regional border restrictions/outbreaks. hand washing and what people can do to prevent covid-19. t4 home, stay, safe, work, sick, family, essential the need to stay home and the impact of covid-19 on essential workers and family. t5 positive, testing, tested, cases, patients, hospital, data this topic focuses on data, particularly number of tests and cases. t6 masks, wear, face, hand, sanitizer, gloves, surgical things we can do to prevent covid-19, e.g., masks and face coverings. our work is distinct from other efforts in that public health experts are actively involved in the process, with the specific goal of informing public health interventions. our results are interpreted by these public health experts, and we use a human-inthe-loop absa approach to obtain domain specific aspect and opinion terms. ## data we use a public twitter dataset about the covid-19 pandemic, collected by @xcite using numerous covid-19 related keywords such as "coronavirus", "covid-19" and "pandemic". the data collection started on january 28, 2020, and is still ongoing, which has published over 123 million tweets. for our work, we select tweets from january to may, whose location is canada and united states (us). foot_0 among the 372,711 tweets in total (canada: 30,235, us: 342,476), we only include tweets written in english using tweet metadata and the spacy-langdetect toolkit foot_1 . this process resulted in 319,524 tweets in total, 25,595 for canada, and 293,929 for us. to remove tweet specific keywords and urls, we use the tweet-preprocessor toolkit foot_2 . we do not remove hashtags and mentions because they can be informative for our work. we lowercase, tokenize using the spacy toolkit @xcite . since the methods we use in this paper are all unsupervised, we do not split the data for 4 what do twitter users discuss about covid-19? to discover topics and track the topic change over time, we construct topic models on our twitter data using lda foot_3 implement in the scikit-learn package @xcite . we choose a model with 20 topics among 5, 10, 20, and 50 because 20 topics showed diverse and less redundant topics when manually examined. the discovered topics are highly related to public health promotions and interventions, such as physical distancing, border restrictions, hand washing, staying-home, and face coverings, as shown in the most prevalent topics in canada and us show differences, as shown in initial outbreak in wuhan. the need to stay home and the impact of covid-19 on essential workers and family. first, we can observe that the patterns in the us tweets and canadian tweets are very similar. although there are slight differences, the overall increase and decrease patterns are almost identical. for example, the topic about air travel and regional border restrictions (t2) shows a peak in february and drastically decreases. second, we can see that the topic trend is highly related to public health interventions. for example, the topic about social distancing (t1) starts to increase in early march after covid-19 became an issue in seattle, us, at the end of february. hand washing (t3) also started to be emphasized then. the topic about the need to stay home (t4) starts to increase around the end of march. in canada, the federal quarantine order was issued on march 24, and in the us, many states issued stay-at-home orders around that time as well. discussion about the number of tests and cases (t5) gradually increases. interestingly, the topic about masks and face coverings (t6) slightly decreases from march this is possibly because public health institutes in both countries announced their position about masks around that time. understanding people's reactions to the covid-19 pandemic is important to public health agencies because it informs how public health agencies should frame their health messaging. to capture sentiment revealed in tweets towards important aspects of covid-19, we use absa. in our work, aspects can include public health interventions or issues associated with covid-19 such as "socialdistancing", "reopening", and "masks". we investigate people's opinion (positive/negative) towards these aspects. we use absapp, a weakly-supervised absa system @xcite . we choose absapp because it does not require labeled data for training, and allows manually editing domain-specific aspect and opinion lexicons produced by the method. this feature is particularly beneficial for us because we can select/add aspects public health agencies are interested in. after training the tweet data using absapp, we obtained 806 aspect terms and 211 opinion terms. editing the lexicons by public health experts resulted in 545 aspect terms (e.g., "vaccines", "economy", and "masks") and 60 domain specific opinion terms (e.g., "infectious"-negative, and "professional"-positive). then, these manually edited terms were used for inference of sentiments. the results of selected aspects are shown in figure 2 . we observe that the sentiment about the coronavirus outbreak itself is dominantly negative. with this, the twitter users' reactions to preparedness and misinformation appear to be more negative than being positive, suggesting the frustration about the current situation and misinformation. the mixed sentiment about masks might reflect the conflicting situation around mask usage. the negative sentiment towards asians found may imply the anti-asian social phenomenon escalated due to covid-19. figure 2 : aspect-based sentiment analysis results for selected aspects. the ratio between # of positive occurrences and # of negative occurrences. ## discussion the topics identified demonstrate twitter users' focus on discussing and reacting to public health interventions. this kind of information helps public health agencies to understand public concerns as well as what public health messages are resonating in our populations who use twitter. for example, public health agencies in north america have focused their messaging around encouraging hand hygiene, limiting physical contact when sick and staying home to prevent infection. we can see this messaging echoing in the topics around hand washing, staying home, mask-wearing and social/physical distancing. the change over time in the age topic shows an area for improving our public messaging. early public health data showed a strong correlation between age and severe covid-19 outcomes @xcite . however, we now know that sars-cov-2 transmission does not show the same correlation (ontario agency for health protection and promotion, 2020). a renewed focus on messaging to highlight this difference would likely benefit our public health response. absa has the potential to track stigma related to covid-19. our communities of asian ethnicity have experienced unprecedented stigma and discrimination due to covid-19. if we can understand the nature and change in stigma over time, we can develop counter-acting messages and measures. ## conclusion in this paper we presented the exploratory results of topic modeling and absa on covid-19 related tweets in north america. we compared topic modeling results of canada and the us, and also showed public health intervention related topic changes over time. in addition, our human-inthe-loop aspect-based sentiment analysis showed twitter user's reactions about covid-19 related aspects, which can be beneficial for public health policy makers. the limitation of this work is that we used only a small set of twitter data because tweets with the location information were limited compared to the whole data set. however, this study is still useful for public health interventions and messaging. for future work, we will analyze our results with other types of public health data such as patient statistics for different regions or mobility information.