DOI: 10.7910/dvn/iayjoc
title: Census-block-level-TSGI

description: &lt;p&gt; Harvard CGA Geotweet Census Archive is a subset of &lt;a href="https://doi.org/10.7910/DVN/3NCMB6"&gt; Harvard CGA Geotweet Archive v2.0 &lt;/a&gt; enriched with nationwide census data. It contains the tweet and user identification records along with census variables and sentiment scores for more than 2 billion geo-tagged tweets from January 2012 to July 2023. The sentiment scores are derived from the BERT sentiment scores from the &lt;a href=https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/X2KJPC&gt;Harvard CGA Geotweet Sentiment Archive&lt;/a&gt;. This dataset is available to the academic community at large, unlike the &lt;a href="https://doi.org/10.7910/DVN/3NCMB6"&gt;Harvard CGA Geotweet Archive v2.0 &lt;/a&gt; which is under &lt;a href="https://developer.twitter.com/en/developer-terms/agreement-and-policy"&gt;Twitter's redistribution policy&lt;/a&gt; restriction for public sharing. It could serve as cross-validation data for publications that used data from &lt;a href="https://doi.org/10.7910/DVN/3NCMB6"&gt;Harvard CGA Geotweet Archive v2.0 &lt;/a&gt;. 

&lt;p&gt;If you are interested in accessing this archive, please fill out our &lt;a href="https://gis.harvard.edu/geotweet-request-form"&gt;Geotweet Request Form&lt;/a&gt;. Before requesting or receiving Tweet IDs, requestors must agree to &lt;a href="https://twitter.com/en/tos"&gt;Twitter's Terms of Service&lt;/a&gt;, &lt;a href="https://twitter.com/en/privacy"&gt;Twitter's Privacy Policy&lt;/a&gt;, and &lt;a href="https://developer.twitter.com/en/developer-terms/policy"&gt; Twitter's Developer Policy &lt;/a&gt;. Geotweets IDs data provided by CGA can only be used for not-for-profit research and academic purposes. Recipients may not share CGA provided Tweet IDs or content derived from them without written permission from the CGA.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Citations:&lt;/strong&gt;&lt;/p&gt;
&lt;p&gt;If you use the Geotweet Archive in your research please reference it: "&lt;a href="https://doi.org/10.7910/DVN/KTRIJP"&gt;Harvard CGA Geotweet IDs Archive&lt;/a&gt;".&lt;/p&gt;

========================================================
&lt;p&gt;Schema of Geotweet Census Archive&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Field name____TYPE____Description&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;day&lt;/strong&gt;----TEXT----The date of the tweet (YYYY-MM-DD)&lt;/p&gt; 

&lt;p&gt;&lt;strong&gt;GEOID20&lt;/strong&gt;----TEXT----Census block geoid&lt;/p&gt; 

&lt;p&gt;&lt;strong&gt;tweet_count&lt;/strong&gt;----INTEGER----Number of tweets in the census block&lt;/p&gt; 

&lt;p&gt;&lt;strong&gt;user_count&lt;/strong&gt;----INTEGER----Number of unique users in the census block&lt;/p&gt; 

&lt;p&gt;&lt;strong&gt;avg_score&lt;/strong&gt;----FLOAT----The average tweet sentiment score in the census block&lt;/p&gt; 

&lt;p&gt;&lt;strong&gt;max_score&lt;/strong&gt;----FLOAT----The maximum tweet sentiment score in the census block&lt;/p&gt; 

&lt;p&gt;&lt;strong&gt;min_score&lt;/strong&gt;----FLOAT----The minimum tweet sentiment score in the census block&lt;/p&gt; 

&lt;p&gt;&lt;strong&gt;std_score&lt;/strong&gt;----FLOAT----The standard deviation of tweet sentiment scores in the census block&lt;/p&gt; 

&lt;p&gt;&lt;strong&gt;score_10q&lt;/strong&gt;----FLOAT----The 10th quantile tweet sentiment score in the census block&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;score_25q&lt;/strong&gt;----FLOAT----The 25th quantile tweet sentiment score in the census block&lt;/p&gt; 

&lt;p&gt;&lt;strong&gt;score_50q&lt;/strong&gt;----FLOAT----The 50th quantile (median) tweet sentiment score in the census block&lt;/p&gt; 

&lt;p&gt;&lt;strong&gt;score_75q&lt;/strong&gt;----FLOAT----The 75th quantile tweet sentiment score in the census block&lt;/p&gt; 

&lt;p&gt;&lt;strong&gt;score_90q&lt;/strong&gt;----FLOAT----The 90th quantile tweet sentiment score in the census block&lt;/p&gt;