Collection 20: U.S. Top Newspapers, 2000-2018 (sample of all articles)
Creators: name: WhatEvery1Says (WE1S) Project
Publisher: name: Zenodo
Year: 2019
Subjects: subject: Humanities
subject: FOS: Humanities
subject: Journalism

description: A collection of word-frequency and other data representing 29,183 unique articles (no duplicates or close variants) published during 2000-2018 in 15 top U.S. newspapers and their associated online blogs. WE1S and other researchers use this data to look for broad patterns and help guide closer study. Collection 20 contains data representing all 15,692 articles from its set of sources in these years mentioning "humanities" and a sample of the 641,617 articles on everything else from those same sources and years ("random" documents found through searching on common English words). It downsamples these "random" articles (while maintaining the proportions of articles from particular sources and years) to achieve a 50/50 balance of articles from each category. The purpose is to allow media discourse on the humanities to be studied alongside "everything else" and not be buried so far down in the statistical pile that it cannot easily be seen in detail. Collection 20 is thus not a representation of the relative weight of discussion of the humanities in media discourse in general but instead an aid to studying the fine features and structures of each. News sources in Collection 20 include: <em>Boston Globe</em>, <em>Chicago Tribune</em>, <em>Daily News</em> (New York), <em>Dallas Morning News</em>, <em>Denver Post</em>, <em>Houston Chronicle</em>, <em>Los Angeles Times</em>, <em>New York Post</em>, <em>New York Times</em> (and its blogs), <em>Newsday</em> (New York), <em>Seattle Times</em>, <em>Star Tribune</em> (Minneapolis, MN), <em>Tampa Bay Times</em>, <em>USA Today</em>, <em>Washington Post</em>. <strong>Kinds of Sources (by Tags)</strong> Sources in Collection 20 are associated with the following non-exclusive metadata categories, which describe the kinds of sources in the collection. Of the 29,183 documents in the collection: all are top-circulating newspapers; 15,150 are from publications located in the North East; 5,037 are from publications located in the Midwest; 3,857 are from publications located in the South; 3,481 are from publications located on the West Coast; 965 are from publications located in the Rocky Mountain region or the Southwest; and 693 are categorized as multiregional or as having national reach. Sources are assigned to categories based solely on explicit publication information and/or self-identification. <strong>Collection Metadata</strong> Created by: Lindsay Thomas Created on: June 20th 2019, 12:00:00 am WE1S Collection Registry ID: 20190703_2140_us-humanities-comparison-top-newspapers Data sources: LexisNexis (via LN Web Services Kit), ProQuest, and direct scraping from the Web. <strong>Suggested Citation for Collection</strong> WE1S Project, Collection 20: U.S. Top Newspapers, 2000-2018 (sample of all articles), 2019, doi: DOI: 10.5281/zenodo.4927419.
description: WE1S makes available only "non-consumptive use" word frequency, topic model, and other datasets along with their visualizations. Datasets cannot be used to access, read, or reconstruct the original texts. <em>(See WE1S Research Materials Overview for the relation between the project's "datasets" and "collections.")</em>