Critical analysis and comment (News Performance)
Authors: Humprecht Edda 
Published: April 2021

Field of application/theoretical foundation:
Analyses of critical analysis and comment are theoretically linked to the news performance and the watchdog function of the media (Donsbach, 1995; McQuail, 1992). This construct is related to the normative expectation that the news media should critically analyze and comment on cases of abuse of power, incompetence, failures and grievances in government institutions, non-profit organizations, or the private sector (Downie & Schudson, 2009).
References/combination with other methods of data collection:
The analysis of critical reporting and comment is complex and requires an understanding of the context and the references made by the journalist. Furthermore, it is empirically demanding to distinguish between critical reporting in the sense of the watchdog function and criticism in the sense of negativity or sensationalism (Humprecht, 2016). Due to this complexity, automated approaches have hardly been employed so far.
Example studies:
Benson (2010); Humprecht (2016)

Table 1. Study summaries

Author(s)

Sample

Unit of Analysis

Values

Reli-ability

Benson (2010)

Content type: immigration news coverage (all articles focused on broad immigration trends, policy making and politics, or individual immigrants)
Outlet/ country: 14 newspapers from two countries (FR, US)
Sampling period: 1991/1994; 2002/2004; 2006)
Sample size: N= 1088

Unit of analysis: critical statements in news articles (from sources/ journalists)
Critical statements are classified according to their target, substantive focus, and sources
Target (government; dominant left parties; dominant right parties; minor political parties; civil society organizations; business; foreign or international organizations)
Focus (administrative, character, truth, ideology, policy, and strategy)

Administrative criticism (failure (e.g., corruption, incompetence, mismanagement)
Truth criticism (e.g., evidence to demonstrate the falsity of claims)
Character criticisms (e.g., attacks on personal characteristics of powerful individuals in public life)
Policy criticism (e.g., logical coherence, feasibility, empirical justification, evidence supporting any pro- posed policy)
Ideology criticism (e.g., criticisms of fascism, racism, sexism, other worldviews)
Strategy criticisms (negative assessments of effectiveness of a particular idea/ action; normative criticisms of political strategies)

Holsti M=0.85

Humprecht (2016)

Content type: Political routine-period online news
Outlet/ country: 48 online news outlets from six countries (CH, DE, FR, IT, UK, US)
Sampling period: June – July 2012
Sample size: N= 1660

Unit of analysis: Political news items (make reference to a political actor, e.g. politician, party, institution in headline, sub?headline, in first paragraph or in an accompanying visual)

Story shows critical perspective towards authorities/power holders
Story raises probing questions at actors responsible for a problem
Story discovers new, previously unknown information about a problem of social/political relevance; story may unveil a ‘scandal’

Cohen’s kappa:
critical perspective = 0.74
probing questions = 0.67
unveiling scandals = 0.81

References
Benson, R. (2010). What Makes for a Critical Press? A Case Study of French and U.S. Immigration News Coverage. The International Journal of Press/Politics, 15(1), 3–24. https://doi.org/10.1177/1940161209349346
Donsbach, W. (1995). Lapdogs, Watchdogs and Junkyard Dogs. Media Studies Journal, Fall 1995, 17–30.
Downie, L., & Schudson, M. (2009). The Reconstruction of American Journalism.
Humprecht, E. (2016). Shaping Online News Performance. In Palgrave Macmillan. Palgrave Macmillan UK. https://doi.org/10.1007/978-1-137-56668-3
McQuail, D. (1992). Media Performance: Mass Communication and the Public Interest. Sage Publications.