Delving into the state of data journalism
By: Elisabetta Tola
Tags: Data Journalism, Facta, Science, Review, Scientific Method

Delving into the state of data journalism

… while continuing to shape Facta

“Science is not only the vault of stories and data we enjoy talking and reading about, but also a frame of mind that can help journalists improve their approach to finding facts, to evaluating them, to either confirming or discarding them.” That’s the core of what I was discussing in my last post. It is also the core around which I am building Facta, an independent center for the Mediterranean region that applies the scientific method to journalism.

In the weeks of working on concepts, design, budgets and strategy here at the Tow-Knight Center for Entrepreneurial Journalism, I have also been spending lots of time thinking about and articulating why I do not feel satisfied with the state of journalism today.

I know, I know. There are tons of reasons the quality of journalism has been publicly discussed in the last few years. Don’t even try to make me write the buzzwords; I do not want to go there. I think it is clear there are serious issues both with verification and with the ability to put the news in context with high-quality content. Plus, some recent media dramas have resulted in public discussions and given more food for thought — well, at least within those groups of people who care about journalism, whether they work in the industry or they support it. Just look at “The Correspondent” or “The MarkUp” situations, where outstanding media projects have to face public scrutiny for very, very different reasons that might result in serious impact on trust, credibility and even readers’ willingness to support similar future ventures.

Let me be clear: I love journalism. And I have a deep, deep respect for all those journalists who work hard, struggle to bring facts and significant stories to their readers’ attention, keep working even when facing threats, when being mistreated or attacked by those in power, when they become object of hate campaigns, or when they risk or even lose their freedom or lives. On these issues, by the way, great recent readings include a post by Jay Rosen on his PressThink blog, the Italian writer Roberto Saviano’s wakeup call; the latest data on the World Press Freedom Index; and this commentary on Columbia Journalism Review. Therefore, I am not at all willing to be cynical. I am firmly convinced that press freedom is a fundamental value, and that journalism needs to be protected.

But it is precisely because I do love journalism that I am disappointed in many of its practices and routines. As it pertains to Facta, my disappointment rises from very specific reasons, which have to do mainly with how journalism has treated, and is treating, data and valuable information. I was a scientist for an important part of my life before moving into journalism. When I encountered data journalism in its early days, almost 10 years ago, I thought I had found the perfect combination. I could combine my scientific thinking with my journalistic skills to produce a type of journalism that was, above all, useful. But now, a few years down the road, I see that data often end up being used in a decorative way — a nice map or infographic to fill a page, lacking context and giving people little means to go deeper on the issues. To complicate things, media are often the source of a high degree of confusion of facts, hypotheses, theories and opinions, with scarce knowledge of the ways facts and information are validated.

I cannot understand the low commitment and incapability to take complex issues, analyze them with a solid methodology, and offer them to the readers or listeners or viewers in a way that allows them to use that information — to understand complicated problems and issues and come up with potential solutions. Maybe I’m naive, but that’s what I expect journalism to do: offer a high-quality information in the service of democracy; connect, bridge and contextualize.

So I looked up studies and research on the quality of data journalism, a practice that, as I said before, has become more and more widespread in the last 10 years. I started from a hypothesis based on experience and my own perception: with some exceptions, and very important ones, data journalism has generally not fulfilled its original promise to help read reality in a more truthful way. I’d be happy to take into account quite different points of view, should they be supported by evidence. In the meantime, here is what I found.

At the end of March, The Guardian published an informative piece collecting the voices of Caelainn Barr, Mona Chalabi and Nick Evershed, The Guardian’s data editors in the U.K., U.S. and Australia respectively. (By the way, I have met Barr a few times, between the International Journalism Festival in Perugia years ago and the Center for investigative reporting in London. She has an amazing track record in data journalism and is by far one of the best journalists on the task today.)

The Guardian took the opportunity to discuss the state of data journalism exactly on the 10th anniversary of the publication of its Datablog, launched in March 2009 by Simon Rogers, undisputedly one of the pioneers of data journalism, who is now data editor on the News Lab team at Google and director of the Data Journalism Award. In this 10-years-later piece, The Guardian’s data editors say a few things that clarify how data journalism is done today and what has changed with respect to its origin. “The Datablog paved the way for the data projects team but the work we do today is very different.” Barr says. “Over the past decade our approach has evolved and now we amplify the stories we find in data by collaborating with specialist reporters to put human voices at the center of our stories.”

At the beginning, data journalism was quite a trial-and-error process, with lots of inventiveness added to the craft, since it was virgin territory. Evershed says The Guardian is “the one publication that really got me interested in data journalism, as it had a very hacker-punk-DIY approach in the early days. This made me think it was the sort of thing I could do even though I’d had no training in programming or data visualisation beyond the little I’d learned studying science.”

To strengthen that notion of how punk-DIY the approach was, there is this popular post — Anyone can do it. Data journalism is the new punk — written by Simon Rogers back in 2012. It’s almost like a manifesto, and I still use it to introduce students to data journalism. But a fundamental difference compared with those early years is clearly that “in the early days there was more of an emphasis on making the data available,” Chalabi says. “We’d always create a Google spreadsheet with the numbers we had used to write the piece.”

This is not happening anymore, with a few exceptions. And I am really not happy about it, since I have been delving into those data for years and think that actually having the data is what makes data journalism useful beyond the storytelling.

Making the data available was indeed one of the first specific characteristics of data journalism when it took off in 2009, as Simon Rogers tells Letizia Gambini in this interview on the European Journalism Centre’s Medium blog. (By the way, the EJC has just launched a new website entirely devoted to data journalism, with lots of great resources for journalists.) “What if we just published this data in an open data format? No pdfs, just interesting accessible data, ready to use, by anyone. And that’s what we did with the Guardian’s Datablog … We started to realise that data could be applied to everything.”

In his words, Rogers conveys the hype for what was an almost pioneering moment, when data projects were setting the mark for a different type of journalism and great collaborations began between journalists and tech people to improve tools and practices for using the data. The Hacks/Hackers movement also took off in those years.

Rogers also gives his insight into the future. “We face a wider and increasingly alarming issue: Trust. Data analysis has always been subject to interpretation and disagreement, but good data journalism can overcome that. At a time when belief in the news and a shared set of facts are in doubt every day, data journalism can light the way for us, by bringing facts and evidence to light in an accessible way.” And I do agree that good data journalism can overcome distrust, or help in that direction.

But is good data journalism a widespread practice? Let’s see what Alberto Cairo, one of the most active and respected experts in data visualization and a tireless, enthusiastic data viz trainer, has to say about it. Back in 2014, Cairo wrote a post on Nieman Lab titled “Data journalism needs to up its own standards.” He talks about the then-recent buzz around “data” and “explanatory” journalism. “I’m talking about websites like Nate Silver’s FiveThirtyEight and Ezra Klein’s Vox.com,” he says, and also about new operations at traditional media, such as The New York Times’ The Upshot.

“There is a lot to praise in what all those ventures — and others that will appear in the future — are trying to achieve,” Cairo admits, soon adding, “But I have to confess my disappointment with the new wave of data journalism — at least for now.” And he lists good examples of why this is so: examples of cherry-picking and carelessly connecting studies to support an idea; examples of proxy variables used without careful analysis; the tendency to derive long-term linear predictions out of nonlinear phenomena; and some other flaws.