News at its most direct: What’s missing from the notifications experience?
By: Madeline Welsh
Tags: Journalism, Mobile, Notifications, Web Notifications

As part of the Guardian US Mobile Innovation Lab’s research into notifications, one of our main areas of focus, I sampled all the notifications that came in over the course of a three day period, between April 12 and 14, from seven news apps. (I know. So much buzzing. I did it to myself.) It’s a sampling that is not meant to be comprehensive. Clearly there are other news organizations that could fit in this group, but it’s a mix of large-scale general news providers and those who have used apps to stand out. So with the Guardian, New York Times, BBC News, Washington Post, Quartz, USA Today and Buzzfeed News’s apps downloaded to my iPhone, I turned on the standard permissions for each and settled in for whatever the week would bring.

The goal of this was to get a baseline sample of the types, tone, and frequency of notifications that news organizations send. Over the course of the three days, I received 49 notifications from these apps, and came away with some observations about the way news organizations are using notifications, and ideas for questions they could be asking themselves in the quest to make notifications better.

Let’s start with the parameters: I couldn’t have predicted what the news cycle would look like during those three days, save for knowing what events would not happen. There was no primary election, for example, and no major American sports or cultural event.

So what did happen? During those three days, a report found that endemic racism had contributed to failings by the Chicago Police Department, Zika virus was confirmed to cause microcephaly, there was a democratic debate, and Kobe Bryant played his last game. While these were all notable news events individually, the three days ended up being fairly ordinary in the life cycle of the news.

All this to say: If this sampling had occurred on different days, particularly those on which there was a breaking news event, it is likely that the overall number of notifications received would have increased, and possible that some of the other observations about tone, utility, whether a notification was time-sensitive or not, might have seemed more or less significant. (I actually repeated this experiment on a primary day and got 51 notifications in a single day.)

From the information we collected, some patterns emerged:

News organizations use notifications in two main ways: to tell you what the news is, as fast as possible, or to let you know about stories they think you should see. In the case of some organizations, like Quartz, the emphasis is squarely on the latter. A few of the more traditional news organizations, like the Guardian or The New York Times, send a mix of notifications that lead to features, as well as to breaking news. Some, like the BBC, which didn’t send a single notification during our sampling period, seem more conservative, and reserve notifications solely as a means of getting urgent information out.

If you’re sending fewer than six notifications a day, don’t worry, that’s normal. Six notifications in a day seems to be the limit (if one does exist) to the number of notifications a news organization will send in one day to users who have not customized the app to receive more specific notifications. Quartz sends that many routinely, while most other organizations sent out one or two per day on days without breaking news.

Notifications aren’t visual. News organizations looking to add informality and mirth are moving to emoji, which we saw from certain Buzzfeed News notifications, and, in the case of Quartz, also haiku. None of organizations of those sampled are experimenting with visuals beyond emoji which, admittedly is down to technical and bandwith limitations more than newsroom choice. Still though, as notifications editorially and technically progress, newsrooms should not dismiss thinking beyond the text alone.

Buzzfeed uses emoji in some notifications, often cultural news, but stays away from them in breaking news

Tone-wise, some are trying to spark conversation. During our three-day sample, only one news organization, The New York Times, experimented with asking a question of readers, and did so only once as a way of highlighting a live blog. (Can Sanders fight outside his comfort zone? Can Clinton excite the base? Here’s our live analysis of tonight’s debate.) Other newsrooms have tried this as well (though not during our sampling). It brings up an interesting question: What room is there for conversation, or even user replies in notifications?

Here’s a different example of the New York Times asking a question via notification.

An example from the Guardian on the night of the New York primary

Descriptive notifications are in … Beyond directly asking questions, some organizations are experimenting with a more descriptive headline a, “Here’s what happened, and here’s why you should care,” format, in contrast to the one-sentence “this happened” headline which gives the facts but lacks any context. The contextualized notifications are generally limited in length to two sentences, or three lines of text. For example, USA Today offered this sparse headline style notification: “CDC: Evidence definitively shows Zika causes birth defects” while Buzzfeed News offered more explanation with “Scientists say Zika causes microcephaly officially confirming the link between the virus and severe birth defects.”

There’s also been a shift towards notifications that tease rather than tell you the main idea in the notification itself. Quartz does this with many of its notification which entice the user to open the app by giving a hint of what they might see without the full news. For example:

Quartz’s notifications tell you what is in the app, but don’t give away the whole story

… But sequential notifications are not. No news organizations offered more than one update on the same story. This is good from a “don’t annoy the user” standpoint, but could also be a missed opportunity. For example: What would a story told through just notifications look like? Would a certain group of users like that if given the option?

The frequency of notifications has a lot to do with the basic notifications settings, which vary widely between apps. In order to best compare the number of notifications received as well as the standard tone, we tried to leave in place the basic settings that the user, upon first opening each app, is prompted by the iOS system dialogue box to accept or reject. (On Android, the user is automatically opted in, with the assumption that they will opt out if they desire.) In all of the apps there was an opportunity to opt out of notifications entirely, or instead, to further opt in to more alerts.

The difference boils down to apps that offer some level of customization, and those that basically ask “notifications: yes or no?”

BBC News and the Washington Post’s apps offer only this one tier of alerts, which the user can opt into of the first time they open the app. In each of these apps, users can customize their in-app viewing experience down to what stories they see and in what order, but this does not extend to customizing or increasing what notifications they receive.

The Guardian also only offers Breaking News alerts without other pre-set categories. Users can also opt to follow stories or authors. The app then sends automated messages when the latest by a selection is published.

USA Today automatically opts the user into Breaking News alerts, but upon opening the app the second time, asks if the user would like to subscribe to more alerts (News, Sports, Life, Money, or Tech).

Buzzfeed News too, offers opportunities to subscribe to more alerts from a preset list including LGBT news, UK News, and other topics.

At The New York Times, the NYTNow app opts the user into Breaking News alerts while the main New York Times app automatically opts the user into “Top Stories” alerts, and gives Business & Tech, New York, Politics, and Sports as additional options.

Quartz automatically opts the user into all of their four varieties of notifications: “really really big news, important and interesting, the daily haiku, and news updates.”

News organizations offer a variety of other ways to interact with notifications. Did you know there are more things you can do with a notification beyond just swipe to dismiss or swipe to view? News organizations have a variety of ways they offer users to interact with the notifications they receive. The Guardian prompts the user to share or save (by opening to the article in app and then also opening the native sharing screen from the bottom of the mobile screen); Buzzfeed News lets you tweet or text (the latter by bringing up the headline and URL in the message bubble — leaving you, the user, only the question of to whom to send it); USA Today gives the option to view article or save article within the app; Quartz seemingly offers a choice: press X, or press a thematically relevant emoji. Disappointingly (maybe just to me though?) pressing the emoji also just dismisses the story.