10 May 2015

Ethnographic study on use of metrics in newsrooms

Be the first to share
Media
Business
Services
Social Issues

The Traffic Factories: Metrics at Chartbeat, Gawker Media, and The New York Times
A report by Caitlin Petre
Tow Center for Digital Journalism
Graduate School of Journalism at Columbia University

Audience metrics have become ubiquitous in news organizations, but there has been little empirical research on how the data is produced or how it affects newsroom culture and journalists daily work. The Tow Center sought to understand how the use of metrics changes reporters behavior and what this means for journalism. Thus, researcher Caitlin Petre conducted ethnographic analysis of the role of metrics in journalism, focusing on three case studies: Chartbeat, a dominant metrics vendor; Gawker Media, a newsroom intently focused on metrics; and The New York Times, a legacy news outlet where currently metrics were more peripheral. Petre offers the following key points based on her findings. The full report is online here, and available as a pdf and ebook downloads here.

  • Metrics exert a powerful influence over journalists’ emotions and morale.
    Metrics inspire a range of strong feelings in journalists, such as excitement, anxiety, self-doubt, triumph, competition, and demoralization. When devising internal policies for the use of metrics, newsroom managers should consider the potential effects of traffic data not only on editorial content, but also on editorial workers.
  • Traffic-based rankings can drown out other forms of evaluation.
    It is not uncommon for journalists to become fixated on metrics that rank them or their stories, even if these are not the sole criteria by which they are evaluated. Once rankings have a prominent place on a newsroom wall or website, it can be difficult to limit their influence.
  • News organizations can benefit from big-picture, strategic thinking about analytics.
    Most journalists are too busy with their daily assignments to think extensively or abstractly about the role of metrics in their organization, or which metrics best complement their journalistic goals. As a result, they tend to consult, interpret, and use metrics in an ad hoc way. But this data is simply too powerful to implement on the fly. Newsrooms should create opportunities—whether internally or by partnering with outside researchers—for reflective, deliberate thinking removed from daily production pressures about how best to use analytics.
  • When a news organization is choosing an analytics service, it should consider the business model and the values of the vendor.
    We have a tendency to see numbers — and, by extension, analytics dashboards — as authoritative and dispassionate reflections of the empirical world. When selecting an analytics service, how- ever, its important to remember that analytics companies have their own business imperatives. Newsroom managers should consider which analytics companies values, branding strategy, and strategic objectives best align with their own goals.
  • Not everything can — or should — be counted.
    Efforts to improve audience analytics and to measure the impact of news are important and worthwhile. But newsroom, analytics companies, funders, and media researchers might consider how some of journalisms most compelling and indispensable traits, such as its social mission, are not easily measured. At a time when data analytics are increasingly valorized, we must take care not to equate what is quantifiable with what is valuable.

Be the first to share
5 April 2019
The story of Spotify personas
Spotify's product designer Mady Torres de Souza and senior user researchers Olga Hörding and Sohit Karol explain how they developed their personas tool, how they use it today and why it’s so useful for an …
4 April 2019
When ethnography becomes a joke
For a number of years, we have witnessed a diminishing appetite for ethnographic work among commercial clients, writes Patricia Sunderland, PhD and founder of Cultural Research and Analysis, on the site of the Qualitative Research …
4 April 2019
Old, online, and fed on lies: How an aging population will reshape the internet
Although many older Americans have, like the rest of us, embraced the tools and playthings of the technology industry, a growing body of research shows they have disproportionately fallen prey to the dangers of internet …
11 January 2019
[Book] Left to Our Own Devices
Left to Our Own Devices: Outsmarting Smart Technology to Reclaim Our Relationships, Health, and Focus Margaret E. Morris MIT Press, 2018 192 pages Unexpected ways that individuals adapt technology to reclaim what matters to them, from working through conflict …
22 December 2018
Intel anthropologist Dawn Nafus interview on the use of data and technology in medical contexts
In an age where we can collect and store (forEVER) every second of every day, how much do we truly need… to learn? To react? To do good deeds that benefit society? Assuming we champion that, …
20 November 2018
Journal of Business Anthropology devoted to design anthropology
The Journal of Business Anthropology is an Open Access journal which publishes the results of anthropological research in business organizations and business situations of all kinds. The theme of the latest issue - Vol 7, …
17 November 2018
[Book] Uberland: How Algorithms Are Rewriting The Rules Of Work
Uberland: How Algorithms Are Rewriting The Rules Of Work by Alex Rosenblat University of California Press October 2018, 296 pages Silicon Valley technology is transforming the way we work, and Uber is leading the charge. An American startup that …
2 November 2018
[Book] Ethnographic study of a Swiss bank’s financial analysts
Stories of Capitalism: Inside the role of financial analysts Stefan Leins University of Chicago Press 2018, 224 pages The financial crisis and the recession that followed caught many people off guard, including experts in the financial sector whose jobs …

We are an international experience design consultancy helping companies and organisations to innovate their products, services and processes by putting people and their experiences first.

5 July 2019
Experientia on addressing vaccine hesitancy

Vaccine hesitancy is a top10 global health threat. Dealing with it successfully requires understanding it as a behaviour and generating a holistic view of people’s perspectives & ecosystems. This way we can identify the best opportunities for intervention. Here is Experientia’s position on vaccine hesitancy and our tailor-made support for the vaccine industry.

2 May 2019
MacArthur Foundation’s “100&Change” competition now calling for applications

100&Change is a MacArthur Foundation competition for a $100 million grant to fund a single proposal that will make measurable progress toward solving a significant problem. 100&Change will select a bold proposal that promises real progress toward solving a critical problem of our time. And it will award a $100 million grant to help make […]

19 March 2019
Interested in a career with us?

Then we are interested in hearing from you. We have several positions available for talented UX/UI and service designers who are passionate about creating world-class user experiences. Please see the job descriptions on our website for more information, and send us your CV with a cover letter statement about yourself, your experience, and what UX […]

22 December 2018
Our very best wishes for 2019! / Auguri da Experientia!
4 October 2018
Bringing​ ​patients into focus at the Roche Innovation Summit

Experientia is proud to have been a key participant at the Roche Innovation Summit, held at Roche headquarters in Basel Switzerland on 19 June 2018. Themed “​Transforming the Healthcare Experience Together​”, the summit aimed to galvanize the Roche community around the future transformation of healthcare and diagnostics. With 800 attendees from Roche and Genentech global […]

13 June 2018
Invito: DesAlps design thinking workshop per la tua startup

Hai una startup? Hai mai pensato ai benefici che potrebbe trarre dal Design Thinking? Questa è l’opportunità per scoprirlo! DesAlps Workshop #2: Il Design Thinking per la tua startup! Giovedì 28 giugno 2018 – dalle 9:30 alle 17:00 @ I3P | Corso Castelfidardo 30/a, Torino —– Nell’ambito del progetto europeo DesAlps, un team di esperti […]

See all articles