29 September 2013

The problem with big data correlations

Be the first to share
Media
Business
Services
Social Issues

“The people using big data don’t presume to peer deeply into people’s souls,” argues David Brooks in the New York Times (in an April 2013 column). “They don’t try to explain why people are doing things. They just want to observe what they are doing.”

“The theory of big data is to have no theory, at least about human nature. You just gather huge amounts of information, observe the patterns and estimate probabilities about how people will act in the future. [In other words,] this movement asks us to move from causation to correlation.”

While this approach has yielded some impressive results, he says, one should be also aware of its limits and goes on to list four of them:

  • The challenge of discerning meaningful correlations from meaningless ones
  • People are discontinuous and the passing of time can produce gigantic and unpredictable changes in taste and behavior
  • The world is error-prone and dynamic
  • The distinction between commodity decisions and flourishing decisions

Interesting too, his conclusion: “My worries mostly concentrate on the cultural impact of the big data vogue. If you adopt a mind-set that replaces the narrative with the empirical, you have problems thinking about personal responsibility and morality, which are based on causation. You wind up with a demoralized society.”

Be the first to share
5 April 2019
The story of Spotify personas
Spotify's product designer Mady Torres de Souza and senior user researchers Olga Hörding and Sohit Karol explain how they developed their personas tool, how they use it today and why it’s so useful for an …
31 March 2019
Research findings send automated sentiment analysis to the trash bin
The age of social media has opened up exciting opportunities for researchers to investigate people’s emotional states on a massive scale. For example, one study found that tweets contain more positive emotional words in the …
24 February 2019
Ten arguments against algorithmic decision making
Against the Dehumanisation of Decision-Making – Algorithmic Decisions at the Crossroads of Intellectual Property, Data Protection, and Freedom of Information by Dr Guido Noto La Diega, Senior Lecturer in Law at the Northumbria University Law School Published …
16 February 2019
[Book] The Next Billion Users: Digital Life Beyond the West
The Next Billion Users: Digital Life Beyond the West by Payal Arora Harvard University Press, 2019 280 pages A digital anthropologist examines the online lives of millions of people in China, India, Brazil, and across the Middle East—home to …
13 February 2019
Papers on behaviour, design and the circular economy
Consumer insights into the circular economy Report of stakeholder meeting, 25 October 2018, 14 pages The "Stakeholder Meeting: Consumer Insights into the Circular Economy" in Brussels on 25 October 2018, was co-organised by the Collaborating Centre on …
11 January 2019
[Book] Left to Our Own Devices
Left to Our Own Devices: Outsmarting Smart Technology to Reclaim Our Relationships, Health, and Focus Margaret E. Morris MIT Press, 2018 192 pages Unexpected ways that individuals adapt technology to reclaim what matters to them, from working through conflict …
1 January 2019
Daniel Kahneman on cutting through the noise
You might be surprised by what occupies Daniel Kahneman’s thoughts. “You seem to think that I think of bias all the time,” he tells esteemed economist Tyler Cowen. “I really don’t think of bias that …
22 December 2018
Intel anthropologist Dawn Nafus interview on the use of data and technology in medical contexts
In an age where we can collect and store (forEVER) every second of every day, how much do we truly need… to learn? To react? To do good deeds that benefit society? Assuming we champion that, …

We are an international experience design consultancy helping companies and organisations to innovate their products, services and processes by putting people and their experiences first.

19 March 2019
Interested in a career with us?

Then we are interested in hearing from you. We have several positions available for talented UX/UI and service designers who are passionate about creating world-class user experiences. Please see the job descriptions on our website for more information, and send us your CV with a cover letter statement about yourself, your experience, and what UX […]

22 December 2018
Our very best wishes for 2019! / Auguri da Experientia!
4 October 2018
Bringing​ ​patients into focus at the Roche Innovation Summit

Experientia is proud to have been a key participant at the Roche Innovation Summit, held at Roche headquarters in Basel Switzerland on 19 June 2018. Themed “​Transforming the Healthcare Experience Together​”, the summit aimed to galvanize the Roche community around the future transformation of healthcare and diagnostics. With 800 attendees from Roche and Genentech global […]

13 June 2018
Invito: DesAlps design thinking workshop per la tua startup

Hai una startup? Hai mai pensato ai benefici che potrebbe trarre dal Design Thinking? Questa è l’opportunità per scoprirlo! DesAlps Workshop #2: Il Design Thinking per la tua startup! Giovedì 28 giugno 2018 – dalle 9:30 alle 17:00 @ I3P | Corso Castelfidardo 30/a, Torino —– Nell’ambito del progetto europeo DesAlps, un team di esperti […]

3 May 2018
Invito: DesAlps innovation workshop per le PMI del territorio piemontese

Experientia è lieta di invitare le piccole e medie imprese del territorio piemontese al: DesAlps Workshop #1: Il Design Thinking per le PMI Venerdì 18 maggio 2018 – dalle 9.00 alle 17.30 @ Rinascimenti Sociali | via Maria Vittoria 38, Torino Scopri i vantaggi che il Design Thinking può portare al tuo business per prepararvi […]

27 April 2018
Impact through Design – Event in Turin, Italy

(Scroll down for English) Come può il design generare impatto? In continuità con il summit International Days of Deans and Experts: Impact Through Design (Barcellona, aprile 2018) Torino ospita il primo evento dedicato alla prospettiva italiana sull’impatto generato attraverso il design in riferimento ai Sustainable Development Goals definiti dalle Nazioni Unite. Attori dell’ecosistema territoriale ed […]

See all articles