29 September 2013

The problem with big data correlations

Be the first to share

“The people using big data don’t presume to peer deeply into people’s souls,” argues David Brooks in the New York Times (in an April 2013 column). “They don’t try to explain why people are doing things. They just want to observe what they are doing.”

“The theory of big data is to have no theory, at least about human nature. You just gather huge amounts of information, observe the patterns and estimate probabilities about how people will act in the future. [In other words,] this movement asks us to move from causation to correlation.”

While this approach has yielded some impressive results, he says, one should be also aware of its limits and goes on to list four of them:

  • The challenge of discerning meaningful correlations from meaningless ones
  • People are discontinuous and the passing of time can produce gigantic and unpredictable changes in taste and behavior
  • The world is error-prone and dynamic
  • The distinction between commodity decisions and flourishing decisions

Interesting too, his conclusion: “My worries mostly concentrate on the cultural impact of the big data vogue. If you adopt a mind-set that replaces the narrative with the empirical, you have problems thinking about personal responsibility and morality, which are based on causation. You wind up with a demoralized society.”

Be the first to share
22 July 2016
[Book] Overcomplicated (or when systems go feral)
Overcomplicated: Technology at the Limits of Comprehension by Samuel Arbesman Current (Penguin Randomhouse), July 2016 256 pages Abstract Why did the New York Stock Exchange suspend trading without warning on July 8, 2015? Why did certain Toyota vehicles accelerate uncontrollably …
18 July 2016
Design research at the New York Times
The pressure to anticipate an audience’s needs and desires is intense—no longer only of concern to business sides of media organizations but a part of the editorial mission, writes Heather Chaplin in the Columbia Journalism …
22 June 2016
A united energy economy: Experientia helps wrap up the CITYOPT Nice pilot project
Can behavioral change address local energy issues, raise people’s awareness energy consumption issues, and directly support non-profit organizations at the same time? With the Nice pilot of the CITYOPT project, we have seen strong suggestions …
21 June 2016
‘Big data is people!’
The sum of our clickstreams is not an objective measure of who we are, but a personal portrait of our hopes and desires, argues Rebecca Lemov, associate professor of the history of science at Harvard …
11 June 2016
Time for big anthropology
"Big data" is one of the most promising developments in health care in a decade. Yet, writes Dan Beckham, they too often breed myopic overconfidence. "The numbers, after all, never lie — except when they …
1 May 2016
Report: User Experience and Usability in Complex Systems
User Experience and Usability in Complex Systems Final Report 1/2015 FIMECC (Finnish Metals and Engineering Competence Cluster) November 2015, 225 pages Five years ago, some of Finland’s metals and engineering industry companies were looking for new ways to tackle …
30 April 2016
The Internet of Things needs design, not just technology
Scott A. Nelson and Paul Metaxatos write that, as B2C companies rush to exploit new IoT applications, pushing technology to potential end users no longer works. Increasingly, the pull of user experience will drive market …
21 April 2016
The product design of IoT
As more and more ‘Internet of Things’ products come into the market, most, if not all will come with significant challenges. The key to overcoming any obstacles, writes Joe Johnston, VP Experience Innovation for Universal …

We are an international experience design consultancy helping companies and organisations to innovate their products, services and processes by putting people and their experiences first.

22 June 2016
A united energy economy: Experientia helps wrap up the CITYOPT Nice pilot project

Can behavioral change address local energy issues, raise people’s awareness energy consumption issues, and directly support non-profit organizations at the same time? With the Nice pilot of the CITYOPT project, we have seen strong suggestions that it can. It also suggests that the sense of belonging to a local community is a strong motivation for […]

23 May 2016
Experientia white paper: “Conducting clinical trials is about working with patients”

Patient-centricity is one of the defining issues facing clinical trials in the pharma industry. The past few years have seen a growing awareness by pharmaceutical companies of the importance of patient-centricity – but they have also illustrated that not everyone is clear on just what patient-centricity is, or how to achieve it. After using UX […]

12 April 2016
The latest on innovation in Energy Efficient Buildings: annual round-up of EU Commission projects

Every year, the Energy-efficient Buildings (EeB) Public Private Partnership (PPP) publishes the EeB PPP project review – a round-up of energy-efficiency projects that have been co-funded by two European Commission schemes. This year, the print and digital booklet design was done by Experientia, in particular by our talented visual and interaction designer Dohun Jang. Experientia […]

8 March 2016
Behavioral modeling – Shaping cultural change and behavioral evolution

One of the things we do here at Experientia that really sets us apart from other UX agencies is behavioral modeling. Our cognitive and behavioral models go beyond the standard customer journeys and personas (both useful tools, and often preliminary steps to behavioral modeling) to create frameworks that can be used to make people more […]

1 March 2016
Singapore’s main newspaper on Experientia’s design with the elderly

Arti Mulchand reports in the Straits Times, Singapore’s main newspaper, on Experientia’s “Design for Ageing Gracefully” project: Putting faces to end-users early in the design process is changing the way designers and organisations are approaching products aimed at Singapore’s growing elderly demographic. Experientia’s ethnographic study, which was commissioned by DesignSingapore Council in a collaboration with […]

18 January 2016
Experientia website completely reshaped

Experientia is pleased to announce that we’ve started 2016 with a brand new website. Experientia’s now officially 10 years old, and we decided that the best way to celebrate is by building a new website that showcases our growth – with new projects, new people in the staff, and two new locations in Lausanne and […]

See all articles