4 August 2017

The human side of autonomous cars — with Nissan Research’s Melissa Cefkin

Be the first to share

Reposted from Medium

Beyond the engineering challenge of creating cars that drive themselves lies the social challenge. Before autonomous cars are ready to navigate our roads, they must be able to navigate the vastly more complicated nuances of human behaviors and interactions — from that friendly nod that says “You first” at a four-way stop, to the driver you just know hasn’t seen your indicator.

This month, we spoke with anthropologist Melissa Cefkin, Principal Scientist and Senior Manager at Nissan Research and keynote speaker at the upcoming EPIC conference, about the challenges of creating autonomous cars that can move smoothly in a human landscape.

Your recent CES talk was entitled “Teaching cars human behaviour. Autonomous Drive.” Since cars are autonomous, why do we need to teach them human behaviour?

Have you ever navigated a four-way stop in the United States, or passed another car on a narrow road anywhere in the world? Road use, whether engaged as a driver, cyclist or pedestrian, demands actions stemming from an encounter with another, however fleeting and unremarkable it seems. Further, we often try to take those actions in the “right” way for that time and place. We read the situation: “Does the other driver see me? Does she seem to be waiting? Are we both seeing the situation the same, that she arrived first and I should wait for her to go, or does she think I arrived first? She’s paused a touch longer than I would have expected. I guess I’ll go.”

How will an automated vehicle (AV) respond to such situations? Who goes first is not necessarily noteworthy in any single instance. But eventually many AV could be moving through the same places one after another. Given that movement through the streets is such a fundamental part of our daily existence, as we scale up these encounters, the implications of any given choices could matter to how familiar, efficient and navigable the roads feel.

At a more fundamental level however, the extent to which people will encounter automated vehicles as more machine-like or more human-like has yet to be determined; it will necessarily evolve over time. And let me say one other thing: we have to consider what “autonomy” really means. We have to recognize that it is an abstraction, it does not exist in an absolute sense. Autonomy only has meaning, conceptually, vis-a-vis another controlling force. People are said to be autonomous when they live free from the control of another governing entity. A machine system is said to be autonomous when it can take actions independent of the control of a person. The route towards autonomy is to enable the vehicle to act on its own goal by goal; driving down a single lane, and then adding a lane change, and then traversing an intersection with lights, and so on. Vehicles already do take actions ‘on their own’ in ways we hardly recognize, such as anti-lock braking systems. The interplay with people will remain, we just have to see exactly where and in what ways.

Who is (or will be) doing this teaching and how is it being done? Is this already a focus of autonomous car makers?

A common approach in the industry is to use machine learning or deep learning. Through the high volume of data gathered by onboard sensors and feeding that data through machine learning algorithms, vehicles are being designed to figure things out for themselves. Another approach is model-driven — making models of human behaviour based on a priori views of people’s actions. At Nissan we are using multiple approaches, including empirical studies driven through social science theories to inform our designs. Machines may become pretty good at identifying similar and different actions and even anticipating patterns over time. But they don’t have a means to understand and judge in social terms about the contingencies and meanings of the patterns, which people use to assess and anticipate actions. Looking at road use through this lens should help us both deepen and improve, and also hasten, the learning of the machines. More importantly, we are able to sensitize the development teams as to what to expect in ongoing development, and how to prioritize focus areas.

Can we actually teach autonomous cars human behaviour or do you think, as an anthropologist, that there are big challenges autonomous car-makers are bumping into?

Of course there are challenges and there is a bit of hubris in describing the effort in this way. They will never be human.

Nor should we necessarily want them to be. Hopefully they’ll never gun through an intersection when a light changes — a big waste of energy. They won’t be fumbling for their cell phones or get distracted by a crying baby.

My view is that we should be examining today’s practices and expectations not with the aim to recreate them exactly. Society is ever changing, after-all, especially as technologies are introduced and continue to be adapted. Personally I’m pretty happy about the changes afforded by graphite and the printing press but somewhat less enamored by the overwhelming effects of the attention-grabbing screen and button of the smart phone. We should be examining today’s practices and expectations to see where fissures and opportunities lie and what that could mean for development tasks. But we should also be using our analysis to raise questions about the potential broader social impacts. This is and always has been the special value of ethnographically informed approaches at work.

Human behaviour will also have to change with autonomous cars on the horizon. What changes do you foresee and how can service designers anticipate them?

I have been referring to our everyday experiences of road use, to how the feel of moving through time and space could shift, if but subtly. Indeed the automobile has been an exceedingly dominant force in shaping our urban landscape, our economic systems, even our social structures. Are we on the cusp of shifting that dominance? There are a plethora of possible implications of automated vehicles for cities, for public spaces, for government services, for family livelihoods — the list goes on. There are tremendous opportunities for rethinking the possibilities of urban spaces and how they are used, for instance, or service models for transportation broadly as time goes on. Nonetheless, given where we are today, it seems to me that most likely near term opportunities lie in services related to commercial transport and urban public transportation.

How/why will service design become even more critical in the automotive industry? What should service designers focus on in the automotive world?

I agree, it is likely to become more important. With increasing autonomy, cars have the potential to realize more fully their eponymous function, to serve as a means for the conveyance of people and things; for moving goods and people about, for providing access to employment and to friends and family, for getting from place to place whether for pleasure or necessity. Mobility as a service. The degree to which vehicles continue to be owned versus accessed remains to be seen. There is of course a great deal of focus on the increased potential for shared use and shared ownership models. Vehicles may in the process also begin to lose something of their potential to act symbolically in other ways, such as markers of status or identity. Or it could go the other way.

As to what service designers should focus on, I can tell you what I would like to see. What I would like to see is that the service design community plays a role in keeping the focus on the systemic aspects of the service systems, to focus on publics and how things work together and not just singular business opportunities, of which there will be many: services related to mobility itself, of course, but also data services and don’t forget the care side of the picture and the maintenance and upkeep of the autonomous vehicle systems.

An anthropologist with a long career at the intersection of social research and business and technology, Melissa Cefkin began working on autonomous vehicles in 2015, fulfilling a life-long love of transportation matters. (Her preferred activity in a new place? Public bus rides.) She works at Nissan Research, where she is a Principal Scientist and Senior Manager. Her work has focused on people’s lives and experiences with automated technology of all kinds, especially those related to mobility, collaboration, work, and lives in organizations.

A long-time observer and participant in the growth of anthropological research in and with business, Melissa is the author of numerous publications including the edited volume Ethnography and the Corporate Encounter. She has served as president and conference co-chair for the Ethnographic Praxis in Industry Conference (EPIC), where she will be a keynote speaker in October this year, and recently on the US National Academies of Science committee on Information Technology, Automation and the Workforce. A frequent public and academic speaker, the work she and her colleagues are doing has been cited broadly, including in PBS, Wired, the Financial Times, the Estonian national press, CNN Chile, Canadian Broadcasting, and beyond. Melissa holds a PhD from Rice University and has been a Fulbright scholar; she worked previously at IBM Research, Sapient and the Institute for Research on Learning (IRL).

Also in this series: Why service design is the new black, Intel’s Todd Harple on fashion tech.

Be the first to share
11 January 2019
[Book] Left to Our Own Devices
Left to Our Own Devices: Outsmarting Smart Technology to Reclaim Our Relationships, Health, and Focus Margaret E. Morris MIT Press, 2018 192 pages Unexpected ways that individuals adapt technology to reclaim what matters to them, from working through conflict …
4 January 2019
Why data is never raw
"Except in divine revelation, data is never simply given, nor should it be accepted on faith," writes Nick Barrowman in The New Atlantis. "How data are construed, recorded, and collected is the result of human …
1 January 2019
Daniel Kahneman on cutting through the noise
You might be surprised by what occupies Daniel Kahneman’s thoughts. “You seem to think that I think of bias all the time,” he tells esteemed economist Tyler Cowen. “I really don’t think of bias that …
22 December 2018
Our very best wishes for 2019! / Auguri da Experientia!
22 December 2018
Intel anthropologist Dawn Nafus interview on the use of data and technology in medical contexts
In an age where we can collect and store (forEVER) every second of every day, how much do we truly need… to learn? To react? To do good deeds that benefit society? Assuming we champion that, …
27 November 2018
Nielsen Norman Group on the user experience of chatbots
Far from being ‘intelligent’, today’s chatbots guide users through simple linear flows, and our user research shows that they have a hard time whenever users deviate from such flows, writes Raluca Budiu of the Nielsen …
20 November 2018
Journal of Business Anthropology devoted to design anthropology
The Journal of Business Anthropology is an Open Access journal which publishes the results of anthropological research in business organizations and business situations of all kinds. The theme of the latest issue - Vol 7, …
19 November 2018
What are Europe’s rules for democratic artificial intelligence?
Vincenzo Tiani has written an excellent summary in Wired Italia of the recently published "Ethical Framework for a Good AI Society: Opportunities, Risks, Principles, and Recommendations", by AI4People, a task force of European experts. With the …

We are an international experience design consultancy helping companies and organisations to innovate their products, services and processes by putting people and their experiences first.

22 December 2018
Our very best wishes for 2019! / Auguri da Experientia!
4 October 2018
Bringing​ ​patients into focus at the Roche Innovation Summit

Experientia is proud to have been a key participant at the Roche Innovation Summit, held at Roche headquarters in Basel Switzerland on 19 June 2018. Themed “​Transforming the Healthcare Experience Together​”, the summit aimed to galvanize the Roche community around the future transformation of healthcare and diagnostics. With 800 attendees from Roche and Genentech global […]

13 June 2018
Invito: DesAlps design thinking workshop per la tua startup

Hai una startup? Hai mai pensato ai benefici che potrebbe trarre dal Design Thinking? Questa è l’opportunità per scoprirlo! DesAlps Workshop #2: Il Design Thinking per la tua startup! Giovedì 28 giugno 2018 – dalle 9:30 alle 17:00 @ I3P | Corso Castelfidardo 30/a, Torino —– Nell’ambito del progetto europeo DesAlps, un team di esperti […]

3 May 2018
Invito: DesAlps innovation workshop per le PMI del territorio piemontese

Experientia è lieta di invitare le piccole e medie imprese del territorio piemontese al: DesAlps Workshop #1: Il Design Thinking per le PMI Venerdì 18 maggio 2018 – dalle 9.00 alle 17.30 @ Rinascimenti Sociali | via Maria Vittoria 38, Torino Scopri i vantaggi che il Design Thinking può portare al tuo business per prepararvi […]

27 April 2018
Impact through Design – Event in Turin, Italy

(Scroll down for English) Come può il design generare impatto? In continuità con il summit International Days of Deans and Experts: Impact Through Design (Barcellona, aprile 2018) Torino ospita il primo evento dedicato alla prospettiva italiana sull’impatto generato attraverso il design in riferimento ai Sustainable Development Goals definiti dalle Nazioni Unite. Attori dell’ecosistema territoriale ed […]

26 February 2018
Designing Patient Solutions with Meaning: Review of technology and health apps for a better patient experience

Technology is radically changing the world of healthcare and acts at different levels in support of different stakeholders. There are several digital tools on the market (e.g. wearables, virtual reality, robotics, etc.), many of which work in integration with each other, for example, wearables connected to IOT applications. Experientia’s report provide an overview of some […]

See all articles