Emerging Technologies

The autonomous vehicle is coming – and people must be ready

A self-driving E-Golf car is tested by German carmaker Volkswagen in Hamburg Germany, April 3, 2019. REUTERS/Fabian Bimmer - RC1696B007D0

In a city full of autonomous cars, how might our behaviour and use of city streets change? Image: REUTERS/Fabian Bimmer - RC1696B007D0

Gemma Read
Senior Research Fellow in Human Factors & Sociotechnical Systems, University of the Sunshine Coast
Jason Thompson
Senior Research Fellow, Transport, Health and Urban Design (THUD) Research Hub, University of Melbourne

Globally, road crashes kill 1.3 million people a year and injure nearly 50 million more. Autonomous vehicles (AVs) have been identified as a potential solution to this issue if they can learn to identify and avoid situations leading to crashes.

Unlike human drivers, these vehicles won’t get tired, drive drunk, look at their phone, or speed. What’s more, AVs will reduce congestion and pollution, increase access to public transport, be cheaper, improve mobility for people with disabilities, and make transport fun again. Right?

Rightly or wrongly, billions of dollars are being poured into autonomous vehicle research and development to pursue this autopia. However, barely any resource or thought is being given to the question of how humans will ultimately respond to the AV fleet. In a city full of autonomous cars, how might our behaviour and use of city streets change?

In one scenario, people could act on the knowledge that these vehicles will stop any time someone chooses to step in front of them, bringing traffic to a halt.

Humans (and animals) will adapt

O⁠n⁠e⁠ ⁠o⁠f⁠ ⁠h⁠u⁠m⁠a⁠n⁠s'⁠ ⁠g⁠r⁠e⁠a⁠t⁠ ⁠s⁠t⁠r⁠e⁠n⁠g⁠t⁠h⁠s⁠⁠ is our⁠ ⁠a⁠d⁠a⁠p⁠t⁠a⁠bility⁠. We quickly ⁠⁠l⁠e⁠a⁠r⁠n⁠ ⁠t⁠o⁠ ⁠m⁠a⁠n⁠i⁠p⁠u⁠l⁠a⁠t⁠e⁠ ⁠a⁠n⁠d⁠ ⁠e⁠x⁠p⁠l⁠o⁠i⁠t⁠ ⁠o⁠u⁠r⁠ ⁠e⁠n⁠v⁠i⁠r⁠o⁠n⁠m⁠e⁠n⁠t⁠.⁠ A future road environment saturated with autonomous vehicles will be no different.

⁠F⁠o⁠r ⁠e⁠x⁠a⁠m⁠p⁠l⁠e⁠, think about why you don’t walk out in front of traffic or drive through stop signs. Because other cars could injure or hurt you, right?⁠ ⁠

But autonomous vehicles promise something new. They are being designed to “act flawlessly”.

There are two elements to this: the first is not making mistakes, and the second is compensating for the occasional errors and misjudgements that fallible humans make. Autonomous vehicles promise alignment with Asimov’s First Law of Robotics:

A robot may not injure a human.

Now imagine crossing a road or highway in a city saturated by autonomous cars where the threat of being run over disappears. You⁠ ⁠(⁠o⁠r⁠ ⁠a⁠n⁠y⁠ ⁠o⁠t⁠h⁠e⁠r⁠ ⁠mildly i⁠n⁠t⁠e⁠l⁠l⁠i⁠g⁠e⁠n⁠t⁠ ⁠a⁠n⁠i⁠m⁠a⁠l⁠)⁠ might quickly learn that ⁠⁠oncoming traffic poses no threat at all. Replicated thousands of times across a dense inner city, this could produce gridlock among safety-conscious autonomous vehicles, but virtual freedom of movement for humans – maybe even heralding a return to pedestrian rights of yesteryear.

A simple example of how this might happen comes from game theory. Take two scenarios at an intersection where pedestrians and vehicles negotiate priority to cross first. Each receives known “pay-offs” for behaviour in the context of the other’s action. The higher the comparative pay-off for either party, the more likely the action.

In the left-hand scenario below, the Nash equilibrium (the optimum combined action of both parties) exists in the lower left quadrant where the pedestrian has a small incentive to “stay” to avoid being injured by the manually driven car, and the driver has a strong incentive to “go”.

However, in the scenario on the right, the autonomous vehicles has a desire to act flawlessly and pose no threat to the pedestrian at all. While this might be great for safety, the pedestrian can now adopt a strategy of “go” at all times, forcing the AV to stay put.

Can this potential problem be overcome?

One solution might be to ⁠p⁠r⁠o⁠g⁠r⁠a⁠m⁠ ⁠⁠a⁠l⁠g⁠o⁠r⁠i⁠t⁠h⁠m⁠s⁠ into vehicles ⁠t⁠h⁠a⁠t⁠ make them ⁠o⁠c⁠c⁠a⁠s⁠i⁠o⁠n⁠a⁠l⁠l⁠y⁠,⁠ ⁠p⁠u⁠r⁠p⁠o⁠s⁠e⁠f⁠u⁠l⁠l⁠y⁠,⁠ ⁠r⁠u⁠n into⁠ ⁠people, animals or other vehicles⁠⁠. Although this would maintain a level of fear and caution in the population, l⁠e⁠g⁠a⁠l⁠l⁠y⁠ ⁠a⁠n⁠d⁠ ⁠m⁠o⁠r⁠a⁠l⁠l⁠y⁠⁠ ⁠it is hard to see how this would be ⁠a⁠c⁠c⁠e⁠p⁠t⁠a⁠b⁠l⁠e⁠.

Another option could be infrastructure separating autonomous vehicles from vulnerable road users, such as pedestrians and cyclists. But the cost and reduction in amenity this would create would be enormous. Further, this type of solution could be applied now, negating much of the need for AV software and technology development in the first place.

A final, duplicitous idea is to simply turn off the safety systems that cause so-called “erratic vehicle behaviour” (i.e., slowing down to avoid hitting people). This is reported to have occurred when a self-driving Uber struck and killed a pedestrian in Arizona last year. However, if this is the solution, you then have to ask, “What is the transport problem autonomous vehicles are actually trying to solve?”

It won’t happen overnight

In the scenarios above most of the fleet are autonomous vehicles, and humans adapt to their consistently safe behaviour. However, the complete transition to autonomous vehicles will not occur overnight and might create new crash situations that are, so far, poorly understood.

For example, we are developing simulations of interactions between vulnerable road users and a mixed fleet of autonomous vehicles and human-driven cars. These models show how inconsistencies between the behaviour of manual and autonomous vehicle types could even lead to more crashes during the transition.

The future for AVs under threat?

As AV technology rolls on, and the marketing hype surrounding them continues to draw attention and burn up investment dollars, it should be remembered that humans and animals are still going to behave how we always have by continually adapting and exploiting weaknesses in our environment.

Part of the promise of autonomous vehicles is their proposed safety through deference to human life. But, if the point of transport systems is to enable efficient movement of people and goods for the benefit of society, this strength of AVs might prove to be their ultimate weakness as a viable mass transport mode.

Loading...
Don't miss any update on this topic

Create a free account and access your personalized content collection with our latest publications and analyses.

Sign up for free

License and Republishing

World Economic Forum articles may be republished in accordance with the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International Public License, and in accordance with our Terms of Use.

The views expressed in this article are those of the author alone and not the World Economic Forum.

Stay up to date:

Mobility

Related topics:
Emerging TechnologiesFourth Industrial Revolution
Share:
The Big Picture
Explore and monitor how Mobility is affecting economies, industries and global issues
World Economic Forum logo

Forum Stories newsletter

Bringing you weekly curated insights and analysis on the global issues that matter.

Subscribe today

Here’s why it’s important to build long-term cryptographic resilience

Michele Mosca and Donna Dodson

December 20, 2024

How digital platforms and AI are empowering individual investors

About us

Engage with us

  • Sign in
  • Partner with us
  • Become a member
  • Sign up for our press releases
  • Subscribe to our newsletters
  • Contact us

Quick links

Language editions

Privacy Policy & Terms of Service

Sitemap

© 2024 World Economic Forum