AXEL

FOR PRIVATELY OWNED AUTONOMOUS VEHICLE

An interaction design solution for future AV owners to control vehicles during L3&L4 autonomous driving mode.

00 OVERVIEW

Project Background

As autonomous vehicle (AV) technology grows so rapidly across the automotive industry, traditional sell-based car companies are also seeking out opportunities to incorporate autonomous driving features into their product offerings. And when AV technology becomes mature enough in the foreseeable future, the launching of privately owned dual-mode AVs is expected.

However, in present days, research still shows that many Americans are holding a negative attitude against AV, and a lot of them are unwilling to use the tech due to lack of authority and concerns of ceding control to a machine.

Therefore, in the future, being able to provide users more controls and a sense of authority in a privately owned dual-mode AV is important. Because:

  • Privately owned: Compared to public AVs, drivers tend to pay more attention to vehicle usage, thus exerting more authority over the vehicle.
  • Dual-Mode: In the context where autonomous driving can only be operated within the mapped area, switching vehicles between auto-mode and manual mode for drivers is required. For drivers who are used to driving a dual-mode AV, being able to influence autonomous driving behavior is highly expected.

Problem Statement

"How might we provide future AV owners more control and authority during autonomous driving?"

Project Info

Duration
Feb.2021 - May.2021

Category
Private interaction design project (topic
originated @Ford Motor Company)

Team members
Sam Ma, Bob Bao

Design Tools
Figma, Sketch, InVision, Adobe Illustrator

About
My colleague Bob and I did a project with a similar topic at Ford in 2019, the project got excellent reviewed but bookshelfed due to company reorganization and shift of focus. After that, Bob and I decided to take on the topic with our perspectives and approaches.

My role
1. Scoped and planned the research, as well as conducted the user interviews.
2. Led the Analysis and synthesis of the research data, came up with insights and design principles, and created a portion of visual assets for storytelling.
3. Led the system design of the product, and prototyped a portion of the UI assets.
4. Conducted usability test and iterated the product based on user feedback.

Process

Understanding users & context

Analysis & Synthesis

Ideation & Design

Prototyping & Iteration

Reflection & Looking forward

  • Research overview

  • Research methods

  • Research details

  • Qualitative data analysis

  • Research findings

  • Problem reframe

  • Design principles

  • Brainstorm

  • Design solution

  • Branding

  • Development process

  • Concept evaluation

  • Concept iteration

  • Takeaways

  • Future work

Jump to the design solution...

01 UNDERSTANDING USERS & CONTEXT

Research Overview

What do future AV owners value? How might we help them better control autonomous driving? To better understand the problem space, user needs, and concerns, user research was conducted, the research objectives include:

  • Understand what “control” means to people and what contributes to the “feel of control” while taking a ride.

  • Understand what drives people to intervene in a riding or request a driving behavior change?

  • Understand people’s expectation towards an AV system.

  • Understand what type of controls people expect from an AV.

Research Method - Analogous Research

Conducting research and predicting precisely the behavior of private AV owners is difficult for they don’t yet exist. Therefore, current vehicle owners were studied as analogous research audiences. To understand how vehicle owners currently exert control, we investigated situations where they take a ride of their vehicle driven by another driver, and then fill the gap between the human driver and autonomous driving.

Research Details

User Interviews

8 user interviews with current vehicle owners were conducted during the research. These vehicle owners came with different demographics, backgrounds, and understanding of autonomous vehicle technologies to make sure the data is representative enough. Each interview lasts 60 minutes.

What was asked

  • In what situations, vehicle owners will let other people drive their vehicle. and how do they feel about them?
  • How do vehicle owners exert authority when their vehicle is driven by another person? What makes them comfortable and uncomfortable?
  • In what situations, vehicle owners will intervene indriver’s driving, and how would they do it?
  • What is people's expectation of a privately owned AV? Do they want to influence the autonomous driving behavior/style, and how do they expect to do it?

02 ANALYSIS & SYTHESIS

Qualitative Data Analysis

A large amount of interview data was organized and structured into a manageable format, and then themes and patterns were mapped out from it. We then further developed insights and design principles from the data. To maintain social distance during the COVID pandemic, an online platform (Figma) was also used for collaboration between team members.

Click the image to see detail data

Research Findings

"Feel in control"

The primary finding from the research is that "feel in control" for people during a ride doesn't only mean being able to control the driving, it is a multi-dimensional notion. We have identified 6 different aspects of "feel in control" in order to better understand it.

See detailed findings...

Expectation of AVs

After understanding what “feel in control” means to current vehicle owners, we change the context to future AV owners. Because the owners of AV don’t exist yet, we start by learning their expectations of the AV system based on foreseeable technological capabilities.

  • People expect the AV system to be visible, consistent, and predictable.
  • People are expecting to intervene in autonomous driving behaviors/styles, and they also expect AV to learn from their inputs.
  • People are not against being able to influence driving all the time, but they do not necessarily need it, because overwhelming amount of information and freedom of control can also create frustration often times.
  • People are expecting different levels of control in different situations during an AV ride.

Levels of Control

4 different levels of control were mapped out based on how people influence human driver's driving at present and their expectation of influencing future autonomous driving.

01 Tactile Control

Tactile controls are leveraged from people’s subconscious body reactions during a ride, and they are usually immediate reactions from the driving.

E.g. scoot over or sudden brake.

02 Real-time Control

Real-time controls are interventions of driving based on real-time traffic and environment, which people can usually make fast decisions about.

E.g. change lanes, overtake

03 Short-term Control

Short-term controls are driving behaviors that people request during a short period of time. Usually driven by the change of driving context.

E.g. increase aggressiveness during a traffic jam.

04 Long-term Control

Long-term controls are driving preferences that people request during a long period of time. Usually driven by the priority and the goal of the trip.

E.g. maximize comfort on the way to work

Problem Reframe

Design Principles

To help guide our design, 8 key design principles were summarized based on the insights and research findings. As one of the core deliverables, these design principles will also be applicable when design other AV systems in the future.

Trustworthy

Our design should be more predictable and consistent to help build trust between the AV system and driver.

Actionable

Our design should support driver’s actions (sense, observe, react, intervene) taken in different driving situations

Smart

Our design should be smart about when and how to provide the driver the right level of control.

Goal-Oriented

Our design should understand the driver’s current riding priorities and optimize driving based on them.

Authorized

Our design should encourage the driver to exert their authority over the vehicle in different ways.

Contextual

Our design should communicate relevant to the current driving context.

Personalized

Our design should respect the difference in personal experiences and provide customized service.

Learnable

Our design should learn from the driver’s input both in manual mode and autonomous mode.

03 DESIGN & DEVELOP

Brainstorm

Individual features and concepts are ideated around each design principle, and they are grouped and combined into design systems.

Click the image to see all concepts/features and design systems

Design Solution

AUTONOMOUS DRIVING CONTROL EXPERIENCE

A design solution for future AV owners to feel in control during autonomous rides

Real-time Traffic Intervene

Support driver's driving decisions based on real-time traffic information.

Context-based Intervene

Help drivers reach their short-term goals in different driving environments and contexts.

Maintain Driving Sensation

Use physical input device to intuitively perform non-traffic-related maneuver controls.

"Hand"ling Emergency

Although the autonomous driving system will manage emergencies in most cases, having physical affordance for the driver to land their body reaction would still help them feel safe and build trust.

Set Trip Priority

Based on the riding priority, 4 general driving styles can be selected by the driver at the beginning of the trip.

Exert Full Control

Full control mode is available for the driver who wants to increase engagement during autonomous driving,

See design details...

Branding

04 PROTOTYPING AND ITERATION

Development Process

Concept Evaluation

6 participants from the original user interviews were invited to the remote concept evaluation sessions. An interactive prototype was sent to them during a task-based study session, and follow-up questions were asked in a post-test interview.

Based on the result of the evolution, some general feedbacks have been summarized, and we have also identified several potential issues that need to be further addressed.

General Feedbacks

  • 6/6 participants considered the design useful and intuitive for exerting control and authority to autonomous driving.
  • 5/6 participants thought the design can help driver to feel more in control.
  • 6/6 participant were able to understand the interaction logic , and were able to take the right action within the time limit during the test.
  • 5/6 participants liked the fact that the design is clean and doesn't provide them with too much information.

Potential Issues

  • Interactable design elements are not identifiable enough in our visual design.
  • Some participants were confused about the driving styles.
  • Understandability of the roadway maneuver options needs to be increased.

Concept Iteration

Visual Design

During the test, we observed that some participants are trying to click non-interactable UI elements because there is not enough visual distinction between interactable elements and non-interactable elements in our design.

Some participants also commented that the visual design is neat, clean, and easy to understand, but as an AV-related product came from the future, the visual design is not "future" and "technology" enough.

Design actions:
We made the color scheme of the UI darker and increased the transparency of the background in order to highlight the interactable design elements.

Driving Styles

When selecting the driving style, some participants commended that they'd always want to select safety because they think safety is the most important thing, and having a safe style makes other styles feel less safe. Some of the participants were also confused about the polite mode.

Design actions:
We removed the safety mode and the polite mode and added Zen mode which is a combination of mental comfort and cautiousness.

Understandability

Another observation is that some participants are confused about the roadway maneuver options, especially misunderstanding lane change as lane bias. They think the options images are a bit too generic and not context-based.

Design actions:
To increase the understandability of the roadway maneuver options, we leveled up the image fidelity to the same level of the situation awareness traffic animation, in order to make the maneuver more recognizable and predictable.

05 REFLECTION & LOOKING FORWARD

Takeaways

Design for the future

Design for future technology and audiences is difficult because data cannot be obtained directly from the users, and technologies are changing exponentially. However, researchers can always start investigating the problem space through the lens of foundational human needs, (in our case, people's need to feel in control inside their own property), and looking into the similar scenario that happens now.

Problem reframe

Most of the time, the research data will lead the problem space in a new direction. When this happens. not only do designers themselves need to be comfortable reframing the problem, but also they need to push and guide the whole team to think beyond the surface of the problem, especially in multi-disciplinary corporative environments, where not everybody has a good practice with design thinking methodologies.

Remote collaboration

During the COVID pandemic, remote team collaboration became a new norm, and it is having a great impact on the design process. Without working on the same topic with physical touchpoints and exchange ideas face to face, designers are facing challenges especially on qualitative data analysis and conceptualization phases. Therefore, after experimenting with different collaboration tools and platforms, our team has changed the strategy of qualitative data analysis to one person lead the process, and the other primarily offering critiques and feedbacks.

Proficiency in the online platforms and tools also increased our remote collaboration efficiency on UI development and prototyping. Trust among team members is crucial when work is split.

Future work

2D (3D) animations

The current situation awareness display doesn't contain animated traffic, further development is needed to show the dynamic traffic and other interaction details.

Maneuver input device and cockpit area

Since physical experience is also an important portion of our design, prototyping the maneuver input device and cockpit area can help us create a more holistic experience.

Usability test with an integrated experience

With the integration of animated situation awareness display and physical touchpoints, we are able to conduct a usability study with the full experience of our design solution. The result of the study will drive future iterations of the design.

Tracking the industry

The autonomous driving industry is still in its growth, any breakthrough of the technology or regulation change is going to impact our design solution.

@ Siyuan (Sam) Ma, 2021