Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Jun 6;14(1):13061.
doi: 10.1038/s41598-024-62052-9.

Effects of multimodal explanations for autonomous driving on driving performance, cognitive load, expertise, confidence, and trust

Robert Kaufman  1 , Jean Costa  2 , Everlyne Kimani  2
Affiliations

Effects of multimodal explanations for autonomous driving on driving performance, cognitive load, expertise, confidence, and trust

Robert Kaufman et al. Sci Rep. .

Abstract

Advances in autonomous driving provide an opportunity for AI-assisted driving instruction that directly addresses the critical need for human driving improvement. How should an AI instructor convey information to promote learning? In a pre-post experiment (n = 41), we tested the impact of an AI Coach's explanatory communications modeled after performance driving expert instructions. Participants were divided into four (4) groups to assess two (2) dimensions of the AI coach's explanations: information type ('what' and 'why'-type explanations) and presentation modality (auditory and visual). We compare how different explanatory techniques impact driving performance, cognitive load, confidence, expertise, and trust via observational learning. Through interview, we delineate participant learning processes. Results show AI coaching can effectively teach performance driving skills to novices. We find the type and modality of information influences performance outcomes. Differences in how successfully participants learned are attributed to how information directs attention, mitigates uncertainty, and influences overload experienced by participants. Results suggest efficient, modality-appropriate explanations should be opted for when designing effective HMI communications that can instruct without overwhelming. Further, results support the need to align communications with human learning and cognitive processes. We provide eight design implications for future autonomous vehicle HMI and AI coach design.

PubMed Disclaimer

Conflict of interest statement

The authors declare no competing interests.

Figures

Figure 1
Figure 1
Full-motion driving simulator.
Figure 2
Figure 2
The green racing line projected on the track is an example of a visual ‘what’ explanation seen by Group 4.
Figure 3
Figure 3
Study timeline. The study duration was approximately 1 hour in total and included a questionnaire, participant driving, AI coach observation, and interview.
Figure 4
Figure 4
Change (Δ) from pre-post observation for driving performance measures by group.
Figure 5
Figure 5
Pre-post scores for self-report measures, all groups combined.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

References

    1. Fagnant DJ, Kockelman K. Preparing a nation for autonomous vehicles: Opportunities, barriers and policy recommendations. Transport. Res. Part A Policy Pract. 2015;77:167–181. doi: 10.1016/j.tra.2015.04.003. - DOI
    1. National Highway Traffic Safety Administration Traffic Safety Facts: 2021 data (2021). https://crashstats.nhtsa.dot.gov/Api/Public/ViewPublication/813473.pdf
    1. Blincoe, L. et al. The economic and societal impact of motor vehicle crashes, 2019. Technical Report (2022).
    1. Singh, S. Critical reasons for crashes investigated in the national motor vehicle crash causation survey. Technical Report (2015).
    1. Braghin F, Cheli F, Melzi S, Sabbioni E. Race driver model. Comput. Struct. 2008;86:1503–1516. doi: 10.1016/j.compstruc.2007.04.028. - DOI