Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 Apr;28(1):e100301.
doi: 10.1136/bmjhci-2020-100301.

How machine learning is embedded to support clinician decision making: an analysis of FDA-approved medical devices

David Lyell  1 , Enrico Coiera  2 , Jessica Chen  2 , Parina Shah  2 , Farah Magrabi  2
Affiliations

How machine learning is embedded to support clinician decision making: an analysis of FDA-approved medical devices

David Lyell et al. BMJ Health Care Inform. 2021 Apr.

Abstract

Objective: To examine how and to what extent medical devices using machine learning (ML) support clinician decision making.

Methods: We searched for medical devices that were (1) approved by the US Food and Drug Administration (FDA) up till February 2020; (2) intended for use by clinicians; (3) in clinical tasks or decisions and (4) used ML. Descriptive information about the clinical task, device task, device input and output, and ML method were extracted. The stage of human information processing automated by ML-based devices and level of autonomy were assessed.

Results: Of 137 candidates, 59 FDA approvals for 49 unique devices were included. Most approvals (n=51) were since 2018. Devices commonly assisted with diagnostic (n=35) and triage (n=10) tasks. Twenty-three devices were assistive, providing decision support but left clinicians to make important decisions including diagnosis. Twelve automated the provision of information (autonomous information), such as quantification of heart ejection fraction, while 14 automatically provided task decisions like triaging the reading of scans according to suspected findings of stroke (autonomous decisions). Stages of human information processing most automated by devices were information analysis, (n=14) providing information as an input into clinician decision making, and decision selection (n=29), where devices provide a decision.

Conclusion: Leveraging the benefits of ML algorithms to support clinicians while mitigating risks, requires a solid relationship between clinician and ML-based devices. Such relationships must be carefully designed, considering how algorithms are embedded in devices, the tasks supported, information provided and clinicians' interactions with them.

Keywords: medical informatics.

PubMed Disclaimer

Conflict of interest statement

Competing interests: None declared.

Figures

Figure 1
Figure 1
Stages of human information processing (top) and their automation (bottom).
Figure 2
Figure 2
Process to search for and identify FDA Approved ML devices. FDA, Food and Drug Administration; ML, machine learning.
Figure 3
Figure 3
Level of autonomy showing the relationship between clinician and device.
See this image and copyright information in PMC

References

    1. Coiera E. Guide to health informatics. Third edition. ed. Boca Raton: CRC Press, Taylor & Francis Group, 2015.
    1. Matheny M, Israni ST, Ahmed M. Artificial intelligence in health care: the hope, the hype, the promise, the peril. Natl Acad Med 2020:94–7.
    1. Domingos P. The master algorithm : how the quest for the ultimate learning machine will remake our world. 1st ed. New York: Basic Books, a member of the Perseus Books Group, 2018.
    1. Parasuraman R, Riley V. Humans and automation: use, misuse, disuse, abuse. Hum Factors 1997;39:230–53. 10.1518/001872097778543886 - DOI
    1. Coiera E. The last mile: where artificial intelligence meets reality. J Med Internet Res 2019;21:e16323. 10.2196/16323 - DOI - PMC - PubMed

LinkOut - more resources