Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2020 Aug 21:3:107.
doi: 10.1038/s41746-020-00318-y. eCollection 2020.

Developing a delivery science for artificial intelligence in healthcare

Ron C Li  1   2 , Steven M Asch  3   4 , Nigam H Shah  2
Affiliations

Developing a delivery science for artificial intelligence in healthcare

Ron C Li et al. NPJ Digit Med. .

Abstract

Artificial Intelligence (AI) has generated a large amount of excitement in healthcare, mostly driven by the emergence of increasingly accurate machine learning models. However, the promise of AI delivering scalable and sustained value for patient care in the real world setting has yet to be realized. In order to safely and effectively bring AI into use in healthcare, there needs to be a concerted effort around not just the creation, but also the delivery of AI. This AI "delivery science" will require a broader set of tools, such as design thinking, process improvement, and implementation science, as well as a broader definition of what AI will look like in practice, which includes not just machine learning models and their predictions, but also the new systems for care delivery that they enable. The careful design, implementation, and evaluation of these AI enabled systems will be important in the effort to understand how AI can improve healthcare.

Keywords: Health services; Translational research.

PubMed Disclaimer

Conflict of interest statement

Competing interestsThe authors declare no competing interests.

Figures

Fig. 1
Fig. 1. Multidisciplinary process for creating, implementing, and evaluating an AI enabled system for healthcare.
Methods from process improvement, design thinking, data science, information technology, and implementation science are combined into an iterative participatory process to build an AI enabled system for improving advance care planning. The expertize used across the different disciplines are as follows: (1) user experience design, (2) data science, (3) healthcare operations, (4) clinical informatics, (5) evaluation, and (6) ethical integrity assessment.
See this image and copyright information in PMC

References

    1. Topol EJ. High-performance medicine: the convergence of human and artificial intelligence. Nat. Med. 2019;25:44–56. doi: 10.1038/s41591-018-0300-7. - DOI - PubMed
    1. Emanuel EJ, Wachter RM. Artificial intelligence in health care will the value match the hype? J. Am. Med. Assoc. 2019;321:2281–2282. doi: 10.1001/jama.2019.4914. - DOI - PubMed
    1. Schulman KA, Richman BD. Toward an effective innovation agenda. N. Engl. J. Med. 2019;380:900–901. doi: 10.1056/NEJMp1812460. - DOI - PubMed
    1. Fihn, S. D. et al. Deploying AI in Clinical Settings. In Artificial Intelligence in Health Care: The Hope, the Hype, the Promise, the Peril (eds Matheny, M., Thadaney-Israni, S., Ahmed, M. & Whicher, D.) (National Academy of Medicine, 2019).
    1. Challener DW, Prokop LJ, Abu-Saleh O. The proliferation of reports on clinical scoring systems: issues about uptake and clinical utility. J. Am. Med. Assoc. 2019;321:2405–2406. doi: 10.1001/jama.2019.5284. - DOI - PubMed