Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Sep 12:12:e47971.
doi: 10.2196/47971.

Implementation of Machine Learning Applications in Health Care Organizations: Protocol for a Systematic Review of Empirical Studies

Vittoria Ardito  1 , Giulia Cappellaro  1   2 , Amelia Compagni  1   2 , Francesco Petracca  1 , Luigi Maria Preti  1
Affiliations

Implementation of Machine Learning Applications in Health Care Organizations: Protocol for a Systematic Review of Empirical Studies

Vittoria Ardito et al. JMIR Res Protoc. .

Abstract

Background: An increasing interest in machine learning (ML) has been observed among scholars and health care professionals. However, while ML-based applications have been shown to be effective and have the potential to change the delivery of patient care, their implementation in health care organizations is complex. There are several challenges that currently hamper the uptake of ML in daily practice, and there is currently limited knowledge on how these challenges have been addressed in empirical studies on implemented ML-based applications.

Objective: The aim of this systematic literature review is twofold: (1) to map the ML-based applications implemented in health care organizations, with a focus on investigating the organizational dimensions that are relevant in the implementation process; and (2) to analyze the processes and strategies adopted to foster a successful uptake of ML.

Methods: We developed this protocol following the PRISMA-P (Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols) guidelines. The search was conducted on 3 databases (PubMed, Scopus, and Web of Science), considering a 10-year time frame (2013-2023). The search strategy was built around 4 blocks of keywords (artificial intelligence, implementation, health care, and study type). Based on the detailed inclusion criteria defined, only empirical studies documenting the implementation of ML-based applications used by health care professionals in clinical settings will be considered. The study protocol was registered in PROSPERO (International Prospective Register of Systematic Reviews).

Results: The review is ongoing and is expected to be completed by September 2023. Data analysis is currently underway, and the first results are expected to be submitted for publication in November 2023. The study was funded by the European Union within the Multilayered Urban Sustainability Action (MUSA) project.

Conclusions: ML-based applications involving clinical decision support and automation of clinical tasks present unique traits that add several layers of complexity compared with earlier health technologies. Our review aims at contributing to the existing literature by investigating the implementation of ML from an organizational perspective and by systematizing a conspicuous amount of information on factors influencing implementation.

International registered report identifier (irrid): DERR1-10.2196/47971.

Keywords: artificial intelligence; barriers; facilitators; health care organization; implementation; machine learning.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: None declared.

References

    1. Yu KH, Beam AL, Kohane IS. Artificial intelligence in healthcare. Nat Biomed Eng. 2018;2(10):719–731. doi: 10.1038/s41551-018-0305-z.10.1038/s41551-018-0305-z - DOI - PubMed
    1. Communication from the Commission to the European Parliament, the European Council, the Council, the European Economic and Social Committee and the Committee of the Regions Artificial Intelligence for Europe. European Commission, Directorate-General for Communications Networks, Content and Technology. 2018. [2023-08-18]. https://eur-lex.europa.eu/legal-content/en/ALL/?uri=CELEX:52018DC0237 .
    1. Kaplan A, Haenlein M. Siri, Siri, in my hand: who's the fairest in the land? On the interpretations, illustrations, and implications of artificial intelligence. Bus Horiz. 2019;62(1):15–25. doi: 10.1016/j.bushor.2018.08.004. https://www.researchgate.net/profile/Michael-Haenlein/publication/328761... - DOI
    1. Witten IH, Frank E, Hall MA. Data Mining: Practical Machine Learning Tools and Techniques, Third Edition. Burlington, MA: Elsevier Science; 2011.
    1. Jakhar D, Kaur I. Artificial intelligence, machine learning and deep learning: definitions and differences. Clin Exp Dermatol. 2020;45(1):131–132. doi: 10.1111/ced.14029. - DOI - PubMed

LinkOut - more resources