Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2020 Jul;4(2):e108-e113.
doi: 10.1055/s-0040-1716748.

Barriers to Implementing an Artificial Intelligence Model for Unplanned Readmissions

Sally L Baxter  1   2 , Jeremy S Bass  1   3 , Amy M Sitapati  1   4
Affiliations

Barriers to Implementing an Artificial Intelligence Model for Unplanned Readmissions

Sally L Baxter et al. ACI open. 2020 Jul.

Abstract

Background: Electronic health record (EHR) vendors now offer "off-the-shelf" artificial intelligence (AI) models to client organizations. Our health system faced difficulties in promoting end-user utilization of a new AI model for predicting readmissions embedded in the EHR.

Objectives: The aim is to conduct a case study centered on identifying barriers to uptake/utilization.

Methods: A qualitative study was conducted using interviews with stakeholders. The interviews were used to identify relevant stakeholders, understand current workflows, identify implementation barriers, and formulate future strategies.

Results: We discovered substantial variation in existing workflows around readmissions. Some stakeholders did not perform any formal readmissions risk assessment. Others accustomed to using existing risk scores such as LACE+ had concerns about transitioning to a new model. Some stakeholders had existing workflows in place that could accommodate the new model, but they were not previously aware that the new model was in production. Concerns expressed by end-users included: whether the model's predictors were relevant to their work, need for adoption of additional workflow processes, need for training and change management, and potential for unintended consequences (e.g., increased health care resource utilization due to potentially over-referring discharged patients to home health services).

Conclusion: AI models for risk stratification, even if "off-the-shelf" by design, are unlikely to be "plug-and-play" in health care settings. Seeking out key stakeholders and defining clear use cases early in the implementation process can better facilitate utilization of these models.

Keywords: artificial intelligence; case management; clinical informatics; electronic health records; health system; machine learning; predictive analytics; predictive models; readmissions.

PubMed Disclaimer

Conflict of interest statement

Conflict of Interest None declared.

Figures

Fig. 1
Fig. 1
Flow diagram of interview questions for stakeholders regarding workflows around reducing unplanned readmissions and the potential role of a new predictive model.
Fig. 2
Fig. 2
Concerns expressed by stakeholders regarding implementation of a new predictive model for unplanned readmissions.
See this image and copyright information in PMC

References

    1. Parikh RB, Kakad M, Bates DW. Integrating predictive analytics into high-value care: the dawn of precision delivery. JAMA 2016; 315(07):651–652 - PubMed
    1. Harris AH. Path from predictive analytics to improved patient outcomes: a framework to guide use, implementation, and evaluation of accurate surgical predictive models. Ann Surg 2017;265 (03):461–463 - PMC - PubMed
    1. Amarasingham R, Patzer RE, Huesch M, Nguyen NQ, Xie B. Implementing electronic health care predictive analytics: considerations and challenges. Health Aff (Millwood) 2014;33(07): 1148–1154 - PubMed
    1. He J, Baxter SL, Xu J, Xu J, Zhou X, Zhang K. The practical implementation of artificial intelligence technologies in medicine. Nat Med 2019;25(01):30–36 - PMC - PubMed
    1. Fountaine T, McCarthy B, Saleh T. Building the AI-powered organization Harvard Business Review. 2019. Available at: https://hbr.org/2019/07/building-the-ai-powered-organization. Accessed April 13, 2020