Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Randomized Controlled Trial
. 2022 Jul 1;5(7):e2223099.
doi: 10.1001/jamanetworkopen.2022.23099.

Effect of Smartphone App-Based Education on Clinician Prescribing Habits in a Learning Health Care System: A Randomized Cluster Crossover Trial

Matthew D McEvoy  1 , Mary Lynn Dear  2 , Reagan Buie  3 , David A Edwards  1 , Tyler W Barrett  4 , Brian Allen  1 , Amy C Robertson  1 , Leslie C Fowler  1 , Cassandra Hennessy  5 , Bonnie M Miller  6 , Kim V Garvey  1 , Robert P Bland 3rd  7 , Geoffrey M Fleming  8 , Don Moore  9 , Todd W Rice  2   10 , Gordon R Bernard  10 , Christopher J Lindsell  5 ; Vanderbilt Learning Healthcare System Platform Investigators and the Vanderbilt Committee on Opioid Monitoring and Stewardship
Collaborators, Affiliations
Randomized Controlled Trial

Effect of Smartphone App-Based Education on Clinician Prescribing Habits in a Learning Health Care System: A Randomized Cluster Crossover Trial

Matthew D McEvoy et al. JAMA Netw Open. .

Abstract

Importance: Effective methods for engaging clinicians in continuing education for learning-based practice improvement remain unknown.

Objective: To determine whether a smartphone-based app using spaced education with retrieval practice is an effective method to increase evidence-based practice.

Design, setting, and participants: A prospective, unblinded, single-center, crossover randomized clinical trial was conducted at a single academic medical center from January 6 to April 24, 2020. Vanderbilt University Medical Center clinicians prescribing intravenous fluids were invited to participate in this study.

Interventions: All clinicians received two 4-week education modules: 1 on prescribing intravenous fluids and 1 on prescribing opioid and nonopioid medications (counterbalancing measure), over a 12-week period. The order of delivery was randomized 1:1 such that 1 group received the fluid management module first, followed by the pain management module after a 4-week break, and the other group received the pain management module first, followed by the fluid management module after a 4-week break.

Main outcomes and measures: The primary outcome was evidence-based clinician prescribing behavior concerning intravenous fluids in the inpatient setting and pain medication prescribing on discharge from the hospital.

Results: A total of 354 participants were enrolled and randomized, with 177 in group 1 (fluid then pain management education) and 177 in group 2 (pain management then fluid education). During the overall study period, 16 868 questions were sent to 349 learners, with 11 783 (70.0%) being opened: 10 885 (92.4%) of those opened were answered and 7175 (65.9%) of those answered were answered correctly. The differences between groups changed significantly over time, indicated by the significant interaction between educational intervention and time (P = .002). Briefly, at baseline evidence-concordant IV fluid ordered 7.2% less frequently in group 1 than group 2 (95% CI, -19.2% to 4.9%). This was reversed after training at 4% higher (95% CI, -8.2% to 16.0%) in group 1 than group 2, a more than doubling in the odds of evidence-concordant ordering (OR, 2.56, 95% CI, 0.80-8.21). Postintervention, all gains had been reversed with less frequent ordering in group 1 than group 2 (-9.5%, 95% CI, -21.6% to 2.7%). There was no measurable change in opioid prescribing behaviors at any time point.

Conclusions and relevance: In this randomized clinical trial, use of smartphone app learning modules resulted in statistically significant short-term improvement in some prescribing behaviors. However, this effect was not sustained over the long-term. Additional research is needed to understand how to sustain improvements in care delivery as a result of continuous professional development at the institutional level.

Trial registration: ClinicalTrials.gov Identifier: NCT03771482.

PubMed Disclaimer

Conflict of interest statement

Conflict of Interest Disclosures: Dr McEvoy has received consulting fees from Takeda Pharmaceuticals for service on a scientific advisory board unrelated to the topic of this study and research funding from Edwards Lifesciences, Cheetah Medical, GE Foundation, and the Tennessee Department of Health, all unrelated to this study. Dr Barrett is partially funded by the National Institutes of Health National Institute on Drug Abuse CTN0099 ED INNOVATION study and the Centers for Disease Control and Prevention and Tennessee Department of Health Services unrelated to the topic of this study. Dr. Rice has received consulting fees from Cumberland Pharmaceuticals Inc as the director of Medical Affairs, Sanofi Inc as a member of a data safety monitoring board, and Cytovale Inc as a consultant, all unrelated to the topic of this study.

Figures

Figure 1.
Figure 1.. Study Design
Group 1 received the fluid management module followed by the pain management module. Group 2 received the pain management module followed by the fluid management module.
Figure 2.
Figure 2.. Participant Flow Diagram
All clinicians were analyzed by their treatment assignment.
See this image and copyright information in PMC

Comment in

References

    1. Morris ZS, Wooding S, Grant J. The answer is 17 years, what is the question: understanding time lags in translational research. J R Soc Med. 2011;104(12):510-520. doi:10.1258/jrsm.2011.110180 - DOI - PMC - PubMed
    1. Rothman BS, Gupta RK, McEvoy MD. Mobile technology in the perioperative arena: rapid evolution and future disruption. Anesth Analg. 2017;124(3):807-818. doi:10.1213/ANE.0000000000001858 - DOI - PubMed
    1. McEvoy MD, Dear ML, Buie R, et al. ; Vanderbilt Learning Healthcare System Investigators . Embedding learning in a learning health care system to improve clinical practice. Acad Med. 2021;96(9):1311-1314. doi:10.1097/ACM.0000000000003969 - DOI - PMC - PubMed
    1. Kerfoot BP, Baker H. An online spaced-education game for global continuing medical education: a randomized trial. Ann Surg. 2012;256(1):33-38. doi:10.1097/SLA.0b013e31825b3912 - DOI - PubMed
    1. Al-Azri H, Ratnapalan S. Problem-based learning in continuing medical education: review of randomized controlled trials. Can Fam Physician. 2014;60(2):157-165. - PMC - PubMed

Publication types

Substances

Associated data

LinkOut - more resources