Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 Jul 27;2(1):83.
doi: 10.1186/s43058-021-00182-1.

Accuracy of emergency physicians' self-estimates of CT scan utilization and its potential effect on an audit and feedback intervention: a randomized trial

Celine Larkin  1 , Alexandra M Sanseverino  2 , James Joseph  2 , Lauren Eisenhauer  2 , Martin A Reznek  2
Affiliations

Accuracy of emergency physicians' self-estimates of CT scan utilization and its potential effect on an audit and feedback intervention: a randomized trial

Celine Larkin et al. Implement Sci Commun. .

Abstract

Background: Audit and feedback (A&F) has been used as a strategy to modify clinician behavior with moderate success. Although A&F is theorized to work by improving the accuracy of clinicians' estimates of their own behavior, few interventions have included assessment of clinicians' estimates at baseline to examine whether they account for intervention success or failure. We tested an A&F intervention to reduce computed tomography (CT) ordering by emergency physicians, while also examining the physicians' baseline estimates of their own behavior compared to peers.

Methods: Our study was a prospective, multi-site, 20-month, randomized trial to examine the effect of an A&F intervention on CT ordering rates, overall and by test subtype. From the electronic health record, we obtained 12 months of baseline CT ordering per 100 patients treated for every physician from four emergency departments. Those who were randomized to receive A&F were shown a de-identified graph of the group's baseline CT utilization, asked to estimate wherein the distribution of their own CT order practices fell, and then shown their actual performance. All participants also received a brief educational intervention. CT ordering rates were collected for all physicians for 6 months after the intervention. Pre-post ordering rates were compared using independent and repeated measures t tests.

Results: Fifty-one of 52 eligible physicians participated. The mean CT ordering rate increased significantly in both experimental conditions after the intervention (intervention pre = 35.7, post = 40.3, t = 4.13, p < 0.001; control pre = 33.9, post = 38.9, t = 3.94, p = 0.001), with no significant between-group difference observed at follow-up (t = 0.43, p = 0.67). Within the intervention group, physicians had poor accuracy in estimating their own ordering behavior at baseline: most overestimated and all guessed that they were in the upper half of the distribution of their peers. CT ordering increased regardless of self-estimate accuracy.

Conclusions: Our A&F intervention failed to reduce physician CT ordering: our feedback to the physicians showed most of them that they had overestimated their CT ordering behavior, and they were therefore unlikely to reduce it as a result. After "audit," it may be prudent to assess baseline clinician awareness of behavior before moving toward a feedback intervention.

Keywords: Audit and feedback; Emergency medicine; Physician ordering.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Self-estimated and actual decile of each physician’s CT ordering before the A&F intervention
Fig. 2
Fig. 2
Rates of CT ordering per 100 patients increased significantly in both the intervention group and the control group between baseline and follow-up
Fig. 3
Fig. 3
Graphical representation of CT ordering used in intervention
See this image and copyright information in PMC

References

    1. Parlangeli O, Giani A, Baccetti F, Bonanno I, Iervolino Y, Todisco M, et al. The evolution of computed tomography (CT) and its user interface: a contextual and comparative analysis of some of the most used solutions. In: Congress of the international ergonomics association. Cham: Springer; 2018 Aug 26. p. 478–87.
    1. Kocher KE, Meurer WJ, Fazel R, Scott PA, Krumholz HM, Nallamothu BK. National trends in use of computed tomography in the emergency department. Ann Emerg Med. 2011;58(5):452–462. doi: 10.1016/j.annemergmed.2011.05.020. - DOI - PubMed
    1. Bellolio MF, Heien HC, Sangaralingham LR, Jeffery MM, Campbell RL, Cabrera D, et al. Increased computed tomography utilization in the emergency department and its association with hospital admission. Western J Emerg Med. 2017;18(5):835–845. doi: 10.5811/westjem.2017.5.34152. - DOI - PMC - PubMed
    1. Levine MB, Moore AB, Franck C, Li J, Kuehl DR. Variation in use of all types of computed tomography by emergency physicians. Am J Emerg Med. 2013;31(10):1437–1442. doi: 10.1016/j.ajem.2013.07.003. - DOI - PubMed
    1. Prevedello LM, Raja AS, Zane RD, Sodickson A, Lipsitz S, Schneider L, et al. Variation in use of head computed tomography by emergency physicians. Am J Med. 2012;125(4):356–364. doi: 10.1016/j.amjmed.2011.06.023. - DOI - PubMed

LinkOut - more resources