Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Randomized Controlled Trial
. 2022 May;37(6):1400-1407.
doi: 10.1007/s11606-021-07002-1. Epub 2021 Sep 9.

Effect of Peer Benchmarking on Specialist Electronic Consult Performance in a Los Angeles Safety-Net: a Cluster Randomized Trial

Behavioral Economics and eConsult Steering Committee; Daniella Meeker  1 , Mark W Friedberg  2   3 , Tara K Knight  4 , Jason N Doctor  4 , Dina Zein  5 , Nancy Cayasso-McIntosh  6 , Noah J Goldstein  7 , Craig R Fox  7 , Jeffrey A Linder  8 , Stephen D Persell  8 , Stanley Dea  6 , Paul Giboney  6 , Hal F Yee  6
Affiliations
Randomized Controlled Trial

Effect of Peer Benchmarking on Specialist Electronic Consult Performance in a Los Angeles Safety-Net: a Cluster Randomized Trial

Behavioral Economics and eConsult Steering Committee et al. J Gen Intern Med. 2022 May.

Abstract

Background: Since the advent of COVID-19, accelerated adoption of systems that reduce face-to-face encounters has outpaced training and best practices. Electronic consultations (eConsults), structured communications between PCPs and specialists regarding a case, have been effective in reducing face-to-face specialist encounters. As the health system rapidly adapts to multiple new practices and communication tools, new mechanisms to measure and improve performance in this context are needed.

Objective: To test whether feedback comparing physicians to top performing peers using co-specialists' ratings improves performance.

Design: Cluster-randomized controlled trial PARTICIPANTS: Eighty facility-specialty clusters and 214 clinicians INTERVENTION: Providers in the feedback arms were sent messages that announced their membership in an elite group of "Top Performers" or provided actionable recommendations with feedback for providers that were "Not Top Performers."

Main measures: The primary outcomes were changes in peer ratings in the following performance dimensions after feedback was received: (1) elicitation of information from primary care practitioners; (2) adherence to institutional clinical guidelines; (3) agreement with peer's medical decision-making; (4) educational value; (5) relationship building.

Key results: Specialists showed significant improvements on 3 of the 5 consultation performance dimensions: medical decision-making (odds ratio 1.52, 95% confidence interval 1.08-2.14, p<.05), educational value (1.86, 1.17-2.96) and relationship building (1.63, 1.13-2.35) (both p<.01).

Conclusions: The pandemic has shed light on clinicians' commitment to professionalism and service as we rapidly adapt to changing paradigms. Interventions that appeal to professional norms can help improve the efficacy of new systems of practice. We show that specialists' performance can be measured and improved with feedback using aspirational norms.

Trial registration: clinicaltrials.gov NCT03784950.

Keywords: behavioral economics; electronic consultation; peer comparison; quality of care; specialty care.

PubMed Disclaimer

Conflict of interest statement

Hal Yee is an advisor to RubiconMD. All other authors declare that they do not have a conflict of interest.

Figures

Figure 1
Figure 1
CONSORT diagram. Specialty-affiliation clusters (m=80) were each randomized to one of three arms, ultimately comprising 214 randomized specialists.
Figure 2
Figure 2
Adjusted odds of improvement after feedback. The odds ratio for improvement for each rated dimension after feedback.
See this image and copyright information in PMC

References

    1. Huang X, Rosenthal MB. Transforming Specialty Practice — The Patient-Centered Medical Neighborhood. New England Journal of Medicine. 2014;370(15):1376–1379. doi: 10.1056/nejmp1315416. - DOI - PubMed
    1. Forrest CB, Glade GB, Baker AE, Bocian A, von Schrader S, Starfield B. Coordination of specialty referrals and physician satisfaction with referral care. Arch Pediatr Adolesc Med. 2000;154(5):499–506. doi: 10.1001/archpedi.154.5.499. - DOI - PubMed
    1. Liddy C, Afkham A, Drosinis P, Joschko J, Keely E. Impact of and Satisfaction with a New eConsult Service: A Mixed Methods Study of Primary Care Providers. J Am Board Fam Med. 2015;28(3):394–403. doi: 10.3122/jabfm.2015.03.140255. - DOI - PubMed
    1. Keely E, Canning S, Saloojee N, Afkham A, Liddy C. Improving Access to Gastroenterologist Using eConsultation: A Way to Potentially Shorten Wait Times. J Can Assoc Gastroenterol. 2018;1(3):124–128. doi: 10.1093/jcag/gwy017. - DOI - PMC - PubMed
    1. Schettini P, Shah KP, O’Leary CP, et al. Keeping care connected: e-Consultation program improves access to nephrology care. J Telemed Telecare. Published online January 1, 2017:1357633X17748350. - PubMed

Publication types

Associated data