Ongoing provision of individual clinician performance data improves practice behavior

Abstract

Background: Clinical practice guidelines summarize evidence from science and attempt to translate those findings into clinical practice. Pervasive and consistent adoption of these guidelines into daily provider practice has proven slow.

Methods: Using postoperative nausea and vomiting (PONV) prophylaxis guideline compliance as our metric, we compared the effects of continuing medical education (CME) alone (I), CME with a single snapshot of provider compliance (II), and ongoing reporting of provider compliance data without further CME (III). We retrospectively analyzed guideline compliance of 23,279 anesthetics at the University of Texas M.D. Anderson Cancer Center. Compliance was defined as a patient with 1 risk factor for PONV receiving at least 1 antiemetic, 2 risk factors receiving at least 2 antiemetics, and 3 risk factors receiving at least 3 antiemetics. Drugs of the same class were counted as single antiemetic administration. Propofol-based anesthetic techniques were counted as receiving 1 antiemetic. Patients with 0 risk factors for PONV were not included. We estimated the compliance rates for each of the 4 time periods of the study adjusting for multiple observations on the same clinician. Individual performance feedback was given once at 6 months after intervention I coincident with a refresher presentation on PONV (start of intervention II) and on an ongoing quarterly basis during intervention III.

Results: Compliance rates were not significantly influenced with CME (intervention I) compared with baseline behavior (54.5% vs 54.4%, P = 0.9140). Significant improvement occurred during the time period when CME was paired with performance data (intervention II) compared with intervention I (59.2% vs 54.4%, P = 0.0002). Further significant improvement occurred when data alone were presented (intervention III) compared with intervention II (65.1% vs 59.2%, P < 0.0001). For patients with 3 risk factors, we saw significant improvement in compliance rates during intervention III (P = 0.0002). In post hoc analysis of overtreatment, the percentage differences between the baseline and time period III decreased as the number of risk factors increased.

Conclusions: We observed the greatest improvement in guideline compliance with ongoing personal performance feedback. Provider feedback can be an effective tool to modify clinical practice but can have unanticipated consequences.