Automated evidence-based critiquing of orders for abdominal radiographs: impact on utilization and appropriateness

Abstract

Objective: Inappropriate utilization of diagnostic testing has been well documented. The purpose of this study was to measure the impact of presenting real time, evidence-based critiques about the appropriateness of abdominal radiograph (KUB) orders on physician decision making.

Design: Prospective trial where evidence-based critiques were presented to ordering clinicians in two kinds of situations: (1) a KUB was likely to have a low probability of providing useful information, or (2) an alternative view(s) was more appropriate given the clinical circumstance. There were two phases of the trial: Phase 1 was a 9-week period where evidence-based critiques were presented at the time of ordering a KUB, followed by Phase 2, a 19-week period in which orderers were randomized to receive critiques either amended to include both institutional data regarding the utility of the critiques and stronger messages about the lack of utility of the study, or the same critiques as presented in Phase 1, depending upon indication. Based upon the radiologist's report of their interpretation of the exams, the results of the examinations were scored as positive, equivocal, or negative using structured criteria.

Results: 299 KUBs in Phase 1 and 385 KUBs in Phase 2 received at least one critique. Cancellation rates of low yield films were low, and were similar in Phase 1 and 2, 8/258 (3%) vs. 10/283 (4%). Compliance with the recommendation for alternative view(s) was higher: 19/104 (38%) in Phase 1 vs. 96/176 (55%) in Phase 2 (p = 0.006). The results differentiated low-yield from non-low-yield films: 5% of low-yield films vs. 20% of non-low-yield films were positive in Phase 2 (p < 0.0001). Surgical physicians were less likely to cancel (p = 0.07) or to change to the suggested view(s) (p < 0.0001) than medical physicians or nurses.

Conclusions: The intervention identified clinical situations in which KUBs appeared to have a low clinical yield. In response to evidence-based critiques, providers were reluctant to cancel their order, but were more willing to change to different views. To reduce the number of inappropriate radiographic films, stronger incentives or interventions may be required.

Figure 1

Structured KUB ordering screen. Capturing history/assessment items; user must enter at least one of each.

Figure 2

Example of low-yield critique. The user is notified that KUB is not likely to yield worthwhile information and that ultrasound might be more useful.

Figure 3

Example of alternate-view critique. In some situations, an alternate view(s) might be superior to KUB.

Figure 4

KUB frequencies over time (January 1994-February 1996) to evaluate whether there was a time series effect associated with the intervention. This was evaluated using piecewise regression. No significant effect was found.