Evaluation of an automated test ordering and feedback system for general practitioners in daily practice

Abstract

Objective: To evaluate the use of an automated test ordering and feedback system (named GRIF) in daily practice. The system produces recommendations to general practitioners (GPs) to improve the application of accepted practice guidelines for test ordering.

Methods: A randomised controlled trial with balanced block design was carried out in general practices in two regions of the Netherlands from August 2000 to July 2001. We implemented the GRIF system on the workstations at the offices of the participating GPs. The GPs (n=11) were asked to use GRIF during patient consultation instead of filling in the paper request form. The system displayed critical comments about their non-adherence to the guidelines as apparent from the request forms.

Results: The median time of producing the comments plus the response time of the GP was 13s. Of the 2780 presented recommendations, 4.3% were accepted. Advice of the GRIF system that presents a concrete test to request in a particular situation is adhered to most frequently. Finally, there seems to be a decrease of accepted comments over the trial period.

Conclusion: Computerised recommendations should contain, if possible, suggestions for alternative tests to improve the application of these recommendations. Furthermore, creative solutions must be developed to avoid that GPs get used to the recommendations of critiquing systems and to stimulate a better adherence to these recommendations.