Be careful with triage in emergency departments: interobserver agreement on 1,578 patients in France

Abstract

Background: For several decades, emergency departments (EDs) utilization has increased, inducing ED overcrowding in many countries. This phenomenon is related partly to an excessive number of nonurgent patients. To resolve ED overcrowding and to decrease nonurgent visits, the most common solution has been to triage the ED patients to identify potentially nonurgent patients, i.e. which could have been dealt with by general practitioner. The objective of this study was to measure agreement among ED health professionals on the urgency of an ED visit, and to determine if the level of agreement is consistent among different sub-groups based on following explicit criteria: age, medical status, type of referral to the ED, investigations performed in the ED, and the discharge from the ED.

Methods: We conducted a multicentric cross-sectional study to compare agreement between nurses and physicians on categorization of ED visits into urgent or nonurgent. Subgroups stratified by criteria characterizing the ED visit were analyzed in relation to the outcome of the visit.

Results: Of 1,928 ED patients, 350 were excluded because data were lacking. The overall nurse-physician agreement on categorization was moderate (kappa = 0.43). The levels of agreement within all subgroups were variable and low. The highest agreement concerned three subgroups of complaints: cranial injury (kappa = 0.61), gynaecological (kappa = 0.66) and toxicology complaints (kappa = 1.00). The lowest agreement concerned two subgroups: urinary-nephrology (kappa = 0.09) and hospitalization (kappa = 0.20). When categorization of ED visits into urgent or nonurgent cases was compared to hospitalization, ED physicians had higher sensitivity and specificity than nurses (respectively 94.9% versus 89.5%, and 43.1% versus 30.9%).

Conclusions: The lack of physician-nurse agreement and the inability to predict hospitalization have important implications for patient safety. When urgency screening is used to determine treatment priority, disagreement might not matter because all patients in the ED are seen and treated. But using assessments as the basis for refusal of care to potential nonurgent patients raises legal, ethical, and safety issues. Managed care organizations should be cautious when applying such criteria to restrict access to EDs.

Figure 1

Receiver operating curve (ROC) and area under curve (AUC) values for categorization into urgent and nonurgent case between triage nurses and ED physicians who were the reference.