Agreement between orthopedic surgeons and neurosurgeons regarding a new algorithm for the treatment of thoracolumbar injuries: a multicenter reliability study

Abstract

Introduction: Considerable variability exists in the management of thoracolumbar (TL) spine injuries. Although there are many influences, one significant factor may be the treating surgeon's specialty and training (ie, orthopedic surgery vs. neurosurgery). Our objective was to assess the agreement between spinal orthopedic and neurologic surgeons in rating the severity of TL spine injuries with a new treatment algorithm. This information could be important in establishing consensus-based protocols for managing these challenging injuries.

Methods: Twenty-eight spinal surgeons (8 neurosurgeons and 20 orthopedic surgeons) reviewed 56 TL injury case histories. Each case was classified and scored according to the TL injury severity score (TLISS). The case histories were reordered and the physicians repeated the exercise 3 months later. At both intervals the surgeons were asked if they agreed with the final treatment recommendation of the TLISS algorithm. The reliability and decision validity of the TLISS was compared.

Results: Between-group interrater reliability was similar to within group reliabilities. Intrarater reliability was also similar between groups. The between speciality interrater reliability of the TLISS management recommendation was moderate (74% agreement, kappa=0.532). Orthopedic and neurosurgeons agreed with the TLISS management recommendation 91.4% and 94.4% of the time, respectively.

Conclusions: The TLISS demonstrated good reliability in terms of intraobserver and interobserver agreement on the algorithmic treatment recommendations. The recommendation for operation seems to be consistent between fellowship-trained orthopedic and neurosurgical spine surgeons. This type of classification system may reduce the existing variability and initial management decision for treatment of TL injuries.