Analyzing the value of IONM as a complex intervention: The gap between published evidence and clinical practice

Abstract

Objective: Intraoperative neurophysiological monitoring (IONM) was investigated as a complex intervention (CI) as defined by the United Kingdom Medical Research Council (MRC) in published studies to identify challenges and solutions in estimating IONM's effects on postoperative outcomes.

Methods: A scoping review to April 2022 of the influence of setting on what was implemented as IONM and how it influenced postoperative outcomes was performed for studies that compared IONM to no IONM cohorts. IONM complexity was assessed with the iCAT_SR tool. Causal graphs were used to represent this complexity.

Results: IONM implementation depended on the surgical procedure, institution and/or surgeon. "How" IONM influenced neurologic outcomes was attributed to surgeon or institutional experience with the surgical procedure, surgeon or institutional experience with IONM, co-interventions in addition to IONM, models of IONM service delivery and individual characteristics of the IONM provider. Indirect effects of IONM mediated by extent of tumor resection, surgical approach, changes in operative procedure, shorter operative time, and duration of aneurysm clipping were also described. There were no quantitative estimates of the relative contribution of these indirect effects to total IONM effects on outcomes.

Conclusions: IONM is a complex intervention whose evaluation is more challenging than that of a simple intervention. Its implementation and largely indirect effects depend on specific settings that are usefully represented in causal graphs.

Significance: IONM evaluation as a complex intervention aided by causal graphs and multivariable analysis could provide a valuable framework for future study design and assessments of IONM effectiveness in different settings.

Keywords: Complex intervention; Intraoperative neurophysiological monitoring; Structural causal model; iCAT_SR.