A national ICU telemedicine survey: validation and results

Abstract

Background: A recent ICU telemedicine research consensus conference identified the need for reliable methods of measuring structural features and processes of critical care delivery in the domains of organizational context and characteristics of ICU teams, ICUs, hospitals, and of the communities supported by an ICU.

Methods: The American College of Chest Physicians Critical Care Institute developed and conducted a survey of ICU telemedicine practices. A 32-item survey was delivered electronically to leaders of 311 ICUs, and 11 domains were identified using principal components analysis. Survey reliability was judged by intraclass correlation among raters, and validity was measured for items for which independent assessment was available.

Results: Complete survey information was obtained for 170 of 311 ICUs sent invitations. Analysis of a subset of surveys from 45 ICUs with complete data from more than one rater indicated that the survey reliability was in the excellent to nearly perfect range. Coefficients for measures of external validation ranged from 0.63 to 1.0. Analyses of the survey revealed substantial variation in the practice of ICU telemedicine, including ICU telemedicine center staffing patterns; qualifications of providers; case sign-out, ICU staffing models, leadership, and governance; intensivist review for new patients; adherence to best practices; use of quality and safety information; and ICU physician sign out for their patients.

Conclusions: The American College of Chest Physicians ICU telemedicine survey is a reliable tool for measuring variation among ICUs with regard to staffing, structure, processes of care, and ICU telemedicine practices.