Adaptation of a communication interaction behavior instrument for use in mechanically ventilated, nonvocal older adults

Abstract

Background: Valid and reliable instruments are needed to measure communication interaction behaviors between nurses and mechanically ventilated intensive care unit patients who are without oral speech.

Objectives: The aim of this study was to refine and evaluate preliminary validity and reliability of a Communication Interaction Behavior Instrument (CIBI) adapted for use with mechanically ventilated, nonvocal patients in the intensive care unit.

Methods: Raters observed nurse-patient communication interactions using a checklist of nurse and patient behaviors, categorized as positive and negative behaviors. Three-minute video-recorded observations of five mechanically ventilated adults (<60 years old) in the intensive care unit and their nurses were used to establish preliminary interrater reliability and confirm appropriateness of definitions (four observations per dyad, n = 20). On the basis of expert input and reliability results, the behaviors and item definitions on the CIBI were revised. The revised tool was then tested in a larger sample of 38 mechanically ventilated intensive care patients (> 60 years old) and their nurses (four observations per dyad, n = 152) to determine interrater reliability.

Results: For preliminary testing, percent agreement for individual items ranged from 60% to 100% for nurse behaviors and 20% to 100% for patient behaviors across the five pilot cases. On the basis of these results, 11 definitions were modified and four items were dropped. Using the revised 29-item instrument, percent agreement improved for nurse behaviors (73%-100%) and patient behaviors (68%-100%). Kappa coefficients ranged from 0.13 to 1.00, with lower coefficients for patient behaviors.

Conclusion: Preliminary results suggest that the revised CIBI has good face validity and shows good interrater reliability for many of the behaviors, but further refinement is needed. The use of dual raters with adjudication of discrepancies is the recommended method of administration for the revised CIBI.