Professional Assessment Tool for Team Improvement: An assessment tool for paediatric intensive care unit nurses' technical and nontechnical skills

Abstract

Background: Cardiorespiratory arrests are rare in paediatric intensive care units, yet intensive care nurses must be able to initiate resuscitation before medical assistance is available. For resuscitation to be successful, instant decision-making, team communication, and the coordinating role of the first responsible nurse are crucial. In-house resuscitation training for nurses includes technical and nontechnical skills.

Objectives: The aim of this study was to develop a valid, reliable, and feasible assessment instrument, called the Professional Assessment Tool for Team Improvement, for the first responsible nurse's technical and nontechnical skills.

Methods: Instrument development followed the COnsensus-based Standards for the selection of health Measurement Instruments guidelines and professionals' expertise. To establish content validity, experts reached consensus via group discussions about the content and the operationalisation of this team role. The instrument was tested using two resuscitation assessment scenarios. Inter-rater reliability was established by assessing 71 nurses in live scenario sessions and videotaped sessions, using intraclass correlation coefficients and Cohen's kappa. Internal consistency for the total instrument was established using Cronbach's alpha. Construct validity was assessed by examining the associations between raters' assessments and nurses' self-assessment scores.

Results: The final instrument included 12 items, divided into four categories: Team role, Teamwork and communication, Technical skills, and Reporting. Intraclass correlation coefficients were good in both live and videotaped sessions (0.78-0.87). Cronbach's alpha was stable around 0.84. Feasibility was approved (assessment time reduced by >30%).

Conclusions: The Professional Assessment Tool for Team Improvement appears to be a promising valid and reliable instrument to assess both technical and nontechnical skills of the first responsible paediatric intensive care unit nurse. The ability of the instrument to detect change over time (i.e., improvement of skills after training) needs to be established.

Keywords: Assessment; Development; Nurses' role; Resuscitation; Teamwork.