Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2022 Aug 1;17(4):220-225.
doi: 10.1097/SIH.0000000000000597. Epub 2021 Jul 28.

Assessing Competence With a Task Trainer: Validity Evidence for Novel Tracheostomy Care Skills Assessment Tool

Rachel Stork Poeppelman  1 , Mary T Coles, Thomas Heater, Luke Vohsing, Victoria Von Sadovszky, Jeffrey E Lutmer, Tensing Maa
Affiliations
Review

Assessing Competence With a Task Trainer: Validity Evidence for Novel Tracheostomy Care Skills Assessment Tool

Rachel Stork Poeppelman et al. Simul Healthc. .

Abstract

Introduction: The purpose of this study was to develop a caregiver and healthcare provider assessment tool to evaluate essential tracheostomy skills using a simulated task trainer.

Methods: Three tracheostomy skill checklists were developed: closed suctioning, open suctioning, and tracheostomy change. Checklist items were developed based on institutional guidelines and a literature review. Items were revised based on iterative expert review and pilot testing. A total of 64 intensive care staff and 24 caregivers were evaluated using the checklists, of which 29 staff members and 4 caregivers were rated simultaneously by 2 raters to estimate interrater reliability. The relationships between checklist performance and staff demographics (experience and discipline) were calculated. A survey examining the selection of automatic fail items and minimum passing score was sent to 660 multidisciplinary staff members.

Results: Intraclass correlations were 0.93 for closed suctioning, 0.93 for open suctioning, and 0.76 for tracheostomy change. Staff performance only correlated with experience for the tracheostomy change checklist and was inconsistently associated with discipline (respiratory therapy vs nursing). A large, multidisciplinary survey with 132 of 660 respondents confirmed the selection of automatic fail items and minimum passing score. A total of 92.9% of the survey respondents agreed with a minimum passing score of 80%.

Conclusions: We developed 3 essential tracheostomy skill checklists with multiple sources of validity evidence to support their use in a simulation-based assessment of tracheostomy skills.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflict of interest.

References

    1. Edwards JD, Kun SS, Keens TG. Outcomes and causes of death in children on home mechanical ventilation via tracheostomy: an institutional and literature review. J Pediatr 2010;157(6):955–959.e2. doi:10.1016/j.jpeds.2010.06.012. - DOI
    1. Kun SS, Edwards JD, Ward SL, Keens TG. Hospital readmissions for newly discharged pediatric home mechanical ventilation patients. Pediatr Pulmonol 2012;47(4):409–414. doi:10.1002/ppul.21536. - DOI
    1. Day T, Farnell S, Haynes S, Wainwright S, Wilson-Barnett J. Tracheal suctioning: an exploration of nurses' knowledge and competence in acute and high dependency ward areas. J Adv Nurs 2002;39(1):35–45. doi:10.1046/j.1365-2648.2002.02240.x. - DOI
    1. Imaiso J, Yamauchi T. Caregiver suctioning education for Japanese patients with an invasive home ventilator. Nurs Health Sci 2009;11(4):422–429. doi:10.1111/j.1442-2018.2009.00469.x. - DOI
    1. Mitchell RB, Hussey HM, Setzen G, et al. Clinical consensus statement: tracheostomy care. Otolaryngol Head Neck Surg 2013;148(1):6–20. doi:10.1177/0194599812460376. - DOI

LinkOut - more resources