Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Jun 15;40(4):Doc47.
doi: 10.3205/zma001629. eCollection 2023.

Successful implementation of a rater training program for medical students to evaluate simulated pediatric emergencies

Nadine Mand  1 , Tina Stibane  2 , Helmut Sitter  2 , Rolf Felix Maier  1 , Andreas Leonhardt  1
Affiliations

Successful implementation of a rater training program for medical students to evaluate simulated pediatric emergencies

Nadine Mand et al. GMS J Med Educ. .

Abstract
in English, German

Introduction: Simulation-based training is increasingly used in pediatrics to teach technical skills, teamwork, and team communication, and to improve potential deficiencies in pediatric emergency care. Team performance must be observed, analyzed, and evaluated by trained raters. The structured training of medical students for the assessment of simulated pediatric emergencies has not yet been investigated.

Methods: We developed a rater training program for medical students to assess guideline adherence, teamwork, and team communication in simulated pediatric emergencies. Interrater reliability was measured at each training stage using Kendall tau coefficients.

Results: In 10 out of 15 pairs of raters interrater reliability was moderate to high (tau>0.4), whereas it was low in the remaining 5 pairs of raters.

Discussion: The interrater reliability showed good agreement between medical students and expert raters at the end of the rater training program. Medical students can be successfully involved in the assessment of guideline adherence as well as teamwork and team communication in simulated pediatric emergencies.

Einleitung: Auf Simulation basierende Schulungsformate werden zunehmend in der Pädiatrie eingesetzt, um technische Fertigkeiten, Teamarbeit und Teamkommunikation zu trainieren und Defizite in pädiatrischen Notfallversorgungen zu verbessern. Geschulte Beobachter*innen sind notwendig, um dies im Rahmen simulierter Notfallsituationen zu erfassen, zu analysieren und zu beurteilen. Die strukturierte Schulung von Medizinstudierenden zur Beurteilung pädiatrischer Notfallsituationen im Rahmen von Simulationstrainings wurde bisher nicht untersucht.

Methoden: Entwicklung eines mehrstufigen Beobachtertrainings für Medizinstudierende zur Bewertung der Leitlinienadhärenz, sowie der Teamarbeit und -kommunikation. Die Interrater-Reliabilität wurde in jeder Stufe des Trainings durch die Bestimmung von Kendall tau-Koeffizienten ermittelt.

Ergebnisse: In 10 von 15 Beobachterpaaren wurde eine moderate bis hohe Interrater-Reliabilität gezeigt (tau>0,4), in den übrigen 5 Beobachterpaaren eine schwache Übereinstimmung.

Diskussion: Die Interrater-Reliabilität zeigte nach Beendigung des Beobachtertrainings eine gute Übereinstimmung zwischen den Beobachter*innen. Medizinstudierende können demnach erfolgreich in die Evaluation der Leitlinienadhärenz sowie der Teamarbeit und -kommunikation einbezogen werden.

Keywords: medical students; pediatric life support; simulation.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Table 1
Table 1. tau* for the agreement between students and the principal investigator
See this image and copyright information in PMC

References

    1. Jones H, Wilmshurst SL, Graydon C. Aetiology and outcome of paediatric cardiopulmonary arrest. Anaesthesia Intensive Care Med. 2017;18(11):537–540. doi: 10.1016/j.mpaic.2017.07.003. - DOI
    1. Kendirli T, Erkek N, Köroğlu T, Yldzdaş D, Bayrakç B, Güzel A, Ctak A, Demirkol D, Agn H, Arslanköylü AE, Kutlu NO, Tuygun N, Paksu MS, Anl AB, Kalkan G, Duman M, Dündaröz R, Asloglu N, Yaman A, Ödek C, Tekin D, Dursan O, Sevketoglu E, Kesici S, Ates C, Gördü Z, Ylmaz HL, Ince E, Karaböcüoglu M. Cardiopulmonary Resuscitation in Children With In-Hospital and Out-of-Hospital Cardiopulmonary Arrest: Multicenter Study From Turkey. Pediatr Emerg Care. 2015;31(11):748–752. doi: 10.1097/PEC.0000000000000337. - DOI - PubMed
    1. Holmberg MJ, Ross CE, Fitzmaurice GM, Chan PS, Duval-Arnould J, Grossestreuer AV, Yankama T, Donnino MW, Andersen LW American Heart Association's Get With The Guidelines-Resuscitation Investigators. Annual Incidence of Adult and Pediatric In-Hospital Cardiac Arrest in the United States. Circ Cardiovasc Qual Outcomes. 2019;12(7):e005580. - PMC - PubMed
    1. Gräsner JT, Lefering R, Koster RW, Masterson S, Böttiger BW, Herlitz J, Wnent J, Tjelmeland IB, Ortiz FR, Maurer H, Baubin M, Mols P, Hadzibegovic I, Ioannides M, Skeluc R, Wissenberg M, Salo A, Hubert H, Nikolaou NI, Loczi G, Svavarsdottir H, Semeraro F, Wright PJ, Clarens C, Pijls R, Cebula G, Correia VG, Cimpoesu D, Raffay V, Trenkler S, Markota A, Srömsöe A, Burkart R, Perkins GD, Bossaert LL EuReCa ONE Collaborators. EuReCa ONE-27 Nations, ONE Europe, ONE Registry: A prospective one month analysis of out-of-hospital cardiac arrest outcomes in 27 countries in Europe. Resuscitation. 2016;105:188–195. doi: 10.1016/j.resuscitation.2016.06.004. - DOI - PubMed
    1. Lehmann R, Seitz A, Meyburg J, Hoppe B, Hoffmann GF, Tönshoff B, Huwendiek S. Pediatric in-hospital emergencies: real life experiences, previous training and the need for training among physicians and nurses. BMC Res Notes. 2019;12(1):19. doi: 10.1186/s13104-019-4051-4. - DOI - PMC - PubMed

Publication types