Assessment of the effectiveness of hospital external disaster functional drills on health care receivers' performance, using standardized patients and mass cards simulation: a pilot study from Saudi Arabia

Abstract

Background: Given the increasing frequency of disasters globally, it is critical that healthcare systems are prepared for these mass casualty events. The Saudi health system's preparedness for mass casualty incidents needs to be more robust, potentially due to limited disaster drills and inadequate standardized patient (SP) simulation training. This study aims to (i) assess the performance of front-line hospital staff in Saudi Arabia through a functional drill and (ii) evaluate the drill's effectiveness using SP and MAC-SIM cards, providing detailed insights into its design and execution.

Methods: A functional drill was conducted at a government hospital in Riyadh, Saudi Arabia, on December 19, 2022, using a cross-sectional approach with two phases. 141 healthcare receivers served as subjects, while 23 volunteers acted as SPs. The scenario simulated a building collapse to assess the emergency department (ED) response, interdepartmental communication, and surge capacity. Data were collected through direct observation of healthcare practitioners' interactions with the SPs, analysis of SP data, and participant feedback. Quantitative data were analyzed descriptively, while qualitative data were examined for patterns and themes related to simulation performance and effectiveness.

Results: The hospital receivers' performances demonstrated accurate triage categories. The ED team assessed most patients (67%) in less than 5 min. For patients requiring definitive care, such as intensive care unit, 95% spent less than 2.5 h in the ED. Most patients (65%) required 'other treatments'. Communication was efficient in the triage zone and the yellow treatment area. Participants' feedback on using MAC-SIM cards during the simulation was overwhelmingly positive with 82.61% reporting that MAC-SIM use helped them respond better. Experienced SPs (paramedics) with prior disaster knowledge and experience outperformed inexperienced SPs (nurses) in the functional exercise.

Conclusion: This groundbreaking study is the first in the Arabic Gulf region to use SPs with MAC-SIM cards in functional drills. The findings highlight the potential of simulation exercises to improve hospital team knowledge and performance when responding to disasters. Multiple evaluation techniques can effectively identify participant strengths and weaknesses, informing future disaster improvement plans. This information is a valuable resource for Arabic and middle-income countries where disaster medicine is still developing.

Keywords: Disaster medicine; Drill; MAC-SIM cards; Realistic scenario; Simulation training; Standardized patient; Team performance.

Fig. 1

Organizational structure. EMS: Emergency Medical Services, HICT: Hospital Incident Command Team

Fig. 2

A Mass Casualty Simulation card (MAC-SIM)

Fig. 3

Color tags given to standardized patients (SPs)

Fig. 4

Time taken to examine standardized patients (SPs) once in the hospital

Fig. 5

Time spent in the ED before the standardized patient (SP) was sent to OR /ICU /Ward

Fig. 6

Methods personnel used to communicate in different areas during the drill