A comprehensive systematic review of the use of simulation in the continuing education and training of qualified medical, nursing and midwifery staff

Abstract

Background: Simulation can be defined as a person, device or set of conditions made to resemble a real life situation. It is used in many high-risk industries particularly when reality is dangerous, critical events are rare and errors are costly in human and/or financial terms. The use of simulation in the UK is now considered an essential component of education programmes designed for healthcare practitioners. However the use of simulation in undergraduate education has been studied in depth but little is known about its use in postgraduate education.

Objective: The aim of this systematic review was to establish: where and in which context is simulation an effective educational medium in post qualifying/continuing education; what is the benefit to learners of using simulation in respect of their knowledge, skills and confidence and what are the implications for future research in this area?

Inclusion criteria: This review looked for both quantitative and qualitative evidence in the form of primary research.The review focused on post qualification medical, nursing and midwifery staff undertaking educational development programmes utilising simulation. Types of interventions: the intervention explored in this review is simulation in the form of the re-creation of a patient centred scenario / event in a realistic context. The review explicitly excluded simulation designed to specifically to improve motor skills in isolation from context, such as part task trainers.

Types of outcome measures: The outcome measures to be explored in this review were: demonstration of the application of knowledge to the simulated clinical situation; demonstrable improvement in knowledge of the environment and equipment; demonstration of risk assessment; safe working practice in relation to the clinical environment; recognition of own limitations and knowing when to call for help; effective communication; team working and leadership skills; evidence from learners in relation to the educational experience; evidence of increased learner confidence following simulated practice; evidence of improved patient outcome being assessed in relation to training SEARCH STRATEGY: The search strategy aimed to find both published and unpublished English language studies from 1998-2009. Databases systematically searched included: Medline, CINAHL, EMBASE, ERIC and the Dissertation Abstracts International Proceedings.

Methodological quality: Papers were assessed for methodological quality independently by two of the review team. Critical appraisal of methodological quality of papers was undertaken using the Joanna Briggs Institute modules, Meta Analysis of Statistics Assessment and Review Instrument (JBI-MAStARI) and Qualitative Assessment and Review Instrument (JBI-QARI). Differences in judgment were resolved through discussion between the two reviewers of their differences and through the inclusion of a third reviewer if necessary in order to reach consensus. A fifth member of the team independently reviewed all included and excluded studies as a quality control mechanism.

Data collection: The process of data extraction was undertaken independently by two reviewers using the JBI data extraction tools.

Data synthesis: A statistical meta-analysis of the data was not possible due to the variation in outcome measures used in the papers. The findings are therefore presented descriptively using the specified outcome measures as a reporting framework.

Results: The initial search identified 1522 papers. Thirty eight papers were considered to have met the inclusion criteria and were subsequently critically appraised for methodological quality. Thirty papers were considered to be of appropriate quality for inclusion in the review. These were predominantly experimental pre post test studies but they covered a wide range of healthcare workers and situations.

Conclusion: There is considerable evidence that suggests that simulation based educational programmes are consistently effective in improving the performance of doctors, nurses and midwives in educational contexts particularly in teamwork and communication. There is also evidence that practitioners value simulation as a learning and teaching strategy. There is however very little evidence to support the assumption that improvements in performance are translated into "real life" clinical settings and ultimately outcomes for service users.

Implications for practice: Although the evidence base provided by this review is relatively weak in terms of educational practice it would seem to have high face validity. The evidence has added coherence when seen in the context of educational theory and those planning educational programmes for healthcare practitioners should be cognizant of the potential benefits offered by simulation as part of a blended approach to learning.

Implications for research: This review has identified a clear need to establish causative links between simulation based educational programmes and improvements in healthcare practice, by using experimental designs where simulation is compared with other educational interventions.