Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2023 Oct 4:16:100-110.
doi: 10.1016/j.sopen.2023.10.002. eCollection 2023 Dec.

Which, how, and what? Using digital tools to train surgical skills; a systematic review and meta-analysis

Tim M Feenstra  1   2   3 , Sebastiaan L van der Storm  1   2   3 , Esther Z Barsom  1   2 , Jaap H Bonjer  1   4 , Els J M Nieveen van Dijkum  1   2   5 , Marlies P Schijven  1   2   3
Affiliations
Review

Which, how, and what? Using digital tools to train surgical skills; a systematic review and meta-analysis

Tim M Feenstra et al. Surg Open Sci. .

Abstract

Background: Digital tools like digital box trainers and VR seem promising in delivering safe and tailored practice opportunities outside of the surgical clinic, yet understanding their efficacy and limitations is essential. This study investigated Which digital tools are available to train surgical skills, How these tools are used, How effective they are, and What skills they are intended to teach.

Methods: Medline, Embase, and Cochrane libraries were systematically reviewed for randomized trials, evaluating digital skill-training tools based on objective outcomes (skills scores and completion time) in surgical residents. Digital tools effectiveness were compared against controls, wet/dry lab training, and other digital tools. Tool and training factors subgroups were analysed, and studies were assessed on their primary outcomes: technical and/or non-technical.

Results: The 33 included studies involved 927 residents and six digital tools; digital box trainers, (immersive) virtual reality (VR) trainers, robot surgery trainers, coaching and feedback, and serious games. Digital tools outperformed controls in skill scores (SMD 1.66 [1.06, 2.25], P < 0.00001, I2 = 83 %) and completion time (SMD -1.05 [-1.72, -0.38], P = 0.0001, I2 = 71 %). There were no significant differences between digital tools and lab training, between tools, or in other subgroups. Only two studies focussed on non-technical skills.

Conclusion: While the efficacy of digital tools in enhancing technical surgical skills is evident - especially for VR-trainers -, there is a lack of evidence regarding non-technical skills, and need to improve methodological robustness of research on new (digital) tools before they are implemented in curricula.

Key message: This study provides critical insight into the increasing presence of digital tools in surgical training, demonstrating their usefulness while identifying current challenges, especially regarding methodological robustness and inattention to non-technical skills.

Keywords: Digital training; Meta-analysis; Residency; Skills; Systematic review; Training.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflict of interest.

Figures

Fig. 1
Fig. 1
PRISMA flow diagram of included studies.
Fig. 2
Fig. 2
a: Effects of digital tools versus controls on skill outcomes b: Effects of digital tools versus controls on time outcomes.
Fig. 3
Fig. 3
Effects of digital tools versus wet and dry lab on skill scores.
Fig. 4
Fig. 4
a: Effects of VR trainers versus box trainers on skill scores. b: Effects of VR trainers versus box trainers on skill completion time.
Fig. 5
Fig. 5
CanMEDS roles and NOTSS components in included studies.
See this image and copyright information in PMC

References

    1. Poulose B.K., Ray W.A., Arbogast P.G., Needleman J., Buerhaus P.I., Griffin M.R., et al. Resident work hour limits and patient safety. Ann Surg. 2005;241(6):847–856. [discussion 56-60] - PMC - PubMed
    1. Tonelli C.M., Cohn T., Abdelsattar Z., Luchette F.A., Baker M.S. Association of resident independence with short-term clinical outcome in core general surgery procedures. JAMA Surg. 2023;158(3):302–309. doi: 10.1001/jamasurg.2022.6971. PMID: 36723925; PMCID: PMC9996403. - DOI - PMC - PubMed
    1. Mazzone E., Puliatti S., Amato M., Bunting B., Rocco B., Montorsi F., et al. A systematic review and meta-analysis on the impact of proficiency-based progression simulation training on performance outcomes. Ann Surg. 2021;274(2):281–289. - PubMed
    1. Wynn G., Lykoudis P., Berlingieri P. Development and implementation of a virtual reality laparoscopic colorectal training curriculum. Am J Surg. 2018;216(3):610–617. - PubMed
    1. Kapila A.K., Farid Y., Kapila V., Schettino M., Vanhoeij M., Hamdi M. The perspective of surgical residents on current and future training in light of the COVID-19 pandemic. Br J Surg. 2020;107(9):e305. doi: 10.1002/bjs.11761. Epub 2020 Jun 22. PMID: 32567688; PMCID: PMC7361412. - DOI - PMC - PubMed

LinkOut - more resources