Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2025 Feb 3:27:e63939.
doi: 10.2196/63939.

Dynamic Augmented Reality Cues for Telementoring in Minimally Invasive Surgeries: Scoping Review

Hawa Hamza  1 , Omar M Aboumarzouk  1 , Abdulla Al-Ansari  1 , Nikhil V Navkar  1
Affiliations

Dynamic Augmented Reality Cues for Telementoring in Minimally Invasive Surgeries: Scoping Review

Hawa Hamza et al. J Med Internet Res. .

Abstract

Background: Remote surgeons use telementoring technologies to provide real-time guidance during minimally invasive surgeries (MIS). Such technologies are continuously improving with the integration of dynamic augmented reality (AR) cues. This includes virtual overlays of hand gestures, pointers, and surgical tools onto the operating surgeon's view. The operating surgeon comprehends this augmented information to operate on the patient. Thus, understanding these dynamic AR cues (either during surgical training or live surgery) is crucial.

Objective: In this paper, we aimed to review the existing telementoring technologies that use dynamic AR cues during MIS. This review describes the MIS (including surgery type, specialty, procedure, and clinical trial), the telementoring system, the dynamic AR cues generated by these systems, and evaluation of the technology in terms of technical aspects, user perceptions, skills gained, and patient outcomes.

Methods: A scoping review was conducted using PubMed, Web of Science, Scopus, IEEE Xplore, and ACM Digital Library databases. The search terms included "telementoring," "minimally invasive surgery," and "augmented reality" without restrictions imposed on the publication year. Articles covering telementoring using dynamic AR cues during MIS, including laparoscopic and robot-assisted, were identified.

Results: A total of 21 articles were included and categorized based on type of surgery, the telementoring technology used, and evaluation of the technology. Most of the articles reported on laparoscopic suturing performed using synthetic phantoms. Hand gestures and surgical tools were the most frequently used dynamic AR cues (10 articles on each cue), while the mentors and mentees primarily consisted of experienced surgeons and medical students. The studies assessing the telementoring technologies were either descriptive (7 articles) or analytical (14 articles) where it was compared against no cue, prerecorded visual cue, in-person guidance, audio cue, or static AR cue. Outcomes were measured mostly using skills gained (13 articles) and user perception about the telementoring system.

Conclusions: In general, telementoring using dynamic AR cues resulted in positive outcomes during MIS. In some cases, they were considered on par with conventional methods such as audio cues and in-person guidance. Further randomized controlled trials are required to objectively assess its clinical benefits.

Keywords: PRISMA; augmented reality; communication; dynamic visual cue; laparoscopic; minimally invasive surgery; patient outcomes; robotics; scoping review; surgeons; technologies; telemedicine; telementoring; teleproctoring.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: None declared.

Figures

Figure 1
Figure 1
Flowchart depicting identification, screening, and inclusion of articles on the use of dynamic augmented reality cues during minimally invasive surgical telementoring.
Figure 2
Figure 2
Depiction of surgical procedures and the corresponding clinical settings under which the telementoring technologies were tested.
Figure 3
Figure 3
Various dynamic augmented reality cues overlayed on the mentee’s operative field.
Figure 4
Figure 4
Number of articles reporting telementoring systems using dynamic augmented reality cues, specifically, hand gestures, pointers, and surgical tools [6,13,18,20-22,40-48,51-54]. ART: augmented reality telementoring; MVR: merged virtual reality; VIPAR: virtual interactive presence and augmented reality.
Figure 5
Figure 5
Number of articles using dynamic augmented reality cues in minimally invasive surgical telementoring.
See this image and copyright information in PMC

References

    1. Fernandes RD, Ghasroddashti A, Sorefan-Mangou F, Williams E, Choi K, Fasola L, Szasz P, Zevin B. Educational effectiveness of telementoring as a continuing professional development intervention for surgeons in practice: a systematic review. Ann Surg Open. 2023;4(4):e341. doi: 10.1097/AS9.0000000000000341. https://europepmc.org/abstract/MED/38144497 - DOI - PMC - PubMed
    1. Netzer I, Kirkpatrick AW, Nissan M, McKee JL, McBeth P, Dobron A, Glassberg E. Rubrum coelis: the contribution of real-time telementoring in acute trauma scenarios-a randomized controlled trial. Telemed J E Health. 2019;25(11):1108–1114. doi: 10.1089/tmj.2018.0173. - DOI - PubMed
    1. Sparn MB, Teixeira H, Chatziisaak D, Schmied B, Hahnloser D, Bischofberger S. Virtual reality simulation training in laparoscopic surgery - does it really matter, what simulator to use? Results of a cross-sectional study. BMC Med Educ. 2024;24(1):589. doi: 10.1186/s12909-024-05574-0. https://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-024-05574-0 10.1186/s12909-024-05574-0 - DOI - DOI - PMC - PubMed
    1. Wagenaar S, Nederhoed JH, Hoksbergen AW, Bonjer HJ, Wisselink W, van Ramshorst GH. Minimally invasive, laparoscopic, and robotic-assisted techniques versus open techniques for kidney transplant recipients: a systematic review. Eur Urol. 2017;72(2):205–217. doi: 10.1016/j.eururo.2017.02.020.S0302-2838(17)30109-4 - DOI - PubMed
    1. Chang SY, Chan KS, Oo AM. Can computerized simulation be used to assess surgical proficiency in laparoscopic colorectal surgeries? A systematic review. Surg Innov. 2024;31(2):195–211. doi: 10.1177/15533506241232791. - DOI - PubMed

Publication types

LinkOut - more resources