Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 Feb 24;7(5):431-434.
doi: 10.1136/bmjstel-2020-000782. eCollection 2021.

Integrated eye tracking on Magic Leap One during augmented reality medical simulation: a technical report

Thomas J Caruso  1 , Olivia Hess  1 , Kenny Roy  2 , Ellen Wang  1 , Samuel Rodriguez  1 , Coby Palivathukal  3 , Nick Haber  4
Affiliations

Integrated eye tracking on Magic Leap One during augmented reality medical simulation: a technical report

Thomas J Caruso et al. BMJ Simul Technol Enhanc Learn. .

Abstract

Augmented reality (AR) has been studied as a clinical teaching tool, however eye-tracking capabilities integrated within an AR medical simulator have limited research. The recently developed Chariot Augmented Reality Medical (CHARM) simulator integrates real-time communication into a portable medical simulator. The purpose of this project was to refine the gaze-tracking capabilities of the CHARM simulator on the Magic Leap One (ML1). Adults aged 18 years and older were recruited using convenience sampling. Participants were provided with an ML1 headset that projected a hologram of a patient, bed and monitor. They were instructed via audio recording to gaze at variables in this scenario. The participant gaze targets from the ML1 output were compared with the specified gaze points from the audio recording. A priori investigators planned to iterative modifications of the eye-tracking software until a capture rate of 80% was achieved. Two consecutive participants with a capture rate less than 80% triggered software modifications and the project concluded after three consecutive participants' capture rates were greater than 80%. Thirteen participants were included in the study. Eye-tracking concordance was less than 80% reliable in the first 10 participants. The investigators hypothesised that the eye movement detection threshold was too sensitive, thus the algorithm was adjusted to reduce noise. The project concluded after the final three participants' gaze capture rates were 80%, 80% and 80.1%, respectively. This report suggests that eye-tracking technology can be reliably used with the ML1 enabled with CHARM simulator software.

Keywords: simulation; simulation in healthcare; simulation-based medical education; simulation-based training; simulator design.

PubMed Disclaimer

Conflict of interest statement

Competing interests: TC, EW and SR are on the board of directors for Chariot Kids, a California non-profit organisation that seeks to train providers how to use technologies in healthcare and distribute technologies to sick children.

Figures

Figure 1
Figure 1
CHARM simulator holographic set-up with view of instructor controller. Gaze targets included each of the vital signs on the monitor and the patient. CHARM, Chariot Augmented Reality Medical.
See this image and copyright information in PMC

References

    1. Lu S, Sanchez Perdomo YP, Jiang X, et al. Integrating eye-tracking to augmented reality system for surgical training. J Med Syst 2020;44:192. 10.1007/s10916-020-01656-w - DOI - PubMed
    1. Tang KS, Cheng DL, Mi E, et al. Augmented reality in medical education: a systematic review. Can Med Ed J 2020;11:e81–96. - PMC - PubMed
    1. Krois W, Reck-Burneo CA, Gröpel P, et al. Joint attention in a laparoscopic simulation-based training: a pilot study on camera work, gaze behavior, and surgical performance in laparoscopic surgery. J Laparoendosc Adv Surg Tech A 2020;30:564–8. 10.1089/lap.2019.0736 - DOI - PubMed
    1. Chen H-E, Bhide RR, Pepley DF, et al. Can eye tracking be used to predict performance improvements in simulated medical training? A case study in central venous catheterization. Proc Int Symp Hum Factors Ergon Healthc 2019;8:110–4. 10.1177/2327857919081025 - DOI - PMC - PubMed
    1. Desvergez A, Winer A, Gouyon J-B, et al. An observational study using eye tracking to assess resident and senior anesthetists' situation awareness and visual perception in postpartum hemorrhage high fidelity simulation. PLoS One 2019;14:e0221515. 10.1371/journal.pone.0221515 - DOI - PMC - PubMed

LinkOut - more resources