Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Nov 24;46(12):102.
doi: 10.1007/s10916-022-01891-3.

Assessment of Core Surgical Skills Using a Mixed Reality Headset - The MoTOR Study

John Valles  1   2 , Taiqing Zhang  3 , Paul McIntosh  3   4 , Maurizio Pacilli  1   2 , Ramesh M Nataraja  5   6
Affiliations

Assessment of Core Surgical Skills Using a Mixed Reality Headset - The MoTOR Study

John Valles et al. J Med Syst. .

Abstract

Introduction: Surgical skill assessment utilises direct observation and feedback by an expert which is potentially subjective, therefore obtaining objective data for hand and eye tracking is essential. Our aim was to evaluate a wearable mixed reality (MR) headset in these domains.

Methods: Participants with differing levels of surgical expertise [novice (N), intermediate (I) & expert (E)] performed 4 simulated surgical tasks; 2 general dexterity (tasks 1&2) and 2 surgical skills (tasks 3&4) wearing the MR headset capturing their hand and eye movements (median & range). Metrics included hand path length and the speed of each index or thumb tip. Gaze data were also captured. Participant demographics, prior expertise and current experience were captured with an electronic survey. Data were analysed with a Shapiro-Wilk test or ANOVA as appropriate. A p-value of < 0.05 was significant.

Results: Thirty-six participants were analysed (N = 18, I = 8, E = 8). Tasks 1&2 revealed 2 speed outcomes (left index and left-hand speed) which were significant. For tasks 3&4, various outcomes were significant: path length for left hand (N:45 cm vs. I:31 cm vs. E:27 cm, p = 0.03) and right hand (N:48 cm vs. I:29 cm vs. E:28 cm, p = 0.01) and total time (N:456s vs. I:292 vs. E: 245, p = 0.0002). With left-hand-tying, average path length (N:61 cm vs. I:39 vs. E:36, p = 0.04), average speed (N:11 cm/s vs. I:23 vs. E:24, p = 0.03), and total time (N:156s vs. I:43 vs. E:37, p = 0.003) were significant. The gaze-tracking was not statistically significant.

Conclusion: The MR headset can be utilised as a valid tool for surgical performance assessment. Outcomes including path length and speed can be valuable metrics captured by the MR Headset during the task completion for detecting surgical proficiency.

Keywords: HoloLens®; Motion tracking; mixed reality; operating room; simulation-based education; surgical simulation; wearable technology.

PubMed Disclaimer

References

    1. Cameron JL. William Stewart Halsted. Our surgical heritage. Ann Surg. 1997;225(5):445–58. - DOI
    1. Hiemstra E, Kolkman W, Wolterbeek R, Trimbos B, Jansen FW. Value of an objective assessment tool in the operating room. Can J Surg J Can De Chir. 2011;54(2):116–22. - DOI
    1. Hove PDv, Tuijthof GJM, Verdaasdonk EGG, Stassen LPS, Dankelman J. Objective assessment of technical surgical skills. Brit J Surg. 2010;97(7):972–87. - DOI
    1. Vedula SS, Ishii M, Hager GD. Objective Assessment of Surgical Technical Skill and Competency in the Operating Room. Annu Rev Biomed Eng. 2017;19(1):301–25. - DOI
    1. Shackelford S, Bowyer M. Modern Metrics for Evaluating Surgical Technical Skills. Curr Surg Reports. 2017;5(10):24. - DOI

LinkOut - more resources