Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 Dec;31(12):8897-8902.
doi: 10.1007/s00330-021-08043-0. Epub 2021 Jun 10.

Augmented reality simulator for CT-guided interventions

D Amiras  1   2 , T J Hurkxkens  3 , D Figueroa  3 , P J Pratt  3   4   5 , B Pitrola  6 , C Watura  6 , S Rostampour  6 , G J Shimshon  7 , M Hamady  6   8
Affiliations

Augmented reality simulator for CT-guided interventions

D Amiras et al. Eur Radiol. 2021 Dec.

Abstract

Introduction: CT-guided interventions are taught using a mentored approach on real patients. It is well established that simulation is a valuable training tool in medicine. This project assessed the feasibility and acceptance of replicating a CT-guided intervention using a bespoke software application with an augmented reality head-mounted display (ARHMD).

Methods: A virtual patient was generated using a CT dataset obtained from The Cancer Imaging Archive. A surface mesh of a virtual patient was projected into the field-of-view of the operator. ChArUco markers, placed on both the needle and agar jelly phantom, were tracked using RGB cameras built into the ARHMD. A virtual CT slice simulating the needle position was generated on voice command. The application was trialled by senior interventional radiologists and trainee radiologists with a structured questionnaire evaluating face validity and technical aspects.

Results: Sixteen users trialled the application and feedback was received from all. Eleven felt the accuracy and realism was adequate for training and twelve felt more confident about their CT biopsy skills after this training session.

Discussion: The study showed the feasibility of simulating a CT-guided procedure with augmented reality and that this could be used as a training tool.

Key points: • Simulating a CT-guided procedure using augmented reality is possible. • The simulator developed could be an effective training tool for clinical practical skills. • Complexity of cases can be tailored to address the training level demands.

Keywords: Augmented reality; Image-guided biopsy; Simulation training; Tomography, X-ray computed.

PubMed Disclaimer

Conflict of interest statement

Philip Pratt is Chief Scientific Officer and Dimitri Amiras is a clinical advisor at Medical iSight Corporation. The authors of this manuscript declare no other relationships with any companies, whose products or services may be related to the subject matter of the article.

Figures

Fig. 1
Fig. 1
a A ChArUco marker in a phantom. b A user wearing the HoloLens 2™
Fig. 2
Fig. 2
a A view of the HoloLens application including a 3D model of a torso and a needle with a ChArUco marker attached. b A view of the HoloLens application including a simulated CT image of a needle
Fig. 3
Fig. 3
An overview of the responses to a selection of closed-ended questions from the feedback questionnaire
See this image and copyright information in PMC

References

    1. Kotsis SV, Chung KC. Application of the see one do one, teach one concept in surgical training. Plast Reconstr Surg. 2013;131:1194–1201. doi: 10.1097/PRS.0b013e318287a0b3. - DOI - PMC - PubMed
    1. Pellegrini VD, Ferguson PC, Cruess R, et al. Sufficient competence to enter the unsupervised practice of orthopaedics: what is it when does it occur, and do we know it when we see it? J Bone Joint Surg Am. 2015;97:1459–1464. doi: 10.2106/JBJS.O.00025. - DOI - PMC - PubMed
    1. Al-Elq AH. Simulation-based medical teaching and learning. J Fam Community Med. 2010;17:35. doi: 10.4103/1319-1683.68787. - DOI - PMC - PubMed
    1. Nestel D, Groom J, Eikeland-Husebø S, O’Donnell JM. Simulation for learning and teaching procedural skills. Simul Healthc. 2011;6:S10–S13. doi: 10.1097/SIH.0b013e318227ce96. - DOI - PubMed
    1. Mendiratta-Lala M, Williams TR, Mendiratta V, et al. Simulation center training as a means to improve resident performance in percutaneous noncontinuous CT-guided fluoroscopic procedures with dose reduction. AJR Am J Roentgenol. 2015;204:W376–W383. doi: 10.2214/AJR.14.13420. - DOI - PubMed

LinkOut - more resources