Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Feb;17(2):385-391.
doi: 10.1007/s11548-021-02526-7. Epub 2021 Nov 24.

HoloUS: Augmented reality visualization of live ultrasound images using HoloLens for ultrasound-guided procedures

Trong Nguyen  1 , William Plishker  2 , Andrew Matisoff  1 , Karun Sharma  1 , Raj Shekhar  3
Affiliations

HoloUS: Augmented reality visualization of live ultrasound images using HoloLens for ultrasound-guided procedures

Trong Nguyen et al. Int J Comput Assist Radiol Surg. 2022 Feb.

Abstract

Purpose: Microsoft HoloLens is a pair of augmented reality (AR) smart glasses that could improve the intraprocedural visualization of ultrasound-guided procedures. With the wearable HoloLens headset, an ultrasound image can be virtually rendered and registered with the ultrasound transducer and placed directly in the practitioner's field of view.

Methods: A custom application, called HoloUS, was developed using the HoloLens and a portable ultrasound machine connected through a wireless network. A custom 3D-printed case with an AR-pattern for the ultrasound transducer permitted ultrasound image tracking and registration. Voice controls on the HoloLens supported the scaling and movement of the ultrasound image as desired. The ultrasound images were streamed and displayed in real-time. A user study was performed to assess the effectiveness of the HoloLens as an alternative display platform. Novices and experts were timed on tasks involving targeting simulated vessels using a needle in a custom phantom.

Results: Technical characterization of the HoloUS app was conducted using frame rate, tracking accuracy, and latency as performance metrics. The app ran at 25 frames/s, had an 80-ms latency, and could track the transducer with an average reprojection error of 0.0435 pixels. With AR visualization, the novices' times improved by 17% but the experts' times decreased slightly by 5%, which may reflect the experts' training and experience bias.

Conclusion: The HoloUS application was found to enhance user experience and simplify hand-eye coordination. By eliminating the need to alternately observe the patient and the ultrasound images presented on a separate monitor, the proposed AR application has the potential to improve efficiency and effectiveness of ultrasound-guided procedures.

Keywords: Augmented reality; Head-mounted display; HoloLens; Ultrasound guidance; Ultrasound registration; Ultrasound visualization.

PubMed Disclaimer

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Shafqat A, Ferguson E, Thanawala V, Bedforth NM, Hardman JG, McCahon RA (2015) Visuospatial ability as a predictor of novice performance in ultrasound-guided regional anesthesia. Anesthesiology 123(5):1188–1197. https://doi.org/10.1097/ALN.0000000000000870 - DOI - PubMed
    1. García-Vázquez V, Von Haxthausen F, Jäckle S, Schumann C, Kuhlemann I, Bouchagiar J, Höfer AC, Matysiak F, Hüttmann G, Goltz JP, Kleemann M (2018) Navigation and visualisation with HoloLens in endovascular aortic repair. Innov Surg Sci 3(3):167–177. https://doi.org/10.1515/iss-2018-2001 - DOI - PubMed - PMC
    1. Kuhlemann I, Kleemann M, Jauer P, Schweikard A, Ernst F (2017) Towards X-ray free endovascular interventions–using HoloLens for on-line holographic visualisation. Healthcare Technol Lett 4(5):184–187. https://doi.org/10.1049/htl.2017.0061 - DOI
    1. Pepe A, Trotta GF, Mohr-Ziak P, Gsaxner C, Wallner J, Bevilacqua V, Egger J (2019) A marker-less registration approach for mixed reality–aided maxillofacial surgery: a pilot evaluation. J Digit Imag 32(6):1008–1018. https://doi.org/10.1007/s10278-019-00272-6 - DOI
    1. Kuzhagaliyev T, Clancy NT, Janatka M, Tchaka K, Vasconcelos F, Clarkson MJ, Gurusamy K, Hawkes DJ, Davidson B, Stoyanov D (2018) Augmented reality needle ablation guidance tool for irreversible electroporation in the pancreas. InMedical Imaging Image-Guided Procedures, Robotic Interventions, and Modeling. Int Soc Opt Photon. https://doi.org/10.1117/12.2293671 - DOI

LinkOut - more resources