Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Jan;49(1):15-22.
doi: 10.1002/mp.15349. Epub 2021 Nov 22.

Patient posture correction and alignment using mixed reality visualization and the HoloLens 2

Perry B Johnson  1   2 , Amanda Jackson  3 , Mohammad Saki  2 , Emily Feldman  2 , Julie Bradley  1   2
Affiliations

Patient posture correction and alignment using mixed reality visualization and the HoloLens 2

Perry B Johnson et al. Med Phys. 2022 Jan.

Abstract

Purpose: The purpose of this study was to develop and preliminarily test a radiotherapy system for patient posture correction and alignment using mixed reality (MixR) visualization. The write-up of this work also provides an opportunity to introduce the concepts and technology of MixR for a medical physics audience who may be unfamiliar with the topic.

Methods: A MixR application was developed for on optical-see-through head-mounted display (HoloLens 2) allowing a user to simultaneously and directly view a patient and a reference hologram derived from their simulation CT scan. The hologram provides a visual reference for the exact posture needed during treatment and is initialized in relation to the origin of a radiotherapy device using marker-based tracking. The system further provides marker-less tracking that allows the user tofreely navigate the room as they view and align the patient from various angles. The system was preliminarily tested using both a rigid (pelvis) and nonrigid (female mannequin) anthropomorphic phantom. Each phantom was aligned via hologram and accuracy quantified using CBCT and CT.

Results: A fully realized system was developed. Rigid registration accuracy was on the order of 3.0 ± 1.5 mm based on the performance of three users repeating alignment five times each. The lateral direction showed the most variability among users and was associated with the largest off-sets (approximately 2.0 mm). For nonrigid alignment, the MixR setup outperformed a setup based on three-point alignment and setup photos, the latter of which showed a difference in arm position of 2 cm and a torso roll of 6-7°.

Conclusions: MixR visualization is a rapidly emerging domain that has the potential to significantly impact the field of medicine. The current application is an illustration of this and highlights the advantages of MixR for patient setup in radiation oncology. The key feature of the system is the way in which it transforms nonrigid registration into rigid registration by providing an efficient, portable, and cost-effective mechanism for reproducing patient posture without the use of ionizing radiation. Preliminary estimates of registration accuracy indicate clinical viability and form the foundation for further development and clinical testing.

Keywords: HoloLens 2; SGRT; augmented reality; mixed reality.

PubMed Disclaimer

References

REFERENCES

    1. Roberts DW, Strohbehn JW, Hatch JF, Murray W, Kettenberger H. A frameless stereotaxic integration of computerized tomographic imaging and the operating microscope. J Neurosurg. 1986;65:545-549.
    1. Gleason PL, Kikinis R, Altobelli D, et al. Video registration virtual reality for nonlinkage stereotactic surgery. Stereotact Funt Neurosurg. 1994;63:139-143.
    1. Gildenberg PL, Ledoux R, Cosman E, Labuz J. The exoscope-a frame based video/graphics system for intraoperative guidance of surgical resection. Stereotact Funct Neurosurg. 1994;63:23-25.
    1. Masutani Y, Dohi T, Yamane F, Iseki H, Takakura K. Augmented reality visualization system for intravascular neurosurgery. Comput Aided Surg. 1998;3:239-247.
    1. Pandya A, Siadat MR, Auner G. Design, implementation and accuracy of a prototype for medical augmented reality. Comput Aided Surg. 2005;10:23-35.

LinkOut - more resources