The use of mixed reality in the preoperative planning of colorectal surgery: Preliminary experience with a narrative review

Abstract

New advanced technologies have recently been developed and preliminarily applied to surgery, including virtual reality (VR), augmented reality (AR) and mixed reality (MR). We retrospectively review all colorectal cases in which we used holographic 3D reconstruction from February 2020 to December 2022. This innovative approach was used to identify vascular anomalies, pinpoint tumor locations, evaluate infiltration into neighboring organs and devise surgical plans for both training and educating trainee assistants. We have also provided a state-of-the-art analysis, briefly highlighting what has been stated by the scientific literature to date. VR facilitates training and anatomical assessments, while AR enhances training and laparoscopic performance evaluations. MR, powered by HoloLens, enriches anatomic recognition, navigation, and visualization. Successful implementation was observed in 10 colorectal cancer cases, showcasing the effectiveness of MR in improving preoperative planning and its intraoperative application. This technology holds significant promise for advancing colorectal surgery by elevating safety and reliability standards.

Keywords: 3D reconstructions; Augmented reality; Cirugía colorrectal; Colorectal surgery; Hologramas; Holograms; Mixed reality; Planificación quirúrgica; Realidad aumentada; Realidad mixta; Realidad virtual; Reconstrucciones en 3D; Surgical planning; Virtual reality.