Artificial intelligence in the operating room: A systematic review of AI models for surgical phase, instruments and anatomical structure identification
- PMID: 40862620
- DOI: 10.1111/aogs.70045
Artificial intelligence in the operating room: A systematic review of AI models for surgical phase, instruments and anatomical structure identification
Abstract
Introduction: This systematic review examines the application of multiple deep learning algorithms in the analysis of intraoperative videos to enable feature extraction and pattern recognition of surgical phases, anatomical structures, and surgical instruments.
Material and methods: A comprehensive literature search was conducted across PubMed, Web of Science, and EBSCO, covering studies published until March 2024. This review includes studies that applied AI models in the operating room for surgical-phase recognition and/or anatomical structures and instruments. Only studies utilizing machine learning or deep learning for surgical video analysis were considered. The primary outcome measures were accuracy, precision, recall, and F1 score.
Results: A total of 21 studies were included. Multilayer architecture of interconnected neural networks was predominantly used. The deep learning models demonstrated promising results, with accuracy ranging from 81% to 93.2% for surgical-phase recognition. Anatomical structure recognition models achieved accuracy between 71.4% and 98.1%.
Conclusions: Artificial intelligence has the potential to significantly improve surgical precision and workflow, with demonstrated success in phase recognition and anatomical structure identification. However, further research is needed to address dataset limitations, standardize annotation protocols, and minimize biases.
Keywords: artificial intelligence; instrument recognition; minimally invasive surgery; surgical step recognition.
© 2025 The Author(s). Acta Obstetricia et Gynecologica Scandinavica published by John Wiley & Sons Ltd on behalf of Nordic Federation of Societies of Obstetrics and Gynecology (NFOG).
References
REFERENCES
-
- Bartoli A, Collins T, Bourdel N, Canis M. Computer assisted minimally invasive surgery: is medical computer vision the answer to improving laparosurgery? Med Hypotheses. 2012;79(6):858‐863.
-
- Madad Zadeh S, Francois T, Calvet L, et al. SurgAI: deep learning for computerized laparoscopic image understanding in gynaecology. Surg Endosc. 2020;34(12):5377‐5383.
-
- Demir KC, Schieber H, Weise T, et al. Deep learning in surgical workflow analysis: a review of phase and step recognition. IEEE J Biomed Health Inform. 2023;27(11):5405‐5417.
-
- Wu Y, Chen B, Zeng A, Pan D, Wang R, Zhao S. Skin cancer classification with deep learning: a systematic review. Front Oncol. 2022;12:893972.
-
- Zheng X, He B, Hu Y, et al. Diagnostic accuracy of deep learning and radiomics in lung cancer staging: a systematic review and meta‐analysis. Front Public Health. 2022;10:938113.
Publication types
LinkOut - more resources
Full Text Sources