Comparing artificial intelligence to humans for endoscopic diagnosis of gastric neoplasia: An external validation study
- PMID: 37408330
- DOI: 10.1111/jgh.16274
Comparing artificial intelligence to humans for endoscopic diagnosis of gastric neoplasia: An external validation study
Abstract
Objectives: Artificial intelligence (AI) uses deep learning functionalities that may enhance the detection of early gastric cancer during endoscopy. An AI-based endoscopic system for upper endoscopy was recently developed in Japan. We aim to validate this AI-based system in a Singaporean cohort.
Methods: There were 300 de-identified still images prepared from endoscopy video files obtained from subjects that underwent gastroscopy in National University Hospital (NUH). Five specialists and 6 non-specialists (trainees) from NUH were assigned to read and categorize the images into "neoplastic" or "non-neoplastic." Results were then compared with the readings performed by the endoscopic AI system.
Results: The mean accuracy, sensitivity, and specificity for the 11 endoscopists were 0.847, 0.525, and 0.872, respectively. These values for the AI-based system were 0.777, 0.591, and 0.791, respectively. While AI in general did not perform better than endoscopists on the whole, in the subgroup of high-grade dysplastic lesions, only 29.1% were picked up by the endoscopist rating, but 80% were classified as neoplastic by AI (P = 0.0011). The average diagnostic time was also faster in AI compared with endoscopists (677.1 s vs 42.02 s (P < 0.001).
Conclusion: We demonstrated that an AI system developed in another health system was comparable in diagnostic accuracy in the evaluation of static images. AI systems are faster and not fatigable and may have a role in augmenting human diagnosis during endoscopy. With more advances in AI and larger studies to support its efficacy it would likely play a larger role in screening endoscopy in future.
Keywords: Artificial intelligence; Deep learning; Endoscopy; Gastric cancer; Screening.
© 2023 The Authors. Journal of Gastroenterology and Hepatology published by Journal of Gastroenterology and Hepatology Foundation and John Wiley & Sons Australia, Ltd.
References
-
- Sung H, Ferlay J, Siegel RL et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J. Clin. 2021; 71: 209-249.
-
- Katai H, Ishikawa T, Akazawa K et al. Five-year survival analysis of surgically resected gastric cancer cases in Japan: a retrospective analysis of more than 100,000 patients from the nationwide registry of the Japanese Gastric Cancer Association (2001-2007). Gastric Cancer 2018; 21: 144-154.
-
- Pimenta-Melo AR, Monteiro-Soares M, Libânio D, Dinis-Ribeiro M. Missing rate for gastric cancer during upper gastrointestinal endoscopy: a systematic review and meta-analysis. Eur. J. Gastroenterol. Hepatol. 2016; 28: 1041-1049.
-
- Ikenoyama Y, Hirasawa T, Ishioka M et al. Detecting early gastric cancer: comparison between the diagnostic ability of convolutional neural networks and endoscopists. Dig. Endosc. 2021; 33: 141-150.
-
- Wong MCS, Huang J, Chan PSF et al. Global incidence and mortality of gastric cancer, 1980-2018. JAMA Netw. Open 2021; 4: e2118457.
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Medical