Computer-aided endoscopic diagnostic system modified with hyperspectral imaging for the classification of esophageal neoplasms

Abstract

Introduction: The early detection of esophageal cancer is crucial to enhancing patient survival rates, and endoscopy remains the gold standard for identifying esophageal neoplasms. Despite this fact, accurately diagnosing superficial esophageal neoplasms poses a challenge, even for seasoned endoscopists. Recent advancements in computer-aided diagnostic systems, empowered by artificial intelligence (AI), have shown promising results in elevating the diagnostic precision for early-stage esophageal cancer.

Methods: In this study, we expanded upon traditional red-green-blue (RGB) imaging by integrating the YOLO neural network algorithm with hyperspectral imaging (HSI) to evaluate the diagnostic efficacy of this innovative AI system for superficial esophageal neoplasms. A total of 1836 endoscopic images were utilized for model training, which included 858 white-light imaging (WLI) and 978 narrow-band imaging (NBI) samples. These images were categorized into three groups, namely, normal esophagus, esophageal squamous dysplasia, and esophageal squamous cell carcinoma (SCC).

Results: An additional set comprising 257 WLI and 267 NBI images served as the validation dataset to assess diagnostic accuracy. Within the RGB dataset, the diagnostic accuracies of the WLI and NBI systems for classifying images into normal, dysplasia, and SCC categories were 0.83 and 0.82, respectively. Conversely, the HSI dataset yielded higher diagnostic accuracies for the WLI and NBI systems, with scores of 0.90 and 0.89, respectively.

Conclusion: The HSI dataset outperformed the RGB dataset, demonstrating an overall diagnostic accuracy improvement of 8%. Our findings underscored the advantageous impact of incorporating the HSI dataset in model training. Furthermore, the application of HSI in AI-driven image recognition algorithms significantly enhanced the diagnostic accuracy for early esophageal cancer.

Keywords: Dysplasia; Esophageal Cancer; Hyperspectral imaging; Narrow-band imaging; SSD; YOLOv5.

Figure 1

Flow chart of HSI algorithm.

Figure 2

Spectrum distributions of (A) WLIs and (B) NBIs.

Figure 3

Complete process of the algorithm designed in this study.

Figure 4

presents the YOLOv5 diagnostic outcomes for the WLI and NBI images of esophageal neoplasms. Blue boxes signify the ground truth. Green-bordered boxes highlight areas identified as esophageal dysplasia, whereas purple-bordered boxes indicate SCC regions. The labels’ numbers indicate the likelihood of an esophageal-neoplasm diagnosis within the box.