Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Feb 16;10(4):e26559.
doi: 10.1016/j.heliyon.2024.e26559. eCollection 2024 Feb 29.

Few-shot learning for the classification of intestinal tuberculosis and Crohn's disease on endoscopic images: A novel learn-to-learn framework

Jiaxi Lin  1   2 , Shiqi Zhu  1   2 , Minyue Yin  1   2 , Hongchen Xue  3 , Lu Liu  1   2 , Xiaolin Liu  1   2 , Lihe Liu  1   2 , Chunfang Xu  1   2 , Jinzhou Zhu  1   2
Affiliations

Few-shot learning for the classification of intestinal tuberculosis and Crohn's disease on endoscopic images: A novel learn-to-learn framework

Jiaxi Lin et al. Heliyon. .

Abstract

Background and aim: Standard deep learning methods have been found inadequate in distinguishing between intestinal tuberculosis (ITB) and Crohn's disease (CD), a shortcoming largely attributed to the scarcity of available samples. In light of this limitation, our objective is to develop an innovative few-shot learning (FSL) system, specifically tailored for the efficient categorization and differential diagnosis of CD and ITB, using endoscopic image data with minimal sample requirements.

Methods: A total of 122 white-light endoscopic images (99 CD images and 23 ITB images) were collected (one ileum image from each patient). A 2-way, 3-shot FSL model that integrated dual transfer learning and metric learning strategies was devised. Xception architecture was selected as the foundation and then underwent a dual transfer process utilizing oesophagitis images sourced from HyperKvasir. Subsequently, the eigenvectors derived from the Xception for each query image were converted into predictive scores, which were calculated using the Euclidean distances to six reference images from the support sets.

Results: The FSL model, which leverages dual transfer learning, exhibited enhanced performance metrics (AUC 0.81) compared to a model relying on single transfer learning (AUC 0.56) across three evaluation rounds. Additionally, its performance surpassed that of a less experienced endoscopist (AUC 0.56) and even a more seasoned specialist (AUC 0.61).

Conclusions: The FSL model we have developed demonstrates efficacy in distinguishing between CD and ITB using a limited dataset of endoscopic imagery. FSL holds value for enhancing the diagnostic capabilities of rare conditions.

Keywords: Crohn's disease; Few-shot learning; Intestinal tuberculosis; Meta learning.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Figures

Fig. 1
Fig. 1
The framework of the few-shot learning model. CD: Crohn's disease. ITB: intestinal tuberculosis. EDC：Euclidean distance classification.
Fig. 2
Fig. 2
The performance of few-shot learning models and endoscopists. AUC: area under the curve.
Fig. 3
Fig. 3
The visual interpretation of the few-shot learning model. Grad-CAM: Gradient-weighted Class Activation Mapping.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

References

    1. Chahal D., Byrne M.F. A primer on artificial intelligence and its application to endoscopy. Gastrointest. Endosc. 2020;92(4):813–820.e4. - PubMed
    1. Sharma P., Hassan C. Artificial intelligence and deep learning for upper gastrointestinal neoplasia. Gastroenterology. 2022;162(4):1056–1066. - PubMed
    1. Lo B., Liu Z., Bendtsen F., Igel C., Vind I., Burisch J. High accuracy in classifying endoscopic severity in ulcerative colitis using convolutional neural network. Am. J. Gastroenterol. 2022;117(10):1648–1654. - PubMed
    1. Houwen B.B.S.L., Nass K.J., Vleugels J.L.A., Fockens P., Hazewinkel Y., Dekker E. Comprehensive review of publicly available colonoscopic imaging databases for artificial intelligence research: availability, accessibility, and usability. Gastrointest. Endosc. 2023;97(2):184–199.e16. - PubMed
    1. Lei S., Zhang H., Wang K., Su Z. How training data affect the accuracy and robustness of neural networks for image classification. 2022. https://openreview.net/forum?id=HklKWhC5F7 Feb [cited 2023 Feb 15]. Available from:

LinkOut - more resources