Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Mar 8;11(2):e210129.
doi: 10.1530/ETJ-21-0129.

External validation of AIBx, an artificial intelligence model for risk stratification, in thyroid nodules

Kristine Z Swan  1 , Johnson Thomas  2 , Viveque E Nielsen  3 , Marie Louise Jespersen  4 , Steen J Bonnema  5
Affiliations

External validation of AIBx, an artificial intelligence model for risk stratification, in thyroid nodules

Kristine Z Swan et al. Eur Thyroid J. .

Abstract

Background: Artificial intelligence algorithms could be used to risk-stratify thyroid nodules and may reduce the subjectivity of ultrasonography. One such algorithm is AIBx which has shown good performance. However, external validation is crucial prior to clinical implementation.

Materials and methods: Patients harboring thyroid nodules 1-4 cm in size, undergoing thyroid surgery from 2014 to 2016 in a single institution, were included. A histological diagnosis was obtained in all cases. Medullary thyroid cancer, metastasis from other cancers, thyroid lymphomas, and purely cystic nodules were excluded. Retrospectively, transverse ultrasound images of the nodules were analyzed by AIBx, and the results were compared with histopathology and Thyroid Imaging Reporting and Data System (TIRADS), calculated by experienced physicians.

Results: Out of 329 patients, 257 nodules from 209 individuals met the eligibility criteria. Fifty-one nodules (20%) were malignant. AIBx had a negative predictive value (NPV) of 89.2%. Sensitivity, specificity, and positive predictive values (PPV) were 78.4, 44.2, and 25.8%, respectively. Considering both TIRADS 4 and TIRADS 5 nodules as malignant lesions resulted in an NPV of 93.0%, while PPV and specificity were only 22.4 and 19.4%, respectively. By combining AIBx with TIRADS, no malignant nodules were overlooked.

Conclusion: When applied to ultrasound images obtained in a different setting than used for training, AIBx had comparable NPVs to TIRADS. AIBx performed even better when combined with TIRADS, thus reducing false negative assessments. These data support the concept of AIBx for thyroid nodules, and this tool may help less experienced operators by reducing the subjectivity inherent to thyroid ultrasound interpretation.

Keywords: TIRADS; artificial intelligence; thyroid nodules; ultrasound.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Patient selection flowchart. US, ultrasonography.
Figure 2
Figure 2
BSRTC category according to histological diagnosis. BSRTC, Bethesda system for reporting thyroid cytopathology; FNAB, fine-needle aspiration biopsy.
See this image and copyright information in PMC

References

    1. Ali SZ, Siperstein A, Sadow PM, Golding AC, Kennedy GC, Kloos RT, Ladenson PW. Extending expressed RNA genomics from surgical decision making for cytologically indeterminate thyroid nodules to targeting therapies for metastatic thyroid cancer. Cancer Cytopathology 2019127362–369. (10.1002/cncy.22132) - DOI - PMC - PubMed
    1. Grant EG, Tessler FN, Hoang JK, Langer JE, Beland MD, Berland LL, Cronan JJ, Desser TS, Frates MC, Hamper UMet al.Thyroid ultrasound reporting lexicon: white paper of the ACR thyroid imaging, reporting and data system (TIRADS) committee. Journal of the American College of Radiology 2015121272–1279. (10.1016/j.jacr.2015.07.011) - DOI - PubMed
    1. Haugen BR, Alexander EK, Bible KC, Doherty GM, Mandel SJ, Nikiforov YE, Pacini F, Randolph GW, Sawka AM, Schlumberger Met al.2015 American Thyroid Association management guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: the American Thyroid Association guidelines task force on thyroid nodules and differentiated thyroid cancer. Thyroid 2016261–133. (10.1089/thy.2015.0020) - DOI - PMC - PubMed
    1. Russ G, Bonnema SJ, Erdogan MF, Durante C, Ngu R, Leenhardt L. European Thyroid Association guidelines for ultrasound malignancy risk stratification of thyroid nodules in adults: the EU-TIRADS. European Thyroid Journal 20176225–237. (10.1159/000478927) - DOI - PMC - PubMed
    1. Kwak JY, Han KH, Yoon JH, Moon HJ, Son EJ, Park SH, Jung HK, Choi JS, Kim BM, Kim EK. Thyroid imaging reporting and data system for US features of nodules: a step in establishing better stratification of cancer risk. Radiology 2011260892–899. (10.1148/radiol.11110206) - DOI - PubMed