Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 May;32(5):3458-3468.
doi: 10.1007/s00330-021-08429-0. Epub 2022 Jan 4.

Quality assessment of radiomics research in cardiac CT: a systematic review

Suji Lee  1 , Kyunghwa Han  1 , Young Joo Suh  2
Affiliations

Quality assessment of radiomics research in cardiac CT: a systematic review

Suji Lee et al. Eur Radiol. 2022 May.

Abstract

Objectives: To assess the quality of current radiomics research on cardiac CT using radiomics quality score (RQS) and Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) systems.

Methods: Systematic searches of PubMed and EMBASE were performed to identify all potentially relevant original research articles about cardiac CT radiomics. Fifteen original research articles were selected. Two cardiac radiologists assessed the quality of the methodology adopted in those studies according to the RQS and TRIPOD guidelines. Basic adherence rates for the following six key domains were evaluated: image protocol and reproducibility, feature reduction and validation, biologic/clinical utility, performance index, high level of evidence, and open science.

Results: Among the 15 included articles, six (40%) were about coronary artery disease and six (40%) were about myocardial infarction. The mean RQS was 9.9 ± 7.3 (27.4% of the ideal score of 36), and the basic adherence rate was 44.6%. Fourteen (93.3%) and nine (60%) studies performed feature selection and validation, but only two (13.3%) of them performed external validation. Two studies (13.3%) were prospective, and only one study (6.7%) conducted calibration analysis and stated the potential clinical utility. None of the studies conducted phantom study and cost-effective analysis. The overall adherence rate for TRIPOD was 63%.

Conclusion: The quality of radiomics studies in cardiac CT is currently insufficient. A higher level of evidence is required, and analysis of clinical utility and calibration of model performance need to be improved.

Key points: • The quality of science of radiomics studies in cardiac CT is currently insufficient. • No study conducted a phantom study or cost-effective analysis, with further limitations being demonstrated in a high level of evidence for radiomics studies. • Analysis of clinical utility and calibration of model performance need to be improved, and a higher level of evidence is required.

Keywords: Heart; Machine learning; Quality improvement; Tomography, X-ray computed.

PubMed Disclaimer

References

    1. Kim YJ, Yong HS, Kim SM, Kim JA, Yang DH, Hong YJ (2015) Korean guidelines for the appropriate use of cardiac CT. Korean J Radiol 16:251–285 - DOI - PMC
    1. Taylor AJ, Cerqueira M, Hodgson JM et al (2010) ACCF/SCCT/ACR/AHA/ASE/ASNC/NASCI/SCAI/SCMR 2010 appropriate use criteria for cardiac computed tomography: a report of the American College of Cardiology Foundation Appropriate Use Criteria Task Force, the Society of Cardiovascular Computed Tomography, the American College of Radiology, the American Heart Association, the American Society of Echocardiography, the American Society of Nuclear Cardiology, the North American Society for Cardiovascular Imaging, the Society for Cardiovascular Angiography and Interventions, and the Society for Cardiovascular Magnetic Resonance. J Am Coll Cardiol 56:1864–1894 - DOI
    1. Doherty JU, Kort S, Mehran R, Schoenhagen P, Soman P (2017) ACC/AATS/AHA/ASE/ASNC/HRS/SCAI/SCCT/SCMR/STS 2017 Appropriate use criteria for multimodality imaging in valvular heart disease: a report of the American College of Cardiology Appropriate Use Criteria Task Force, American Association for Thoracic Surgery, American Heart Association, American Society of Echocardiography, American Society of Nuclear Cardiology, Heart Rhythm Society, Society for Cardiovascular Angiography and Interventions, Society of Cardiovascular Computed Tomography, Society for Cardiovascular Magnetic Resonance, and Society of Thoracic Surgeons. J Am Coll Cardiol 70:1647–1672 - DOI
    1. Doherty JU, Kort S, Mehran R et al (2019) ACC/AATS/AHA/ASE/ASNC/HRS/SCAI/SCCT/SCMR/STS 2019 Appropriate use criteria for multimodality imaging in the assessment of cardiac structure and function in nonvalvular heart disease. J Nucl Cardiol 26:1392–1413 - DOI
    1. Williams MC, Moss AJ, Dweck M et al (2019) Coronary artery plaque characteristics associated with adverse outcomes in the SCOT-HEART study. J Am Coll Cardiol 73:291–301 - DOI - PMC

Publication types