Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Sep 16;2(3):qyae094.
doi: 10.1093/ehjimp/qyae094. eCollection 2024 Jul.

Quality control of cardiac magnetic resonance imaging segmentation, feature tracking, aortic flow, and native T1 analysis using automated batch processing in the UK Biobank study

Affiliations

Quality control of cardiac magnetic resonance imaging segmentation, feature tracking, aortic flow, and native T1 analysis using automated batch processing in the UK Biobank study

Sucharitha Chadalavada et al. Eur Heart J Imaging Methods Pract. .

Abstract

Aims: Automated algorithms are regularly used to analyse cardiac magnetic resonance (CMR) images. Validating data output reliability from this method is crucial for enabling widespread adoption. We outline a visual quality control (VQC) process for image analysis using automated batch processing. We assess the performance of automated analysis and the reliability of replacing visual checks with statistical outlier (SO) removal approach in UK Biobank CMR scans.

Methods and results: We included 1987 CMR scans from the UK Biobank COVID-19 imaging study. We used batch processing software (Circle Cardiovascular Imaging Inc.-CVI42) to automatically extract chamber volumetric data, strain, native T1, and aortic flow data. The automated analysis outputs (∼62 000 videos and 2000 images) were visually checked by six experienced clinicians using a standardized approach and a custom-built R Shiny app. Inter-observer variability was assessed. Data from scans passing VQC were compared with a SO removal QC method in a subset of healthy individuals (n = 1069). Automated segmentation was highly rated, with over 95% of scans passing VQC. Overall inter-observer agreement was very good (Gwet's AC2 0.91; 95% confidence interval 0.84, 0.94). No difference in overall data derived from VQC or SO removal in healthy individuals was observed.

Conclusion: Automated image analysis using CVI42 prototypes for UK Biobank CMR scans demonstrated high quality. Larger UK Biobank data sets analysed using these automated algorithms do not require in-depth VQC. SO removal is sufficient as a QC measure, with operator discretion for visual checks based on population or research objectives.

Keywords: Shiny app; automated image analysis; cardiac magnetic resonance imaging; machine learning; quality control.

PubMed Disclaimer

Conflict of interest statement

Conflict of interest: S.E.P. provides consultancy to Circle Cardiovascular Imaging, Inc., Calgary, Alberta, Canada. The remaining authors have nothing to disclose.

Figures

Graphical Abstract
Graphical Abstract
Created using Biorendr.com.
Figure 1
Figure 1
Flow chart detailing timeline of CMR image analysis and quality control process. Created using Biorendr.com.
Figure 2
Figure 2
Custom-built shiny app user-friendly interface and layout. Created using Biorendr.com.
Figure 3
Figure 3
Coefficient (Gwet AC2) by image sequence of scans visually checked by six different operators. The P value for all the results shown was <0.05, and the detailed results are shown in Supplementary data online, Table S3. Created using Biorendr.com. LV, Left ventricle; SAX, short axis; LAX, long axis; RV, right ventricle; LA, left atrium.

References

    1. Arnold JR, McCann GP. Cardiovascular magnetic resonance: applications and practical considerations for the general cardiologist. Heart 2020;106:174–81. - PubMed
    1. Baritussio A, Scatteia A, Bucciarelli-Ducci C. Role of cardiovascular magnetic resonance in acute and chronic ischemic heart disease. Int J Cardiovasc Imaging 2018;34:67–80. - PMC - PubMed
    1. Bailly A, Lipiecki J, Chabrot P, Alwdja A, Garcier JM, Ughetto S et al. Assessment of left ventricular volumes and function by cine-MR imaging depending on the investigator’s experience. Surg Radiol Anat 2009;31:113–20. - PubMed
    1. Bernard O, Lalande A, Zotti C, Cervenansky F, Yang X, Heng PA et al. Deep learning techniques for automatic MRI cardiac multi-structures segmentation and diagnosis: is the problem solved? IEEE Trans Med Imaging 2018;37:2514–25. - PubMed
    1. Leiner T, Rueckert D, Suinesiaputra A, Baeßler B, Nezafat R, Išgum I et al. Machine learning in cardiovascular magnetic resonance: basic concepts and applications. J Cardiovasc Magn Reson 2019;21:1–14. - PMC - PubMed

LinkOut - more resources