Quality control of cardiac magnetic resonance imaging segmentation, feature tracking, aortic flow, and native T1 analysis using automated batch processing in the UK Biobank study
- PMID: 39385845
- PMCID: PMC11462446
- DOI: 10.1093/ehjimp/qyae094
Quality control of cardiac magnetic resonance imaging segmentation, feature tracking, aortic flow, and native T1 analysis using automated batch processing in the UK Biobank study
Abstract
Aims: Automated algorithms are regularly used to analyse cardiac magnetic resonance (CMR) images. Validating data output reliability from this method is crucial for enabling widespread adoption. We outline a visual quality control (VQC) process for image analysis using automated batch processing. We assess the performance of automated analysis and the reliability of replacing visual checks with statistical outlier (SO) removal approach in UK Biobank CMR scans.
Methods and results: We included 1987 CMR scans from the UK Biobank COVID-19 imaging study. We used batch processing software (Circle Cardiovascular Imaging Inc.-CVI42) to automatically extract chamber volumetric data, strain, native T1, and aortic flow data. The automated analysis outputs (∼62 000 videos and 2000 images) were visually checked by six experienced clinicians using a standardized approach and a custom-built R Shiny app. Inter-observer variability was assessed. Data from scans passing VQC were compared with a SO removal QC method in a subset of healthy individuals (n = 1069). Automated segmentation was highly rated, with over 95% of scans passing VQC. Overall inter-observer agreement was very good (Gwet's AC2 0.91; 95% confidence interval 0.84, 0.94). No difference in overall data derived from VQC or SO removal in healthy individuals was observed.
Conclusion: Automated image analysis using CVI42 prototypes for UK Biobank CMR scans demonstrated high quality. Larger UK Biobank data sets analysed using these automated algorithms do not require in-depth VQC. SO removal is sufficient as a QC measure, with operator discretion for visual checks based on population or research objectives.
Keywords: Shiny app; automated image analysis; cardiac magnetic resonance imaging; machine learning; quality control.
© The Author(s) 2024. Published by Oxford University Press on behalf of the European Society of Cardiology.
Conflict of interest statement
Conflict of interest: S.E.P. provides consultancy to Circle Cardiovascular Imaging, Inc., Calgary, Alberta, Canada. The remaining authors have nothing to disclose.
Figures
References
-
- Arnold JR, McCann GP. Cardiovascular magnetic resonance: applications and practical considerations for the general cardiologist. Heart 2020;106:174–81. - PubMed
-
- Bailly A, Lipiecki J, Chabrot P, Alwdja A, Garcier JM, Ughetto S et al. Assessment of left ventricular volumes and function by cine-MR imaging depending on the investigator’s experience. Surg Radiol Anat 2009;31:113–20. - PubMed
-
- Bernard O, Lalande A, Zotti C, Cervenansky F, Yang X, Heng PA et al. Deep learning techniques for automatic MRI cardiac multi-structures segmentation and diagnosis: is the problem solved? IEEE Trans Med Imaging 2018;37:2514–25. - PubMed
LinkOut - more resources
Full Text Sources