Diagnostic assessment of a deep learning system for detecting atrial fibrillation in pulse waveforms
- PMID: 29853485
- DOI: 10.1136/heartjnl-2018-313147
Diagnostic assessment of a deep learning system for detecting atrial fibrillation in pulse waveforms
Abstract
Objective: To evaluate the diagnostic performance of a deep learning system for automated detection of atrial fibrillation (AF) in photoplethysmographic (PPG) pulse waveforms.
Methods: We trained a deep convolutional neural network (DCNN) to detect AF in 17 s PPG waveforms using a training data set of 149 048 PPG waveforms constructed from several publicly available PPG databases. The DCNN was validated using an independent test data set of 3039 smartphone-acquired PPG waveforms from adults at high risk of AF at a general outpatient clinic against ECG tracings reviewed by two cardiologists. Six established AF detectors based on handcrafted features were evaluated on the same test data set for performance comparison.
Results: In the validation data set (3039 PPG waveforms) consisting of three sequential PPG waveforms from 1013 participants (mean (SD) age, 68.4 (12.2) years; 46.8% men), the prevalence of AF was 2.8%. The area under the receiver operating characteristic curve (AUC) of the DCNN for AF detection was 0.997 (95% CI 0.996 to 0.999) and was significantly higher than all the other AF detectors (AUC range: 0.924-0.985). The sensitivity of the DCNN was 95.2% (95% CI 88.3% to 98.7%), specificity was 99.0% (95% CI 98.6% to 99.3%), positive predictive value (PPV) was 72.7% (95% CI 65.1% to 79.3%) and negative predictive value (NPV) was 99.9% (95% CI 99.7% to 100%) using a single 17 s PPG waveform. Using the three sequential PPG waveforms in combination (<1 min in total), the sensitivity was 100.0% (95% CI 87.7% to 100%), specificity was 99.6% (95% CI 99.0% to 99.9%), PPV was 87.5% (95% CI 72.5% to 94.9%) and NPV was 100% (95% CI 99.4% to 100%).
Conclusions: In this evaluation of PPG waveforms from adults screened for AF in a real-world primary care setting, the DCNN had high sensitivity, specificity, PPV and NPV for detecting AF, outperforming other state-of-the-art methods based on handcrafted features.
Keywords: atrial fibrillation; ehealth/telemedicine/mobile health; premature ventricular beats.
© Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.
Conflict of interest statement
Competing interests: M-ZP and YCP are employees of Cardiio and have an ownership stake in the company, which holds intellectual property rights to the new algorithm tested in this work.
Comment in
-
New approaches to detection of atrial fibrillation.Heart. 2018 Dec;104(23):1898-1899. doi: 10.1136/heartjnl-2018-313423. Epub 2018 Jun 20. Heart. 2018. PMID: 29925541 No abstract available.
Similar articles
-
Deep Learning Approaches to Detect Atrial Fibrillation Using Photoplethysmographic Signals: Algorithms Development Study.JMIR Mhealth Uhealth. 2019 Jun 6;7(6):e12770. doi: 10.2196/12770. JMIR Mhealth Uhealth. 2019. PMID: 31199302 Free PMC article.
-
Diagnostic Performance of a Smartphone-Based Photoplethysmographic Application for Atrial Fibrillation Screening in a Primary Care Setting.J Am Heart Assoc. 2016 Jul 21;5(7):e003428. doi: 10.1161/JAHA.116.003428. J Am Heart Assoc. 2016. PMID: 27444506 Free PMC article.
-
Mobile Phone-Based Use of the Photoplethysmography Technique to Detect Atrial Fibrillation in Primary Care: Diagnostic Accuracy Study of the FibriCheck App.JMIR Mhealth Uhealth. 2019 Mar 27;7(3):e12284. doi: 10.2196/12284. JMIR Mhealth Uhealth. 2019. PMID: 30916656 Free PMC article.
-
Diagnostic accuracy of ECG smart chest patches versus PPG smartwatches for atrial fibrillation detection: a systematic review and meta-analysis.BMC Cardiovasc Disord. 2025 Feb 25;25(1):132. doi: 10.1186/s12872-025-04582-2. BMC Cardiovasc Disord. 2025. PMID: 40000931 Free PMC article.
-
Accuracy of Smartphone Camera Applications for Detecting Atrial Fibrillation: A Systematic Review and Meta-analysis.JAMA Netw Open. 2020 Apr 1;3(4):e202064. doi: 10.1001/jamanetworkopen.2020.2064. JAMA Netw Open. 2020. PMID: 32242908 Free PMC article.
Cited by
-
Identification of undiagnosed atrial fibrillation patients using a machine learning risk prediction algorithm and diagnostic testing (PULsE-AI): Study protocol for a randomised controlled trial.Contemp Clin Trials. 2020 Dec;99:106191. doi: 10.1016/j.cct.2020.106191. Epub 2020 Oct 19. Contemp Clin Trials. 2020. PMID: 33091585 Free PMC article.
-
Deep Learning Approaches to Detect Atrial Fibrillation Using Photoplethysmographic Signals: Algorithms Development Study.JMIR Mhealth Uhealth. 2019 Jun 6;7(6):e12770. doi: 10.2196/12770. JMIR Mhealth Uhealth. 2019. PMID: 31199302 Free PMC article.
-
An Application of Machine Learning to Etiological Diagnosis of Secondary Hypertension: Retrospective Study Using Electronic Medical Records.JMIR Med Inform. 2021 Jan 25;9(1):e19739. doi: 10.2196/19739. JMIR Med Inform. 2021. PMID: 33492233 Free PMC article.
-
How machine learning is impacting research in atrial fibrillation: implications for risk prediction and future management.Cardiovasc Res. 2021 Jun 16;117(7):1700-1717. doi: 10.1093/cvr/cvab169. Cardiovasc Res. 2021. PMID: 33982064 Free PMC article. Review.
-
Photoplethysmography based atrial fibrillation detection: a review.NPJ Digit Med. 2020 Jan 10;3:3. doi: 10.1038/s41746-019-0207-9. eCollection 2020. NPJ Digit Med. 2020. PMID: 31934647 Free PMC article. Review.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical