Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices
- PMID: 31304320
- PMCID: PMC6550188
- DOI: 10.1038/s41746-018-0040-6
Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices
Abstract
Artificial Intelligence (AI) has long promised to increase healthcare affordability, quality and accessibility but FDA, until recently, had never authorized an autonomous AI diagnostic system. This pivotal trial of an AI system to detect diabetic retinopathy (DR) in people with diabetes enrolled 900 subjects, with no history of DR at primary care clinics, by comparing to Wisconsin Fundus Photograph Reading Center (FPRC) widefield stereoscopic photography and macular Optical Coherence Tomography (OCT), by FPRC certified photographers, and FPRC grading of Early Treatment Diabetic Retinopathy Study Severity Scale (ETDRS) and Diabetic Macular Edema (DME). More than mild DR (mtmDR) was defined as ETDRS level 35 or higher, and/or DME, in at least one eye. AI system operators underwent a standardized training protocol before study start. Median age was 59 years (range, 22-84 years); among participants, 47.5% of participants were male; 16.1% were Hispanic, 83.3% not Hispanic; 28.6% African American and 63.4% were not; 198 (23.8%) had mtmDR. The AI system exceeded all pre-specified superiority endpoints at sensitivity of 87.2% (95% CI, 81.8-91.2%) (>85%), specificity of 90.7% (95% CI, 88.3-92.7%) (>82.5%), and imageability rate of 96.1% (95% CI, 94.6-97.3%), demonstrating AI's ability to bring specialty-level diagnostics to primary care settings. Based on these results, FDA authorized the system for use by health care providers to detect more than mild DR and diabetic macular edema, making it, the first FDA authorized autonomous AI diagnostic system in any field of medicine, with the potential to help prevent vision loss in thousands of people with diabetes annually. ClinicalTrials.gov NCT02963441.
Keywords: Biomedical engineering; Eye manifestations.
Conflict of interest statement
Competing interestsM.D.A. is shareholder, director, and employee of IDx, LLC, and has relevant patents and patent applications assigned to the University of Iowa; P.T.L. received fees from IDx, LLC for statistical consultancy; N.S. and M.B. declare no competing interests. J.C.F. is shareholder of IDx, LLC. Disclosure forms provided by the authors are available with the full text of this article. Patents (all issued) that may be affected by this study are: applied for by the University of Iowa, inventor M.D.A., 7,474,775, Automatic Detection of Red Lesions in Digital Color Fundus Photographs; 7,712,898, Methods and Systems for Optic Nerve Head Segmentation; 8,340,437, Methods and Systems for Determining Optimal Features for Classifying Patterns or Objects in Images; 9,924,867, Automated Determination of Arteriovenous Ratio in Images of Blood Vessels; applied by IDx, inventor M.D.A., 9,155,465, Snapshot Spectral Domain Optical Coherence Tomographer; 9,782,065, Parallel optical coherence tomography apparatuses, systems and related methods; 9,814,386, Systems and methods for alignment of the eye for ocular imaging.
Figures
Similar articles
-
Artificial Intelligence Detection of Diabetic Retinopathy: Subgroup Comparison of the EyeArt System with Ophthalmologists' Dilated Examinations.Ophthalmol Sci. 2022 Sep 30;3(1):100228. doi: 10.1016/j.xops.2022.100228. eCollection 2023 Mar. Ophthalmol Sci. 2022. PMID: 36345378 Free PMC article.
-
Pivotal Evaluation of an Artificial Intelligence System for Autonomous Detection of Referrable and Vision-Threatening Diabetic Retinopathy.JAMA Netw Open. 2021 Nov 1;4(11):e2134254. doi: 10.1001/jamanetworkopen.2021.34254. JAMA Netw Open. 2021. PMID: 34779843 Free PMC article. Clinical Trial.
-
Evaluation of an Artificial Intelligence System for the Detection of Diabetic Retinopathy in Chinese Community Healthcare Centers.Front Med (Lausanne). 2022 Apr 11;9:883462. doi: 10.3389/fmed.2022.883462. eCollection 2022. Front Med (Lausanne). 2022. PMID: 35479949 Free PMC article.
-
Determinants for scalable adoption of autonomous AI in the detection of diabetic eye disease in diverse practice types: key best practices learned through collection of real-world data.Front Digit Health. 2023 May 18;5:1004130. doi: 10.3389/fdgth.2023.1004130. eCollection 2023. Front Digit Health. 2023. PMID: 37274764 Free PMC article. Review.
-
[Current trends in the screening for diabetic retinopathy].Vestn Oftalmol. 2020;136(4. Vyp. 2):300-309. doi: 10.17116/oftalma2020136042300. Vestn Oftalmol. 2020. PMID: 32880155 Review. Russian.
Cited by
-
Effectiveness of artificial intelligence for diabetic retinopathy screening in community in Binh Dinh Province, Vietnam.Taiwan J Ophthalmol. 2024 Sep 13;14(3):394-402. doi: 10.4103/tjo.TJO-D-23-00101. eCollection 2024 Jul-Sep. Taiwan J Ophthalmol. 2024. PMID: 39430352 Free PMC article.
-
Multi-modal representation learning in retinal imaging using self-supervised learning for enhanced clinical predictions.Sci Rep. 2024 Nov 5;14(1):26802. doi: 10.1038/s41598-024-78515-y. Sci Rep. 2024. PMID: 39500979 Free PMC article.
-
Artificial intelligence for improving sickle cell retinopathy diagnosis and management.Eye (Lond). 2021 Oct;35(10):2675-2684. doi: 10.1038/s41433-021-01556-4. Epub 2021 May 6. Eye (Lond). 2021. PMID: 33958737 Free PMC article. Review.
-
Assessing the Clinical Utility of Expanded Macular OCTs Using Machine Learning.Transl Vis Sci Technol. 2021 May 3;10(6):32. doi: 10.1167/tvst.10.6.32. Transl Vis Sci Technol. 2021. PMID: 34038502 Free PMC article.
-
Artificial Intelligence-Based Clinical Decision Support for COVID-19-Where Art Thou?Adv Intell Syst. 2020 Sep;2(9):2000104. doi: 10.1002/aisy.202000104. Epub 2020 Jun 23. Adv Intell Syst. 2020. PMID: 32838300 Free PMC article.
References
-
- Centers for Disease Control and Prevention. Diabetes Report Card 2012. Atlanta, GA: U.S. Department of Health and Human Services; 2012.
-
- National Health Service Diabetic Retinopathy Programme Annual Report, April 2007-March 2008 (2008).
Associated data
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical