Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2018 Feb;96(1):63-68.
doi: 10.1111/aos.13613. Epub 2017 Nov 27.

Validation of automated screening for referable diabetic retinopathy with the IDx-DR device in the Hoorn Diabetes Care System

Amber A van der Heijden  1   2 , Michael D Abramoff  3   4   5 , Frank Verbraak  6 , Manon V van Hecke  7 , Albert Liem  8 , Giel Nijpels  1   2
Affiliations

Validation of automated screening for referable diabetic retinopathy with the IDx-DR device in the Hoorn Diabetes Care System

Amber A van der Heijden et al. Acta Ophthalmol. 2018 Feb.

Abstract

Purpose: To increase the efficiency of retinal image grading, algorithms for automated grading have been developed, such as the IDx-DR 2.0 device. We aimed to determine the ability of this device, incorporated in clinical work flow, to detect retinopathy in persons with type 2 diabetes.

Methods: Retinal images of persons treated by the Hoorn Diabetes Care System (DCS) were graded by the IDx-DR device and independently by three retinal specialists using the International Clinical Diabetic Retinopathy severity scale (ICDR) and EURODIAB criteria. Agreement between specialists was calculated. Results of the IDx-DR device and experts were compared using sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV), distinguishing between referable diabetic retinopathy (RDR) and vision-threatening retinopathy (VTDR). Area under the receiver operating characteristic curve (AUC) was calculated.

Results: Of the included 1415 persons, 898 (63.5%) had images of sufficient quality according to the experts and the IDx-DR device. Referable diabetic retinopathy (RDR) was diagnosed in 22 persons (2.4%) using EURODIAB and 73 persons (8.1%) using ICDR classification. Specific intergrader agreement ranged from 40% to 61%. Sensitivity, specificity, PPV and NPV of IDx-DR to detect RDR were 91% (95% CI: 0.69-0.98), 84% (95% CI: 0.81-0.86), 12% (95% CI: 0.08-0.18) and 100% (95% CI: 0.99-1.00; EURODIAB) and 68% (95% CI: 0.56-0.79), 86% (95% CI: 0.84-0.88), 30% (95% CI: 0.24-0.38) and 97% (95% CI: 0.95-0.98; ICDR). The AUC was 0.94 (95% CI: 0.88-1.00; EURODIAB) and 0.87 (95% CI: 0.83-0.92; ICDR). For detection of VTDR, sensitivity was lower and specificity was higher compared to RDR. AUC's were comparable.

Conclusion: Automated grading using the IDx-DR device for RDR detection is a valid method and can be used in primary care, decreasing the demand on ophthalmologists.

Keywords: automated grading; diabetic retinopathy; type 2 diabetes; validation.

PubMed Disclaimer

References

    1. Abramoff MD & Suttorp‐Schulten MS (2005): Web‐based screening for diabetic retinopathy in a primary care population: the EyeCheck project. Telemed J E Health 11: 668–674. - PubMed
    1. Abramoff MD, Reinhardt JM, Russell SR, Folk JC, Mahajan VB, Niemeijer M & Quellec G (2010): Automated early detection of diabetic retinopathy. Ophthalmology 117: 1147–1154. - PMC - PubMed
    1. Abramoff MD, Folk JC, Han DP et al. (2013): Automated analysis of retinal images for detection of referable diabetic retinopathy. JAMA Ophthalmol 131: 351–357. - PubMed
    1. Abramoff MD, Lou Y, Erginay A, Clarida W, Amelon R, Folk JC & Niemeijer M (2016): Improved automated detection of diabetic retinopathy on a publicly available dataset through integration of deep learning. Invest Ophthalmol Vis Sci 57: 5200–5206. - PubMed
    1. Aldington SJ, Kohner EM, Meuer S, Klein R & Sjolie AK (1995): Methodology for retinal photography and assessment of diabetic retinopathy: the EURODIAB IDDM complications study. Diabetologia 38: 437–444. - PubMed

Publication types