Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2013 May 1;54(5):3546-59.
doi: 10.1167/iovs.12-10347.

Validating retinal fundus image analysis algorithms: issues and a proposal

Emanuele Trucco  1 , Alfredo Ruggeri, Thomas Karnowski, Luca Giancardo, Edward Chaum, Jean Pierre Hubschman, Bashir Al-Diri, Carol Y Cheung, Damon Wong, Michael Abràmoff, Gilbert Lim, Dinesh Kumar, Philippe Burlina, Neil M Bressler, Herbert F Jelinek, Fabrice Meriaudeau, Gwénolé Quellec, Tom Macgillivray, Bal Dhillon
Affiliations

Validating retinal fundus image analysis algorithms: issues and a proposal

Emanuele Trucco et al. Invest Ophthalmol Vis Sci. .

Abstract

This paper concerns the validation of automatic retinal image analysis (ARIA) algorithms. For reasons of space and consistency, we concentrate on the validation of algorithms processing color fundus camera images, currently the largest section of the ARIA literature. We sketch the context (imaging instruments and target tasks) of ARIA validation, summarizing the main image analysis and validation techniques. We then present a list of recommendations focusing on the creation of large repositories of test data created by international consortia, easily accessible via moderated Web sites, including multicenter annotations by multiple experts, specific to clinical tasks, and capable of running submitted software automatically on the data stored, with clear and widely agreed-on performance criteria, to provide a fair comparison.

Keywords: fundus image analysis; reference standards; validation.

PubMed Disclaimer

References

    1. Abràmoff MD, Garvin M, Sonka M. Retinal image analysis: a review. IEEE Rev Biomed Eng. 2010; 3: 169–208. - PMC - PubMed
    1. Abramoff MD, Reinhardt JM, Russell SR, et al. Automated early detection of diabetic retinopathy. Ophthalmology. 2010; 117: 1147–1154. - PMC - PubMed
    1. Chabouis A, Berdugo M, Meas T, et al. Benefits of Ophdiat, a telemedical network to screen for diabetic retinopathy: a retrospective study in five reference hospital centres. Diabetes Metab. 2009; 35: 228–232. - PubMed
    1. Ding J, Patton N, Deary I, et al. Retinal vascular abnormalities and cognitive dysfunction: a systematic review. Br J Ophthalmol. 2008; 92: 1017–2005. - PubMed
    1. Patton N, Aslam T, McGillivray T, et al. Retinal image analysis: concepts, application and potential. Progr Retin Eye Res. 2006; 25: 99–127. - PubMed

Publication types