Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2002 Jun;86(6):636-9.
doi: 10.1136/bjo.86.6.636.

Reliability of expert interpretation of retinal photographs for the diagnosis of toxoplasma retinochoroiditis

M R Stanford  1 , L Gras, A Wade, R E Gilbert
Affiliations

Reliability of expert interpretation of retinal photographs for the diagnosis of toxoplasma retinochoroiditis

M R Stanford et al. Br J Ophthalmol. 2002 Jun.

Abstract

Aims: To measure agreement and estimate sensitivity and specificity of uveitis experts' interpretation of retinal photographs for the diagnosis of toxoplasma retinochoroiditis.

Methods: The authors collated 96 retinal photographs from patients presenting with symptomatic posterior uveitis to ophthalmology clinics within a defined geographical area. Five uveitis experts independently ranked each photograph as definite, probable, possible, or not toxoplasma retinochoroiditis. They measured interobserver agreement based on an intraclass correlation coefficient and estimated sensitivity and specificity for each observer using a maximum likelihood model.

Results: The intraclass correlation coefficient for all five observers was 0.62 (95% CI: 0.54 to 0.69). Estimates of sensitivity and specificity for individual observers ranged from 71% to 96% and 58% to 100% respectively when appearances were dichotomised as definite or probable toxoplasma retinochoroiditis, versus possible or not.

Conclusion: Agreement between uveitis experts on the interpretation of retinal photographs was moderate to good, but the estimates of sensitivity and specificity of their interpretation for the diagnosis of toxoplasma retinochoroiditis were highly variable. Assuming that interpretation of photographs is similar to real time ophthalmoscopy, clinicians need to beware that treatment decisions made on the basis of a single assessment will include patients without toxoplasma retinochoroiditis and will miss patients with the disease.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Retinal photograph used in the study on which all assessors agreed. Definite toxoplasma retinochoroiditis.
Figure 2
Figure 2
Retinal photograph used in the study on which all assessors agreed. Probable toxoplasma retinochoroiditis.
Figure 3
Figure 3
Retinal photograph used in the study on which all assessors agreed. Possible toxoplasma retinochoroiditis.
Figure 4
Figure 4
Retinal photograph used in the study on which all assessors agreed. Not toxoplasma retinochoroiditis.
Figure 5
Figure 5
Histogram showing frequency of categorisation of photographs by the five assessors as definite (1), probable (2), possible (3), or not toxoplasma retinochoroiditis (4).
See this image and copyright information in PMC

Comment in

  • Clinical decision making in ophthalmology.
    van der Meulen J, Rahi J. van der Meulen J, et al. Br J Ophthalmol. 2002 Jun;86(6):599-600. doi: 10.1136/bjo.86.6.599. Br J Ophthalmol. 2002. PMID: 12034675 Free PMC article. No abstract available.

References

    1. Gilbert RE, Dunn D, Lightman S, et al. Incidence of symptomatic toxoplasma eye disease: aetiology and public health implications. Epidemiol Infect 1999;123:283–9. - PMC - PubMed
    1. Holland GN, O'Connor GR, Belfort-Junior R, et al. Toxoplasmosis. In: Pepose JS, Holland GN, Wilhelmus KR, eds. Ocular infection and immunity. St Louis: Mosby, 1996:1183–223.
    1. Power W, Rodriguez A, Pedroze-Seres M. The value of combined serum angiotensin converting enzyme and gallium scan in diagnosing ocular sarcoidosis. Ophthalmology 1995;102:2007–11. - PubMed
    1. Streiner DL, Norman GR, eds. Reliability. In: Health measurement scales. A practical guide to their development and use. Oxford: Oxford Medical Publications, 1995:104–27.
    1. Fleiss JL, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurements 1973;33:613–19.

Publication types