Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Randomized Controlled Trial
. 2012 Dec;119(12):2549-57.
doi: 10.1016/j.ophtha.2012.06.040. Epub 2012 Aug 28.

Optical coherence tomography grading reproducibility during the Comparison of Age-related Macular Degeneration Treatments Trials

Affiliations
Randomized Controlled Trial

Optical coherence tomography grading reproducibility during the Comparison of Age-related Macular Degeneration Treatments Trials

Francis Char DeCroos et al. Ophthalmology. 2012 Dec.

Abstract

Objective: To report reading center reproducibility during grading of Stratus optical coherence tomography (OCT) (Carl Zeiss Meditec, Dublin, CA) images obtained during the Comparison of Age-Related Macular Degeneration Treatments Trials (CATT).

Design: Prospective, clinical trial.

Participants: Independent reading teams reevaluated 270 OCT scans randomly sampled from the first 2 years of CATT enrollment. To assess temporal drift, a cohort of 23 scans submitted during the initial portion of the CATT study was longitudinally followed with serial reproducibility analysis.

Intervention: The CATT readers performed standardized grading of OCT images. A reader team, composed of 2 independent readers and a senior reader, evaluated each scan. Grading included the CATT OCT end points of total thickness at the foveal center point and intraretinal fluid (IRF), subretinal fluid (SRF), and subretinal pigment epithelium (RPE) fluid. Independent reading teams masked to the results of initial grading reevaluated scans to determine the reproducibility of qualitative grading and measurements.

Main outcome measures: Categorical grading agreement was reported using percent agreement and kappa statistic, and measurement agreement was reported using intraclass correlations and paired differences.

Results: Reading center teams reproducibly graded IRF (percent agreement = 73%, kappa = 0.48; 95% confidence interval [CI], 0.38-0.58), SRF (percent agreement = 90%; kappa = 0.80; 95% CI, 0.73-0.87), and sub-RPE fluid (percent agreement 88%; kappa = 0.75; 95% CI, 0.67-0.83). For independent reading center team measurements of total thickness at the foveal center point, the intraclass correlation was 0.99 (95% CI, 0.99-0.99), and the mean paired difference between reading center teams was 4 μm (95% limits of agreement, -55 to 47 μm). There was no qualitative or quantitative grading drift.

Conclusions: The standardized protocols used to evaluate OCT scans from the CATT study were reproducible. The methods used are suitable to monitor OCT imaging data from a large, neovascular age-related macular degeneration, interventional, multicenter study.

Financial disclosure(s): The author(s) have no proprietary or commercial interest in any materials discussed in this article.

PubMed Disclaimer

Conflict of interest statement

Conflict of Interest: No conflicting relationship exists for any author.

Figures

Figure 1
Figure 1
a – f: Representative morphologic features from Optical Coherence Tomography (OCT) images produced by the macular thickness map (MTM) protocol: 1a. Obvious vitreomacular attachment (VMA) - vitreous attachment and focal separation from the inner retina within a 3 mm diameter horizontal region centered at the middle of the fovea, 1b. Subtle VMA, 1c. Obvious epiretinal membrane (ERM), 1d. Subtle ERM, 1e. Obvious intraretinal fluid (IRF), and 1f. Subtle IRF.
Figure 2
Figure 2
a – f: Representative morphologic features from Optical Coherence Tomography (OCT) images produced by the macular thickness map (MTM) protocol: 2a. Obvious subretinal fluid (SRF), 2b. Subtle SRF, 2c. Obvious subretinal hyperreflective material (SHRM), 2d. Subtle SHRM, 2e. Obvious retinal pigment epithelium elevation (RPEE), 2f. Subtle RPEE.
Figure 3
Figure 3
a – i: Examples of grading subcategories for morphologic features noted on Optical Coherence Tomography (OCT) images produced by the macular thickness map (MTM) protocol: 3a. Epiretinal membrane (ERM) present with any deformation of the central 1 mm (horizontal dimension) of the retina, 3b. Vitreomacular attachment (VMA) present with any deformation of the central 1 mm of the retina, 3c. Any intraretinal fluid (IRF) present within central 1 mm of the retina, 3d. IRF present at the foveal center point, 3e. Any subretinal fluid (SRF) present within central 1 mm of the retina, 3f. SRF present at the foveal center point, 3g. Any sub-retinal pigment epithelium (RPE) fluid present within central 1 mm of the retina, 3h. Sub-RPE fluid present at the foveal center point, 3i. Any subretinal hyperreflective material (SHRM) present within central 1 mm of the retina.
Figure 4
Figure 4
Representative scan demonstrating choroidal neovascular membrane – pigment epithelial detachment (CNV – PED) thickness measurement at foveal center point. The measurement was performed from the outer boundary of Bruch’s membrane to the inner boundary of the CNV.
Figure 5
Figure 5
OCT scan work-flow demonstrated for reproducibility analysis between hypothetical Reading Center “Team A” and “Team B” when grading the same scan. All team analyses were performed more than 5 weeks after initial reading. solid lines = initial grading, dashed lines = reproducibility analysis. *Readers were randomly selected from pool of 8 readers, and no individual reader was part of both team A and B. **Senior Readers were randomly selected from pool of 4 Senior Readers, and no individual Senior Reader was part of both team A and B.
Figure 6
Figure 6
a – b: Comparison of single largest intraretinal cystoid hyporeflective cross sectional area from optical coherence tomography scans: 6a.Median single largest intraretinal cystoid hyporeflective cross sectional area where only one Reading Team reported intraretinal fluid as present, 6b. Median single largest intraretinal cystoid hyporeflective cross sectional area for scans where both Reading Teams agreed on presence of intraretinal fluid.

Similar articles

Cited by

References

    1. Martin DF, Maguire MG, Ying GS, et al. Ranibizumab and bevacizumab for neovascular age-related macular degeneration. N Engl J Med. 2011;364:1897–1908. - PMC - PubMed
    1. Hee MR, Baumal CR, Puliafito CA, et al. Optical coherence tomography of age-related macular degeneration and choroidal neovascularization. Ophthalmology. 1996;103:1260–1270. - PubMed
    1. Jaffe GJ, Caprioli J. Optical coherence tomography to detect and manage retinal disease and glaucoma. Am J Ophthalmol. 2004;137:156–169. - PubMed
    1. Ting TD, Oh M, Cox TA, et al. Decreased visual acuity associated with cystoid macular edema in neovascular age-related macular degeneration. Arch Ophthalmol. 2002;120:731–737. - PubMed
    1. Hee MR, Puliafito CA, Wong C, et al. Quantitative assessment of macular edema with optical coherence tomography. Arch Ophthalmol. 1995;113:1019–1029. - PubMed

Publication types

MeSH terms