Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Oct 10;10(10):1177.
doi: 10.3390/bioengineering10101177.

Improving OCT Image Segmentation of Retinal Layers by Utilizing a Machine Learning Based Multistage System of Stacked Multiscale Encoders and Decoders

Affiliations

Improving OCT Image Segmentation of Retinal Layers by Utilizing a Machine Learning Based Multistage System of Stacked Multiscale Encoders and Decoders

Arunodhayan Sampath Kumar et al. Bioengineering (Basel). .

Abstract

Optical coherence tomography (OCT)-based retinal imagery is often utilized to determine influential factors in patient progression and treatment, for which the retinal layers of the human eye are investigated to assess a patient's health status and eyesight. In this contribution, we propose a machine learning (ML)-based multistage system of stacked multiscale encoders and decoders for the image segmentation of OCT imagery of the retinal layers to enable the following evaluation regarding the physiological and pathological states. Our proposed system's results highlight its benefits compared to currently investigated approaches by combining commonly deployed methods from deep learning (DL) while utilizing deep neural networks (DNN). We conclude that by stacking multiple multiscale encoders and decoders, improved scores for the image segmentation task can be achieved. Our retinal-layer-based segmentation results in a final segmentation performance of up to 82.25±0.74% for the Sørensen-Dice coefficient, outperforming the current best single-stage model by 1.55% with a score of 80.70±0.20%, given the evaluated peripapillary OCT data set. Additionally, we provide results on the data sets Duke SD-OCT, Heidelberg, and UMN to illustrate our model's performance on especially noisy data sets.

Keywords: OCT biomarkers; OCT segmentation; computer vision and pattern recognition; deep learning; machine learning; ophthalmology; ophthalmology diseases.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflict of interest.

Figures

Figure 1
Figure 1
Overview of our public data sets for qualitative assessment, Duke SD-OCT [14] (top row), UMN [54] (middle row), and Heidelberg [55] (bottom row), with and their annotations, if available. For the Duke SD-OCT data set, the retinal layers are highlighted in terms of different levels of brightness. For the UMN data set, areas with fluids are additionally available (highlighted in green). For the Heidelberg data set, no annotations are available.
Figure 2
Figure 2
Overview of our data set with two selected samples and their visualized retinal layers following the color scheme presented in Table 2 as a legend for the present visualizations. Table 2 gives an overview of our data set with its samples and the proposed data set split ratio. In the top row, exemplary peripapillary OCT images are shown with their annotations in the bottom row.
Figure 3
Figure 3
The model architecture and framework of our proposed model. (a) The general model used to stack multiple encoders and decoders is illustrated. (b) The model with two stacks of encoders and decoders is shown. For visualization purposes, cyan and orange represent the input and the output, light cyan represents the first stack with encoder 1 and decoder 1, and light orange represents the second stack with encoder 2 and decoder 2.
Figure 4
Figure 4
Visualization of the quantitative results with (a) one stack and (b) two stacks from Table 3 and Table 4.
Figure 5
Figure 5
Qualitative peripapillary data set with the original, ground truth segmentation, and segmentation model results as a color-coded overlay. The individual, class-wise Dice scores are shown in Table 6.
Figure 5
Figure 5
Qualitative peripapillary data set with the original, ground truth segmentation, and segmentation model results as a color-coded overlay. The individual, class-wise Dice scores are shown in Table 6.
Figure 6
Figure 6
Qualitative results based on the Heidelberg OCT data set described in Section 2.1.4. For the Heidelberg OCT data set, no annotations are available. We consider the Heidelberg data set to be a particularly noisy data set. This is apparent when comparing Figure 5 with (c) and (k): General image noise and artifacts are observed.
Figure 7
Figure 7
Qualitative results based on the Duke SD-OCT data set described in Section 2.1.2. The ground truth comprises fluid and non-fluid manual annotations of eight boundaries.
Figure 8
Figure 8
Qualitative results based on the UMN data set described in Section 2.1.3. The ground truth comprises the retinal fluid regions.

References

    1. Anders J., Dapp U., Laub S., Renteln-Kruse W. Impact of fall risk and fear of falling on mobility of independently living senior citizens transitioning to frailty: Screening results concerning fall prevention in the community. Z. Gerontol. Geriatr. 2007;40:255–267. doi: 10.1007/s00391-007-0473-z. - DOI - PubMed
    1. E J.Y., Li T., Mclnally L., Thomson K., Shahani U., Gray L., Howe T., Skelton D. Environmental and behavioural interventions for reducing physical activity limitation and preventing falls in older people with visual impairment. Cochrane Database Syst. Rev. 2020;9:CD009233. doi: 10.1002/14651858.CD009233.pub3. - DOI - PMC - PubMed
    1. Pascolini D., Mariotti S. Global Estimates of Visual Impairment: 2010. Br. J. Ophthalmol. 2011;96:614–618. doi: 10.1136/bjophthalmol-2011-300539. - DOI - PubMed
    1. Reitmeir P., Linkohr B., Heier M., Molnos S., Strobl R., Schulz H., Breier M., Faus T., Küster D.M., Wulff A., et al. Common eye diseases in older adults of southern Germany: Results from the KORA-Age study. Age Ageing. 2017;46:481–486. doi: 10.1093/ageing/afw234. - DOI - PMC - PubMed
    1. Finger R.P., Fimmers R., Holz F.G., Scholl H.P. Incidence of blindness and severe visual impairment in Germany: Projections for 2030. Investig. Ophthalmol. Vis. Sci. 2011;52:4381–4389. doi: 10.1167/iovs.10-6987. - DOI - PubMed

LinkOut - more resources