Segmentation in large-scale cellular electron microscopy with deep learning: A literature survey
- PMID: 37572414
- DOI: 10.1016/j.media.2023.102920
Segmentation in large-scale cellular electron microscopy with deep learning: A literature survey
Abstract
Electron microscopy (EM) enables high-resolution imaging of tissues and cells based on 2D and 3D imaging techniques. Due to the laborious and time-consuming nature of manual segmentation of large-scale EM datasets, automated segmentation approaches are crucial. This review focuses on the progress of deep learning-based segmentation techniques in large-scale cellular EM throughout the last six years, during which significant progress has been made in both semantic and instance segmentation. A detailed account is given for the key datasets that contributed to the proliferation of deep learning in 2D and 3D EM segmentation. The review covers supervised, unsupervised, and self-supervised learning methods and examines how these algorithms were adapted to the task of segmenting cellular and sub-cellular structures in EM images. The special challenges posed by such images, like heterogeneity and spatial complexity, and the network architectures that overcame some of them are described. Moreover, an overview of the evaluation measures used to benchmark EM datasets in various segmentation tasks is provided. Finally, an outlook of current trends and future prospects of EM segmentation is given, especially with large-scale models and unlabeled images to learn generic features across EM datasets.
Keywords: Deep learning; Electron microscopy; Instance; Segmentation; Self-supervised; Semantic; Supervised.
Copyright © 2023 The Authors. Published by Elsevier B.V. All rights reserved.
Conflict of interest statement
Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Similar articles
-
CEM500K, a large-scale heterogeneous unlabeled cellular electron microscopy image dataset for deep learning.Elife. 2021 Apr 8;10:e65894. doi: 10.7554/eLife.65894. Elife. 2021. PMID: 33830015 Free PMC article.
-
RETINA: Reconstruction-based pre-trained enhanced TransUNet for electron microscopy segmentation on the CEM500K dataset.PLoS Comput Biol. 2025 May 28;21(5):e1013115. doi: 10.1371/journal.pcbi.1013115. eCollection 2025 May. PLoS Comput Biol. 2025. PMID: 40435368 Free PMC article.
-
Deep learning based domain adaptation for mitochondria segmentation on EM volumes.Comput Methods Programs Biomed. 2022 Jul;222:106949. doi: 10.1016/j.cmpb.2022.106949. Epub 2022 Jun 14. Comput Methods Programs Biomed. 2022. PMID: 35753105
-
Deep learning models for ischemic stroke lesion segmentation in medical images: A survey.Comput Biol Med. 2024 Jun;175:108509. doi: 10.1016/j.compbiomed.2024.108509. Epub 2024 Apr 25. Comput Biol Med. 2024. PMID: 38677171 Review.
-
VoxResNet: Deep voxelwise residual networks for brain segmentation from 3D MR images.Neuroimage. 2018 Apr 15;170:446-455. doi: 10.1016/j.neuroimage.2017.04.041. Epub 2017 Apr 23. Neuroimage. 2018. PMID: 28445774 Review.
Cited by
-
Automated quantification of photoreceptor outer segments in developing and degenerating retinas on microscopy images across scales.Front Mol Neurosci. 2024 May 24;17:1398447. doi: 10.3389/fnmol.2024.1398447. eCollection 2024. Front Mol Neurosci. 2024. PMID: 38854587 Free PMC article.
-
Applications of Artificial Intelligence, Deep Learning, and Machine Learning to Support the Analysis of Microscopic Images of Cells and Tissues.J Imaging. 2025 Feb 15;11(2):59. doi: 10.3390/jimaging11020059. J Imaging. 2025. PMID: 39997561 Free PMC article. Review.
-
FeatureForest: the power of foundation models, the usability of random forests.Npj Imaging. 2025 Jul 8;3(1):32. doi: 10.1038/s44303-025-00089-9. Npj Imaging. 2025. PMID: 40629147 Free PMC article.
-
Densely Populated Cell and Organelles Segmentation with U-Net Ensembles.bioRxiv [Preprint]. 2025 Jan 7:2024.11.19.623228. doi: 10.1101/2024.11.19.623228. bioRxiv. 2025. PMID: 39605330 Free PMC article. Preprint.
-
Sparse Annotation is Sufficient for Bootstrapping Dense Segmentation.bioRxiv [Preprint]. 2024 Oct 26:2024.06.14.599135. doi: 10.1101/2024.06.14.599135. bioRxiv. 2024. PMID: 38915491 Free PMC article. Preprint.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources