Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 May 23:10:1800508.
doi: 10.1109/JTEHM.2022.3176737. eCollection 2022.

Znet: Deep Learning Approach for 2D MRI Brain Tumor Segmentation

Affiliations

Znet: Deep Learning Approach for 2D MRI Brain Tumor Segmentation

Mohammad Ashraf Ottom et al. IEEE J Transl Eng Health Med. .

Abstract

Background: Detection and segmentation of brain tumors using MR images are challenging and valuable tasks in the medical field. Early diagnosing and localizing of brain tumors can save lives and provide timely options for physicians to select efficient treatment plans. Deep learning approaches have attracted researchers in medical imaging due to their capacity, performance, and potential to assist in accurate diagnosis, prognosis, and medical treatment technologies.

Methods and procedures: This paper presents a novel framework for segmenting 2D brain tumors in MR images using deep neural networks (DNN) and utilizing data augmentation strategies. The proposed approach (Znet) is based on the idea of skip-connection, encoder-decoder architectures, and data amplification to propagate the intrinsic affinities of a relatively smaller number of expert delineated tumors, e.g., hundreds of patients of the low-grade glioma (LGG), to many thousands of synthetic cases.

Results: Our experimental results showed high values of the mean dice similarity coefficient (dice = 0.96 during model training and dice = 0.92 for the independent testing dataset). Other evaluation measures were also relatively high, e.g., pixel accuracy = 0.996, F1 score = 0.81, and Matthews Correlation Coefficient, MCC = 0.81. The results and visualization of the DNN-derived tumor masks in the testing dataset showcase the ZNet model's capability to localize and auto-segment brain tumors in MR images. This approach can further be generalized to 3D brain volumes, other pathologies, and a wide range of image modalities.

Conclusion: We can confirm the ability of deep learning methods and the proposed Znet framework to detect and segment tumors in MR images. Furthermore, pixel accuracy evaluation may not be a suitable evaluation measure for semantic segmentation in case of class imbalance in MR images segmentation. This is because the dominant class in ground truth images is the background. Therefore, a high value of pixel accuracy can be misleading in some computer vision applications. On the other hand, alternative evaluation metrics, such as dice and IoU (Intersection over Union), are more factual for semantic segmentation.

Clinical impact: Artificial intelligence (AI) applications in medicine are advancing swiftly, however, there is a lack of deployed techniques in clinical practice. This research demonstrates a practical example of AI applications in medical imaging, which can be deployed as a tool for auto-segmentation of tumors in MR images.

Keywords: Brain tumor; augmentation; deep learning; neural networks; region segmentation.

PubMed Disclaimer

Figures

FIGURE 1.
FIGURE 1.
Fully convolutional network .
FIGURE 2.
FIGURE 2.
Unet architecture , an extension and modification of fully convolutional network, receives a new MR image and produces the mask tracking the shape of the detected tumor.
FIGURE 3.
FIGURE 3.
(A) Samples of dataset images (B) the corresponding annotated ground truth (tumor mask).
FIGURE 4.
FIGURE 4.
Samples of data augmentation using albumentations python library techniques.
FIGURE 5.
FIGURE 5.
Proposed architecture of the Znet.
FIGURE 6.
FIGURE 6.
The proposed algorithm training and validation performance.
FIGURE 7.
FIGURE 7.
Visual results and comparison of MR images tumor segmentation using the proposed model (Znet) and the benchmark model Unet.

References

    1. Mandal P. K., Mahajan R., and Dinov I. D., “Structural brain atlases: Design, rationale, and applications in normal and pathological cohorts,” J. Alzheimer’s Disease, vol. 31, no. s3, pp. S169–S188, Sep. 2012. - PMC - PubMed
    1. Colby J. B., Soderberg L., Lebel C., Dinov I. D., Thompson P. M., and Sowell E. R., “Along-tract statistics allow for enhanced tractography analysis,” NeuroImage, vol. 59, no. 4, pp. 3227–3242, Feb. 2012. - PMC - PubMed
    1. Tang Y.et al., “The construction of a Chinese MRI brain atlas: A morphometric comparison study between Chinese and Caucasian cohorts,” NeuroImage, vol. 51, no. 1, pp. 33–41, May 2010. - PMC - PubMed
    1. Ottom M. A., “Convolutional neural network for diagnosing skin cancer,” Int. J. Adv. Comput. Sci. Appl., vol. 10, no. 7, pp. 333–338, 2019.
    1. Dinov I. D., Data Science and Predictive Analytics. Cham, Switzerland: Springer, 2018.

Publication types

MeSH terms