Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2018 Sep:11045:3-11.
doi: 10.1007/978-3-030-00889-5_1. Epub 2018 Sep 20.

UNet++: A Nested U-Net Architecture for Medical Image Segmentation

Zongwei Zhou  1 , Md Mahfuzur Rahman Siddiquee  1 , Nima Tajbakhsh  1 , Jianming Liang  1
Affiliations

UNet++: A Nested U-Net Architecture for Medical Image Segmentation

Zongwei Zhou et al. Deep Learn Med Image Anal Multimodal Learn Clin Decis Support (2018). 2018 Sep.

Abstract

In this paper, we present UNet++, a new, more powerful architecture for medical image segmentation. Our architecture is essentially a deeply-supervised encoder-decoder network where the encoder and decoder sub-networks are connected through a series of nested, dense skip pathways. The re-designed skip pathways aim at reducing the semantic gap between the feature maps of the encoder and decoder sub-networks. We argue that the optimizer would deal with an easier learning task when the feature maps from the decoder and encoder networks are semantically similar. We have evaluated UNet++ in comparison with U-Net and wide U-Net architectures across multiple medical image segmentation tasks: nodule segmentation in the low-dose CT scans of chest, nuclei segmentation in the microscopy images, liver segmentation in abdominal CT scans, and polyp segmentation in colonoscopy videos. Our experiments demonstrate that UNet++ with deep supervision achieves an average IoU gain of 3.9 and 3.4 points over U-Net and wide U-Net, respectively.

PubMed Disclaimer

Figures

Fig. 1:
Fig. 1:
(a) UNet++ consists of an encoder and decoder that are connected through a series of nested dense convolutional blocks. The main idea behind UNet++ is to bridge the semantic gap between the feature maps of the encoder and decoder prior to fusion. For example, the semantic gap between (X0,0,X1,3) is bridged using a dense convolution block with three convolution layers. In the graphical abstract, black indicates the original U-Net, green and blue show dense convolution blocks on the skip pathways, and red indicates deep supervision. Red, green, and blue components distinguish UNet++ from U-Net. (b) Detailed analysis of the first skip pathway of UNet++. (c) UNet++ can be pruned at inference time, if trained with deep supervision.
Fig. 2:
Fig. 2:
Qualitative comparison between U-Net, wide U-Net, and UNet++, showing segmentation results for polyp, liver, and cell nuclei datasets (2D-only for a distinct visualization).
Fig. 3:
Fig. 3:
Complexity, speed, and accuracy of UNet++ after pruning on (a) cell nuclei, (b) colon polyp, (c) liver, and (d) lung nodule segmentation tasks respectively. The inference time is the time taken to process 10k test images using one NVIDIA TITAN X (Pascal) with 12 GB memory.
See this image and copyright information in PMC

References

    1. Armato SG, McLennan G, Bidaut L, McNitt-Gray MF, Meyer CR, Reeves AP, Zhao B, Aberle DR, Henschke CI, Hoffman EA, et al. The lung image database consortium (lidc) and image database resource initiative (idri): a completed reference database of lung nodules on ct scans. Medical physics, 38(2):915–931, 2011. - PMC - PubMed
    1. Drozdzal M, Vorontsov E, Chartrand G, Kadoury S, and Pal C The importance of skip connections in biomedical image segmentation In Deep Learning and Data Labeling for Medical Applications, pages 179–187. Springer, 2016.
    1. Fourure D, Emonet R, Fromont E, Muselet D, Tremeau A, and Wolf C Residual conv-deconv grid network for semantic segmentation. arXiv preprint arXiv:1707.07958, 2017.
    1. He K, Gkioxari G, Dollár P, and Girshick R Mask r-cnn In Computer Vision (ICCV), 2017 IEEE International Conference on, pages 2980–2988. IEEE, 2017.
    1. Huang G, Liu Z, Weinberger KQ, and van der Maaten L Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, volume 1, page 3, 2017.

LinkOut - more resources