Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022:13131:123-131.
doi: 10.1007/978-3-030-93722-5_14. Epub 2022 Jan 14.

Simultaneous Segmentation and Motion Estimation of Left Ventricular Myocardium in 3D Echocardiography Using Multi-task Learning

Kevinminh Ta  1 , Shawn S Ahn  1 , John C Stendahl  2 , Jonathan Langdon  3 , Albert J Sinusas  2   3 , James S Duncan  1   4   3
Affiliations

Simultaneous Segmentation and Motion Estimation of Left Ventricular Myocardium in 3D Echocardiography Using Multi-task Learning

Kevinminh Ta et al. Stat Atlases Comput Models Heart. 2022.

Abstract

Motion estimation and segmentation are both critical steps in identifying and assessing myocardial dysfunction, but are traditionally treated as unique tasks and solved as separate steps. However, many motion estimation techniques rely on accurate segmentations. It has been demonstrated in the computer vision and medical image analysis literature that both these tasks may be mutually beneficial when solved simultaneously. In this work, we propose a multi-task learning network that can concurrently predict volumetric segmentations of the left ventricle and estimate motion between 3D echocardiographic image pairs. The model exploits complementary latent features between the two tasks using a shared feature encoder with task-specific decoding branches. Anatomically inspired constraints are incorporated to enforce realistic motion patterns. We evaluate our proposed model on an in vivo 3D echocardiographic canine dataset. Results suggest that coupling these two tasks in a learning framework performs favorably when compared against single task learning and other alternative methods.

Keywords: Echocardiography; Motion estimation; Multi-task learning; Segmentation.

PubMed Disclaimer

Figures

Fig. 1.
Fig. 1.
The proposed network and its components. (A) Motion estimation and segmentation tasks are coupled in a multi-task learning framework. (B) An overview of the residual block.
Fig. 2.
Fig. 2.
Motion estimations from end-disatole to end-systole for healthy baseline canines. From left to right for both (a) and (b): optical flow, motion only, proposed model.
Fig. 3.
Fig. 3.
Predicted left ventricular masks. From left to right for both (a) and (b): segmentation only, proposed model.
See this image and copyright information in PMC

References

    1. Cheng J, et al.: SegFlow: joint learning for video object segmentation and optical flow. In: IEEE International Conference on Computer Vision (2017)
    1. Qin C, et al.: Joint learning of motion estimation and segmentation for cardiac MR image sequences. In: Frangi AF, Schnabel JA, Davatzikos C, Alberola-López C, Fichtinger G (eds.) MICCAI 2018. LNCS, vol. 11071, pp. 472–480. Springer, Cham: (2018). 10.1007/978-3-030-00934-2_53 - DOI
    1. Ta K, Ahn SS, Stendahl JC, Sinusas AJ, Duncan JS: A semi-supervised joint network for simultaneous left ventricular motion tracking and segmentation in 4D echocardiography. In: Martel AL, et al. (eds.) MICCAI 2020. LNCS, vol. 12266, pp. 468–477. Springer, Cham: (2020). 10.1007/978-3-030-59725-2_45 - DOI - PMC - PubMed
    1. Chen C, et al.: Deep learning for cardiac image segmentation: a review. Front. Cardiovasc. Med 7, 25 (2020) - PMC - PubMed
    1. Huang X, et al.: Contour tracking in echocardiographic sequences via sparse representation and dictionary learning. Med. Image Anal 18, 253–271 (2014) - PMC - PubMed

LinkOut - more resources