Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Jul 20;42(7):1019-1025.
doi: 10.12122/j.issn.1673-4254.2022.07.08.

[Multimodality-based super-resolution reconstruction for routine brain magnetic resonance images]

[Article in Chinese]
Z Cao  1   2   3 , G Liu  4 , Z Zhang  4 , F Shi  3 , Y Zhang  1   2
Affiliations

[Multimodality-based super-resolution reconstruction for routine brain magnetic resonance images]

[Article in Chinese]
Z Cao et al. Nan Fang Yi Ke Da Xue Xue Bao. .

Abstract
in English, Chinese

Objective: To propose a multi-modality-based super-resolution synthesis model for reconstruction of routine brain magnetic resonance images (MRI) with a low resolution and a high thickness into high-resolution images.

Methods: Based on real paired low-high resolution MRI data (2D T1, 2D T2 FLAIR and 3D T1), a structure-constrained image mapping network was used to extract important features from the images with different modalities including the whole T1 and subcortical regions of T2 FLAIR to reconstruct T1 images with higher resolutions. The gray scale intensity and structural similarities between the super-resolution images and high-resolution images were used to enhance the reconstruction performance. We used the anatomical information acquired from segment maps of the super-resolution T1 image and the ground truth by a segmentation tool as a significant constraint for adaptive learning of the intrinsic tissue structure characteristics of the brain to improve the reconstruction performance of the model.

Results: Our method showed the performance on the testing dataset than other methods with an average PSNR of 33.11 and SSIM of 0.996. The anatomical structure of the brain including the sulcus, gyrus, and subcortex were all reconstructed clearly using the proposed method, which also greatly enhanced the precision of MSCSR for brain volume measurement.

Conclusion: The proposed MSCSR model shows excellent performance for reconstructing super-resolution brain MR images based on the information of brain tissue structure and multimodality MR images.

目的: 探讨基于多模态脑影像数据的超分辨率合成模型将低分辨率的厚层数据重建成为高分辨率的薄层数据。

方法: 使用真实成对的多模态低-高分辨率MRI数据(2D-T1，2D-T2 FLAIR和3D-T1)设计结构约束的图像超分辨率重建网络，从不同模态的低分辨率MRI提取重要特征重建更高分辨率的T1图像。将T1作为主要模态使用图像全部信息，T2 FLAIR作为补充模态选取皮层下核团为关键区域进行信息增强。通过比较超分辨率重建图像与真实的高分辨率图像之间的灰度和结构相似性来确定网络的学习方向，同时通过脑分割工具获取重建图像和金标准图像的大脑解剖学结构信息，并将其作为重要约束条件来让重建模型自适应的学习大脑的组织结构特征，从而有效提升模型的重建性能。

结果: 在整体图像质量评价方面，该模型在149例测试集上的重建图像的平均PSNR值为33.11，SSIM为0.996，质量优于本文的其余对比方法生成的结果。在大脑解剖结构方面，我们的方法可以重建出较为清晰的脑沟、脑回以及皮层下核团，可视化结果显示了根据医学图像特性加入解剖学结构信息的有效性。分别使用单模态T1和多模态T1、T2 FLAIR进行图像重建的结果说明了有效选择第二模态关键区域的可行性。同时，在高分辨率图像作为金标准的情况下，使用本文提出的方法重建得到的超分辨率图像与使用低分辨率图像相比，在大脑灰质、白质和脑脊液上的体积测量平均精度有了较大的提升，灰质体积平均误差从3%降到1%，白质从18%降为了2%，脑脊液从35%降为了8%。

结论: 基于多模态的MRI脑影像超分辨率模型加入了同一组织的不同模态信息与解剖学信息，相比现有的方法，可以重建出更为接近真实高分辨率的图像，有望将其应用于临床诊疗流程中。

Keywords: anatomical information; brain images; image super resolution; magnetic resonance imaging; multimodality.

PubMed Disclaimer

Figures

图 1
图 1
图像预处理步骤 Preprocessing of brain MRI for super-resolution.
图 2
图 2
多模态MR图像超分辨率重建框架图（MSCSR） Framework of image super-resolution with multimodality MRI.
图 3
图 3
图像超分辨率映射网络结构 Structure of image super-resolution mapping network.
图 4
图 4
不同图像超分辨率重建方法在测试集中一例数据的可视化结果 Visualization results of different methods for image super-resolution task in the test dataset. LR: Low-Resolution image which was used as the input of SR networks. FSRCNN: Fast super-resolution convolutional neural network. SRFBN: Super-resolution feedback network. SCSR: Structure-constrained super-resolution network. MSCSR: Multi-modality structure-constrained superresolution network. HR: High resolution image which is the ground truth.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

References

    1. David B, Kröll-Seger J, Schuch F, et al. External validation of automated focal cortical dysplasia detection using morphometric analysis. Epilepsia. 2021;62(4):1005–21. doi: 10.1111/epi.16853. - DOI - PubMed
    1. Bernasconi A, Cendes F, Theodore WH, et al. Recommendations for the use of structural magnetic resonance imaging in the care of patients with epilepsy: a consensus report from the international league against epilepsy neuroimaging task force. Epilepsia. 2019;60(6):1054–68. - PubMed
    1. Crespo FB, Roiz SR, Pérez IR, et al. Sex-specific variation of MRIbased cortical morphometry in adult healthy volunteers: the effect on cognitive functioning. Prog Neuropsychopharmacol Biol Psychiatry. 2011;35(2):616–23. doi: 10.1016/j.pnpbp.2011.01.005. - DOI - PMC - PubMed
    1. Tian QY, Bilgic B, Fan QY, et al. Improving in vivo human cerebral cortical surface reconstruction using data-driven super-resolution. Cereb Cortex. 2021;31(1):463–82. doi: 10.1093/cercor/bhaa237. - DOI - PMC - PubMed
    1. Yang WM, Zhang XC, Tian YP, et al. Deep learning for single image super-resolution: a brief review. IEEE Trans Multimed. 2019;21(12):3106–21. doi: 10.1109/TMM.2019.2919431. - DOI

MeSH terms

LinkOut - more resources