Recent Advancements in Multimodal Medical Image Fusion Techniques for Better Diagnosis: An Overview

Abstract

Medical imaging plays a vital role in medical diagnosis and clinical treatment. The biggest challenge in the medical field is the correct identification of disease and better treatment. Multi-modal Medical Image Fusion (MMIF) is the process of merging multiple medical images from different modalities into a single fused image. The main objective of the medical image fusion is to obtain a large amount of appropriate information (i.e., features) to improve the quality and make it more informative for increasing clinical therapy for better diagnosis and clear assessment of medical-related problems. The MMIF is generally considered with MRI (Magnetic Resonance Imaging), CT (Computed Tomography), PET (Positron Emission Tomography), SPECT (Single Photon Emission Computed Tomography), MRA (Magnetic Resonance Angiography), T1-weighted MR, T2-weighted MR, X-ray, and ultrasound imaging (Vibro-Acoustography). This review article presents a comprehensive survey of existing medical image fusion methods and has been characterized into six parts: (1) Multi-modality medical images, (2) Literature review process, (3) Image fusion rules, (4) Quality evaluation metrics for assessment of fused image, (5) Experimental results on registered datasets and (6) Conclusion. In addition, this review article provides scientific challenges faced in MMIF and future directions for better diagnosis. It is expected that this review will be useful in establishing a concrete foundation for developing more valuable fusion methods for medical diagnosis.

Keywords: Multi-modality; diagnosis; image fusion rules; medical image fusion; medical images; quality assessment metrics.