Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Jul 2;11(7):673.
doi: 10.3390/bioengineering11070673.

Deep Attention Fusion Hashing (DAFH) Model for Medical Image Retrieval

Gangao Wu  1   2   3 , Enhui Jin  1   2   3 , Yanling Sun  1   2   4 , Bixia Tang  1   2   4 , Wenming Zhao  1   2   3   4
Affiliations

Deep Attention Fusion Hashing (DAFH) Model for Medical Image Retrieval

Gangao Wu et al. Bioengineering (Basel). .

Abstract

In medical image retrieval, accurately retrieving relevant images significantly impacts clinical decision making and diagnostics. Traditional image-retrieval systems primarily rely on single-dimensional image data, while current deep-hashing methods are capable of learning complex feature representations. However, retrieval accuracy and efficiency are hindered by diverse modalities and limited sample sizes.

Objective: To address this, we propose a novel deep learning-based hashing model, the Deep Attention Fusion Hashing (DAFH) model, which integrates advanced attention mechanisms with medical imaging data.

Methods: The DAFH model enhances retrieval performance by integrating multi-modality medical imaging data and employing attention mechanisms to optimize the feature extraction process. Utilizing multimodal medical image data from the Cancer Imaging Archive (TCIA), this study constructed and trained a deep hashing network that achieves high-precision classification of various cancer types.

Results: At hash code lengths of 16, 32, and 48 bits, the model respectively attained Mean Average Precision (MAP@10) values of 0.711, 0.754, and 0.762, highlighting the potential and advantage of the DAFH model in medical image retrieval.

Conclusions: The DAFH model demonstrates significant improvements in the efficiency and accuracy of medical image retrieval, proving to be a valuable tool in clinical settings.

Keywords: deep hashing; deep learning; medical image retrieval.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflicts of interest.

Figures

Figure 1
Figure 1
Flow chart for data preprocessing.
Figure 2
Figure 2
The architecture of DAFH.
Figure 3
Figure 3
The confusion matrix of MAP@1.
See this image and copyright information in PMC

References

    1. Alexander A., McGill M., Tarasova A., Ferreira C., Zurkiya D. Scanning the future of medical imaging. J. Am. Coll. Radiol. 2019;16:501–507. doi: 10.1016/j.jacr.2018.09.050. - DOI - PubMed
    1. Shen D., Wu G., Suk H.I. Deep learning in medical image analysis. Annu. Rev. Biomed. Eng. 2017;19:221–248. doi: 10.1146/annurev-bioeng-071516-044442. - DOI - PMC - PubMed
    1. Anwar S.M., Majid M., Qayyum A., Awais M., Alnowami M., Khan M.K. Medical image analysis using convolutional neural networks: A review. J. Med. Syst. 2018;42:1–13. doi: 10.1007/s10916-018-1088-1. - DOI - PubMed
    1. Litjens G., Kooi T., Bejnordi B.E., Setio A.A.A., Ciompi F., Ghafoorian M., Van Der Laak J.A., Van Ginneken B., Sánchez C.I. A survey on deep learning in medical image analysis. Med. Image Anal. 2017;42:60–88. doi: 10.1016/j.media.2017.07.005. - DOI - PubMed
    1. Liu X., Gao K., Liu B., Pan C., Liang K., Yan L., Ma J., He F., Zhang S., Pan S., et al. Advances in deep learning-based medical image analysis. Health Data Sci. 2021;2021:8786793. doi: 10.34133/2021/8786793. - DOI - PMC - PubMed

LinkOut - more resources