Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Feb 21:2021:726-735.
eCollection 2021.

Integrating Multimodal Electronic Health Records for Diagnosis Prediction

Rui Li  1 , Fenglong Ma  2 , Jing Gao  3
Affiliations

Integrating Multimodal Electronic Health Records for Diagnosis Prediction

Rui Li et al. AMIA Annu Symp Proc. .

Abstract

Diagnosis prediction aims to predict the patient's future diagnosis based on their Electronic Health Records (EHRs). Most existing works adopt recurrent neural networks (RNNs) to model the sequential EHR data. However, they mainly utilize medical codes and ignore other useful information such as patients' clinical features and demographics. We proposed a new model called MDP to augment the prediction performance by integrating the multimodal clinical data. MDP learns the clinical feature representation by adjusting the weights of clinical features based on a patient's current health condition and demographics. Also, the clinical feature representation, diagnosis codes representation and the demographic embedding are integrated to perform the prediction task. Experiments on a real-world dataset demonstrate that MDP outperforms the state-of-the-art methods.

PubMed Disclaimer

Figures

Figure 1:
Figure 1:
Framework for MDP.
Figure 2:
Figure 2:
Clinical Feature Importance Analysis.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

References

    1. Choi E, Bahadori MT, Sun J, Kulas J, Schuetz A, Stewart W. RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanism. In: Lee D, Sugiyama M, Luxburg U, Guyon I, Garnett R, editors. Advances in Neural Information Processing Systems. vol. 29. Curran Associates, Inc.; 2016.
    1. Ma F, Chitta R, Zhou J, You Q, Sun T, Gao J. Dipole: Diagnosis prediction in healthcare via attention-based bidirectional recurrent neural networks. Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining. 2017:1903–1911.
    1. Choi E, Bahadori MT, Song L, Stewart WF, Sun J. GRAM: graph-based attention model for healthcare representation learning. Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining. 2017:787–795. - PMC - PubMed
    1. Ma F, You Q, Xiao H, Chitta R, Zhou J, Gao J. Kame: Knowledge-based attention model for diagnosis prediction in healthcare. Proceedings of the 27th ACM International Conference on Information and Knowledge Management. 2018:743–752.
    1. Zhang M, King CR, Avidan M, Chen Y. Hierarchical Attention Propagation for Healthcare Representation Learning. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2020:249–256.

Publication types

LinkOut - more resources