Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 Mar 1;28(3):541-548.
doi: 10.1093/jamia/ocaa263.

Natural language processing to measure the frequency and mode of communication between healthcare professionals and family members of critically ill patients

Filipe R Lucini  1   2 , Karla D Krewulak  1 , Kirsten M Fiest  1   3   4 , Sean M Bagshaw  5   6 , Danny J Zuege  1   6 , Joon Lee  2   3   7 , Henry T Stelfox  1   3
Affiliations

Natural language processing to measure the frequency and mode of communication between healthcare professionals and family members of critically ill patients

Filipe R Lucini et al. J Am Med Inform Assoc. .

Abstract

Objective: To apply natural language processing (NLP) techniques to identify individual events and modes of communication between healthcare professionals and families of critically ill patients from electronic medical records (EMR).

Materials and methods: Retrospective cohort study of 280 randomly selected adult patients admitted to 1 of 15 intensive care units (ICU) in Alberta, Canada from June 19, 2012 to June 11, 2018. Individual events and modes of communication were independently abstracted using NLP and manual chart review (reference standard). Preprocessing techniques and 2 NLP approaches (rule-based and machine learning) were evaluated using sensitivity, specificity, and area under the receiver operating characteristic curves (AUROC).

Results: Over 2700 combinations of NLP methods and hyperparameters were evaluated for each mode of communication using a holdout subset. The rule-based approach had the highest AUROC in 65 datasets compared to the machine learning approach in 21 datasets. Both approaches had similar performance in 17 datasets. The rule-based AUROC for the grouped categories of patient documented to have family or friends (0.972, 95% CI 0.934-1.000), visit by family/friend (0.882 95% CI 0.820-0.943) and phone call with family/friend (0.975, 95% CI: 0.952-0.998) were high.

Discussion: We report an automated method to quantify communication between healthcare professionals and family members of adult patients from free-text EMRs. A rule-based NLP approach had better overall operating characteristics than a machine learning approach.

Conclusion: NLP can automatically and accurately measure frequency and mode of documented family visitation and communication from unstructured free-text EMRs, to support patient- and family-centered care initiatives.

Keywords: communication; electronic medical records; family; intensive care units; natural language processing.

PubMed Disclaimer

Figures

Figure 1.
Figure 1.
Framework overview.
See this image and copyright information in PMC

References

    1. Fix GM, VanDeusen Lukas C, Bolton RE, et al. Patient-centred care is a way of doing things: How healthcare employees conceptualize patient-centred care. Health Expect 2018; 21 (1): 300–7. doi: 10.1111/hex.12615 - PMC - PubMed
    1. Fiest KM, McIntosh CJ, Demiantschuk D, et al. Translating evidence to patient care through caregivers: a systematic review of caregiver-mediated interventions. BMC Med 2018; 16 (1): 1–10. doi: 10.1186/s12916-018-1097-4 - PMC - PubMed
    1. Davidson JE, Aslakson RA, Long AC, et al. Guidelines for family-centered care in the neonatal, pediatric, and adult ICU. Crit Care Med 2017; 45 (1): 103–28. - PubMed
    1. Au SS, Roze Des Ordons AL, Amir Ali A, et al. Communication with patients’ families in the intensive care unit: a point prevalence study. J Crit Care 2019; 54: 235–8. - PubMed
    1. Kreimeyer K, Foster M, Pandey A, et al. Natural language processing systems for capturing and standardizing unstructured clinical information: a systematic review. J Biomed Inform 2017; 73: 14–29. - PMC - PubMed

Publication types