Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 Mar;28(1):e100262.
doi: 10.1136/bmjhci-2020-100262.

Applying natural language processing and machine learning techniques to patient experience feedback: a systematic review

Affiliations

Applying natural language processing and machine learning techniques to patient experience feedback: a systematic review

Mustafa Khanbhai et al. BMJ Health Care Inform. 2021 Mar.

Abstract

Objectives: Unstructured free-text patient feedback contains rich information, and analysing these data manually would require a lot of personnel resources which are not available in most healthcare organisations.To undertake a systematic review of the literature on the use of natural language processing (NLP) and machine learning (ML) to process and analyse free-text patient experience data.

Methods: Databases were systematically searched to identify articles published between January 2000 and December 2019 examining NLP to analyse free-text patient feedback. Due to the heterogeneous nature of the studies, a narrative synthesis was deemed most appropriate. Data related to the study purpose, corpus, methodology, performance metrics and indicators of quality were recorded.

Results: Nineteen articles were included. The majority (80%) of studies applied language analysis techniques on patient feedback from social media sites (unsolicited) followed by structured surveys (solicited). Supervised learning was frequently used (n=9), followed by unsupervised (n=6) and semisupervised (n=3). Comments extracted from social media were analysed using an unsupervised approach, and free-text comments held within structured surveys were analysed using a supervised approach. Reported performance metrics included the precision, recall and F-measure, with support vector machine and Naïve Bayes being the best performing ML classifiers.

Conclusion: NLP and ML have emerged as an important tool for processing unstructured free text. Both supervised and unsupervised approaches have their role depending on the data source. With the advancement of data analysis tools, these techniques may be useful to healthcare organisations to generate insight from the volumes of unstructured free-text data.

Keywords: BMJ health informatics; computer methodologies; information management; patient care.

PubMed Disclaimer

Conflict of interest statement

Competing interests: None declared.

Figures

Figure 1
Figure 1
Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2009 flowchart. NLP, natural language processing.
Figure 2
Figure 2
Most common approaches used to analyse free-text patient experience data identified in the systematic review.

Similar articles

Cited by

References

    1. Darzi A. High quality care for all: NHS next stage review final report department of health, 2008. Available: www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPoli... - PubMed
    1. Coulter AFR, Cornwell J. Measures of patients’ experience in hospital: purpose, methods and uses. Kings Fund, 2009.
    1. Coulter A. What do patients and the public want from primary care? BMJ 2005;331:1199–201. 10.1136/bmj.331.7526.1199 - DOI - PMC - PubMed
    1. Coulter A, Cleary PD. Patients' experiences with hospital care in five countries. Health Aff 2001;20:244–52. 10.1377/hlthaff.20.3.244 - DOI - PubMed
    1. NHS England . The friends and family test. Publication Gateway Ref, 2014.

Publication types

LinkOut - more resources