Applying natural language processing and machine learning techniques to patient experience feedback: a systematic review
- PMID: 33653690
- PMCID: PMC7929894
- DOI: 10.1136/bmjhci-2020-100262
Applying natural language processing and machine learning techniques to patient experience feedback: a systematic review
Abstract
Objectives: Unstructured free-text patient feedback contains rich information, and analysing these data manually would require a lot of personnel resources which are not available in most healthcare organisations.To undertake a systematic review of the literature on the use of natural language processing (NLP) and machine learning (ML) to process and analyse free-text patient experience data.
Methods: Databases were systematically searched to identify articles published between January 2000 and December 2019 examining NLP to analyse free-text patient feedback. Due to the heterogeneous nature of the studies, a narrative synthesis was deemed most appropriate. Data related to the study purpose, corpus, methodology, performance metrics and indicators of quality were recorded.
Results: Nineteen articles were included. The majority (80%) of studies applied language analysis techniques on patient feedback from social media sites (unsolicited) followed by structured surveys (solicited). Supervised learning was frequently used (n=9), followed by unsupervised (n=6) and semisupervised (n=3). Comments extracted from social media were analysed using an unsupervised approach, and free-text comments held within structured surveys were analysed using a supervised approach. Reported performance metrics included the precision, recall and F-measure, with support vector machine and Naïve Bayes being the best performing ML classifiers.
Conclusion: NLP and ML have emerged as an important tool for processing unstructured free text. Both supervised and unsupervised approaches have their role depending on the data source. With the advancement of data analysis tools, these techniques may be useful to healthcare organisations to generate insight from the volumes of unstructured free-text data.
Keywords: BMJ health informatics; computer methodologies; information management; patient care.
© Author(s) (or their employer(s)) 2021. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.
Conflict of interest statement
Competing interests: None declared.
Figures
Similar articles
-
Natural language processing with machine learning methods to analyze unstructured patient-reported outcomes derived from electronic health records: A systematic review.Artif Intell Med. 2023 Dec;146:102701. doi: 10.1016/j.artmed.2023.102701. Epub 2023 Nov 1. Artif Intell Med. 2023. PMID: 38042599 Free PMC article.
-
Machine learning in medicine: a practical introduction to natural language processing.BMC Med Res Methodol. 2021 Jul 31;21(1):158. doi: 10.1186/s12874-021-01347-1. BMC Med Res Methodol. 2021. PMID: 34332525 Free PMC article.
-
A comparison of rule-based and machine learning approaches for classifying patient portal messages.Int J Med Inform. 2017 Sep;105:110-120. doi: 10.1016/j.ijmedinf.2017.06.004. Epub 2017 Jun 23. Int J Med Inform. 2017. PMID: 28750904 Free PMC article.
-
Leveraging Natural Language Processing and Machine Learning Methods for Adverse Drug Event Detection in Electronic Health/Medical Records: A Scoping Review.Drug Saf. 2025 Apr;48(4):321-337. doi: 10.1007/s40264-024-01505-6. Epub 2025 Jan 9. Drug Saf. 2025. PMID: 39786481 Free PMC article.
-
Natural language processing of symptoms documented in free-text narratives of electronic health records: a systematic review.J Am Med Inform Assoc. 2019 Apr 1;26(4):364-379. doi: 10.1093/jamia/ocy173. J Am Med Inform Assoc. 2019. PMID: 30726935 Free PMC article.
Cited by
-
Closing the accessibility gap to mental health treatment with a personalized self-referral chatbot.Nat Med. 2024 Feb;30(2):595-602. doi: 10.1038/s41591-023-02766-x. Epub 2024 Feb 5. Nat Med. 2024. PMID: 38317020
-
Artificial intelligence after the bedside: co-design of AI-based clinical informatics workflows to routinely analyse patient-reported experience measures in hospitals.BMJ Health Care Inform. 2024 Dec 9;31(1):e101124. doi: 10.1136/bmjhci-2024-101124. BMJ Health Care Inform. 2024. PMID: 39653514 Free PMC article.
-
Application of the FRAME-IS to a multifaceted implementation strategy.BMC Health Serv Res. 2024 Jun 1;24(1):695. doi: 10.1186/s12913-024-11139-0. BMC Health Serv Res. 2024. PMID: 38822342 Free PMC article. Clinical Trial.
-
Sailing Too Close to the Wind? How Harnessing Patient Voice Can Identify Drift towards Boundaries of Acceptable Performance.Healthcare (Basel). 2024 Aug 1;12(15):1532. doi: 10.3390/healthcare12151532. Healthcare (Basel). 2024. PMID: 39120235 Free PMC article.
-
Assessing Patient-Perceived Hospital Service Quality and Sentiment in Malaysian Public Hospitals Using Machine Learning and Facebook Reviews.Int J Environ Res Public Health. 2021 Sep 21;18(18):9912. doi: 10.3390/ijerph18189912. Int J Environ Res Public Health. 2021. PMID: 34574835 Free PMC article.
References
-
- Darzi A. High quality care for all: NHS next stage review final report department of health, 2008. Available: www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPoli... - PubMed
-
- Coulter AFR, Cornwell J. Measures of patients’ experience in hospital: purpose, methods and uses. Kings Fund, 2009.
-
- NHS England . The friends and family test. Publication Gateway Ref, 2014.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources