Improving patient experience in primary care: a multimethod programme of research on the measurement and improvement of patient experience
- PMID: 28654227
- Bookshelf ID: NBK436541
- DOI: 10.3310/pgfar05090
Improving patient experience in primary care: a multimethod programme of research on the measurement and improvement of patient experience
Excerpt
Background: There has been an increased focus towards improving quality of care within the NHS in the last 15 years; as part of this, there has been an emphasis on the importance of patient feedback within policy, through National Service Frameworks and the Quality and Outcomes Framework. The development and administration of large-scale national patient surveys to gather representative data on patient experience, such as the national GP Patient Survey in primary care, has been one such initiative. However, it remains unclear how the survey is used by patients and what impact the data may have on practice.
Objectives: Our research aimed to gain insight into how different patients use surveys to record experiences of general practice; how primary care staff respond to feedback; and how to engage primary care staff in responding to feedback.
Methods: We used methods including quantitative survey analyses, focus groups, interviews, an exploratory trial and an experimental vignette study.
Results: (1) Understanding patient experience data. Patients readily criticised their care when reviewing consultations on video, although they were reluctant to be critical when completing questionnaires. When trained raters judged communication during a consultation to be poor, a substantial proportion of patients rated the doctor as ‘good’ or ‘very good’. Absolute scores on questionnaire surveys should be treated with caution; they may present an overoptimistic view of general practitioner (GP) care. However, relative rankings to identify GPs who are better or poorer at communicating may be acceptable, as long as statistically reliable figures are obtained. Most patients have a particular GP whom they prefer to see; however, up to 40% of people who have such a preference are unable regularly to see the doctor of their choice. Users of out-of-hours care reported worse experiences when the service was run by a commercial provider than when it was run by a not-for profit or NHS provider. (2) Understanding patient experience in minority ethnic groups. Asian respondents to the GP Patient Survey tend to be registered with practices with generally low scores, explaining about half of the difference in the poorer reported experiences of South Asian patients than white British patients. We found no evidence that South Asian patients used response scales differently. When viewing the same consultation in an experimental vignette study, South Asian respondents gave higher scores than white British respondents. This suggests that the low scores given by South Asian respondents in patient experience surveys reflect care that is genuinely worse than that experienced by their white British counterparts. We also found that service users of mixed or Asian ethnicity reported lower scores than white respondents when rating out-of-hours services. (3) Using patient experience data. We found that measuring GP–patient communication at practice level masks variation between how good individual doctors are within a practice. In general practices and in out-of-hours centres, staff were sceptical about the value of patient surveys and their ability to support service reconfiguration and quality improvement. In both settings, surveys were deemed necessary but not sufficient. Staff expressed a preference for free-text comments, as these provided more tangible, actionable data. An exploratory trial of real-time feedback (RTF) found that only 2.5% of consulting patients left feedback using touch screens in the waiting room, although more did so when reminded by staff. The representativeness of responding patients remains to be evaluated. Staff were broadly positive about using RTF, and practices valued the ability to include their own questions. Staff benefited from having a facilitated session and protected time to discuss patient feedback.
Conclusions: Our findings demonstrate the importance of patient experience feedback as a means of informing NHS care, and confirm that surveys are a valuable resource for monitoring national trends in quality of care. However, surveys may be insufficient in themselves to fully capture patient feedback, and in practice GPs rarely used the results of surveys for quality improvement. The impact of patient surveys appears to be limited and effort should be invested in making the results of surveys more meaningful to practice staff. There were several limitations of this programme of research. Practice recruitment for our in-hours studies took place in two broad geographical areas, which may not be fully representative of practices nationally. Our focus was on patient experience in primary care; secondary care settings may face different challenges in implementing quality improvement initiatives driven by patient feedback. Recommendations for future research include consideration of alternative feedback methods to better support patients to identify poor care; investigation into the factors driving poorer experiences of communication in South Asian patient groups; further investigation of how best to deliver patient feedback to clinicians to engage them and to foster quality improvement; and further research to support the development and implementation of interventions aiming to improve care when deficiencies in patient experience of care are identified.
Funding: The National Institute for Health Research Programme Grants for Applied Research programme.
Copyright © Queen’s Printer and Controller of HMSO 2017. This work was produced by Burt et al. under the terms of a commissioning contract issued by the Secretary of State for Health. This issue may be freely reproduced for the purposes of private research and study and extracts (or indeed, the full report) may be included in professional journals provided that suitable acknowledgement is made and the reproduction is not associated with any form of advertising. Applications for commercial reproduction should be addressed to: NIHR Journals Library, National Institute for Health Research, Evaluation, Trials and Studies Coordinating Centre, Alpha House, University of Southampton Science Park, Southampton SO16 7NS, UK.
Sections
- Plain English summary
- Scientific summary
- Chapter 1. Introduction to the IMPROVE (improving patient experience in primary care) programme
-
Section A. Understanding patient experience data
- Chapter 2. How do patients respond to communication items on patient experience questionnaires? Video elicitation interviews with patients
- Chapter 3. The association between patients’, raters’ and general practitioners’ assessments of communication in a consultation
- Chapter 4. Ability of patients to see the clinician of their choice
- Section B. Understanding patient experience in minority ethnic groups
-
Section C. Using data on patient experience for quality improvement
- Chapter 7. Attitudes to receiving feedback from patient experience surveys: focus groups with practice staff
- Chapter 8. Attitudes to receiving feedback from patient experience surveys: interviews with general practitioners
- Chapter 9. Understanding high and low patient experience scores: analysis of patients’ survey data for general practices and individual general practitioners
- Chapter 10. Exploratory trial of a real-time feedback intervention to improve patient experience in general practice
- Chapter 11. The validity and use of patient experience survey data in out-of-hours care
- Chapter 12. Conclusions, implications for practice and recommendations for future research
- Acknowledgements
- References
- Appendix 1. Global Consultation Rating Scale
-
Appendix 2.
Chapter 9 : patient questionnaire -
Appendix 3.
Chapter 9 : calculation of reliability - Appendix 4. Cochrane Central Register of Controlled Trials (CENTRAL) search strategy
-
Appendix 5.
Chapter 10 : the development of the Value of Patient Feedback scale -
Appendix 6.
Chapter 11 : supplementary tables -
Appendix 7.
Chapters 2 and3 : practice information sheet -
Appendix 8.
Chapters 2 and3 : general practitioner information sheet -
Appendix 9.
Chapters 2 and3 : general practitioner consent form -
Appendix 10.
Chapters 2 and3 : patient full information sheet -
Appendix 11.
Chapters 2 and3 : patient summary information sheet -
Appendix 12.
Chapters 2 and3 : patient video consent form -
Appendix 13.
Chapters 2 and3 : general practitioner questionnaire -
Appendix 14.
Chapters 2 and3 : patient questionnaire -
Appendix 15.
Chapter 2 : patient interview information sheet -
Appendix 16.
Chapter 2 : patient interview consent form -
Appendix 17.
Chapter 2 : video elicitation interview topic guide -
Appendix 18.
Chapter 6 : computer-assisted personal interview schedule -
Appendix 19.
Chapter 7 : participant information sheet -
Appendix 20.
Chapter 7 : participant consent form -
Appendix 21.
Chapter 7 : focus group topic guide -
Appendix 22.
Chapter 8 : participant information sheet -
Appendix 23.
Chapter 8 : participant consent form -
Appendix 24.
Chapter 8 : interview topic guide -
Appendix 25.
Chapter 9 : practice information sheet -
Appendix 26.
Chapter 9 : patient information sheet -
Appendix 27.
Chapter 10 : practice information sheet -
Appendix 28.
Chapter 10 : practice consent form -
Appendix 29.
Chapter 10 : practice profile questionnaire -
Appendix 30.
Chapter 10 : The Value of Patient Feedback scale -
Appendix 31.
Chapter 10 : structured observation sheets -
Appendix 32.
Chapter 10 : patient exit surveys -
Appendix 33.
Chapter 10 : example focus group/interview topic guide -
Appendix 34.
Chapter 10 : facilitator interview topic guide -
Appendix 35.
Chapter 11 : provider information sheet -
Appendix 36.
Chapter 11 : patient survey information sheet -
Appendix 37.
Chapter 11 : patient questionnaire -
Appendix 38.
Chapter 11 : patient interview information sheet -
Appendix 39.
Chapter 11 : patient interview consent form -
Appendix 40.
Chapter 11 : patient interview topic guide -
Appendix 41.
Chapter 11 : service provider information sheet -
Appendix 42.
Chapter 11 : service provider consent form -
Appendix 43.
Chapter 11 : service provider interview topic guide - List of abbreviations
Similar articles
-
Understanding negative feedback from South Asian patients: an experimental vignette study.BMJ Open. 2016 Sep 8;6(9):e011256. doi: 10.1136/bmjopen-2016-011256. BMJ Open. 2016. PMID: 27609844 Free PMC article.
-
Current experience and future potential of facilitating access to digital NHS primary care services in England: the Di-Facto mixed-methods study.Health Soc Care Deliv Res. 2024 Sep;12(32):1-197. doi: 10.3310/JKYT5803. Health Soc Care Deliv Res. 2024. PMID: 39324475 Review.
-
Evidence Brief: The Quality of Care Provided by Advanced Practice Nurses [Internet].Washington (DC): Department of Veterans Affairs (US); 2014 Sep. Washington (DC): Department of Veterans Affairs (US); 2014 Sep. PMID: 27606392 Free Books & Documents. Review.
-
Intersecting factors of disadvantage and discrimination and their effect on daily life during the coronavirus pandemic: the CICADA-ME mixed-methods study.Health Soc Care Deliv Res. 2025 Feb;13(2):1-185. doi: 10.3310/KYTF4381. Health Soc Care Deliv Res. 2025. PMID: 39949202
-
Promoting and supporting self-management for adults living in the community with physical chronic illness: A systematic review of the effectiveness and meaningfulness of the patient-practitioner encounter.JBI Libr Syst Rev. 2009;7(13):492-582. doi: 10.11124/01938924-200907130-00001. JBI Libr Syst Rev. 2009. PMID: 27819974
Publication types
LinkOut - more resources
Full Text Sources
Research Materials