Development and validation of a patient experience of care survey for emergency departments
- PMID: 34382685
- PMCID: PMC8763294
- DOI: 10.1111/1475-6773.13853
Development and validation of a patient experience of care survey for emergency departments
Abstract
Objectives: To (1) develop a survey to assess the patient experience of care in hospital-based emergency departments (ED) and (2) evaluate the reliability and validity of composite measures of patient experience using data collected through the experimental implementation of the newly developed Emergency Department Patient Experience of Care (EDPEC) Discharged to Community (DTC) Survey.
Data source: 4893 adult patients were treated in the ED of 16 hospitals across the United States in 2018.
Study design: The study utilized a cross-sectional survey.
Data collection: Survey development activities included a literature review, focus groups, and cognitive interviews with recently discharged ED patients, technical expert panels, and multiple field experiments. Survey development resulted in a 34-item instrument; the analysis reported here focuses on 18 items on patient experience of care. Using data from the EDPEC DTC Survey in the 2018 Feasibility Test, we performed confirmatory factor analysis to group 15 evaluative survey items into composite measures. We examined internal consistency reliability, interunit reliability, and associations between each composite measure and patients' overall rating and willingness to recommend the ED.
Principal findings: Analyses of 15 evaluative items identified four composite measures: Getting Timely Care, How Well Doctors and Nurses Communicate, Communication about Medications, and Communication about Follow-up. Patient-level internal consistency reliability exceeded 0.75 for two of four composites; ED-level internal consistency reliability exceeded 0.83 for all four composites. Interunit reliability estimates indicated that 450 survey completes per ED results in at least 0.70 reliability for all composites. Higher scores on each composite were associated with higher overall ratings and willingness to recommend the ED.
Conclusions: The composite measures derived from the EDPEC DTC Survey are statistically reliable and valid. These results provide guidance for EDPEC DTC Survey adopters on how to construct meaningful and psychometrically-sound composite measures for monitoring the quality of care they provide.
Keywords: emergency department; patient experience; reliability; validity.
© 2021 Health Research and Educational Trust.
Similar articles
-
What role does compassion have on quality care ratings? A regression analysis and validation of the SCQ in emergency department patients.BMC Emerg Med. 2024 Jul 18;24(1):124. doi: 10.1186/s12873-024-01040-8. BMC Emerg Med. 2024. PMID: 39026184 Free PMC article.
-
Psychometric evaluation of the Medicare Advantage and prescription drug plan disenrollment reasons survey.Health Serv Res. 2019 Aug;54(4):930-939. doi: 10.1111/1475-6773.13160. Epub 2019 Apr 26. Health Serv Res. 2019. PMID: 31025723 Free PMC article.
-
Psychometric validation of a patient-reported experience measure for older adults attending the emergency department: the PREM-ED 65 study.Emerg Med J. 2024 Oct 23;41(11):645-653. doi: 10.1136/emermed-2023-213521. Emerg Med J. 2024. PMID: 38834289
-
Development and psychometric properties of surveys to assess patient and family caregiver experience with care transitions.BMC Health Serv Res. 2021 Aug 9;21(1):785. doi: 10.1186/s12913-021-06766-w. BMC Health Serv Res. 2021. PMID: 34372847 Free PMC article. Review.
-
Establishing the content validity of a new emergency department patient-reported experience measure (ED PREM): a Delphi study.BMC Emerg Med. 2022 Apr 9;22(1):65. doi: 10.1186/s12873-022-00617-5. BMC Emerg Med. 2022. PMID: 35397490 Free PMC article.
Cited by
-
What role does compassion have on quality care ratings? A regression analysis and validation of the SCQ in emergency department patients.BMC Emerg Med. 2024 Jul 18;24(1):124. doi: 10.1186/s12873-024-01040-8. BMC Emerg Med. 2024. PMID: 39026184 Free PMC article.
-
Development of a Patient-Reported Experience Measure Tool for Ambulatory Patients With Acute Unexpected Needs: The APEX Questionnaire.J Patient Exp. 2024 Apr 11;11:23743735241229373. doi: 10.1177/23743735241229373. eCollection 2024. J Patient Exp. 2024. PMID: 38618513 Free PMC article.
-
The Importance of Being Taken Care of-Patients' Experience with the Quality of Healthcare in a Norwegian Hospital.Nurs Rep. 2023 Dec 15;13(4):1742-1750. doi: 10.3390/nursrep13040144. Nurs Rep. 2023. PMID: 38133120 Free PMC article.
-
Mixed methods scoping review of patients' experiences of urgent and emergency cancer care.Support Care Cancer. 2025 Feb 21;33(3):208. doi: 10.1007/s00520-025-09245-8. Support Care Cancer. 2025. PMID: 39979647 Free PMC article.
-
Associations of Patient Experience With Doctor-Patient Communication and Patient-Reported Physical and Mental Health in Seriously Ill Adults.J Patient Exp. 2025 Aug 14;12:23743735251352601. doi: 10.1177/23743735251352601. eCollection 2025. J Patient Exp. 2025. PMID: 40823338 Free PMC article.
References
-
- AHRQ , CAHPS Patient Experience Surveys and Guidance. Rockville, MD: Agency for Healthcare Quality and Research. https://www.ahrq.gov/cahps/surveys-guidance/index.html. Accessed October 15, 2019.
-
- National Center for Health Statistics . Health, United States, 2014: With Special Feature on Adults Aged 55–64. Hyattsville, MD. Report No. 2015‐1232; National Center for Health Statistics; 2015. - PubMed