Effects of survey mode, patient mix, and nonresponse on CAHPS hospital survey scores
- PMID: 19317857
- PMCID: PMC2677051
- DOI: 10.1111/j.1475-6773.2008.00914.x
Effects of survey mode, patient mix, and nonresponse on CAHPS hospital survey scores
Abstract
Objective: To evaluate the need for survey mode adjustments to hospital care evaluations by discharged inpatients and develop the appropriate adjustments.
Data source: A total of 7,555 respondents from a 2006 national random sample of 45 hospitals who completed the CAHPS Hospital (HCAHPS [Hospital Consumer Assessments of Healthcare Providers and Systems]) Survey.
Study design/data collection/extraction methods: We estimated mode effects in linear models that predicted each HCAHPS outcome from hospital-fixed effects and patient-mix adjustors.
Principal findings: Patients randomized to the telephone and active interactive voice response (IVR) modes provided more positive evaluations than patients randomized to mail and mixed (mail with telephone follow-up) modes, with some effects equivalent to more than 30 percentile points in hospital rankings. Mode effects are consistent across hospitals and are generally larger than total patient-mix effects. Patient-mix adjustment accounts for any nonresponse bias that could have been addressed through weighting.
Conclusions: Valid comparisons of hospital performance require that reported hospital scores be adjusted for survey mode and patient mix.
Similar articles
-
Updated Adjustment of the HCAHPS Survey for New Modes of Survey Administration and Patient Mix.Med Care. 2025 May 1;63(5):358-365. doi: 10.1097/MLR.0000000000002127. Epub 2025 Jan 28. Med Care. 2025. PMID: 39878622
-
Effects of Survey Mode on Consumer Assessment of Healthcare Providers and Systems (CAHPS) Hospice Survey Scores.J Am Geriatr Soc. 2018 Mar;66(3):546-552. doi: 10.1111/jgs.15265. Epub 2018 Jan 23. J Am Geriatr Soc. 2018. PMID: 29360140
-
Equivalence of mail and telephone responses to the CAHPS Hospital Survey.Health Serv Res. 2005 Dec;40(6 Pt 2):2120-39. doi: 10.1111/j.1475-6773.2005.00479.x. Health Serv Res. 2005. PMID: 16316441 Free PMC article.
-
Case-mix adjustment of the CAHPS Hospital Survey.Health Serv Res. 2005 Dec;40(6 Pt 2):2162-81. doi: 10.1111/j.1475-6773.2005.00470.x. Health Serv Res. 2005. PMID: 16316443 Free PMC article.
-
Patterns of unit and item nonresponse in the CAHPS Hospital Survey.Health Serv Res. 2005 Dec;40(6 Pt 2):2096-119. doi: 10.1111/j.1475-6773.2005.00476.x. Health Serv Res. 2005. PMID: 16316440 Free PMC article.
Cited by
-
Differences in CAHPS reports and ratings of health care provided to adults and children.Med Care. 2012 Nov;50 Suppl(Suppl):S35-9. doi: 10.1097/MLR.0b013e3182610a88. Med Care. 2012. PMID: 23064275 Free PMC article.
-
Perceived Access to Outpatient Care and Hospital Reutilization Following Acute Respiratory Illnesses.Acad Pediatr. 2019 May-Jun;19(4):370-377. doi: 10.1016/j.acap.2018.07.001. Epub 2018 Jul 25. Acad Pediatr. 2019. PMID: 30053631 Free PMC article.
-
Hemodialysis patient characteristics associated with better experience as measured by the In-center Hemodialysis Consumer Assessment of Healthcare Providers and Systems (ICH CAHPS) survey.BMC Nephrol. 2018 Nov 28;19(1):340. doi: 10.1186/s12882-018-1147-3. BMC Nephrol. 2018. PMID: 30486811 Free PMC article.
-
Factors associated with variability in the assessment of UK doctors' professionalism: analysis of survey results.BMJ. 2011 Oct 27;343:d6212. doi: 10.1136/bmj.d6212. BMJ. 2011. PMID: 22034193 Free PMC article.
-
Comparing Inpatient Satisfaction Collected via a Web-Based Questionnaire Self-Completion and Through a Telephone Interview: An Ancillary Study of the SENTIPAT Randomized Controlled Trial.J Med Internet Res. 2017 Aug 23;19(8):e293. doi: 10.2196/jmir.7061. J Med Internet Res. 2017. PMID: 28835354 Free PMC article. Clinical Trial.
References
-
- Agency for Healthcare Research and Quality. [November 15, 2007]. “Case-Mix Adjustment in CAHPS Surveys” Available at https://www.cahps.ahrq.gov/content/cahpsOverview/case_mix_adjustment.asp.
-
- Baddeley AD, Hitch GJ. Recency Re-Examined. In: Dornic S, editor. Attention and Performance IV. Hillsdale, NJ: Erlbaum; 1977. pp. 647–67.
-
- Barkley WM, Furse DH. Changing Priorities for Improvement: The Impact of Low Response Rates in Patient Satisfaction. Joint Commission Journal on Quality Improvement. 1996;22(6):427–33. - PubMed
-
- Burroughs TE, Waterman BM, Cira JC, Desikan R, Claiborne DW. Patient Satisfaction Measurement Strategies: A Comparison of Phone and Mail Methods. Joint Commission Journal on Quality and Patient Safety. 2001;27(7):349–61. - PubMed
-
- Centers for Medicare & Medicaid Services. [November 15, 2007]. CAHPS Hospital Survey, Quality Assurance Guidelines, version 2.0” Available at http://www.hcahpsonline.org.
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Medical