Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2002 Oct;37(5):1403-17.
doi: 10.1111/1475-6773.11194.

A demonstration of the impact of response bias on the results of patient satisfaction surveys

Kathleen M Mazor  1 , Brian E Clauser, Terry Field, Robert A Yood, Jerry H Gurwitz
Affiliations

A demonstration of the impact of response bias on the results of patient satisfaction surveys

Kathleen M Mazor et al. Health Serv Res. 2002 Oct.

Abstract

Objectives: The purposes of the present study were to examine patient satisfaction survey data for evidence of response bias, and to demonstrate, using simulated data, how response bias may impact interpretation of results.

Data sources: Patient satisfaction ratings of primary care providers (family practitioners and general internists) practicing in the context of a group-model health maintenance organization and simulated data generated to be comparable to the actual data.

Study design: Correlational analysis of actual patient satisfaction data, followed by a simulation study where response bias was modeled, with comparison of results from biased and unbiased samples.

Principal findings: A positive correlation was found between mean patient satisfaction rating and response rate in the actual patient satisfaction data. Simulation results suggest response bias could lead to overestimation of patient satisfaction overall, with this effect greatest for physicians with the lowest satisfaction scores.

Conclusions: Findings suggest that response bias may significantly impact the results of patient satisfaction surveys, leading to overestimation of the level of satisfaction in the patient population overall. Estimates of satisfaction may be most inflated for providers with the least satisfied patients, thereby threatening the validity of provider-level comparisons.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Mean Satisfaction Rating by Response Rate by Provider. A circle represents one provider. If there is more than one provider at a single point, the number of lines extending out from the center of the circle equals the total number of providers at that point
Figure 2
Figure 2
Differences between Full Sample Mean Ratings and Biased Mean Ratings by Provider
See this image and copyright information in PMC

References

    1. Asch D, Jedrziewski M, Christakis N. “Response Rates to Mail Surveys Published in Medical Journals.”. Clinical Epidemiology. 1997;50(10):1129–36. - PubMed
    1. Band P, Spinelli J, Threlfall W, Fang R, Le N, Gallagher R. “Identification of Occupational Cancer Risks in British Columbia. Part 1: Methodology Descriptive Results and Analysis of Cancer Risks by Cigarette Smoking Categories of 15,463 Incident Cancer Cases.”. Journal of Occupational and Environmental Medicine. 1999;41(4):224–32. - PubMed
    1. Barkley WM, Furse DH. “Changing Priorities for Improvement: The Impact of Low Response Rates in Patient Satisfaction.”. Joint Commission Journal on Quality Improvement. 1996;22(6):427–33. - PubMed
    1. Benfante R, Reed D, MacLean C, Kagan A. “Response Bias in the Honolulu Heart Program.”. American Journal of Epidemiology. 1989;130(6):1088–100. - PubMed
    1. Carlson MJ, Blustein J, Fiorentino N, Prestianni F. “Socioeconomic Status and Dissatisfaction Among HMO Enrollees.”. Medical Care. 2000;38(5):508–16. - PubMed

MeSH terms