Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2019 Jun;54(3):714-721.
doi: 10.1111/1475-6773.13109. Epub 2019 Jan 18.

The effect of administration mode on CAHPS survey response rates and results: A comparison of mail and web-based approaches

Floyd J Fowler Jr  1 , Carol Cosenza  1 , Lauren A Cripps  2 , Susan Edgman-Levitan  3 , Paul D Cleary  4
Affiliations

The effect of administration mode on CAHPS survey response rates and results: A comparison of mail and web-based approaches

Floyd J Fowler Jr et al. Health Serv Res. 2019 Jun.

Abstract

Objective: The objective of this study was to compare response rates, respondents' characteristics, and substantive results for CAHPS surveys administered using web and mail protocols.

Data sources: Patients who had one or more primary care visits in the preceding 6 months.

Study design/data collection methods: Patients for whom primary care practices had email addresses were randomized to one of four survey administration protocols: web via a portal invitation; web via an email invitation; combination of web and mail; and mail only. Another sample of patients without known email addresses was surveyed by mail. Samples of nonrespondents to the Internet and mail protocols were surveyed by telephone.

Principal findings: Response rates to surveys administered using the Internet protocols were lower than for the surveys administered by mail (20 percent vs over 40 percent). However, characteristics of respondents and survey answers were very similar across protocols. Respondents without email addresses were older, less educated, and more likely to be male than those with email addresses, and there were a few differences in their responses. There was little evidence of nonresponse bias in either the mail or web protocols.

Conclusion: In this well-educated patient population, web protocols had lower response rates, but substantive results very similar to those from mail protocols.

Keywords: CAHPS; internet surveys; mode of data collection; nonresponse bias.

PubMed Disclaimer

References

    1. Cleary PD. Evolving concepts of patient‐centered care and the assessment of patient care experiences; optimism and opposition. J Health Polit Policy Law. 2016;41(4):675‐696. - PubMed
    1. Bergeson SC, Gray LA, Ehrmantraut T, Laibson T, Hays RD. Comparing web‐based and mail survey administration of the Consumer Asssessment of Healthcare Providers and Systems (CAHPS) Clinician and Group Survey. Prim Health Care. 2013. 10.4172/2176-1079.1000132 - DOI - PMC - PubMed
    1. Medway RL, Fulton J. When more gets you less: a meta‐analysis of the effect of concurrent web options on mail survey response rates. Public Opin Q. 2012;76(4):733‐746.
    1. Converse PD, Wolfe EW, Huang X, Oswant FL. Response rates for mixed‐mode surveys using mail and e‐mail/web. Am J Eval. 2008;29(1):99‐107.
    1. Dillman DA, Smyth JD, Christian LM. Internet, Mail and Mixed Mode Surveys: The Tailored Design Method, 4th edn New York, NY: John Wiley; 2014.

Publication types

LinkOut - more resources