Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Randomized Controlled Trial
. 2010 Jun 8:10:50.
doi: 10.1186/1471-2288-10-50.

Shortening a survey and using alternative forms of prenotification: impact on response rate and quality

Timothy J Beebe  1 , Enrique Rey, Jeanette Y Ziegenfuss, Sarah Jenkins, Kandace Lackore, Nicholas J Talley, Richard G Locke 3rd
Affiliations
Randomized Controlled Trial

Shortening a survey and using alternative forms of prenotification: impact on response rate and quality

Timothy J Beebe et al. BMC Med Res Methodol. .

Abstract

Background: Evidence suggests that survey response rates are decreasing and that the level of survey response can be influenced by questionnaire length and the use of pre-notification. The goal of the present investigation was determine the effect of questionnaire length and pre-notification type (letter vs. postcard) on measures of survey quality, including response rates, response times (days to return the survey), and item nonresponse.

Methods: In July 2008, the authors randomized 900 residents of Olmsted County, Minnesota aged 25-65 years to one of two versions of the Talley Bowel Disease Questionnaire, a survey designed to assess the prevalence of functional gastrointestinal disorders (FGID). One version was two pages long and the other 4 pages. Using a 2 x 2 factorial design, respondents were randomized to survey length and one of two pre-notification types, letter or postcard; 780 residents ultimately received a survey, after excluding those who had moved outside the county or passed away.

Results: Overall, the response rates (RR) did not vary by length of survey (RR = 44.6% for the 2-page survey and 48.4% for the 4-page) or pre-notification type (RR = 46.3% for the letter and 46.8% for the postcard). Differences in response rates by questionnaire length were seen among younger adults who were more likely to respond to the 4-page than the 2-page questionnaire (RR = 39.0% compared to 21.8% for individuals in their 20s and RR = 49.0% compared to 32.3% for those in their 30s). There were no differences across conditions with respect to item non-response or time (days after mailing) to survey response.

Conclusion: This study suggests that the shortest survey does not necessarily provide the best option for increased response rates and survey quality. Pre-notification type (letter or postcard) did not impact response rate suggesting that postcards may be more beneficial due to the lower associated costs of this method of contact.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Randomization and response rates of sample population. Note: Response rates did not differ significantly between the 2 and 4 page conditions
See this image and copyright information in PMC

References

    1. Berk ML, Schur CL, Feldman J. Twenty-five years of health surveys: does more data mean better data? Health Aff (Millwood) 2007;26(6):1599–1611. doi: 10.1377/hlthaff.26.6.1599. - DOI - PubMed
    1. Curtin R, Presser S, Singer E. Changes in Telephone Survey Nonresponse over the Past Quarter Century. Public Opin Q %R101093/poq/nfi002. 2005;69(1):87–98. doi: 10.1093/poq/nfi002. - DOI
    1. de Leeuw E, de Heer W. In: Survey Nonresponse. Groves R, Dillman D, Eltinge J, Little R, editor. New York: Wiley; 2002. Trends in household survey nonresponse: A longitudinal and international comparison; pp. 41–54.
    1. Groves R, Couper M. Nonresponse in household interview surveys. New York: John Wiley & Sons; 1998.
    1. Hox J, de Leeuw E. A comparison of nonresponse in mail, telephone, and face-to-face surveys: Applying multilevel modeling to meta-analysis. Quality and Quantity. 1994;28(4):329–344. doi: 10.1007/BF01097014. - DOI

Publication types

LinkOut - more resources