Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2019 Dec 5;19(1):230.
doi: 10.1186/s12874-019-0868-8.

Effectiveness of incentives and follow-up on increasing survey response rates and participation in field studies

Michael G Smith  1 , Maryam Witte  2 , Sarah Rocha  2 , Mathias Basner  2
Affiliations

Effectiveness of incentives and follow-up on increasing survey response rates and participation in field studies

Michael G Smith et al. BMC Med Res Methodol. .

Abstract

Background: Questionnaires are valuable data collection instruments in public health research, and can serve to pre-screen respondents for suitability in future studies. Survey non-response leads to reduced effective sample sizes and can decrease representativeness of the study population, so high response rates are needed to minimize the risk of bias. Here we present results on the success of different postal questionnaire strategies at effecting response, and the effectiveness of these strategies at recruiting participants for a field study on the effects of aircraft noise on sleep.

Methods: In total, we mailed 17 rounds of 240 questionnaires (total n = 4080) to randomly selected households around Atlanta International Airport. Different mailing rounds were varied in the length of the questionnaire (11, 26 or 55 questions), survey incentive (gift card or $2 cash), number of follow-up waves (0, 2 or 3), incentive for participating in a 5-night in-home sleep study ($100, $150 or $200), and address personalization.

Results: We received completed questionnaires from 407 respondents (response rate 11.4%). Personalizing the address, enclosing a $2 cash incentive with the initial questionnaire mailing and repeated follow-up mailings were effective at increasing response rate. Despite the increased expense of these approaches in terms of each household mailed, the higher response rates meant that they were more cost-effective overall for obtaining an equivalent number of responses. Interest in participating in the field study decreased with age, but was unaffected by the mailing strategies or cash incentives for field study participation. The likelihood that a respondent would participate in the field study was unaffected by survey incentive, survey length, number of follow-up waves, field study incentive, age or sex.

Conclusions: Pre-issued cash incentives and sending follow-up waves could maximize the representativeness and numbers of people from which to recruit, and may be an effective strategy for improving recruitment into field studies.

Keywords: Aircraft noise; Cost effectiveness; Field study recruitment; Postal questionnaires; Public health research; Response rate; Sleep disturbance.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no competing interests.

References

    1. Dillman DA, Smyth JD, Christian LM. Internet, phone, mail, and mixed-mode surveys : the tailored design method, 4th edition. Edn. Hoboken: Wiley; 2014.
    1. Teddlie C, Yu F. Mixed methods sampling a typology with examples. J Mixed Methods Res. 2007;1(1):77–100. doi: 10.1177/1558689806292430. - DOI
    1. Singer E. Introduction - nonresponse bias in household surveys. Public Opin Q. 2006;70(5):637–645. doi: 10.1093/poq/nfl034. - DOI
    1. Baruch Y. Response rate in academic studies - a comparative analysis. Hum Relat. 1999;52(4):421–438.
    1. Groves RM. Nonresponse rates and nonresponse bias in household surveys. Public Opin Q. 2006;70(5):646–675. doi: 10.1093/poq/nfl033. - DOI

Publication types