Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Randomized Controlled Trial
. 2019 Jul 17;19(1):151.
doi: 10.1186/s12874-019-0799-4.

Can targeted cover letters improve participation in health surveys? Results from a randomized controlled trial

Anne Illemann Christensen  1 , Peter Lynn  2 , Janne Schurmann Tolstrup  3
Affiliations
Randomized Controlled Trial

Can targeted cover letters improve participation in health surveys? Results from a randomized controlled trial

Anne Illemann Christensen et al. BMC Med Res Methodol. .

Abstract

Background: Improving response rates in epidemiologic studies is important for the generalizability of the outcome. The aim of this study was to examine whether it can be advantageous for participation to target different versions of the cover letters to different sample subgroups.

Methods: A randomized trial was incorporated in a cross-sectional health survey in Denmark (n = 25,000) where a motivational sentence in the cover letter intended to heighten perceptions of relevance of the survey was varied among 11 sample subgroups (treatment groups). Ten different versions of a sentence outlining questionnaire themes were tested: each mentioned three out of five themes: stress, alcohol, sex, sleep problems, and contact with family and friends. An eleventh group, the control group, omitted this sentence.

Results: On average, the additional motivational sentence resulted in a significantly lower response rate overall compared to the control group. However, the additional motivational sentence was found to have heterogeneous effects on survey response. Furthermore, the nature of the heterogeneity differed between the versions of the sentence. Specifically, the additional sentence tended to produce a higher response rate among the youngest age group and a lower response rate in the oldest age group compared to the generic letter. The use of alcohol in the motivational sentence tended to have a positive effect on response in the age group 16-24 years, and stress tended to have a positive effect in the age group ≥65 years. On the contrary, sex tended to have a negative effect in the age groups 45-64 years and ≥ 65 years. However, a significant interaction was only found between the use of stress and age group (p = < 0.0001).

Conclusion: The findings of significant and heterogeneous effects suggest that there is potential for a targeted approach to improve both response rates and sample composition. The uneven effect of the separate themes across age groups suggests that the selection of themes to be included in the motivational sentence is important for the use of targeted appeals to be successful and warrants further research to better identify which themes works in which contexts, in which subgroups and under which circumstances.

Trial registration: ClinicalTrials.gov ID: NCT03046368 , retrospectively registered February 8th, 2017.

Keywords: Cover letter; Cross sectional; Health survey; Response rate; Targeted survey design.

PubMed Disclaimer

Conflict of interest statement

The authors declare no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Figures

Fig. 1
Fig. 1
Flow diagram of the progress through the phases of a parallel randomised trial of the control and intervention groups
Fig. 2
Fig. 2
Response rate by running mean age (± 2 years). Percent
See this image and copyright information in PMC

References

    1. Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17(9):643–653. doi: 10.1016/j.annepidem.2007.03.013. - DOI - PubMed
    1. Edwards PJ, Roberts I, Clarke MJ, DiGuiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S. Methods to increase response to postal and electronic questionnaires. Cochrane Db Syst Rev. 2009;3:1–527. https://www.ncbi.nlm.nih.gov/pubmed/19588449. - PMC - PubMed
    1. Kreuter F. Facing the nonresponse challenge. Ann Am Acad Polit Ss. 2012;645(1):23–35. doi: 10.1177/0002716212456815. - DOI
    1. Lynn P. Tackling Panel Attrition. In: Krosnick DLVJA, editor. The Palgrave Handbook of Survey Research. 1st ed: Palgrave Macmillan; 2018. p. 143–53.
    1. de Leeuw EH, Hox J, Dillman DA. International handbook of survey methodology. New York: Taylor & Francis Group; 2008.

Publication types

Associated data