Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2020 Jun 22;20(1):163.
doi: 10.1186/s12874-020-01034-7.

Increasing questionnaire response: evidence from a nested RCT within a longitudinal birth cohort study

Michaela Goodwin  1 , Tanya Walsh  2 , William Whittaker  3 , Richard Emsley  4 , Matt Sutton  3 , Martin Tickle  2 , Michael P Kelly  5 , Iain A Pretty  2
Affiliations

Increasing questionnaire response: evidence from a nested RCT within a longitudinal birth cohort study

Michaela Goodwin et al. BMC Med Res Methodol. .

Abstract

Background: High response rates are essential when questionnaires are used within research, as representativeness can affect the validity of studies and the ability to generalise the findings to a wider population. The study aimed to measure the response rate to questionnaires from a large longitudinal epidemiological study and sought to determine if any changes made throughout data collection had a positive impact on the response to questionnaires and addressed any imbalance in response rates by participants' levels of deprivation.

Methods: Data were taken from a prospective, comparative study, designed to examine the effects of the reintroduction of water fluoridation on children's oral health over a five-year period. Response rates were analysed for the first year of data collection. During this year changes were made to the questionnaire layout and cover letter to attempt to increase response rates. Additionally a nested randomised control trial compared the effect on response rates of three different reminders to complete questionnaires.

Results: Data were available for 1824 individuals. Sending the complete questionnaire again to non-responders resulted in the highest level of response (25%). A telephone call to participants was the only method that appeared to address the imbalance in deprivation, with a mean difference in deprivation score of 2.65 (95% CI -15.50 to 10.20) between the responders and non-responders.

Conclusions: Initially, low response rates were recorded within this large, longitudinal study giving rise to concerns about non-response bias. Resending the entire questionnaire again was the most effective way of reminding participants to complete the questionnaire. As this is a less labour intensive method than for example, calling participants, more time can then be spent targeting groups who are underrepresented. In order to address these biases, data can be weighted in order to draw conclusions about the population.

Keywords: RCT; deprivation; non-response bias; questionnaires; response rates.

PubMed Disclaimer

Conflict of interest statement

MG is an Associate Editor at BMC Oral Health.

All other authors declare no competing interests.

Figures

Fig. 1
Fig. 1
Flow chart of methods used to increase questionnaire response for each wave
Fig. 2
Fig. 2
Flow diagram of response for each wave
Fig. 3
Fig. 3
Flow chart showing IMD by response for each wave
See this image and copyright information in PMC

References

    1. Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, Kwan I. Increasing response rates to postal questionnaires: systematic review. BMJ. 2002;324:1183. doi: 10.1136/bmj.325.7361.444. - DOI - PMC - PubMed
    1. Fairhurst C, Bell K, Clark L, Mitchell N, Lenaghan E, Blacklock J, Shepstone L, Torgerson D. Scoop pen sub-study-a ‘trial within a trial’ of enclosing a pen in questionnaire mailings to increase response rate. Trials. 2015;16:O11. doi: 10.1186/1745-6215-16-S2-O11. - DOI
    1. Duncan A, Bonetti D, Clarkson J, Ramsay C. Improving trial questionnaire response rates using behaviour change theory. Trials. 2015;16:P92. doi: 10.1186/1745-6215-16-S2-P92. - DOI
    1. T. Mostafa, G. Ploubidis, Millennium Cohort Study - Sixth Survey 2015-2016, 2017. http://doc.ukdataservice.ac.uk/doc/8156/mrdoc/pdf/mcs6_report_on_respons... (Accessed 11 Mar 2020).
    1. Corry NH, Williams CS, Battaglia M, McMaster HS, Stander VA. Assessing and adjusting for non-response in the Millennium Cohort Family Study. BMC Med Res Methodol. 2017;17:16. doi: 10.1186/S12874-017-0294-8. - DOI - PMC - PubMed

Publication types