Effects of a financial incentive on health researchers' response to an online survey: a randomized controlled trial
- PMID: 20457556
- PMCID: PMC2885780
- DOI: 10.2196/jmir.1251
Effects of a financial incentive on health researchers' response to an online survey: a randomized controlled trial
Abstract
Background: Nonresponse to questionnaires can affect the validity of surveys and introduce bias. Offering financial incentives can increase response rates to postal questionnaires, but the effect of financial incentives on response rates to online surveys is less clear.
Objective: As part of a survey, we aimed to test whether knowledge of a financial incentive would increase the response rate to an online questionnaire.
Methods: A randomized controlled trial of 485 UK-based principal investigators of publicly funded health services and population health research. Participants were contacted by email and invited to complete an online questionnaire via an embedded URL. Participants were randomly allocated to groups with either "knowledge of" or "no knowledge of" a financial incentive ( pound10 Amazon gift voucher) to be provided on completion of the survey. At the end of the study, gift vouchers were given to all participants who completed the questionnaire regardless of initial randomization status. Four reminder emails (sent from the same email address as the initial invitation) were sent out to nonrespondents at one, two, three, and four weeks; a fifth postal reminder was also undertaken. The primary outcome measure for the trial was the response rate one week after the second reminder. Response rate was also measured at the end of weeks one, two, three, four, and five, and after a postal reminder was sent.
Results: In total, 243 (50%) questionnaires were returned (232 completed, 11 in which participation was declined). One week after the second reminder, the response rate in the "knowledge" group was 27% (66/244) versus 20% (49/241) in the "no knowledge" group (chi(2) (1) = 3.0, P = .08). The odds ratio for responding among those with knowledge of an incentive was 1.45 (95% confidence interval [CI] 0.95 - 2.21). At the third reminder, participants in the "no knowledge" group were informed about the incentive, ending the randomized element of the study. However we continued to follow up all participants, and from reminder three onwards, no significant differences were observed in the response rates of the two groups.
Conclusions: Knowledge of a financial incentive did not significantly increase the response rate to an online questionnaire. Future surveys should consider including a randomized element to further test the utility of offering incentives of other types and amounts to participate in online questionnaires.
Trial registration: ISRCTN59912797; http://www.controlled-trials.com/ISRCTN59912797 (Archived by WebCite at http://www.webcitation.org/5iPPLbT7s).
Conflict of interest statement
None declared
Figures
Similar articles
-
Impact and costs of incentives to reduce attrition in online trials: two randomized controlled trials.J Med Internet Res. 2011 Mar 2;13(1):e26. doi: 10.2196/jmir.1523. J Med Internet Res. 2011. PMID: 21371988 Free PMC article. Clinical Trial.
-
Effect of Recruitment Methods on Response Rate in a Web-Based Study for Primary Care Physicians: Factorial Randomized Controlled Trial.J Med Internet Res. 2018 Feb 8;20(2):e28. doi: 10.2196/jmir.8561. J Med Internet Res. 2018. PMID: 29422450 Free PMC article. Clinical Trial.
-
Effect of Web-Based Versus Paper-Based Questionnaires and Follow-Up Strategies on Participation Rates of Dutch Childhood Cancer Survivors: A Randomized Controlled Trial.JMIR Cancer. 2015 Nov 24;1(2):e11. doi: 10.2196/cancer.3905. JMIR Cancer. 2015. PMID: 28410161 Free PMC article.
-
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217. Cochrane Database Syst Rev. 2022. PMID: 36321557 Free PMC article.
-
Incentives in Diabetic Eye Assessment by Screening (IDEAS) trial: a three-armed randomised controlled trial of financial incentives.Southampton (UK): NIHR Journals Library; 2017 Mar. Southampton (UK): NIHR Journals Library; 2017 Mar. PMID: 28375591 Free Books & Documents. Review.
Cited by
-
Knee pain and related health in the community study (KPIC): a cohort study protocol.BMC Musculoskelet Disord. 2017 Sep 21;18(1):404. doi: 10.1186/s12891-017-1761-4. BMC Musculoskelet Disord. 2017. PMID: 28934932 Free PMC article. Clinical Trial.
-
Methods to increase response to postal and electronic questionnaires.Cochrane Database Syst Rev. 2023 Nov 30;11(11):MR000008. doi: 10.1002/14651858.MR000008.pub5. Cochrane Database Syst Rev. 2023. PMID: 38032037 Free PMC article.
-
Motivation and Barriers to Research among Nursing Professionals in Southeast Spain.Healthcare (Basel). 2022 Apr 2;10(4):675. doi: 10.3390/healthcare10040675. Healthcare (Basel). 2022. PMID: 35455852 Free PMC article.
-
Participating in online mental health interventions: who is most likely to sign up and why?Depress Res Treat. 2014;2014:790457. doi: 10.1155/2014/790457. Epub 2014 Apr 2. Depress Res Treat. 2014. PMID: 24804089 Free PMC article.
-
Seeing Is Believing? Unique Capabilities of Internet-Only Studies as a Tool for Implementation Research on HIV Prevention for Men Who Have Sex With Men: A Review of Studies and Methodological Considerations.J Acquir Immune Defic Syndr. 2019 Dec;82 Suppl 3(Suppl 3):S253-S260. doi: 10.1097/QAI.0000000000002217. J Acquir Immune Defic Syndr. 2019. PMID: 31764261 Free PMC article.
References
-
- Göritz AS. Incentives in Web studies: Methodological issues and a review. International Journal of Internet Science. 2008;1:58–70.
-
- Homans GC. Social Behavior as Exchange. Amer J Sociol. 1958;63(6):597–606. doi: 10.1086/222355. - DOI
-
- Bagozzi RP. Marketing as exchange. J Mark. 1975;39:32–9.
Publication types
MeSH terms
Associated data
Grants and funding
LinkOut - more resources
Full Text Sources
Research Materials