Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Randomized Controlled Trial
. 2021 Dec:111:106598.
doi: 10.1016/j.cct.2021.106598. Epub 2021 Oct 12.

A/B design testing of a clinical trial recruitment website: A pilot study to enhance the enrollment of older adults

Hailey N Miller  1 , Timothy B Plante  2 , Kelly T Gleason  3 , Jeanne Charleston  4 , Christine M Mitchell  5 , Edgar R Miller 3rd  6 , Lawrence J Appel  6 , Stephen P Juraschek  7
Affiliations
Randomized Controlled Trial

A/B design testing of a clinical trial recruitment website: A pilot study to enhance the enrollment of older adults

Hailey N Miller et al. Contemp Clin Trials. 2021 Dec.

Abstract

Introduction: Online tools are increasingly utilized in clinical trial recruitment. A/B testing is an effective technology used in political campaigns and commercial marketing to improve contributions or sales. However, to our knowledge, A/B has not been described in the context of clinical trial recruitment.

Methods: Two A/B testing experiments were implemented on the recruitment website of the Study To Understand Fall Reduction and Vitamin D in You (STURDY), a response-adaptive, two-stage, randomized controlled trial. Commercial A/B platforms randomized web-users to different versions of the trial's website landing page; Experiment 1 included two infographic versions and Experiment 2 included three video versions. We compared web-user engagement metrics between each version and the original landing page. We determined the effect of each version compared to the original landing page on the likelihood of a web-user to (1) request more information about the trial, (2) complete a screening visit, or (3) enroll in the trial.

Results: A total of 2605 and 374 web-users visited the trial's website during Experiment 1 and 2, respectively. Response to the online interest form significantly differed by infographic version in Experiment 1. The number of individuals who engaged with website content and pages significantly differed by video in Experiment 2.

Conclusion: In a pilot study implementing A/B testing of a clinical trial recruitment website, different versions of the website led to differences in web-user engagement and interest in the trial. A/B testing tools offer a promising approach to test the effectiveness of clinical trial recruitment materials and to optimize recruitment campaigns.

Clinical trial registration: This trial is registered at ClinicalTrials.gov. The trial registration number is NCT02166333. The URL is: https://clinicaltrials.gov/ct2/show/NCT02166333 Trial Registration Number: NCT02166333 Trial Register: ClinicalTrials.gov.

Keywords: A/B testing; Clinical trials; Randomized control trial; Recruitment methods.

PubMed Disclaimer

Conflict of interest statement

Declaration of Competing Interest

The authors declare that there is no conflicts of interest.

Figures

Fig. A1.
Fig. A1.
Original landing page.
Fig. 1.
Fig. 1.
Experiment design diagrams. aDigital randomization completed by A/B testing platform. bUser data includes the number of webpage visitors and the number of clicks on the webpage. cThere was only 1 place to access the form on the website. The forms were identical, but unique to each version in order to track response rates. dUser data includes the number of webpage visitors,the bounce rate and the goal conversion rate for each visit.
Fig. 2.
Fig. 2.
Experiment 1 infographics. Note: Infographics were formatted to grayscale for publication.
See this image and copyright information in PMC

References

    1. Fogel DB, Factors associated with clinical trials that fail and opportunities for improving the likelihood of success: a review, Contemp. Clin. Trials Commun 11 (2018) 156–164, 10.1016/j.conctc.2018.08.001. - DOI - PMC - PubMed
    1. Sully BGO, Julious SA, Nicholl J, A reinvestigation of recruitment to randomised, controlled, multicenter trials: a review of trials funded by two UK funding agencies, Trials. 14 (2013) 166, 10.1186/1745-6215-14-166. - DOI - PMC - PubMed
    1. Walters SJ, Bonacho I. Cadby Dos Anjos Henriques, Bortolami O, et al., Recruitment and retention of participants in randomised controlled trials: a review of trials funded and published by the United Kingdom Health Technology Assessment Programme, BMJ Open 7 (3) (2017), e015276, 10.1136/bmjopen-2016-015276. - DOI - PMC - PubMed
    1. Campbell MK, Snowdon C, Francis D, et al., Recruitment to randomised trials: strategies for trial enrollment and participation study. The STEPS study, Health Technol. Assess 11 (48) (2007) iii, ix–105, 10.3310/hta11480. - DOI - PubMed
    1. McDonald AM, Knight RC, Campbell MK, et al., What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies, Trials. 7 (2006) 9, 10.1186/1745-6215-7-9. - DOI - PMC - PubMed

Publication types

Associated data