An evaluation of the effectiveness of recruitment methods: the staying well after depression randomized controlled trial

Abstract

Background: Randomized controlled trials (RCTs) are widely accepted as being the most efficient way of investigating the efficacy of psychological therapies. However, researchers conducting RCTs commonly report difficulties in recruiting an adequate sample within planned timescales. In an effort to overcome recruitment difficulties, researchers often are forced to expand their recruitment criteria or extend the recruitment phase, thus increasing costs and delaying publication of results. Research investigating the effectiveness of recruitment strategies is limited, and trials often fail to report sufficient details about the recruitment sources and resources utilized.

Purpose: We examined the efficacy of strategies implemented during the Staying Well after Depression RCT in Oxford to recruit participants with a history of recurrent depression.

Methods: We describe eight recruitment methods utilized and two further sources not initiated by the research team and examine their efficacy in terms of (1) the return, including the number of potential participants who contacted the trial and the number who were randomized into the trial; (2) cost-effectiveness, comprising direct financial cost and manpower for initial contacts and randomized participants; and (3) comparison of sociodemographic characteristics of individuals recruited from different sources.

Results: Poster advertising, web-based advertising, and mental health worker referrals were the cheapest methods per randomized participant; however, the ratio of randomized participants to initial contacts differed markedly per source. Advertising online, via posters, and on a local radio station were the most cost-effective recruitment methods for soliciting participants who subsequently were randomized into the trial. Advertising across many sources (saturation) was found to be important.

Limitations: It may not be feasible to employ all the recruitment methods used in this trial to obtain participation from other populations, such as those currently unwell, or in other geographical locations. Recruitment source was unavailable for participants who could not be reached after the initial contact. Thus, it is possible that the efficiency of certain methods of recruitment was poorer than estimated. Efficacy and costs of other recruitment initiatives, such as providing travel expenses to the in-person eligibility assessment and making follow-up telephone calls to candidates who contacted the recruitment team but could not be screened promptly, were not analysed.

Conclusion: Website advertising resulted in the highest number of randomized participants and was the second cheapest method of recruiting. Future research should evaluate the effectiveness of recruitment strategies for other samples to contribute to a comprehensive base of knowledge for future RCTs.

Figure 1. The number of initial trial contacts where recruitment source is known and randomized participants by recruitment source.