Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2017 Apr 14;17(1):57.
doi: 10.1186/s12874-017-0333-5.

Practical application of opt-out recruitment methods in two health services research studies

Christopher J Miller  1 , James F Burgess Jr  2 , Ellen P Fischer  3 , Deborah J Hodges  4 , Lindsay K Belanger  2 , Jessica M Lipschitz  5 , Siena R Easley  2 , Christopher J Koenig  6 , Regina L Stanley  7 , Jeffrey M Pyne  8
Affiliations

Practical application of opt-out recruitment methods in two health services research studies

Christopher J Miller et al. BMC Med Res Methodol. .

Abstract

Background: Participant recruitment is an ongoing challenge in health research. Recruitment may be especially difficult for studies of access to health care because, even among those who are in care, people using services least often also may be hardest to contact and recruit. Opt-out recruitment methods (in which potential participants are given the opportunity to decline further contact about the study (opt out) following an initial mailing, and are then contacted directly if they have not opted out within a specified period) can be used for such studies. However, there is a dearth of literature on the effort needed for effective opt-out recruitment.

Methods: In this paper we describe opt-out recruitment procedures for two studies on access to health care within the U.S. Department of Veterans Affairs. We report resource requirements for recruitment efforts (number of opt-out packets mailed and number of phone calls made). We also compare the characteristics of study participants to potential participants via t-tests, Fisher's exact tests, and chi-squared tests.

Results: Recruitment rates for our two studies were 12 and 21%, respectively. Across multiple study sites, we had to send between 4.3 and 9.2 opt-out packets to recruit one participant. The number of phone calls required to arrive at a final status for each potentially eligible Veteran (i.e. study participation or the termination of recruitment efforts) were 2.9 and 6.1 in the two studies, respectively. Study participants differed as expected from the population of potentially eligible Veterans based on planned oversampling of certain subpopulations. The final samples of participants did not differ statistically from those who were mailed opt-out packets, with one exception: in one of our two studies, participants had higher rates of mental health service use in the past year than did those mailed opt-out packets (64 vs. 47%).

Conclusions: Our results emphasize the practicality of using opt-out methods for studies of access to health care. Despite the benefits of these methods, opt-out alone may be insufficient to eliminate non-response bias on key variables. Researchers will need to balance considerations of sample representativeness and feasibility when designing studies investigating access to care.

Keywords: Access; Health services; Opt-out; Recruitment.

PubMed Disclaimer

Figures

Fig. 1
Fig. 1
Access study flow diagram
Fig. 2
Fig. 2
Tailoring study flow diagram
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Johnson LC, Beaton R, Murphy S, Pike K. Sampling bias and other methodological threats to the validity of health survey research. Int J Stress Mgmt. 2000;7(4):247–267. doi: 10.1023/A:1009589812697. - DOI
    1. Treweek S, Pitkethly M, Cook J, Kjeldstrom M, Taskila T, Johansen M, Mitchell E. Strategies to improve recruitment to randomised controlled trials. Cochrane Database Syst Rev. 2011;10-.[MR000013]. doi:10.1002/14651858.MR000013.pub5. - PubMed
    1. Sadler GR, Lee HC, Lim RSH, Fullerton J. Recruitment of hard‐to‐reach population subgroups via adaptations of the snowball sampling strategy. Nurs Health Sci. 2010;12(3):369–374. doi: 10.1111/j.1442-2018.2010.00541.x. - DOI - PMC - PubMed
    1. Atkinson R, Flint J. Accessing hidden and hard-to-reach populations: snowball research strategies. Soc Res Update. 2001;33(1):1–4.
    1. Salganik MJ. Variance estimation, design effects, and sample size calculations for respondent-driven sampling. J Urban Health. 2006;83(1):98–112. doi: 10.1007/s11524-006-9106-x. - DOI - PMC - PubMed

LinkOut - more resources