Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2016 Jul;111(7):1226-34.
doi: 10.1111/add.13327. Epub 2016 Apr 1.

Assessing sample representativeness in randomized controlled trials: application to the National Institute of Drug Abuse Clinical Trials Network

Ryoko Susukida  1 , Rosa M Crum  1   2   3 , Elizabeth A Stuart  1 , Cyrus Ebnesajjad  1 , Ramin Mojtabai  1   3
Affiliations

Assessing sample representativeness in randomized controlled trials: application to the National Institute of Drug Abuse Clinical Trials Network

Ryoko Susukida et al. Addiction. 2016 Jul.

Abstract

Aims: To compare the characteristics of individuals participating in randomized controlled trials (RCTs) of treatments of substance use disorder (SUD) with individuals receiving treatment in usual care settings, and to provide a summary quantitative measure of differences between characteristics of these two groups of individuals using propensity score methods. Design Analyses using data from RCT samples from the National Institute of Drug Abuse Clinical Trials Network (CTN) and target populations of patients drawn from the Treatment Episodes Data Set-Admissions (TEDS-A). Settings Multiple clinical trial sites and nation-wide usual SUD treatment settings in the United States.

Participants: A total of 3592 individuals from 10 CTN samples and 1 602 226 individuals selected from TEDS-A between 2001 and 2009. Measurements The propensity scores for enrolling in the RCTs were computed based on the following nine observable characteristics: sex, race/ethnicity, age, education, employment status, marital status, admission to treatment through criminal justice, intravenous drug use and the number of prior treatments. Findings The proportion of those with ≥ 12 years of education and the proportion of those who had full-time jobs were significantly higher among RCT samples than among target populations (in seven and nine trials, respectively, at P < 0.001). The pooled difference in the mean propensity scores between the RCTs and the target population was 1.54 standard deviations and was statistically significant at P < 0.001.

Conclusions: In the United States, individuals recruited into randomized controlled trials of substance use disorder treatments appear to be very different from individuals receiving treatment in usual care settings. Notably, RCT participants tend to have more years of education and a greater likelihood of full-time work compared with people receiving care in usual care settings.

Keywords: Clinical trials; sample representativeness; substance use disorders.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Density plots of propensity scores in 10 National Institute of Drug Use Clinical Trial Network (CTN) randomized controlled trials (RCTs) and target samples from the Treatment Episodes Data-Admission (TEDS-A).
See this image and copyright information in PMC

Comment in

References

    1. Last JM. A Dictionary of Epidemiology. Oxford, United Kingdom: Oxford University Press; 1983.
    1. Bartlett C, Doyal L, Ebrahim S, Davey P, Bachmann M, Egger M, et al. The causes and effects of socio-demographic exclusions from clinical trials. Heal Technol Assess. 2005;9(38):iii–iv. ix–x, 1–152. - PubMed
    1. Bonell C, Oakley A, Hargreaves J, Strange V, Rees R. Assessment of generalisability in trials of health interventions: suggested framework and systematic review. BMJ. 2006;333(7563):346–9. - PMC - PubMed
    1. Blanco C, Olfson M, Goodwin RD, Ogburn E, Liebowitz MR, Nunes EV, et al. Generalizability of clinical trial results for major depression to community samples: results from the National Epidemiologic Survey on Alcohol and Related Conditions. J Clin Psychiatry. 2008;69(8):1276–80. - PubMed
    1. Humphreys K, Weingardt KR, Harris AH. Influence of subject eligibility criteria on compliance with National Institutes of Health guidelines for inclusion of women, minorities, and children in treatment research. Alcohol Clin Exp Res. 2007;31(6):988–95. - PubMed

MeSH terms