Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 Dec;77(4):1467-1481.
doi: 10.1111/biom.13377. Epub 2020 Oct 11.

Improving precision and power in randomized trials for COVID-19 treatments using covariate adjustment, for binary, ordinal, and time-to-event outcomes

David Benkeser  1 , Iván Díaz  2 , Alex Luedtke  3   4 , Jodi Segal  5 , Daniel Scharfstein  6 , Michael Rosenblum  7
Affiliations

Improving precision and power in randomized trials for COVID-19 treatments using covariate adjustment, for binary, ordinal, and time-to-event outcomes

David Benkeser et al. Biometrics. 2021 Dec.

Abstract

Time is of the essence in evaluating potential drugs and biologics for the treatment and prevention of COVID-19. There are currently 876 randomized clinical trials (phase 2 and 3) of treatments for COVID-19 registered on clinicaltrials.gov. Covariate adjustment is a statistical analysis method with potential to improve precision and reduce the required sample size for a substantial number of these trials. Though covariate adjustment is recommended by the U.S. Food and Drug Administration and the European Medicines Agency, it is underutilized, especially for the types of outcomes (binary, ordinal, and time-to-event) that are common in COVID-19 trials. To demonstrate the potential value added by covariate adjustment in this context, we simulated two-arm, randomized trials comparing a hypothetical COVID-19 treatment versus standard of care, where the primary outcome is binary, ordinal, or time-to-event. Our simulated distributions are derived from two sources: longitudinal data on over 500 patients hospitalized at Weill Cornell Medicine New York Presbyterian Hospital and a Centers for Disease Control and Prevention preliminary description of 2449 cases. In simulated trials with sample sizes ranging from 100 to 1000 participants, we found substantial precision gains from using covariate adjustment-equivalent to 4-18% reductions in the required sample size to achieve a desired power. This was the case for a variety of estimands (targets of inference). From these simulations, we conclude that covariate adjustment is a low-risk, high-reward approach to streamlining COVID-19 treatment trials. We provide an R package and practical recommendations for implementation.

Keywords: COVID-19; covariate adjustment; ordinal outcomes; randomized trial; survival analysis.

PubMed Disclaimer

Figures

FIGURE 1
FIGURE 1
Example figures illustrating covariate‐adjusted estimates of the PMF and CDF by study arm with pointwise (black) and simultaneous (gray) confidence intervals. “ICU” represents survival and ICU admission; “None” represents survival and no ICU admission
See this image and copyright information in PMC

Update of

Comment in

References

    1. Austin, P.C. , Manca, A. , Zwarenstein, M. , Juurlink, D.N. and Stanbrook, M.B. (2010) A substantial and confusing variation exists in handling of baseline covariates in randomized controlled trials: a review of trials published in leading medical journals. Journal of Clinical Epidemiology, 63, 142–153. - PubMed
    1. Beigel, J.H. , Tomashek, K.M. , Dodd, L.E. , Mehta, A.K. , Zingman, B.S. , Kalil, A.C et al. (2020) Remdesivir for the treatment of COVID‐19 – preliminary report. New England Journal of Medicine. 10.1056/NEJMoa2007764. - DOI - PubMed
    1. Benkeser, D. , Carone, M. and Gilbert, P.B. (2018) Improved estimation of the cumulative incidence of rare outcomes. Statistics in Medicine, 37, 280–293. - PMC - PubMed
    1. Benkeser, D. , Diaz, I. , Luedtke, A. , Segal, J. , Scharfstein, D. and Rosenblum, M. (2020) Improving precision and power in randomized trials for COVID‐19 treatments using covariate adjustment, for ordinal or time‐to‐event outcomes. Available at: https://www.medrxiv.org/content/10.1101/2020.04.19.20069922v1?versioned=.... Accessed April 23, 2020. - DOI
    1. Benkeser, D. , Gilbert, P.B. and Carone, M. (2019) Estimating and testing vaccine sieve effects using machine learning. Journal of the American Statistical Association, 114, 1038–1049. - PMC - PubMed

Publication types