Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2025 Apr 11;11(1):27-40.
doi: 10.1353/obs.2025.a956839. eCollection 2025.

What randomization can and cannot guarantee

Peng Ding  1
Affiliations

What randomization can and cannot guarantee

Peng Ding. Obs Stud. .

Abstract

Aronow et al. (2024) provide a great service to the causal inference community by delineating the key results in Robins and Ritov (1997). They show that randomized controlled trials (RCTs) ensure much stronger statistical inference than unconfounded observational studies even though nonparametric identification is identical in both settings. These results are in sharp contrast to the claim in Pearl and Mackenzie (2018) that RCTs are not the gold standard of causal analysis. Pearl and Mackenzie's (2018) claim is false and misleading for empirical researchers who want to infer causal effects based on data with finite sample sizes. I will further review what randomization can and cannot guarantee more broadly. In particular, I will highlight the value of randomization-based inference in RCTs, the limit of randomization alone for more complicated causal inference questions, and the importance of sensitivity analysis in observational studies.

Keywords: causal inference; overlap; potential outcome; propensity score; randomization test; randomized controlled trial.

PubMed Disclaimer

References

    1. Inference for misspecified models with fixed regressors. Abadie A., Imbens G. W., Zheng F. 2014Journal of the American Statistical Association. 109:1601–1614.
    1. Identification of causal effects using instrumental variables (with discussion) Angrist J. D., Imbens G. W., Rubin D. B. 1996Journal of the American Statistical Association. 91:444–455.
    1. Fast computation of exact confidence intervals for randomized experiments with binary outcomes. Aronow P. M., Chang H., Lopatto P. 2023arXiv preprint arXiv:2305.09906.
    1. Nonparametric identification is not enough, but randomized controlled trials are. Aronow P. M., Robins J. M., Saarinen T., Sävje F., Sekhon J. 2024Observational Studies. in press.
    1. Estimating average causal effects under general interference, with application to a social network experiment. Aronow P. M., Samii C. 2017Annals of Applied Statistics. 11:1912–1947.

LinkOut - more resources