Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Meta-Analysis
. 2022 Apr;23(3):425-438.
doi: 10.1007/s11121-021-01246-3. Epub 2021 May 7.

Meta-analysis with Robust Variance Estimation: Expanding the Range of Working Models

James E Pustejovsky  1 , Elizabeth Tipton  2
Affiliations
Meta-Analysis

Meta-analysis with Robust Variance Estimation: Expanding the Range of Working Models

James E Pustejovsky et al. Prev Sci. 2022 Apr.

Abstract

In prevention science and related fields, large meta-analyses are common, and these analyses often involve dependent effect size estimates. Robust variance estimation (RVE) methods provide a way to include all dependent effect sizes in a single meta-regression model, even when the exact form of the dependence is unknown. RVE uses a working model of the dependence structure, but the two currently available working models are limited to each describing a single type of dependence. Drawing on flexible tools from multilevel and multivariate meta-analysis, this paper describes an expanded range of working models, along with accompanying estimation methods, which offer potential benefits in terms of better capturing the types of data structures that occur in practice and, under some circumstances, improving the efficiency of meta-regression estimates. We describe how the methods can be implemented using existing software (the "metafor" and "clubSandwich" packages for R), illustrate the proposed approach in a meta-analysis of randomized trials on the effects of brief alcohol interventions for adolescents and young adults, and report findings from a simulation study evaluating the performance of the new methods.

Keywords: Dependent effect sizes; Meta-analysis; Meta-regression; Robust standard errors.

PubMed Disclaimer

References

    1. Baudry, C., Tarabulsy, G. M., Atkinson, L., Pearson, J., & St-Pierre, A. (2017). Intervention with adolescent mother–child dyads and cognitive development in early childhood: a meta-analysis. Prevention Science, 18, 116–130. https://doi.org/10.1007/s11121-016-0731-7
    1. Chhin, C. S., Taylor, K. A., & Wei, W. S. (2018). Supporting a culture of replication: an examination of education and special education research grants funded by the Institute of Education Sciences. Educational Researcher, 47, 594–605. https://doi.org/10.3102/0013189X18788047 - DOI
    1. Conley, C. S., Durlak, J. A., & Kirsch, A. C. (2015). A meta-analysis of universal mental health prevention programs for higher education students. Prevention Science, 16, 487–507. https://doi.org/10.1007/s11121-015-0543-1 - DOI
    1. Fisher, Z., Tipton, E., & Zhipeng, H. (2017). robumeta: Robust Variance Meta-Regression (2.0) [Computer software]. https://github.com/zackfisher/robumeta
    1. Gleser, L. J., & Olkin, I. (2009). Stochastically dependent effect sizes. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The Handbook of Research Synthesis and Meta-Analysis (2nd ed., pp. 357–376). Russell Sage Foundation.

Publication types

LinkOut - more resources