A Comparison of Agent-Based Models and the Parametric G-Formula for Causal Inference
- PMID: 28838064
- PMCID: PMC5860229
- DOI: 10.1093/aje/kwx091
A Comparison of Agent-Based Models and the Parametric G-Formula for Causal Inference
Abstract
Decision-making requires choosing from treatments on the basis of correctly estimated outcome distributions under each treatment. In the absence of randomized trials, 2 possible approaches are the parametric g-formula and agent-based models (ABMs). The g-formula has been used exclusively to estimate effects in the population from which data were collected, whereas ABMs are commonly used to estimate effects in multiple populations, necessitating stronger assumptions. Here, we describe potential biases that arise when ABM assumptions do not hold. To do so, we estimated 12-month mortality risk in simulated populations differing in prevalence of an unknown common cause of mortality and a time-varying confounder. The ABM and g-formula correctly estimated mortality and causal effects when all inputs were from the target population. However, whenever any inputs came from another population, the ABM gave biased estimates of mortality-and often of causal effects even when the true effect was null. In the absence of unmeasured confounding and model misspecification, both methods produce valid causal inferences for a given population when all inputs are from that population. However, ABMs may result in bias when extrapolated to populations that differ on the distribution of unmeasured outcome determinants, even when the causal network linking variables is identical.
Keywords: Monte Carlo methods; agent-based models; causal inference; decision analysis; individual-level models; mathematical models; medical decision making; parametric g-formula.
© The Author(s) 2017. Published by Oxford University Press on behalf of the Johns Hopkins Bloomberg School of Public Health. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.
Figures


Comment in
-
Invited Commentary: Agent-Based Models-Bias in the Face of Discovery.Am J Epidemiol. 2017 Jul 15;186(2):146-148. doi: 10.1093/aje/kwx090. Am J Epidemiol. 2017. PMID: 28673036 Free PMC article.
-
Invited Commentary: Causal Inference Across Space and Time-Quixotic Quest, Worthy Goal, or Both?Am J Epidemiol. 2017 Jul 15;186(2):143-145. doi: 10.1093/aje/kwx089. Am J Epidemiol. 2017. PMID: 28679174 Free PMC article.
Similar articles
-
Invited Commentary: Causal Inference Across Space and Time-Quixotic Quest, Worthy Goal, or Both?Am J Epidemiol. 2017 Jul 15;186(2):143-145. doi: 10.1093/aje/kwx089. Am J Epidemiol. 2017. PMID: 28679174 Free PMC article.
-
Invited Commentary: Agent-Based Models-Bias in the Face of Discovery.Am J Epidemiol. 2017 Jul 15;186(2):146-148. doi: 10.1093/aje/kwx090. Am J Epidemiol. 2017. PMID: 28673036 Free PMC article.
-
Causal evidence in health decision making: methodological approaches of causal inference and health decision science.Ger Med Sci. 2022 Dec 21;20:Doc12. doi: 10.3205/000314. eCollection 2022. Ger Med Sci. 2022. PMID: 36742460 Free PMC article. Review.
-
Evaluating Model Specification When Using the Parametric G-Formula in the Presence of Censoring.Am J Epidemiol. 2023 Nov 3;192(11):1887-1895. doi: 10.1093/aje/kwad143. Am J Epidemiol. 2023. PMID: 37338985 Free PMC article.
-
COVID-19 and the epistemology of epidemiological models at the dawn of AI.Ann Hum Biol. 2020 Sep;47(6):506-513. doi: 10.1080/03014460.2020.1839132. Ann Hum Biol. 2020. PMID: 33228409 Review.
Cited by
-
Disseminated Effects in Agent-Based Models: A Potential Outcomes Framework and Application to Inform Preexposure Prophylaxis Coverage Levels for HIV Prevention.Am J Epidemiol. 2021 May 4;190(5):939-948. doi: 10.1093/aje/kwaa239. Am J Epidemiol. 2021. PMID: 33128066 Free PMC article. Clinical Trial.
-
Added Benefits of Pre-Exposure Prophylaxis Use on HIV Incidence with Minimal Changes in Efficiency in the Context of High Treatment Engagement Among Men Who Have Sex with Men.AIDS Patient Care STDS. 2020 Dec;34(12):506-515. doi: 10.1089/apc.2020.0151. Epub 2020 Nov 19. AIDS Patient Care STDS. 2020. PMID: 33216618 Free PMC article.
-
Evaluation of Rhode Island's Early Geographic COVID-19 Vaccine Prioritization Policy.Am J Public Health. 2024 Oct;114(S7):S580-S589. doi: 10.2105/AJPH.2024.307741. Epub 2024 Aug 28. Am J Public Health. 2024. PMID: 39197141 Free PMC article.
-
"Complete Streets" and Adult Bicyclist Fatalities: Applying G-Computation to Evaluate an Intervention That Affects the Size of a Population at Risk.Am J Epidemiol. 2018 Sep 1;187(9):2038-2045. doi: 10.1093/aje/kwy100. Am J Epidemiol. 2018. PMID: 29767676 Free PMC article.
-
Improving the impact of HIV pre-exposure prophylaxis implementation in small urban centers among men who have sex with men: An agent-based modelling study.PLoS One. 2018 Jul 9;13(7):e0199915. doi: 10.1371/journal.pone.0199915. eCollection 2018. PLoS One. 2018. PMID: 29985949 Free PMC article.
References
-
- Sonnenberg FA, Beck JR. Markov models in medical decision making: a practical guide. Med Decis Making. 1993;13(4):322–338. - PubMed
-
- Beck JR, Pauker SG. The Markov process in medical prognosis. Med Decis Making. 1983;3(4):419–458. - PubMed
-
- Robins JM, Hernán MA. Estimation of the causal effects of time-varying exposures In: Fitzmaurice G, Davidian M, Verbeke G, et al., eds. Longitudinal Data Analysis. New York, NY: Chapman and Hall/CRC Press; 2008:553–599.
-
- Robins J. A new approach to causal inference in mortality studies with sustained exposure periods—application to control of the healthy worker survivor effect [published erratum appears in Comput Math Appl 1987;14(9–12):917–921]. Math Model. 1986;7(9–12):1393–1512.
-
- Siebert U, Alagoz O, Bayoumi AM, et al. . State-transition modeling: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force-3. Med Decis Making. 2012;32(5):690–700. - PubMed
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources