Contamination bias in the estimation of child maltreatment causal effects on adolescent internalizing and externalizing behavior problems
- PMID: 38634466
- PMCID: PMC11486838
- DOI: 10.1111/jcpp.13990
Contamination bias in the estimation of child maltreatment causal effects on adolescent internalizing and externalizing behavior problems
Abstract
Background: When unaddressed, contamination in child maltreatment research, in which some proportion of children recruited for a nonmaltreated comparison group are exposed to maltreatment, downwardly biases the significance and magnitude of effect size estimates. This study extends previous contamination research by investigating how a dual-measurement strategy of detecting and controlling contamination impacts causal effect size estimates of child behavior problems.
Methods: This study included 634 children from the LONGSCAN study with 63 cases of confirmed child maltreatment after age 8 and 571 cases without confirmed child maltreatment. Confirmed child maltreatment and internalizing and externalizing behaviors were recorded every 2 years between ages 4 and 16. Contamination in the nonmaltreated comparison group was identified and controlled by either a prospective self-report assessment at ages 12, 14, and 16 or by a one-time retrospective self-report assessment at age 18. Synthetic control methods were used to establish causal effects and quantify the impact of contamination when it was not controlled, when it was controlled for by prospective self-reports, and when it was controlled for by retrospective self-reports.
Results: Rates of contamination ranged from 62% to 67%. Without controlling for contamination, causal effect size estimates for internalizing behaviors were not statistically significant. Causal effects only became statistically significant after controlling contamination identified from either prospective or retrospective reports and effect sizes increased by between 17% and 54%. Controlling contamination had a smaller impact on effect size increases for externalizing behaviors but did produce a statistically significant overall effect, relative to the model ignoring contamination, when prospective methods were used.
Conclusions: The presence of contamination in a nonmaltreated comparison group can underestimate the magnitude and statistical significance of causal effect size estimates, especially when investigating internalizing behavior problems. Addressing contamination can facilitate the replication of results across studies.
Keywords: Child maltreatment; causal estimation; contamination; externalizing behaviors; internalizing behaviors; synthetic control method.
© 2024 The Authors. Journal of Child Psychology and Psychiatry published by John Wiley & Sons Ltd on behalf of Association for Child and Adolescent Mental Health.
Conflict of interest statement
Similar articles
-
Controlling contamination in child maltreatment research: Impact on effect size estimates for child behavior problems measured throughout childhood and adolescence.Dev Psychopathol. 2022 Oct;34(4):1287-1299. doi: 10.1017/S0954579420002242. Epub 2021 Mar 15. Dev Psychopathol. 2022. PMID: 33719996 Free PMC article.
-
Internalizing problems: a potential pathway from childhood maltreatment to adolescent smoking.J Adolesc Health. 2011 Mar;48(3):247-52. doi: 10.1016/j.jadohealth.2010.07.004. Epub 2010 Sep 15. J Adolesc Health. 2011. PMID: 21338895 Free PMC article.
-
Child Maltreatment and Substance Use in Emerging Adulthood: Internalizing and Externalizing Behaviors at the Transition to Adolescence as Indirect Pathways.Child Maltreat. 2022 Aug;27(3):490-500. doi: 10.1177/10775595211010965. Epub 2021 Apr 22. Child Maltreat. 2022. PMID: 33882711 Free PMC article.
-
Contamination in Observational Research on Child Maltreatment: A Conceptual and Empirical Review With Implications for Future Research.Child Maltreat. 2025 Feb;30(1):9-20. doi: 10.1177/10775595231224472. Epub 2023 Dec 26. Child Maltreat. 2025. PMID: 38146950 Free PMC article. Review.
-
Systematic Review and Meta-analysis of Parent Group Interventions for Primary School Children Aged 4-12 Years with Externalizing and/or Internalizing Problems.Child Psychiatry Hum Dev. 2018 Apr;49(2):244-267. doi: 10.1007/s10578-017-0745-9. Child Psychiatry Hum Dev. 2018. PMID: 28699101
References
-
- Abadie A (2021). Using synthetic controls: Feasibility, data requirements, and methodological aspects. Journal of Economic Literature, 59(2), 391–425.
-
- Abadie A, Diamond A, & Hainmueller J (2010). Synthetic control methods for comparative case studies: Estimating the effect of California’s tobacco control program. Journal of the American Statistical Association, 105(490), 493–505.
-
- Angrist JD, Imbens GW, & Rubin DB (1996). Identification of causal effects using instrumental variables. Journal of the American Statistical Association, 91(434), 444–455.
-
- Ben-Michael E, Feller A, & Rothstein J (2022). Synthetic controls with staggered adoption. Journal of the Royal Statistical Society Series B: Statistical Methodology, 84(2), 351–381.
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Medical