When the Evidence Says, "Yes, No, and Maybe So": Attending to and Interpreting Inconsistent Findings Among Evidence-Based Interventions
- PMID: 21243087
- PMCID: PMC3021137
- DOI: 10.1111/j.1467-8721.2008.00546.x
When the Evidence Says, "Yes, No, and Maybe So": Attending to and Interpreting Inconsistent Findings Among Evidence-Based Interventions
Abstract
An international, multi-disciplinary effort aims to identify evidence-based treatments (EBTs) or interventions. The goal of this effort is to identify specific techniques or programs that successfully target and change specific behaviors. In clinical psychology, EBTs are identified based on the outcomes of randomized controlled trials examining whether treatments outperform control or alternative treatment conditions. Treatment outcomes are measured in multiple ways. Consistently, different ways of gauging outcomes yield inconsistent conclusions. Historically, EBT research has not accounted for these inconsistencies. This paper highlights the implications of inconsistencies, describes a framework for redressing inconsistent findings, and illustrates how the framework guides future work examining how to administer and combine treatments to maximize treatment effects, and study treatments meta-analytically.
Similar articles
-
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217. Cochrane Database Syst Rev. 2022. PMID: 36321557 Free PMC article.
-
The future of Cochrane Neonatal.Early Hum Dev. 2020 Nov;150:105191. doi: 10.1016/j.earlhumdev.2020.105191. Epub 2020 Sep 12. Early Hum Dev. 2020. PMID: 33036834
-
How often do community-based mental health providers educate and initiate PTSD treatment following training? Answering the question of reach.Implement Res Pract. 2021 May 31;2:26334895211011771. doi: 10.1177/26334895211011771. eCollection 2021 Jan-Dec. Implement Res Pract. 2021. PMID: 37090016 Free PMC article.
-
A scoping review of cultural adaptations of substance use disorder treatments across Latinx communities: Guidance for future research and practice.J Subst Abuse Treat. 2022 Jun;137:108716. doi: 10.1016/j.jsat.2021.108716. Epub 2022 Jan 11. J Subst Abuse Treat. 2022. PMID: 35148923 Free PMC article.
-
Pilot evaluation of the Fiscal Mapping Process for sustainable financing of evidence-based youth mental health treatments: A comparative case study analysis.Implement Res Pract. 2024 May 9;5:26334895241249394. doi: 10.1177/26334895241249394. eCollection 2024 Jan-Dec. Implement Res Pract. 2024. PMID: 38737584 Free PMC article.
Cited by
-
Testing informant discrepancies as predictors of early adolescent psychopathology: why difference scores cannot tell you what you want to know and how polynomial regression may.J Abnorm Child Psychol. 2013 Jan;41(1):1-14. doi: 10.1007/s10802-012-9659-y. J Abnorm Child Psychol. 2013. PMID: 22773360
-
The longitudinal consistency of mother-child reporting discrepancies of parental monitoring and their ability to predict child delinquent behaviors two years later.J Youth Adolesc. 2010 Dec;39(12):1417-30. doi: 10.1007/s10964-009-9496-7. Epub 2009 Dec 18. J Youth Adolesc. 2010. PMID: 20020188 Free PMC article.
-
Evidence-based psychotherapy in children and adolescents: advances, methodological and conceptual limitations, and perspectives.Eur Child Adolesc Psychiatry. 2013 May;22(5):265-8. doi: 10.1007/s00787-013-0415-9. Eur Child Adolesc Psychiatry. 2013. PMID: 23553576 No abstract available.
-
Whose depression relates to discrepancies? Testing relations between informant characteristics and informant discrepancies from both informants' perspectives.Psychol Assess. 2008 Jun;20(2):139-49. doi: 10.1037/1040-3590.20.2.139. Psychol Assess. 2008. PMID: 18557691 Free PMC article.
-
The effectiveness of Stepping Stones Triple P parenting support in parents of children with borderline to mild intellectual disability and psychosocial problems: a randomized controlled trial.BMC Med. 2014 Oct 28;12:191. doi: 10.1186/s12916-014-0191-5. BMC Med. 2014. PMID: 25348259 Free PMC article. Clinical Trial.
References
-
- Achenbach TM. As others see us: Clinical and research implications of cross-informant correlations for psychopathology. Current Directions in Psychological Science. 2006;15:94–98.
-
- Barrett PM, Dadds MR, Rapee RM. Family treatment of childhood anxiety: A controlled trial. Journal of Consulting and Clinical Psychology. 1996;64:333–342. - PubMed
-
- Blanton H, Jaccard J. Arbitrary metrics in psychology. American Psychologist. 2006;61:27–41. - PubMed
-
- De Los Reyes A, Kazdin AE. Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin. 2005;131:483–509. - PubMed
Recommended Readings
-
- Achenbach TM, Krukowski RA, Dumenci L, Ivanova MY. Assessment of adult psychopathology: Meta-analyses and implications of cross-informant correlations. Psychological Bulletin. 2005;131:361–382. Documented the general importance of informant discrepancies to adult clinical assessments. - PubMed
-
- Achenbach TM, McConaughy SH, Howell CT. Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin. 1987;101:213–232. A seminal meta-analysis that identified informant discrepancies as a general clinical child assessment issue. - PubMed
-
- Achenbach TM. 2006 See reference list. A brief review of the implications of informant discrepancies for clinical assessment.
-
- De Los Reyes A, Kazdin AE. 2005 See reference list. This paper advances a theoretical framework to explain why informant discrepancies exist in clinical child assessments. - PubMed
-
- De Los Reyes A, Kazdin AE. 2006 See reference list. This paper discusses the RPC Model in more detail than the current paper. - PubMed
Grants and funding
LinkOut - more resources
Full Text Sources