Pilot evaluation of the Fiscal Mapping Process for sustainable financing of evidence-based youth mental health treatments: A comparative case study analysis
- PMID: 38737584
- PMCID: PMC11084999
- DOI: 10.1177/26334895241249394
Pilot evaluation of the Fiscal Mapping Process for sustainable financing of evidence-based youth mental health treatments: A comparative case study analysis
Abstract
Background: Sustained delivery of evidence-based treatments (EBTs) is essential to addressing the public health impacts of youth mental health problems, but is complicated by the limited and fragmented funding available to youth mental health service agencies. Supports are needed that can guide service agencies in accessing sustainable funding for EBTs. We conducted a pilot evaluation of the Fiscal Mapping Process, an Excel-based strategic planning tool that helps service agency leaders identify and coordinate financing strategies for their EBT programs.
Method: Pilot testing of the Fiscal Mapping Process was completed with 10 youth mental health service agencies over a 12-month period, using trauma-focused cognitive-behavioral therapy or parent-child interaction therapy programs. Service agency representatives received initial training and monthly coaching in using the tool. We used case study methods to synthesize all available data (surveys, focus groups, coaching notes, document review) and contrast agency experiences to identify key findings through explanation building.
Results: Key evaluation findings related to the process and outcomes of using the Fiscal Mapping Process, as well as contextual influences. Process evaluation findings helped clarify the primary use case for the tool and identified the importance-and challenges-of engaging external collaborators. Outcome evaluation findings documented the impacts of the Fiscal Mapping Process on agency-reported sustainment capacities (strategic planning, funding stability), which fully explained reported improvements in outcomes (extent and likelihood)-although these impacts were incremental. Findings on contextual factors documented the influence of environmental and organizational capacities on engagement with the tool and concerns about equitable impacts, but also the view that the process could usefully generalize to other EBTs.
Conclusions: Our pilot evaluation of the Fiscal Mapping Process was promising. In future work, we plan to integrate the tool into EBT implementation initiatives and test its impact on long-term sustainment outcomes across various EBTs, while increasing attention to equity considerations.
Keywords: evidence-based treatment; financing strategies; strategic planning; sustainment; tailored implementation strategies; youth mental health services.
Plain language summary
Pilot-Testing a Tool for Planning the Sustainable Financing of Youth Mental Health Treatments that Work Plain Language Summary Youth mental health treatments that work must be consistently available to improve youth mental health in our communities, but funding for these treatments is often limited and hard to access. Youth mental health service agencies need tools that can help guide them in accessing sustainable funding for evidence-based treatments. We developed the Fiscal Mapping Process, an Excel-based strategic planning tool for planning sustainable financing of youth mental health treatment programs, and conducted a 1-year pilot-testing evaluation with 10 youth mental health service agencies. We used case study methods to compare and contrast agency experiences with using the tool, related to the process, outcomes, and contextual influences on using the Fiscal Mapping Process. Key findings included clarification of the ideal characteristics of contributors and treatment programs for using the tool; initial confirmation that the tool can improve agency-reported capacities for sustaining treatments that work and long-term sustainment outlooks, although these impacts were incremental; and documentation of the influence of environmental and organizational capacities on engagement with the tool, concerns about equitable impacts, and user views that the process could be applied to a wide range of treatment models. In summary, our pilot evaluation of the Fiscal Mapping Process showed that this tool is promising for supporting the financial sustainment of treatments that work in youth mental health services. In future research, we plan to incorporate the tool into real-world training initiatives with mental health service agencies, test its impact on long-term sustainment across a variety of treatment models, and incorporate attention to equity considerations.
© The Author(s) 2024.
Conflict of interest statement
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Figures
Similar articles
-
Coordination of sustainable financing for evidence-based youth mental health treatments: protocol for development and evaluation of the fiscal mapping process.Implement Sci Commun. 2022 Jan 4;3(1):1. doi: 10.1186/s43058-021-00234-6. Implement Sci Commun. 2022. PMID: 34983689 Free PMC article.
-
Perspectives on Financing Strategies for Evidence-Based Treatment Implementation in Youth Mental Health Systems.J Ment Health Policy Econ. 2023 Sep 1;26(3):115-190. J Ment Health Policy Econ. 2023. PMID: 37772508 Free PMC article.
-
Evaluating the sector-wide implementation of virtual child and youth mental health services in response to the COVID-19 pandemic: Perspectives from service providers, agency leaders and clients.Implement Res Pract. 2021 Oct 7;2:26334895211045690. doi: 10.1177/26334895211045690. eCollection 2021 Jan-Dec. Implement Res Pract. 2021. PMID: 37089999 Free PMC article.
-
A scoping review of strategies for financing the implementation of evidence-based practices in behavioral health systems: State of the literature and future directions.Implement Res Pract. 2020 Aug 30;1:2633489520939980. doi: 10.1177/2633489520939980. eCollection 2020 Jan-Dec. Implement Res Pract. 2020. PMID: 37089129 Free PMC article.
-
PERSPECTIVE: Economic and Policy Research Interests Highlighted in the 25th NIMH-Sponsored Mental Health Services Research Conference.J Ment Health Policy Econ. 2023 Sep 1;26(3):109-114. J Ment Health Policy Econ. 2023. PMID: 37772507 Free PMC article. Review.
References
-
- Aarons G. A., Green A. E., Willging C. E., Ehrhart M. G., Roesch S. C., Hecht D. B., Chaffin M. J. (2014). Mixed-method study of a conceptual model of evidence-based intervention sustainment across multiple public-sector service settings. Implementation Science, 9, 183. 10.1186/s13012-014-0183-z - DOI - PMC - PubMed
-
- Bartlett L., Vavrus F. (2017). Comparative case studies: An innovative approach. Nordic Journal of Comparative and International Education (NJCIE), 1(1), 5–17. 10.7577/njcie.1929 - DOI
Grants and funding
LinkOut - more resources
Full Text Sources