Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2013 Jun 10:8:65.
doi: 10.1186/1748-5908-8-65.

Development of a framework and coding system for modifications and adaptations of evidence-based interventions

Shannon Wiltsey Stirman  1 , Christopher J Miller, Katherine Toder, Amber Calloway
Affiliations
Review

Development of a framework and coding system for modifications and adaptations of evidence-based interventions

Shannon Wiltsey Stirman et al. Implement Sci. .

Abstract

Background: Evidence-based interventions are frequently modified or adapted during the implementation process. Changes may be made to protocols to meet the needs of the target population or address differences between the context in which the intervention was originally designed and the one into which it is implemented [Addict Behav 2011, 36(6):630-635]. However, whether modification compromises or enhances the desired benefits of the intervention is not well understood. A challenge to understanding the impact of specific types of modifications is a lack of attention to characterizing the different types of changes that may occur. A system for classifying the types of modifications that are made when interventions and programs are implemented can facilitate efforts to understand the nature of modifications that are made in particular contexts as well as the impact of these modifications on outcomes of interest.

Methods: We developed a system for classifying modifications made to interventions and programs across a variety of fields and settings. We then coded 258 modifications identified in 32 published articles that described interventions implemented in routine care or community settings.

Results: We identified modifications made to the content of interventions, as well as to the context in which interventions are delivered. We identified 12 different types of content modifications, and our coding scheme also included ratings for the level at which these modifications were made (ranging from the individual patient level up to a hospital network or community). We identified five types of contextual modifications (changes to the format, setting, or patient population that do not in and of themselves alter the actual content of the intervention). We also developed codes to indicate who made the modifications and identified a smaller subset of modifications made to the ways that training or evaluations occur when evidence-based interventions are implemented. Rater agreement analyses indicated that the coding scheme can be used to reliably classify modifications described in research articles without overly burdensome training.

Conclusions: This coding system can complement research on fidelity and may advance research with the goal of understanding the impact of modifications made when evidence-based interventions are implemented. Such findings can further inform efforts to implement such interventions while preserving desired levels of program or intervention effectiveness.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Article selection procedure and results.
Figure 2
Figure 2
System of classifying modifications to evidence-based programs or interventions.
See this image and copyright information in PMC

References

    1. Lundgren L. et al.Modifications of evidence-based practices in community-based addiction treatment organizations: a qualitative research study. Addict Behav. 2011;36(6):630–635. doi: 10.1016/j.addbeh.2011.01.003. - DOI - PubMed
    1. Schoenwald SK. et al.Toward the effective and efficient measurement of implementation fidelity. Adm Policy Ment Health. 2011;38(1):32–43. doi: 10.1007/s10488-010-0321-0. - DOI - PMC - PubMed
    1. Waltz J. et al.Testing the Integrity of a Psychotherapy Protocol: Assessment of Adherence and Competence. J Consult Clin Psychol. 1993;61(4):620–630. - PubMed
    1. Stirman SW. et al.The sustainability of new programs and interventions: A review of the empirical literature and recommendations for future research. Implementation Sci. 2012;7:17. doi: 10.1186/1748-5908-7-17. - DOI - PMC - PubMed
    1. Zvoch K. Treatment fidelity in multisite evaluation. Am J Evaluation. 2009;30(1):44–61. doi: 10.1177/1098214008329523. - DOI

Publication types

MeSH terms

LinkOut - more resources