Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2013 Nov 15;3(11):e003555.
doi: 10.1136/bmjopen-2013-003555.

Fidelity in complex behaviour change interventions: a standardised approach to evaluate intervention integrity

Tom Mars  1 , David Ellard, Dawn Carnes, Kate Homer, Martin Underwood, Stephanie J C Taylor
Affiliations

Fidelity in complex behaviour change interventions: a standardised approach to evaluate intervention integrity

Tom Mars et al. BMJ Open. .

Abstract

Objectives: The aim of this study was to (1) demonstrate the development and testing of tools and procedures designed to monitor and assess the integrity of a complex intervention for chronic pain (COping with persistent Pain, Effectiveness Research into Self-management (COPERS) course); and (2) make recommendations based on our experiences.

Design: Fidelity assessment of a two-arm randomised controlled trial intervention, assessing the adherence and competence of the facilitators delivering the intervention.

Setting: The intervention was delivered in the community in two centres in the UK: one inner city and one a mix of rural and urban locations.

Participants: 403 people with chronic musculoskeletal pain were enrolled in the intervention arm and 300 attended the self-management course. Thirty lay and healthcare professionals were trained and 24 delivered the courses (2 per course). We ran 31 courses for up to 16 people per course and all were audio recorded.

Interventions: The course was run over three and a half days; facilitators delivered a semistructured manualised course.

Outcomes: We designed three measures to evaluate fidelity assessing adherence to the manual, competence and overall impression.

Results: We evaluated a random sample of four components from each course (n=122). The evaluation forms were reliable and had good face validity. There were high levels of adherence in the delivery: overall adherence was two (maximum 2, IQR 1.67-2.00), facilitator competence exhibited more variability, and overall competence was 1.5 (maximum 2, IQR 1.25-2.00). Overall impression was three (maximum 4, IQR 2.00-3.00).

Conclusions: Monitoring and assessing adherence and competence at the point of intervention delivery can be realised most efficiently by embedding the principles of fidelity measurement within the design stage of complex interventions and the training and assessment of those delivering the intervention. More work is necessary to ensure that more robust systems of fidelity evaluation accompany the growth of complex interventions.

Trial registration isrctn no: ISRCTN24426731.

Keywords: Complex Interventions; Fidelity; Treatment Integrity.

PubMed Disclaimer

References

    1. Michie S, Fixsen D, Grimshaw JM, et al. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci 2009;4:40. - PMC - PubMed
    1. Medical Research Council Developing and evaluating complex interventions: new guidance. London: Medical Research Council, 2008
    1. Bellg AJ, Borrelli B, Resnick B, et al. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol 2004;23:443–51 - PubMed
    1. Yeaton WH, Sechrest L. Critical dimensions in the choice and maintenance of successful treatments: strength, integrity, and effectiveness. J Consult Clin Psychol 1981;49:156–67 - PubMed
    1. Moncher FJ, Prinz R. Treatment fidelity in outcome studies. Clin Psychol Rev 1991;11:247–66

LinkOut - more resources