Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2017 Nov;22(4):872-903.
doi: 10.1111/bjhp.12260. Epub 2017 Aug 1.

Measures of fidelity of delivery of, and engagement with, complex, face-to-face health behaviour change interventions: A systematic review of measure quality

Holly Walton  1 , Aimee Spector  1 , Ildiko Tombor  2 , Susan Michie  1
Affiliations

Measures of fidelity of delivery of, and engagement with, complex, face-to-face health behaviour change interventions: A systematic review of measure quality

Holly Walton et al. Br J Health Psychol. 2017 Nov.

Abstract

Purpose: Understanding the effectiveness of complex, face-to-face health behaviour change interventions requires high-quality measures to assess fidelity of delivery and engagement. This systematic review aimed to (1) identify the types of measures used to monitor fidelity of delivery of, and engagement with, complex, face-to-face health behaviour change interventions and (2) describe the reporting of psychometric and implementation qualities.

Methods: Electronic databases were searched, systematic reviews and reference lists were hand-searched, and 21 experts were contacted to identify articles. Studies that quantitatively measured fidelity of delivery of, and/or engagement with, a complex, face-to-face health behaviour change intervention for adults were included. Data on interventions, measures, and psychometric and implementation qualities were extracted and synthesized using narrative analysis.

Results: Sixty-six studies were included: 24 measured both fidelity of delivery and engagement, 20 measured fidelity of delivery, and 22 measured engagement. Measures of fidelity of delivery included observation (n = 17; 38.6%), self-report (n = 15; 34%), quantitatively rated qualitative interviews (n = 1; 2.3%), or multiple measures (n = 11; 25%). Measures of engagement included self-report (n = 18; 39.1%), intervention records (n = 11; 24%), or multiple measures (n = 17; 37%). Fifty-one studies (77%) reported at least one psychometric or implementation quality; 49 studies (74.2%) reported at least one psychometric quality, and 17 studies (25.8%) reported at least one implementation quality.

Conclusion: Fewer than half of the reviewed studies measured both fidelity of delivery of, and engagement with complex, face-to-face health behaviour change interventions. More studies reported psychometric qualities than implementation qualities. Interpretation of intervention outcomes from fidelity of delivery and engagement measurements may be limited due to a lack of reporting of psychometric and implementation qualities. Statement of contribution What is already known on this subject? Evidence of fidelity and engagement is needed to understand effectiveness of complex interventions Evidence of fidelity and engagement are rarely reported High-quality measures are needed to measure fidelity and engagement What does this study add? Evidence that indicators of quality of measures are reported in some studies Evidence that psychometric qualities are reported more frequently than implementation qualities A recommendation for intervention evaluations to report indicators of quality of fidelity and engagement measures.

Keywords: behaviour change; complex intervention; engagement; fidelity of delivery; health; implementation; measures; psychometric; quality.

PubMed Disclaimer

Figures

Figure 1
Figure 1
A flow diagram of the paper selection process (based on Moher, Liberati, Tetzlaff, and Altman's (2009) PRISMA flow diagram).
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Angell, B. , Matthews, E. , Barrenger, S. , Watson, A. C. , & Draine, J. (2014). Engagement processes in model programs for community reentry from prison for people with serious mental illness. International Journal of Law and Psychiatry, 37, 490–500. https://doi.org/10.1016/j.ijlp.2014.02.022 - DOI - PMC - PubMed
    1. Apter, A. J. , Wang, X. , Bogen, D. K. , Rand, C. S. , McElligott, S. , Polsky, D. , … Have, T.T. (2011). Problem solving to improve adherence and asthma outcomes in urban adults with moderate or severe asthma: A randomized controlled trial. Journal of Allergy and Clinical Immunology, 128, 516–523. e515. https://doi.org/10.1016/j.jaci.2011.05.010*1 - DOI - PMC - PubMed
    1. Arends, I. , Bültmann, U. , Nielsen, K. , van Rhenen, W. , de Boer, M. R. , & van der Klink, J. J. (2014). Process evaluation of a problem solving intervention to prevent recurrent sickness absence in workers with common mental disorders. Social Science and Medicine, 100, 123–132. https://doi.org/10.1016/j.socscimed.2013.10.041*2 - DOI - PubMed
    1. Baer, J. S. , Ball, S. A. , Campbell, B. K. , Miele, G. M. , Schoener, E. P. , & Tracy, K. (2007). Training and fidelity monitoring of behavioral interventions in multi‐site addictions research. Drug and Alcohol Dependence, 87, 107–118. https://doi.org/10.1016/j.drugalcdep.2006.08.028 - DOI - PMC - PubMed
    1. Bailey, W. C. , Richards, J. M. , Brooks, C. M. , Soong, S.‐J. , Windsor, R. A. , & Manzella, B. A. (1990). A randomized trial to improve self‐management practices of adults with asthma. Archives of Internal Medicine, 150, 1664–1668. https://doi.org/10.1001/archinte.1990.00040031664013*4 - DOI - PubMed

Publication types

LinkOut - more resources