Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Nov 25;22(1):302.
doi: 10.1186/s12874-022-01767-7.

What do we want to get out of this? a critical interpretive synthesis of the value of process evaluations, with a practical planning framework

Caroline French  1 , Anna Dowrick  2 , Nina Fudge  3 , Hilary Pinnock  4 , Stephanie J C Taylor  3
Affiliations

What do we want to get out of this? a critical interpretive synthesis of the value of process evaluations, with a practical planning framework

Caroline French et al. BMC Med Res Methodol. .

Abstract

Background: Process evaluations aim to understand how complex interventions bring about outcomes by examining intervention mechanisms, implementation, and context. While much attention has been paid to the methodology of process evaluations in health research, the value of process evaluations has received less critical attention. We aimed to unpack how value is conceptualised in process evaluations by identifying and critically analysing 1) how process evaluations may create value and 2) what kind of value they may create.

Methods: We systematically searched for and identified published literature on process evaluation, including guidance, opinion pieces, primary research, reviews, and discussion of methodological and practical issues. We conducted a critical interpretive synthesis and developed a practical planning framework.

Results: We identified and included 147 literature items. From these we determined three ways in which process evaluations may create value or negative consequences: 1) through the socio-technical processes of 'doing' the process evaluation, 2) through the features/qualities of process evaluation knowledge, and 3) through using process evaluation knowledge. We identified 15 value themes. We also found that value varies according to the characteristics of individual process evaluations, and is subjective and context dependent.

Conclusion: The concept of value in process evaluations is complex and multi-faceted. Stakeholders in different contexts may have very different expectations of process evaluations and the value that can and should be obtained from them. We propose a planning framework to support an open and transparent process to plan and create value from process evaluations and negotiate trade-offs. This will support the development of joint solutions and, ultimately, generate more value from process evaluations to all.

Keywords: Critical interpretive synthesis; Process evaluation; Research impact; Systematic review; Values.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
PRISMA flow diagram
Fig. 2
Fig. 2
Overview of synthesis findings
Fig. 3
Fig. 3
Overview of the themes of value
Fig. 4
Fig. 4
Process evaluation planning framework
See this image and copyright information in PMC

References

    1. Moore G, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: UK Medical Research Council (MRC) guidance. London: MRC Population Health Science Network; 2014.
    1. Raine R, Fitzpatrick R, Barratt H, Bevan G, Black N, Boaden R, et al. Challenges, solutions and future directions in the evaluation of service innovations in health care and public health. Health Services and Delivery Research. 2016;4(16). - PubMed
    1. Public Health England. Process evaluation: evaluation in health and wellbeing. 2018. https://www.gov.uk/guidance/evaluation-in-health-and-wellbeing-process Accessed 15 Mar 2022.
    1. Baranowski T, Stables G. Process evaluations of the 5-a-Day projects. Health Educ Behav. 2000;27(2):157–166. doi: 10.1177/109019810002700202. - DOI - PubMed
    1. Bakker FC, Persoon A, Reelick MF, van Munster BC, Hulscher M, Olde RM. Evidence from multicomponent interventions: value of process evaluations. J Am Geriatr Soc. 2013;61(5):844–845. doi: 10.1111/jgs.12231. - DOI - PubMed

Publication types

LinkOut - more resources