Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Mar 28;19(1):33.
doi: 10.1186/s12966-022-01267-3.

The ENCOMPASS framework: a practical guide for the evaluation of public health programmes in complex adaptive systems

Angie Luna Pinzon  1 , Karien Stronks  2 , Coosje Dijkstra  3 , Carry Renders  3 , Teatske Altenburg  4 , Karen den Hertog  5 , Stef P J Kremers  6 , Mai J M Chinapaw  4 , Arnoud P Verhoeff  7   8 , Wilma Waterlander  2
Affiliations

The ENCOMPASS framework: a practical guide for the evaluation of public health programmes in complex adaptive systems

Angie Luna Pinzon et al. Int J Behav Nutr Phys Act. .

Abstract

Background: Systems thinking embraces the complexity of public health problems, including childhood overweight and obesity. It aids in understanding how factors are interrelated, and it can be targeted to produce favourable changes in a system. There is a growing call for systems approaches in public health research, yet limited practical guidance is available on how to evaluate public health programmes within complex adaptive systems. The aim of this paper is to present an evaluation framework that supports researchers in designing systems evaluations in a comprehensive and practical way.

Methods: We searched the literature for existing public health systems evaluation studies. Key characteristics on how to conduct a systems evaluation were extracted and compared across studies. Next, we overlaid the identified characteristics to the context of the Lifestyle Innovations Based on Youth Knowledge and Experience (LIKE) programme evaluation and analyzed which characteristics were essential to carry out the LIKE evaluation. This resulted in the Evaluation of Programmes in Complex Adaptive Systems (ENCOMPASS) framework.

Results: The ENCOMPASS framework includes five iterative stages: (1) adopting a system dynamics perspective on the overall evaluation design; (2) defining the system boundaries; (3) understanding the pre-existing system to inform system changes; (4) monitoring dynamic programme output at different system levels; and (5) measuring programme outcome and impact in terms of system changes.

Conclusions: The value of ENCOMPASS lies in the integration of key characteristics from existing systems evaluation studies, as well as in its practical, applied focus. It can be employed in evaluating public health programmes in complex adaptive systems. Furthermore, ENCOMPASS provides guidance for the entire evaluation process, all the way from understanding the system to developing actions to change it and to measuring system changes. By the nature of systems thinking, the ENCOMPASS framework will likely evolve further over time, as the field expands with more completed studies.

Keywords: Complex systems; Evaluation; Overweight and obesity; Participatory action research; Practice; Public health; Systems thinking; Whole-of-systems approaches.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Overview of the LIKE programme
Fig. 2
Fig. 2
Overview of the various iterative stages in the ENCOMPASS framework*
See this image and copyright information in PMC

References

    1. McGlashan J, Hayward J, Brown A, Owen B, Millar L, Johnstone M, et al. Comparing complex perspectives on obesity drivers: action‐driven communities and evidence‐oriented experts. Obes Sci Pract. 2018;4(6):575–581. doi: 10.1002/osp4.306. - DOI - PMC - PubMed
    1. Swinburn BA, Kraak VI, Allender S, Atkins VJ, Baker PI, Bogard JR, et al. The global syndemic of obesity, undernutrition, and climate change: the Lancet Commission report. Lancet. 2019;393(10173):791–846. doi: 10.1016/S0140-6736(18)32822-8. - DOI - PubMed
    1. Carey G, Malbon E, Carey N, Joyce A, Crammond B, Carey A. Systems science and systems thinking for public health: a systematic review of the field. BMJ Open. 2015;5(12) - PMC - PubMed
    1. Egan M, McGill E, Penney T, Anderson de Cuevas R, Er V, Orton L, et al. NIHR SPHR Guidance on Systems Approaches to Local Public Health Evaluation. Part 1: Introducing Systems Thinking. NIHR SPHR Guidance on Systems Approaches to Local Public Health Evaluation Part 1: Introducing systems thinking. 2019.
    1. McGill E, Er V, Penney T, Egan M, White M, Meier P, et al. Evaluation of public health interventions from a complex systems perspective: a research methods review. Soc Sci Med. 2021;113697. 10.1016/j.socscimed.2021.113697. - PubMed

Publication types