Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Apr:91:102053.
doi: 10.1016/j.evalprogplan.2022.102053. Epub 2022 Feb 18.

A comprehensive monitoring and evaluation framework for evidence to policy networks

Tanja Kuchenmüller  1 , Evelina Chapman  2 , Ryoko Takahashi  3 , Louise Lester  4 , Marge Reinap  5 , Moriah Ellen  6 , Michelle M Haby  7
Affiliations

A comprehensive monitoring and evaluation framework for evidence to policy networks

Tanja Kuchenmüller et al. Eval Program Plann. 2022 Apr.

Abstract

Objective: To describe the development of a framework for monitoring and evaluating knowledge translation (KT) networks.

Method: The framework was developed using mixed methods over four phases, including i) a targeted literature review of KT networks, activities and indicators, ii) two scoping reviews to further enhance the set of indicators, iii) peer-reviews by international KT experts and an online expert consultation, and iv) piloting.

Results: A comprehensive theory of change (ToC) and indicators, both for the Network Secretariat and its participating member countries, were identified to develop the monitoring and evaluation framework. The framework includes (i) a ToC, including three key indicator domains across the results chain (outputs, short term outcomes, intermediate outcomes), and (ii) indicators for the three key domains, that can be selected depending on the stage of network maturity, along with suggested data collection methods. The three key indicator domains are 1) KT capacity and skill building; 2) network (structure, governance and leadership); and 3) KT/evidence-informed policy value and culture.

Conclusion: The monitoring and evaluation framework that links KT activities with policy and health outcomes fills an important gap in optimizing KT procedures, generating lessons learned and increasing accountability of major multipartner KT networks.

Keywords: Evidence-informed policy; Knowledge translation; Monitoring and evaluation framework; Network.

PubMed Disclaimer

Conflict of interest statement

Declaration of Competing Interest

The authors declare the following financial interests/personal relationships which may be considered as potential competing interests: TK, RT, and MR are employed full-time with WHO and have been working for EVIPNet Europe. EC had a short-term staff contract with WHO, working for EVIPNet Europe and LL was seconded from the NHS to EVIPNet Europe when conducting the pilot study. ME served as a peer-reviewer to the M&E framework. WHO Europe had no role in the decision to publish, or preparation of the manuscript, although they did approve the final manuscript for submission.

Figures

Fig. 1
Fig. 1. EVIPNet Europe – network structure.
Source: Adapted from Starkley 1997 in Ramalingam (2011).
Fig. 2
Fig. 2. Network life cycle.
Source: Based on Creech and Ramji (2004).
Fig. 3
Fig. 3
Development process for the EVIPNet Europe M&E framework. The user validation of the framework will be addressed in the next stage of the M&E framework development.
Fig. 4
Fig. 4. EVIPNet Europe Theory of Change.
Source: Adapted from Lester et al. (2020).
See this image and copyright information in PMC

References

    1. Asian Development Bank. Knowledge Solutions: Tools, Methods, and Approaches to Drive Development Forward and Enhance Its Effects. Mandaluyong City, Philippines: Asian Development Bank; 2010.
    1. Balls E, Nurova N. Outcome mapping and research into use: analysing monitoring data for effective strategies. Development in Practce. 2020;30(2):255–267. doi: 10.1080/09614524.2019.1701989. - DOI
    1. Bennett G, Jessani N. The Knowledge Translation Toolkit Bridging the Know-Do Gap: A Resource for Researchers. Ottawa: International Development Research Centre; 2011.
    1. Best A, Terpstra JL, Moor G, Riley B, Norman CD, Glasgow RE. Building Knowledge Integration Systems for Evidence-Informed Decisions. Journal of Health Organization and Management. 2009;23(6):627–641. - PubMed
    1. Brennan SE, McKenzie JE, Turner T, Redman S, Makkar S, Williamson A, Green SE. Development and validation of SEER (Seeking, Engaging with and Evaluating Research): a measure of policymakers’ capacity to engage with and use research. Health Research Policy and Systems. 2017;15(1):1. doi: 10.1186/s12961-016-0162-8. - DOI - PMC - PubMed

LinkOut - more resources