Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Dec 10;8(1):72.
doi: 10.1186/s40900-022-00405-2.

A scoping review of methods to measure and evaluate citizen engagement in health research

Anmol Shahid  1 , Inara N Lalani  1 , Brianna K Rosgen  1   2 , Bonnie G Sept  1 , Shelly Longmore  1 , Jeanna Parsons Leigh  1   3 , Henry T Stelfox  4   5   6 , Kirsten M Fiest  1   2   7
Affiliations

A scoping review of methods to measure and evaluate citizen engagement in health research

Anmol Shahid et al. Res Involv Engagem. .

Abstract

Background: Citizen engagement, or partnering with interested members of the public in health research, is becoming more common. While ongoing assessment of citizen engagement practices is considered important to its success, there is little clarity around aspects of citizen engagement that are important to assess (i.e., what to look for) and methods to assess (i.e., how to measure and/ or evaluate) citizen engagement in health research.

Methods: In this scoping review, we included peer-reviewed literature that focused primarily on method(s) to measure and/or evaluate citizen engagement in health research. Independently and in duplicate, we completed title and abstract screening and full-text screening and extracted data including document characteristics, citizen engagement definitions and goals, and methods to measure or evaluate citizen engagement (including characteristics of these methods).

Results: Our search yielded 16,762 records of which 33 records (31 peer-reviewed articles, one government report, one conference proceeding) met our inclusion criteria. Studies discussed engaging citizens (i.e., patients [n = 16], members of the public [n = 7], service users/consumers [n = 4], individuals from specific disease groups [n = 3]) in research processes. Reported methods of citizen engagement measurement and evaluation included frameworks, discussion-based methods (i.e., focus groups, interviews), survey-based methods (e.g., audits, questionnaires), and other methods (e.g., observation, prioritization tasks). Methods to measure and evaluate citizen engagement commonly focused on collecting perceptions of citizens and researchers on aspects of citizen engagement including empowerment, impact, respect, support, and value.

Discussion and conclusion: We found that methods to measure and/or evaluate citizen engagement in health research vary widely but share some similarities in aspect of citizen engagement considered important to measure or evaluate. These aspects could be used to devise a more standardized, modifiable, and widely applicable framework for measuring and evaluating citizen engagement in research.

Patient or public contribution: Two citizen team members were involved as equal partners in study design and interpretation of its findings.

Systematic review registration: Open Science Framework (10.17605/OSF.IO/HZCBR).

Keywords: Citizen engagement; Co-designed research; Community-based participatory research; Patient and public involvement; Scoping review.

Plain language summary

Involving members of the public (citizens) in health research is important. It helps make sure that research focuses on issues that are most important to citizens. It also helps ensure that the research done is respectful of citizen participation and most likely to provide benefit. However, the best way to engage citizens in research is unclear. In this scoping review, we examined existing studies that assessed citizen engagement in health research. We found that citizen engagement was often assessed by asking for feedback from both citizens and researchers. Feedback was collected in person (one on one interviews or group discussions) or in writing (using surveys or audits). Frameworks (organized ways of thinking about an issue) were also sometimes used to measure empowerment, impact, respect, support, and value of engaging citizens. It was clear from the frameworks that there is a need to develop clearer roles for citizens in research. The two citizen members of our research team who helped interpret our study findings felt that a set of guidelines for citizens to help them best participate in health research needs to be developed. We believe these observations could be used to create a more standard method for assessing citizen engagement in research.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Flow diagram of included studies and reasons for exclusion
Fig. 2
Fig. 2
Word cloud of citizen engagement descriptions, activities, and key terms described in included literature
Fig. 3
Fig. 3
Similar and unique features of the five frameworks for measuring and/or evaluating citizen engagement included in this scoping review
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Russell J, Fudge N, Greenhalgh T. The impact of public involvement in health research: what are we measuring? Why are we measuring it? Should we stop measuring it? Res Involv Engagem. 2020;6:63. doi: 10.1186/s40900-020-00239-w. - DOI - PMC - PubMed
    1. Research CIoH. CIHR background: Government of Canada; 2019. https://letstalk-cihr.ca/about.
    1. Canadian Institutes of Health Research. CIHR’s Framework for Citizen Engagement. Ottawa, ON; 2012.
    1. Research CIoH. Health Research in Canada and You Ottawa, Canada2015 [updated 2015-01-12. https://cihr-irsc.gc.ca/e/43753.html.
    1. The Value of Engagement Washington, DC: Patient-Centered Outcomes Research Institute; updated October 30, 2018. https://www.pcori.org/engagement/value-engagement.

Publication types

LinkOut - more resources