Evaluating research co-production: protocol for the Research Quality Plus for Co-Production (RQ+ 4 Co-Pro) framework

Robert K D McLean^{1

2}, Fred Carden³, Ian D Graham⁴, Alice B Aiken⁵, Rebecca Armstrong⁶, Judy Bray⁷, Christine E Cassidy⁸, Olivia Daub⁹, Erica Di Ruggiero¹⁰, Leslie A Fierro¹¹, Michelle Gagnon¹², Alison M Hutchinson¹³, Roman Kislov¹⁴, Anita Kothari¹⁵, Sara Kreindler^{16

17}, Chris McCutcheon⁹, Jessica Reszel¹⁸, Gayle Scarrow¹⁹

Affiliations

¹ Policy and Evaluation Division, International Development Research Centre, Ottawa, Canada. rmclean@idrc.ca.
² Integrated Knowledge Translation Research Network, Ottawa Hospital Research Institute, Ottawa, Canada. rmclean@idrc.ca.
³ Using Evidence Inc., Ottawa, Canada.
⁴ Clinical Epidemiology Program, Ottawa Hospital Research Institute & Schools of Epidemiology and Public Health & Nursing, University of Ottawa, Ottawa, Canada.
⁵ Dalhousie University, Halifax, Canada.
⁶ Research and Evaluation Branch, National Disability Insurance Agency, Melbourne, Australia.
⁷ Canadian Cancer Society, Toronto, Canada.
⁸ School of Nursing, Dalhousie University, Halifax, Canada.
⁹ Integrated Knowledge Translation Research Network, Ottawa Hospital Research Institute, Ottawa, Canada.
¹⁰ Dalla Lana School of Public Health, University of Toronto, Toronto, Canada.
¹¹ Max Bell School of Public Policy, McGill University, Montreal, Canada.
¹² Consultant, Ottawa, Canada.
¹³ School of Nursing and Midwifery, Centre for Quality and Patient Safety in the Institute for Health Transformation, Deakin University, Geelong, Australia & Monash Health, Melbourne, Australia.
¹⁴ Faculty of Business and Law, Manchester Metropolitan University, Manchester, UK & School of Health Sciences, The University of Manchester, Manchester, UK.
¹⁵ School of Health Studies, Western University, London, Canada.
¹⁶ Department of Community Health Sciences, University of Manitoba, Winnipeg, Canada.
¹⁷ George & Fay Yee Centre for Healthcare Innovation, University of Manitoba, Winnipeg, Canada.
¹⁸ Ottawa Hospital Research Institute, Ottawa, Canada & School of Nursing, University of Ottawa, Ottawa, Canada.
¹⁹ Michael Smith Health Research B.C., Vancouver, Canada.

PMID: 35287758
PMCID: PMC8919555
DOI: 10.1186/s43058-022-00265-7

Evaluating research co-production: protocol for the Research Quality Plus for Co-Production (RQ+ 4 Co-Pro) framework

Robert K D McLean et al. Implement Sci Commun. 2022.

. 2022 Mar 14;3(1):28.

doi: 10.1186/s43058-022-00265-7.

Authors

Affiliations

¹ Policy and Evaluation Division, International Development Research Centre, Ottawa, Canada. rmclean@idrc.ca.
² Integrated Knowledge Translation Research Network, Ottawa Hospital Research Institute, Ottawa, Canada. rmclean@idrc.ca.
³ Using Evidence Inc., Ottawa, Canada.
⁴ Clinical Epidemiology Program, Ottawa Hospital Research Institute & Schools of Epidemiology and Public Health & Nursing, University of Ottawa, Ottawa, Canada.
⁵ Dalhousie University, Halifax, Canada.
⁶ Research and Evaluation Branch, National Disability Insurance Agency, Melbourne, Australia.
⁷ Canadian Cancer Society, Toronto, Canada.
⁸ School of Nursing, Dalhousie University, Halifax, Canada.
⁹ Integrated Knowledge Translation Research Network, Ottawa Hospital Research Institute, Ottawa, Canada.
¹⁰ Dalla Lana School of Public Health, University of Toronto, Toronto, Canada.
¹¹ Max Bell School of Public Policy, McGill University, Montreal, Canada.
¹² Consultant, Ottawa, Canada.
¹³ School of Nursing and Midwifery, Centre for Quality and Patient Safety in the Institute for Health Transformation, Deakin University, Geelong, Australia & Monash Health, Melbourne, Australia.
¹⁴ Faculty of Business and Law, Manchester Metropolitan University, Manchester, UK & School of Health Sciences, The University of Manchester, Manchester, UK.
¹⁵ School of Health Studies, Western University, London, Canada.
¹⁶ Department of Community Health Sciences, University of Manitoba, Winnipeg, Canada.
¹⁷ George & Fay Yee Centre for Healthcare Innovation, University of Manitoba, Winnipeg, Canada.
¹⁸ Ottawa Hospital Research Institute, Ottawa, Canada & School of Nursing, University of Ottawa, Ottawa, Canada.
¹⁹ Michael Smith Health Research B.C., Vancouver, Canada.

PMID: 35287758
PMCID: PMC8919555
DOI: 10.1186/s43058-022-00265-7

Abstract

Background: Research co-production is an umbrella term used to describe research users and researchers working together to generate knowledge. Research co-production is used to create knowledge that is relevant to current challenges and to increase uptake of that knowledge into practice, programs, products, and/or policy. Yet, rigorous theories and methods to assess the quality of co-production are limited. Here we describe a framework for assessing the quality of research co-production-Research Quality Plus for Co-Production (RQ+ 4 Co-Pro)-and outline our field test of this approach.

Methods: Using a co-production approach, we aim to field test the relevance and utility of the RQ+ 4 Co-Pro framework. To do so, we will recruit participants who have led research co-production projects from the international Integrated Knowledge Translation Research Network. We aim to sample 16 to 20 co-production project leads, assign these participants to dyadic groups (8 to 10 dyads), train each participant in the RQ+ 4 Co-Pro framework using deliberative workshops and oversee a simulation assessment exercise using RQ+ 4 Co-Pro within dyadic groups. To study this experience, we use a qualitative design to collect participant demographic information and project demographic information and will use in-depth semi-structured interviews to collect data related to the experience each participant has using the RQ+ 4 Co-Pro framework.

Discussion: This study will yield knowledge about a new way to assess research co-production. Specifically, it will address the relevance and utility of using RQ+ 4 Co-Pro, a framework that includes context as an inseparable component of research, identifies dimensions of quality matched to the aims of co-production, and applies a systematic and transferable evaluative method for reaching conclusions. This is a needed area of innovation for research co-production to reach its full potential. The findings may benefit co-producers interested in understanding the quality of their work, but also other stewards of research co-production. Accordingly, we undertake this study as a co-production team representing multiple perspectives from across the research enterprise, such as funders, journal editors, university administrators, and government and health organization leaders.

PubMed Disclaimer

Conflict of interest statement

IDG is the scientific director of the IKTRN, AK is the deputy director of the IKTRN, CM is the manager of the IKTRN, JR is the research coordinator of the IKTRN. AMH is protocols editor at Implementation Science.

Figures

**Fig. 2**
The RQ+ 4 Co-Pro framework [adapted from infographic originally published by authors (RKDM, IDG, FC), and secondly in 25]

**Fig. 3**
Outline of the research life cycle

See this image and copyright information in PMC

References

1. Lavery JV. Building an evidence base for stakeholder engagement. Science. 2018;6361(6402):554–555. doi: 10.1126/science.aat8429. - DOI - PMC - PubMed
1. Eccles MP, Mittman BS. Welcome to implementation science. Implement Sci. 2006;1(1):1. doi: 10.1186/1748-5908-1-1. - DOI
1. Barwick M, Dubrowski R, Petricca K. Knowledge Translation: The Rise of Implementation. 2020.
1. Davis R, D’Lima D. Building capacity in dissemination and implementation science: a systematic review of the academic literature on teaching and training initiatives. Implement Sci. 2020;15(1). 10.1186/s13012-020-01051-6. - PMC - PubMed
1. Harries S. Bridging policy and delivery with knowledge: the case for intervention. In: Records Management and Knowledge Mobilisation. Oxford: Elsevier; 2012. p. 145–68. 10.1016/b978-1-84334-653-1.50007-x.

Grants and funding

143237/CAPMC/ CIHR/Canada

LinkOut - more resources

Full Text Sources

Save citation to file

Email citation

Add to Collections

Add to My Bibliography

Your saved search

Create a file for external citation management software

Your RSS Feed

Evaluating research co-production: protocol for the Research Quality Plus for Co-Production (RQ+ 4 Co-Pro) framework

Affiliations

Evaluating research co-production: protocol for the Research Quality Plus for Co-Production (RQ+ 4 Co-Pro) framework

Authors

Affiliations

Abstract

Conflict of interest statement

Figures

References

Grants and funding

LinkOut - more resources

Full Text Sources