Main outcomes of an RCT to pilot test reporting and feedback to foster research integrity climates in the VA
- PMID: 28949895
- PMCID: PMC5689383
- DOI: 10.1080/23294515.2017.1363318
Main outcomes of an RCT to pilot test reporting and feedback to foster research integrity climates in the VA
Abstract
Background: Assessing the integrity of research climates and sharing such information with research leaders may support research best practices. We report here results of a pilot trial testing the effectiveness of a reporting and feedback intervention using the Survey of Organizational Research Climate (SOuRCe).
Methods: We randomized 41 Veterans Health Administration (VA) facilities to a phone-based intervention designed to help research leaders understand their survey results (enhanced arm) or to an intervention in which results were simply distributed to research leaders (basic arm). Primary outcomes were (1) whether leaders took action, (2) whether actions taken were consistent with the feedback received, and (3) whether responses differed by receptivity to quality improvement input.
Results: Research leaders from 25 of 42 (59%) VA facilities consented to participate in the study intervention and follow-up, of which 14 were at facilities randomized to the enhanced arm. We completed follow-up interviews with 21 of the 25 leaders (88%), 12 from enhanced arm facilities. While not statistically significant, the proportion of leaders reporting taking some action in response to the feedback was twice as high in the enhanced arm than in the basic arm (67% vs. 33%, p = .20). While also not statistically significant, a higher proportion of actions taken among facilities in the enhanced arm were responsive to the survey results than in the basic arm (42% vs. 22%, p = .64).
Conclusions: Enhanced feedback of survey results appears to be a promising intervention that may increase the likelihood of responsive action to improve organizational climates. Due to the small sample size of this pilot study, even large percentage-point differences between study arms are not statistically distinguishable. This hypothesis should be tested in a larger trial.
Keywords: Veterans Affairs; organizational climate; randomized controlled trial; reporting and feedback; research integrity; survey.
Conflict of interest statement
Similar articles
-
Initial Results from the Survey of Organizational Research Climates (SOuRCe) in the U.S. Department of Veterans Affairs Healthcare System.PLoS One. 2016 Mar 11;11(3):e0151571. doi: 10.1371/journal.pone.0151571. eCollection 2016. PLoS One. 2016. PMID: 26967736 Free PMC article.
-
Organizational culture and climate as moderators of enhanced outreach for persons with serious mental illness: results from a cluster-randomized trial of adaptive implementation strategies.Implement Sci. 2018 Jul 9;13(1):93. doi: 10.1186/s13012-018-0787-9. Implement Sci. 2018. PMID: 29986765 Free PMC article. Clinical Trial.
-
Factors affecting the use of patient survey data for quality improvement in the Veterans Health Administration.BMC Health Serv Res. 2011 Dec 12;11:334. doi: 10.1186/1472-6963-11-334. BMC Health Serv Res. 2011. PMID: 22151714 Free PMC article.
-
Assessment of Veterans Affairs Case Management Leadership.Prof Case Manag. 2023 May-Jun 01;28(3):110-120. doi: 10.1097/NCM.0000000000000615. Prof Case Manag. 2023. PMID: 36999761 Review.
-
Interorganizational Care Coordination of Rural Veterans by Veterans Affairs and Community Care Programs: A Systematic Review.Med Care. 2021 Jun 1;59(Suppl 3):S259-S269. doi: 10.1097/MLR.0000000000001542. Med Care. 2021. PMID: 33976075 Free PMC article.
Cited by
-
Comment on "Improving research misconduct policies" by Redman & Caplan.EMBO Rep. 2017 Jun;18(6):866. doi: 10.15252/embr.201744295. Epub 2017 May 4. EMBO Rep. 2017. PMID: 28473421 Free PMC article.
-
Assessing the climate for research ethics in labs: Development and validation of a brief measure.Account Res. 2022 Jan;29(1):2-17. doi: 10.1080/08989621.2021.1881891. Epub 2021 Feb 4. Account Res. 2022. PMID: 33517782 Free PMC article.
-
Perceptions of research integrity climate differ between academic ranks and disciplinary fields: Results from a survey among academic researchers in Amsterdam.PLoS One. 2019 Jan 18;14(1):e0210599. doi: 10.1371/journal.pone.0210599. eCollection 2019. PLoS One. 2019. PMID: 30657778 Free PMC article.
References
-
- Barends E, Janssen B, ten Have W, ten Have S. Effects of Change Interventions: What Kind of Evidence Do We Really Have? The Journal of Applied Behavioral Science. 2014;50(1):5–27. doi: 10.1177/0021886312473152. - DOI
-
- Born Dana H, Mathieu John E. Differential Effects of Survey-Guided Feedback: The Rich Get Richer and the Poor Get Poorer. Group & Organization Management. 1996;21(4):388–404.
-
- Burke W Warner, Litwin George H. A Causal Model of Organizational Performance and Change. Journal of Management. 1992;18(3):523–45. doi: 10.1177/014920639201800306. - DOI
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources