Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2023 Oct;24(7):1275-1291.
doi: 10.1007/s11121-023-01543-z. Epub 2023 May 13.

Open Science Standards at Journals that Inform Evidence-Based Policy

Sean Grant  1   2 , Evan Mayo-Wilson  3   4 , Sina Kianersi  4   5 , Kevin Naaman  4   6 , Beate Henschel  4
Affiliations
Review

Open Science Standards at Journals that Inform Evidence-Based Policy

Sean Grant et al. Prev Sci. 2023 Oct.

Abstract

Evidence-based policy uses intervention research to inform consequential decisions about resource allocation. Research findings are often published in peer-reviewed journals. Because detrimental research practices associated with closed science are common, journal articles report more false-positives and exaggerated effect sizes than would be desirable. Journal implementation of standards that promote open science-such as the transparency and openness promotion (TOP) guidelines-could reduce detrimental research practices and improve the trustworthiness of research evidence on intervention effectiveness. We evaluated TOP implementation at 339 peer-reviewed journals that have been used to identify evidence-based interventions for policymaking and programmatic decisions. Each of ten open science standards in TOP was not implemented in most journals' policies (instructions to authors), procedures (manuscript submission systems), or practices (published articles). Journals implementing at least one standard typically encouraged, but did not require, an open science practice. We discuss why and how journals could improve implementation of open science standards to safeguard evidence-based policy.

Keywords: Evidence clearinghouse; Evidence-based policy; Open science; TOP guidelines.

PubMed Disclaimer

References

    1. Altman, D. G., Furberg, C. D., Grimshaw, J. M., & Shanahan, D. R. (2014). Linked publications from a single trial: A thread of evidence. Trials, 15(1), 369. https://doi.org/10.1186/1745-6215-15-369 - DOI - PubMed - PMC
    1. Axford, N., Berry, V., Lloyd, J., Hobbs, T., & Wyatt, K. (2022). Promoting learning from null or negative results in prevention science trials. Prevention Science, 23(5), 751–763. - PubMed - DOI
    1. Baker, M. (2016). 1,500 scientists lift the lid on reproducibility. Nature, 533(7604), Article 7604.
    1. Bakker, B. N., Jaidka, K., Dörr, T., Fasching, N., & Lelkes, Y. (2021). Questionable and open research practices: Attitudes and perceptions among quantitative communication researchers. Journal of Communication, 71(5), 715–738. - DOI
    1. Baron, J. (2018). A brief history of evidence-based policy. The ANNALS of the American Academy of Political and Social Science, 678(1), 40–50. - DOI

Publication types

LinkOut - more resources