Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2018 Sep 12;13(9):e0202447.
doi: 10.1371/journal.pone.0202447. eCollection 2018.

Use of reproducible research practices in public health: A survey of public health analysts

Jenine K Harris  1 , Kimberly J Johnson  1 , Bobbi J Carothers  1   2 , Todd B Combs  1   2 , Douglas A Luke  1   2 , Xiaoyan Wang  1   2
Affiliations

Use of reproducible research practices in public health: A survey of public health analysts

Jenine K Harris et al. PLoS One. .

Abstract

Objective: Use of reproducible research practices improves the quality of science and the speed of scientific development. We sought to understand use of reproducible research practices in public health and associated barriers and facilitators.

Methods: In late 2017, we surveyed members of the American Public Health Association Applied Public Health Statistics section and others; 247 of 278 who screened eligible answered the survey, and 209 answered every applicable question. The survey included questions about file management, code annotation and documentation, reproducibility of analyses, and facilitators and barriers of using reproducible practices.

Results: Just 14.4% of participants had shared code, data, or both. Many participants reported their data (33%) and code (43.2%) would be difficult for colleagues to find if they left their institution. Top reported barriers to using reproducible practices were data privacy (49.8%) and lack of time (41.7%). Participants suggested training (50.9%) and requirements by journals (44.4%) and funders (40.2%) to increase use of reproducible research practices.

Conclusions: Increasing use of reproducible research practices is important for public health and requires action from researchers, training programs, funders, and journals.

PubMed Disclaimer

Conflict of interest statement

The authors have declared that no competing interests exist.

Figures

Fig 1
Fig 1. Of participants who made data (n = 25) or code (n = 20) publicly available, which (if any) entity required the data or code to be public?
These responses are from the reproducibility of statistical analyses section of the survey.
Fig 2
Fig 2. Percent of participants who perceived each of seven barriers to using reproducible research practices.
These responses are from the research reproducibility facilitators and barriers section of the survey.
Fig 3
Fig 3. Percentage of participants who included each of 11 details that could facilitate reproducibility in recent publication or report.
These responses are from the reproducibility of statistical analyses section of the survey.
Fig 4
Fig 4. Percentage of participants who used coding practices recommended to facilitate reproducible research.
These responses are from the code annotation and documentation section of the survey.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Fang FC, Steen RG, Casadevall A. Misconduct accounts for the majority of retracted scientific publications. Proc Natl Acad Sci USA. 2012;109: 17028–17033. 10.1073/pnas.1212247109 - DOI - PMC - PubMed
    1. Steen RG. Retractions in the scientific literature: Is the incidence of research fraud increasing? J Med Ethics. 2011;37: 249–253. 10.1136/jme.2010.040923 - DOI - PubMed
    1. Prinz F, Schlange T, Asadullah K. Believe it or not: How much can we rely on published data on potential drug targets? Nat Rev Drug Discov. 2011;10: 712–712. 10.1038/nrd3439-c1 - DOI - PubMed
    1. Estimating the reproducibility of psychological science. Science American Association for the Advancement of Science; 2015;349 10.1126/science.aac4716 - DOI - PubMed
    1. Camerer CF, Dreber A, Forsell E, Ho TH, Huber J, Johannesson M, et al. Evaluating replicability of laboratory experiments in economics. Science. 2016;351: 1433–1436. 10.1126/science.aaf0918 - DOI - PubMed

Publication types

LinkOut - more resources