Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2015 Jun 9;13(6):e1002165.
doi: 10.1371/journal.pbio.1002165. eCollection 2015 Jun.

The Economics of Reproducibility in Preclinical Research

Affiliations

The Economics of Reproducibility in Preclinical Research

Leonard P Freedman et al. PLoS Biol. .

Erratum in

Abstract

Low reproducibility rates within life science research undermine cumulative knowledge production and contribute to both delays and costs of therapeutic drug development. An analysis of past studies indicates that the cumulative (total) prevalence of irreproducible preclinical research exceeds 50%, resulting in approximately US$28,000,000,000 (US$28B)/year spent on preclinical research that is not reproducible-in the United States alone. We outline a framework for solutions and a plan for long-term improvements in reproducibility rates that will help to accelerate the discovery of life-saving therapies and cures.

PubMed Disclaimer

Conflict of interest statement

Dr. Simcoe currently works as a Senior Economist for the Council of Economic Advisers (CEA). The CEA disclaims responsibility for any of the views expressed herein and these views do not necessarily represent the views of the CEA or the United States.

Figures

Fig 1
Fig 1. Studies reporting the prevalence of irreproducibility.
Source: Begley and Ellis [6], Prinz et al. [7], Vasilevsky [8], Hartshorne and Schachner [5], and Glasziou et al. [9].
Fig 2
Fig 2. Estimated US preclinical research spend and categories of errors that contribute to irreproducibility.
Note that the percentage value of error for each category is the midpoint of the high and low prevalence estimates for that category divided (weighted) by the sum of all midpoint error rates (see S1 Dataset). Source: Chakma et al. [18] and the American Association for the Advancement of Science (AAAS) [19].

Comment in

  • OWNING UP TO THE TRUTH.
    [No authors listed] [No authors listed] Biotechniques. 2015 Oct;59(4):179. Biotechniques. 2015. PMID: 26744757 No abstract available.

References

    1. Collins FS, Tabak LA (2014) NIH plans to enhance reproducibility. Nature 505: 612–613. - PMC - PubMed
    1. Begley CG, Ioannidis JP (2015) Reproducibility in Science: improving the standard for basic and preclinical research. Circ Res 116: 116–126. 10.1161/CIRCRESAHA.114.303819 - DOI - PubMed
    1. Macleod MR, Michie S, Roberts I, Dirnagl U, Chalmers I, et al. (2014) Biomedical research: increasing value, reducing waste. Lancet 383: 101–104. 10.1016/S0140-6736(13)62329-6 - DOI - PubMed
    1. Freedman LP, Gibson MC (2015) The impact of preclinical irreproducibility on drug development. Clin Pharmacol Therap 97: 16–18. 10.1002/cpt.9 - DOI - PubMed
    1. Hartshorne JK, Schachner A (2012) Tracking replicability as a method of post-publication open evaluation. Front Comput Neurosci 6: 1–13. 10.3389/fncom.2012.00001 - DOI - PMC - PubMed

MeSH terms

LinkOut - more resources