Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2017 Sep;26(9):1018-1032.
doi: 10.1002/pds.4295.

Reporting to Improve Reproducibility and Facilitate Validity Assessment for Healthcare Database Studies V1.0

Shirley V Wang  1   2 , Sebastian Schneeweiss  1   2 , Marc L Berger  3 , Jeffrey Brown  4 , Frank de Vries  5 , Ian Douglas  6 , Joshua J Gagne  1   2 , Rosa Gini  7 , Olaf Klungel  8 , C Daniel Mullins  9 , Michael D Nguyen  10 , Jeremy A Rassen  11 , Liam Smeeth  6 , Miriam Sturkenboom  12 ; joint ISPE-ISPOR Special Task Force on Real World Evidence in Health Care Decision Making
Collaborators, Affiliations

Reporting to Improve Reproducibility and Facilitate Validity Assessment for Healthcare Database Studies V1.0

Shirley V Wang et al. Pharmacoepidemiol Drug Saf. 2017 Sep.

Erratum in

  • Erratum.
    [No authors listed] [No authors listed] Pharmacoepidemiol Drug Saf. 2017 Dec;26(12):1570. doi: 10.1002/pds.4353. Pharmacoepidemiol Drug Saf. 2017. PMID: 29205684 Free PMC article. No abstract available.

Abstract

Purpose: Defining a study population and creating an analytic dataset from longitudinal healthcare databases involves many decisions. Our objective was to catalogue scientific decisions underpinning study execution that should be reported to facilitate replication and enable assessment of validity of studies conducted in large healthcare databases.

Methods: We reviewed key investigator decisions required to operate a sample of macros and software tools designed to create and analyze analytic cohorts from longitudinal streams of healthcare data. A panel of academic, regulatory, and industry experts in healthcare database analytics discussed and added to this list.

Conclusion: Evidence generated from large healthcare encounter and reimbursement databases is increasingly being sought by decision-makers. Varied terminology is used around the world for the same concepts. Agreeing on terminology and which parameters from a large catalogue are the most essential to report for replicable research would improve transparency and facilitate assessment of validity. At a minimum, reporting for a database study should provide clarity regarding operational definitions for key temporal anchors and their relation to each other when creating the analytic dataset, accompanied by an attrition table and a design diagram. A substantial improvement in reproducibility, rigor and confidence in real world evidence generated from healthcare databases could be achieved with greater transparency about operational study parameters used to create analytic datasets from longitudinal healthcare databases.

Keywords: Transparency; healthcare databases; longitudinal data; methods; pharmacoepidemiology; replication; reproducibility.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Data provenance: transitions from healthcare delivery to analysis results. [Colour figure can be viewed at wileyonlinelibrary.com]
Figure 2
Figure 2
Example design diagram. [Colour figure can be viewed at wileyonlinelibrary.com]
See this image and copyright information in PMC

Comment in

References

    1. Schneeweiss S, Avorn J. A review of uses of health care utilization databases for epidemiologic research on therapeutics. J Clin Epidemiol. Apr 2005;58(4):323‐337. - PubMed
    1. Califf RM, Robb MA, Bindman AB, et al. Transforming Evidence Generation to Support Health and Health Care Decisions. N Engl J Med. 2016;375(24):2395‐2400. - PubMed
    1. Psaty BM, Breckenridge AM. Mini‐Sentinel and regulatory science‐‐big data rendered fit and functional. N Engl J Med. Jun 5. 2014;370(23):2165‐2167. - PubMed
    1. Fleurence RL, Curtis LH, Califf RM, Platt R, Selby JV, Brown JS. Launching PCORnet, a national patient‐centered clinical research network. J Am Med Inform Assoc. Jul‐Aug. 2014;21(4):578‐582. - PMC - PubMed
    1. Oliveira JL, Lopes P, Nunes T, et al. The EU‐ADR Web Platform: delivering advanced pharmacovigilance tools. Pharmacoepidemiol Drug Saf. 2013 May. 2013;22(5):459‐467. - PubMed

MeSH terms