Approaches for combining primary care electronic health record data from multiple sources: a systematic review of observational studies

Abstract

Objective: To identify observational studies which used data from more than one primary care electronic health record (EHR) database, and summarise key characteristics including: objective and rationale for using multiple data sources; methods used to manage, analyse and (where applicable) combine data; and approaches used to assess and report heterogeneity between data sources.

Design: A systematic review of published studies.

Data sources: Pubmed and Embase databases were searched using list of named primary care EHR databases; supplementary hand searches of reference list of studies were retained after initial screening.

Study selection: Observational studies published between January 2000 and May 2018 were selected, which included at least two different primary care EHR databases.

Results: 6054 studies were identified from database and hand searches, and 109 were included in the final review, the majority published between 2014 and 2018. Included studies used 38 different primary care EHR data sources. Forty-seven studies (44%) were descriptive or methodological. Of 62 analytical studies, 22 (36%) presented separate results from each database, with no attempt to combine them; 29 (48%) combined individual patient data in a one-stage meta-analysis and 21 (34%) combined estimates from each database using two-stage meta-analysis. Discussion and exploration of heterogeneity was inconsistent across studies.

Conclusions: Comparing patterns and trends in different populations, or in different primary care EHR databases from the same populations, is important and a common objective for multi-database studies. When combining results from several databases using meta-analysis, provision of separate results from each database is helpful for interpretation. We found that these were often missing, particularly for studies using one-stage approaches, which also often lacked details of any statistical adjustment for heterogeneity and/or clustering. For two-stage meta-analysis, a clear rationale should be provided for choice of fixed effect and/or random effects or other models.

Keywords: epidemiology; public health; statistics & research methods.

Figure 1

Selection and inclusion of studies for systematic review (adapted from Moher et al70).

Figure 2

Comparison of relative risk (RR) estimates reported in studies using two or more methods to combine data from multiple sources. [study] refers to the review database id number (see online supplemental table S1).