Systematic reviews do not adequately report or address missing outcome data in their analyses: a methodological survey

doi:10.1016/j.jclinepi.2018.02.016

Review

. 2018 Jul:99:14-23.

doi: 10.1016/j.jclinepi.2018.02.016. Epub 2018 Mar 2.

Systematic reviews do not adequately report or address missing outcome data in their analyses: a methodological survey

Lara A Kahale¹, Batoul Diab¹, Romina Brignardello-Petersen², Arnav Agarwal³, Reem A Mustafa⁴, Joey Kwong⁵, Ignacio Neumann⁶, Ling Li⁷, Luciane Cruz Lopes⁸, Matthias Briel⁹, Jason W Busse¹⁰, Alfonso Iorio¹¹, Per Olav Vandvik¹², Paul Elias Alexander¹³, Gordon Guyatt¹¹, Elie A Akl¹⁴

Affiliations

¹ Clinical Epidemiology Unit, American University of Beirut, Beirut, Lebanon.
² Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Evidence Based Dentistry Unit, Faculty of Dentistry, Universidad de Chile, Santiago, Chile.
³ Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada.
⁴ Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Department of Medicine, University of Missouri-Kansas City, Kansas City, MO, USA; Department of Biomedical and Health Informatics, University of Missouri-Kansas City, Kansas City, MO, USA.
⁵ JC School of Public Health and Primary Care, The Chinese University of Hong Kong, Hong Kong, China.
⁶ Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Department of Internal Medicine, School of Medicine, Pontificia Universidad Católica de Chile, Santiago, Chile.
⁷ Clinical Research and Evaluation Unit, Chinese Evidence-based Medicine Center, West China Hospital, Sichuan University, Chengdu, China.
⁸ Pharmaceutical Sciences Post Graduate Course, University of Sorocaba, UNISO, Sorocaba, Sao Paulo, Brazil.
⁹ Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Basel Institute for Clinical Epidemiology and Biostatistics, Department of Clinical Research, University Hospital Basel, University of Basel, Spitalstrasse 12 4031, Basel, Switzerland.
¹⁰ Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Department of Anesthesia, McMaster University, Hamilton, Canada; The Michael G. DeGroote Institute for Pain Research and Care, McMaster University, Hamilton, Canada.
¹¹ Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Department of Medicine, McMaster University, Hamilton, Canada.
¹² Norwegian Knowledge Centre for the Health Services, Oslo, Norway; Department of Medicine, Innlandet Hospital Trust, Gjøvik, Norway.
¹³ Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada.
¹⁴ Clinical Epidemiology Unit, American University of Beirut, Beirut, Lebanon; Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada. Electronic address: ea32@aub.edu.lb.

PMID: 29505859
DOI: 10.1016/j.jclinepi.2018.02.016

Review

Systematic reviews do not adequately report or address missing outcome data in their analyses: a methodological survey

Lara A Kahale et al. J Clin Epidemiol. 2018 Jul.

. 2018 Jul:99:14-23.

doi: 10.1016/j.jclinepi.2018.02.016. Epub 2018 Mar 2.

Authors

Affiliations

¹ Clinical Epidemiology Unit, American University of Beirut, Beirut, Lebanon.
² Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Evidence Based Dentistry Unit, Faculty of Dentistry, Universidad de Chile, Santiago, Chile.
³ Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada.
⁴ Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Department of Medicine, University of Missouri-Kansas City, Kansas City, MO, USA; Department of Biomedical and Health Informatics, University of Missouri-Kansas City, Kansas City, MO, USA.
⁵ JC School of Public Health and Primary Care, The Chinese University of Hong Kong, Hong Kong, China.
⁶ Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Department of Internal Medicine, School of Medicine, Pontificia Universidad Católica de Chile, Santiago, Chile.
⁷ Clinical Research and Evaluation Unit, Chinese Evidence-based Medicine Center, West China Hospital, Sichuan University, Chengdu, China.
⁸ Pharmaceutical Sciences Post Graduate Course, University of Sorocaba, UNISO, Sorocaba, Sao Paulo, Brazil.
⁹ Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Basel Institute for Clinical Epidemiology and Biostatistics, Department of Clinical Research, University Hospital Basel, University of Basel, Spitalstrasse 12 4031, Basel, Switzerland.
¹⁰ Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Department of Anesthesia, McMaster University, Hamilton, Canada; The Michael G. DeGroote Institute for Pain Research and Care, McMaster University, Hamilton, Canada.
¹¹ Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Department of Medicine, McMaster University, Hamilton, Canada.
¹² Norwegian Knowledge Centre for the Health Services, Oslo, Norway; Department of Medicine, Innlandet Hospital Trust, Gjøvik, Norway.
¹³ Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada.
¹⁴ Clinical Epidemiology Unit, American University of Beirut, Beirut, Lebanon; Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada. Electronic address: ea32@aub.edu.lb.

PMID: 29505859
DOI: 10.1016/j.jclinepi.2018.02.016

Abstract

Objectives: To describe how systematic review authors report and address categories of participants with potential missing outcome data of trial participants.

Study design and setting: Methodological survey of systematic reviews reporting a group-level meta-analysis.

Results: We included a random sample of 50 Cochrane and 50 non-Cochrane systematic reviews. Of these, 25 reported in their methods section a plan to consider at least one of the 10 categories of missing outcome data; 42 reported in their results, data for at least one category of missing data. The most reported category in the methods and results sections was "unexplained loss to follow-up" (n = 34 in methods section and n = 6 in the results section). Only 19 reported a method to handle missing data in their primary analyses, which was most often complete case analysis. Few reviews (n = 9) reported in the methods section conducting sensitivity analysis to judge risk of bias associated with missing outcome data at the level of the meta-analysis; and only five of them presented the results of these analyses in the results section.

Conclusion: Most systematic reviews do not explicitly report sufficient information on categories of trial participants with potential missing outcome data or address missing data in their primary analyses.

Keywords: Imputation; Meta-analysis; Missing outcome data; Risk of bias; Systematic reviews; Trials.

PubMed Disclaimer

Cited by

PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews.
Page MJ, Moher D, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, Hróbjartsson A, Lalu MM, Li T, Loder EW, Mayo-Wilson E, McDonald S, McGuinness LA, Stewart LA, Thomas J, Tricco AC, Welch VA, Whiting P, McKenzie JE. Page MJ, et al. BMJ. 2021 Mar 29;372:n160. doi: 10.1136/bmj.n160. BMJ. 2021. PMID: 33781993 Free PMC article.
Meta-Analyses Proved Inconsistent in How Missing Data Were Handled Across Their Included Primary Trials: A Methodological Survey.
Kahale LA, Khamis AM, Diab B, Chang Y, Lopes LC, Agarwal A, Li L, Mustafa RA, Koujanian S, Waziry R, Busse JW, Dakik A, Hooft L, Guyatt GH, Scholten RJPM, Akl EA. Kahale LA, et al. Clin Epidemiol. 2020 May 27;12:527-535. doi: 10.2147/CLEP.S242080. eCollection 2020. Clin Epidemiol. 2020. PMID: 32547244 Free PMC article.
Participants' outcomes gone missing within a network of interventions: Bayesian modeling strategies.
Spineli LM, Kalyvas C, Pateras K. Spineli LM, et al. Stat Med. 2019 Sep 10;38(20):3861-3879. doi: 10.1002/sim.8207. Epub 2019 May 27. Stat Med. 2019. PMID: 31134664 Free PMC article.
Potential impact of missing outcome data on treatment effects in systematic reviews: imputation study.
Kahale LA, Khamis AM, Diab B, Chang Y, Lopes LC, Agarwal A, Li L, Mustafa RA, Koujanian S, Waziry R, Busse JW, Dakik A, Schünemann HJ, Hooft L, Scholten RJ, Guyatt GH, Akl EA. Kahale LA, et al. BMJ. 2020 Aug 26;370:m2898. doi: 10.1136/bmj.m2898. BMJ. 2020. PMID: 32847800 Free PMC article. Review.
How robust are findings of pairwise and network meta-analysis in the presence of missing participant outcome data?
Spineli LM, Kalyvas C, Papadimitropoulou K. Spineli LM, et al. BMC Med. 2021 Dec 21;19(1):323. doi: 10.1186/s12916-021-02195-y. BMC Med. 2021. PMID: 34930276 Free PMC article.

See all "Cited by" articles

Publication types

Actions
Actions

MeSH terms

Actions
Actions
Actions
Actions
Actions
Actions
Actions

LinkOut - more resources

Full Text Sources
- ClinicalKey
- Elsevier Science
Other Literature Sources
- scite Smart Citations

Save citation to file

Email citation

Add to Collections

Add to My Bibliography

Your saved search

Create a file for external citation management software

Your RSS Feed

Systematic reviews do not adequately report or address missing outcome data in their analyses: a methodological survey

Affiliations

Systematic reviews do not adequately report or address missing outcome data in their analyses: a methodological survey

Authors

Affiliations

Abstract

Similar articles

Cited by

Publication types

MeSH terms

LinkOut - more resources

Full Text Sources

Other Literature Sources