Three challenges described for identifying participants with missing data in trials reports, and potential solutions suggested to systematic reviewers

Abstract

Objective: To categorize the challenges in determining the extent of missing participant data in randomized trials and suggest potential solutions for systematic review authors.

Study design and setting: During the process of updating a series of Cochrane systematic reviews on the topic of anticoagulation in patients with cancer, we identified challenges and used an iterative approach to improve, and a consensus process to agree on the challenges identified, and to suggest potential ways of dealing with them. The five systematic reviews included 58 trials and 75 meta-analyses for patient-important dichotomous outcomes with 27,037 randomized participants.

Results: We identified three categories of challenges: (1) Although systematic reviewers require information about missing data to be reported by outcome, trialists typically report the information by participant; (2) It is not always clear whether the trialists followed up participants in certain categories (e.g., noncompliers), that is, whether some categories of participants did or did not have missing data; (3) It is not always clear how the trialists dealt with missing data in their analysis (e.g., exclusion from the denominator vs. assumptions made for the numerator). We discuss potential solutions for each one of these challenges and suggest further research work.

Conclusion: Current reporting of missing data is often not explicit and transparent, and although our potential solutions to problems of suboptimal reporting may be helpful, reliable and valid characterization of the extent and nature of missing data remains elusive. Reporting of missing data in trials needs further improvement.

Keywords: Attrition bias; Lost to follow-up; Missing participant data; Non-compliance; Randomized controlled trials; Systematic reviews.