The currency, completeness and quality of systematic reviews of acute management of moderate to severe traumatic brain injury: A comprehensive evidence map

Abstract

Objective: To appraise the currency, completeness and quality of evidence from systematic reviews (SRs) of acute management of moderate to severe traumatic brain injury (TBI).

Methods: We conducted comprehensive searches to March 2016 for published, English-language SRs and RCTs of acute management of moderate to severe TBI. Systematic reviews and RCTs were grouped under 12 broad intervention categories. For each review, we mapped the included and non-included RCTs, noting the reasons why RCTs were omitted. An SR was judged as 'current' when it included the most recently published RCT we found on their topic, and 'complete' when it included every RCT we found that met its inclusion criteria, taking account of when the review was conducted. Quality was assessed using the AMSTAR checklist (trichotomised into low, moderate and high quality).

Findings: We included 85 SRs and 213 RCTs examining the effectiveness of treatments for acute management of moderate to severe TBI. The most frequently reviewed interventions were hypothermia (n = 17, 14.2%), hypertonic saline and/or mannitol (n = 9, 7.5%) and surgery (n = 8, 6.7%). Of the 80 single-intervention SRs, approximately half (n = 44, 55%) were judged as current and two-thirds (n = 52, 65.0%) as complete. When considering only the most recently published review on each intervention (n = 25), currency increased to 72.0% (n = 18). Less than half of the 85 SRs were judged as high quality (n = 38, 44.7%), and nearly 20% were low quality (n = 16, 18.8%). Only 16 (20.0%) of the single-intervention reviews (and none of the five multi-intervention reviews) were judged as current, complete and high-quality. These included reviews of red blood cell transfusion, hypothermia, management guided by intracranial pressure, pharmacological agents (various) and prehospital intubation. Over three-quarters (n = 167, 78.4%) of the 213 RCTs were included in one or more SR. Of the remainder, 17 (8.0%) RCTs post-dated or were out of scope of existing SRs, and 29 (13.6%) were on interventions that have not been assessed in SRs.

Conclusion: A substantial number of SRs in acute management of moderate to severe TBI lack currency, completeness and quality. We have identified both potential evidence gaps and also substantial research waste. Novel review methods, such as Living Systematic Reviews, may ameliorate these shortcomings and enhance utility and reliability of the evidence underpinning clinical care.

Fig 1. Currency, completeness, and quality of single-intervention systematic reviews.

Each bubble represents a single-intervention systematic review (n = 80). The ideal scenario is for bubbles to sit in the bottom right corner (denoting high quality and completeness), and be green in colour (denoting currency). Abbreviations: RCT = randomised controlled trial, SR = systematic review.