A systematic review and meta-analysis of sample size methodology for traumatic hemorrhage trials
- PMID: 36879398
- DOI: 10.1097/TA.0000000000003944
A systematic review and meta-analysis of sample size methodology for traumatic hemorrhage trials
Abstract
Background: Trauma hemorrhage remains the most common cause of preventable mortality in trauma. To guide clinical practice, RCTs provide high-quality evidence to inform clinical decision making. The clinical relevance and inferences made by RCTs are dependent on assumptions made during sample size calculation.
Methods: To describe the quality of methodology for sample size determination, we conducted a systemic review RCTs evaluating interventions that aim to improve survival in adults with trauma-related hemorrhage. Estimated and actual outcome data are compared, including components of sample size determination.
Results: A total of 13 RCTs were included. We noted a high rate of negative trial results (11 of 13 studies). Most studies were multi-center and conducted in North America, evaluating patients with blunt and penetrating injuries. The criteria for hemorrhagic shock varied across studies. All studies did not accurately estimate the mortality rate during sample size calculation. All but one study overestimated the mortality reduction during sample size calculation; the median absolute mortality reduction was 3%, compared with a target of 10%. Only the CRASH-2 study used a minimal clinically important different for treatment effect target. No RCTs employed prognostic enrichment. Most studies were terminated (8 of 13), mainly for futility.
Conclusion: Taken together, this review highlights that current clinical trial methodology is limited by imprecise control group risk estimates, overly optimistic treatment effect estimates, and lack of transparent justification for such targets. These limitations result in studies at high risk for futility and potentially premature abandonment of promising therapies. Given the high morbidity and mortality of trauma-related hemorrhage, we recommend that future conduct of trauma RCTs incorporate (1) prognostic enrichment to inform baseline risk, (2) justify target treatment differences based on clinical importance and realistic estimates of feasibility, and (3) be transparent and provide justification for the assumptions made.
Level of evidence: Systematic Review/Meta-Analysis; Level III.
Copyright © 2023 Wolters Kluwer Health, Inc. All rights reserved.
References
-
- Eastridge BJ, Holcomb JB, Shackelford S. Outcomes of traumatic hemorrhagic shock and the epidemiology of preventable death from injury. Transfusion . 2019;59(S2):1423–1428.
-
- Shackelford SA, Colton K, Stansbury LG, Galvagno SM Jr., Anazodo AN, Dubose JJ, et al. Early identification of uncontrolled hemorrhage after trauma: current status and future direction. J Trauma Acute Care Surg . 2014;77(3 Suppl 2):S222–S227.
-
- Holcomb JB, Jenkins D, Rhee P, Johannigman J, Mahoney P, Mehta S, et al. Damage control resuscitation: directly addressing the early coagulopathy of trauma. J Trauma . 2007;62(2):307–310.
-
- Spahn DR, Bouillon B, Cerny V, Duranteau J, Filipescu D, Hunt BJ. The European guideline on management of major bleeding and coagulopathy following trauma: fifth edition. Crit Care . 2019;23(1):98.
-
- Cook JA, Julious SA, Sones W, Hampson LV, Hewitt C, Berlin JA, et al. DELTA 2 guidance on choosing the target difference and undertaking and reporting the sample size calculation for a randomised controlled trial. Trials . 2018;19(1):606.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Medical
Research Materials