Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 Apr 20;11(4):e044480.
doi: 10.1136/bmjopen-2020-044480.

Testing for non-inferior mortality: a systematic review of non-inferiority margin sizes and trial characteristics

Sandra Pong  1 , Martin Urner  2   3 , Robert A Fowler  2   4 , Nicholas Mitsakakis  5 , Winnie Seto  6   7 , James S Hutchison  8 , Michelle Science  9 , Nick Daneman  10
Affiliations

Testing for non-inferior mortality: a systematic review of non-inferiority margin sizes and trial characteristics

Sandra Pong et al. BMJ Open. .

Abstract

Objective: To describe the size and variability of non-inferiority margins used in non-inferiority trials of medications with primary outcomes involving mortality, and to examine the association between trial characteristics and non-inferiority margin size.

Design: Systematic review.

Data sources: Medline, Medline In Process, Medline Epub Ahead of Print and Embase Classic+Embase databases from January 1989 to December 2019.

Eligibility criteria: Prospective non-inferiority randomised controlled trials comparing pharmacological therapies, with primary analyses for non-inferiority and primary outcomes involving mortality alone or as part of a composite outcome. Trials had to prespecify non-inferiority margins as absolute risk differences or relative to risks of outcome and provide a baseline risk of primary outcome in the control intervention.

Results: 3992 records were screened, 195 articles were selected for full text review and 111 articles were included for analyses. 82% of trials were conducted in thrombosis, infectious diseases or oncology. Mortality was the sole primary outcome in 23 (21%) trials, and part of a composite primary outcome in 88 (79%) trials. The overall median non-inferiority margin was an absolute risk difference of 9% (IQR 4.2%-10%). When non-inferiority margins were expressed relative to the baseline risk of primary outcome in control groups, the median relative non-inferiority margin was 1.5 (IQR 1.3-1.7). In multivariable regression analyses examining the association between trial characteristics (medical specialty, inclusion of paediatric patients, mortality as a sole or part of a composite primary outcome, presence of industry funding) and non-inferiority margin size, only medical specialty was significantly associated with non-inferiority margin size.

Conclusion: Absolute and relative non-inferiority margins used in published trials comparing medications are large, allowing conclusions of non-inferiority in the context of large differences in mortality. Accepting the potential for large increases in outcomes involving mortality while declaring non-inferiority is a challenging methodological issue in the conduct of non-inferiority trials.

Keywords: clinical trials; epidemiology; statistics & research methods.

PubMed Disclaimer

Conflict of interest statement

Competing interests: None declared.

Figures

Figure 1
Figure 1
PRISMA flow diagram. PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses.
Figure 2
Figure 2
Association between absolute non-inferiority margins and estimated risks of outcome in control group.
Figure 3
Figure 3
Distribution of absolute and relative non-inferiority margins for primary outcomes involving mortality.
See this image and copyright information in PMC

References

    1. Piaggio G, Elbourne DR, Altman DG, et al. Reporting of noninferiority and equivalence randomized trials: an extension of the CONSORT statement. JAMA 2006;295:1152–60. 10.1001/jama.295.10.1152 - DOI - PubMed
    1. Mauri L, D’Agostino RB. Challenges in the design and interpretation of Noninferiority trials. N Engl J Med 2017;377:1357–67. 10.1056/NEJMra1510063 - DOI - PubMed
    1. Suda KJ, Hurley AM, McKibbin T, et al. Publication of noninferiority clinical trials: changes over a 20-year interval. Pharmacotherapy 2011;31:833–9. 10.1592/phco.31.9.833 - DOI - PubMed
    1. Wangge G, Klungel OH, Roes KCB, et al. Room for improvement in conducting and reporting non-inferiority randomized controlled trials on drugs: a systematic review. PLoS One 2010;5:e13550. 10.1371/journal.pone.0013550 - DOI - PMC - PubMed
    1. Schiller P, Burchardi N, Niestroj M, et al. Quality of reporting of clinical non-inferiority and equivalence randomised trials—update and extension. Trials 2012;13:214. 10.1186/1745-6215-13-214 - DOI - PMC - PubMed

Publication types

LinkOut - more resources