Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2021 Oct 30;40(24):5333-5350.
doi: 10.1002/sim.9128. Epub 2021 Jul 8.

Group sequential Holm and Hochberg procedures

Ajit C Tamhane  1 , Dong Xi  2 , Jiangtao Gou  3
Affiliations
Review

Group sequential Holm and Hochberg procedures

Ajit C Tamhane et al. Stat Med. .

Abstract

The problem of testing multiple hypotheses using a group sequential procedure often arises in clinical trials. We review several group sequential Holm (GSHM) type procedures proposed in the literature and clarify the relationships between them. In particular, we show which procedures are equivalent or, if different, which are more powerful and what are their pros and cons. We propose a step-up group sequential Hochberg (GSHC) procedure as a reverse application of a particular step-down GSHM procedure. We conducted an extensive simulation study to evaluate the familywise error rate (FWER) and power properties of that GSHM procedure and the GSHC procedure and found that the GSHC procedure controls FWER more closely and is more powerful. All procedures are illustrated with a common numerical example, the data for which are chosen to bring out the differences between them. A real case study is also presented to illustrate application of these procedures. R programs for applying the proposed procedures, additional simulation results, and the proof of the FWER control of the GSHC procedure in a special case are provided in Supplementary Material.

Keywords: Lan and DeMets flexible boundary; O'Brien-Fleming boundary; Pocock boundary; closed procedure; error spending function; familywise error rate; multiple hypothesis testing.

PubMed Disclaimer

References

REFERENCES

    1. Food and Drug Administration (FDA) Multiple endpoints in clinical trials guidance for industry (draft guidance). U.S. Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research (CDER), Center for Biologics Evaluation and Research (CBER), FDA-2016-D-4460; 2017.
    1. Holm S. A simple sequentially rejective multiple test procedure. Scand J Stat. 1979;6:65-70.
    1. Hochberg Y. A sharper Bonferroni procedure for multiple tests of significance. Biometrika. 1988;75(4):800-802. https://doi.org/10.1093/biomet/75.4.800.
    1. Tang D-I, Gnecco C, Geller NL. Design of group sequential clinical trials with multiple endpoints. J Am Stat Assoc. 1989;84(407):776-779.
    1. Follmann DA, Proschan MA, Geller NL. Monitoring pairwise comparisons in multi-armed clinical trials. Biometrics. 1994;50(2):325-336.

MeSH terms