Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2025 Jul 1;20(1):31.
doi: 10.1186/s13012-025-01443-6.

Properties of adaptive, cluster-randomised controlled trials with few clusters: a simulation study

Erin Nolan  1   2   3 , Joshua Dizon  4   5 , Christopher Oldmeadow  4   5 , Elizabeth Holliday  4 , Alix Hall  4   5   6   7 , Daniel Barker  4   5
Affiliations

Properties of adaptive, cluster-randomised controlled trials with few clusters: a simulation study

Erin Nolan et al. Implement Sci. .

Abstract

Trials optimising implementation strategies are complex, assess multicomponent strategies, and cluster randomise. We define optimisation as identifying the best combination of components for multi-component implementation strategies. Multi-arm, fixed, cluster randomised control trials (cRCTs) can assess multiple implementation components but suffer from low power due to challenges of recruitment. Adaptive designs offer increased efficiency, when compared to "fixed trial" approaches. A simulation study was conducted to assess whether adaptive designs are feasible (acceptable operating characteristics and adaptive interim decisions) for implementation cRCTs with few clusters. A four-arm cRCT was simulated under varying trial properties. The trials were simulated using fixed design and adaptive design parameters (number of interim analyses, timing of interim analysis, actions at interim e.g. allowing for early stopping for futility, arm dropping) and modelled using Bayesian hierarchical models. The power and type 1 error were compared between the fixed and adaptive designs, and the number of correct interim decisions under the adaptive design were examined. When the intra-class correlation (ICC) was high, the proportion of trials that incorrectly dropped the most effective arm increased. There were small power gains for adaptive designs, without increasing type 1 error. Power gains attenuated when ICC was high and sample size was low. Type 1 error was lower comparable between adaptive and non-adaptive designs. Adaptive designs are feasible for cRCTs with few clusters. They are not as feasible when the ICC is high due to increased risk of incorrect adaptive interim decisions.

Keywords: Adaptive designs; Bayesian; Implementation; Optimisation; Simulation.

PubMed Disclaimer

Conflict of interest statement

Declarations. Ethics approval and consent to participate: Not applicable. Consent for publication: Not applicable. Competing interests: The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Proportion of trials that dropped an arm or stopped for futility by trial properties
Fig. 2
Fig. 2
Power of the adaptive and non-adaptive designs over trial properties. Error bars represent the Monte Carlo standard error
Fig. 3
Fig. 3
Type 1 error for the adaptive and non-adaptive designs over trial properties. Error bars represent the Monte Carlo standard error
See this image and copyright information in PMC

References

    1. Levati S, et al. Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used. Pilot and Feasibility Studies. 2016;2(1):17. - PMC - PubMed
    1. Wolfenden L, et al. Optimisation: defining and exploring a concept to enhance the impact of public health initiatives. Health Research Policy and Systems. 2019;17(1):108. - PMC - PubMed
    1. Lane C, et al. Optimising a multi-strategy implementation intervention to improve the delivery of a school physical activity policy at scale: findings from a randomised noninferiority trial. Int J Behav Nutr Phys Act. 2022;19(1):106. - PMC - PubMed
    1. Nathan N, et al. Multi-strategy intervention increases school implementation and maintenance of a mandatory physical activity policy: outcomes of a cluster randomised controlled trial. Br J Sports Med. 2022;56(7):385–93. - PMC - PubMed
    1. Nathan N, et al. Implementation of a School Physical Activity Policy Improves Student Physical Activity Levels: Outcomes of a Cluster-Randomized Controlled Trial. J Phys Act Health. 2020;17(10):1009–18. - PubMed

Publication types

LinkOut - more resources