The use of percentage change from baseline as an outcome in a controlled trial is statistically inefficient: a simulation study
- PMID: 11459516
- PMCID: PMC34605
- DOI: 10.1186/1471-2288-1-6
The use of percentage change from baseline as an outcome in a controlled trial is statistically inefficient: a simulation study
Abstract
Background: Many randomized trials involve measuring a continuous outcome - such as pain, body weight or blood pressure - at baseline and after treatment. In this paper, I compare four possibilities for how such trials can be analyzed: post-treatment; change between baseline and post-treatment; percentage change between baseline and post-treatment and analysis of covariance (ANCOVA) with baseline score as a covariate. The statistical power of each method was determined for a hypothetical randomized trial under a range of correlations between baseline and post-treatment scores.
Results: ANCOVA has the highest statistical power. Change from baseline has acceptable power when correlation between baseline and post-treatment scores is high;when correlation is low, analyzing only post-treatment scores has reasonable power. Percentage change from baseline has the lowest statistical power and was highly sensitive to changes in variance. Theoretical considerations suggest that percentage change from baseline will also fail to protect from bias in the case of baseline imbalance and will lead to an excess of trials with non-normally distributed outcome data.
Conclusions: Percentage change from baseline should not be used in statistical analysis. Trialists wishing to report this statistic should use another method, such as ANCOVA, and convert the results to a percentage change by using mean baseline scores.
Figures
Similar articles
-
The correlation between baseline score and post-intervention score, and its implications for statistical analysis.Trials. 2019 Jan 11;20(1):43. doi: 10.1186/s13063-018-3108-3. Trials. 2019. PMID: 30635021 Free PMC article.
-
Bias, precision and statistical power of analysis of covariance in the analysis of randomized trials with baseline imbalance: a simulation study.BMC Med Res Methodol. 2014 Apr 9;14:49. doi: 10.1186/1471-2288-14-49. BMC Med Res Methodol. 2014. PMID: 24712304 Free PMC article.
-
Parametric versus non-parametric statistics in the analysis of randomized trials with non-normally distributed data.BMC Med Res Methodol. 2005 Nov 3;5:35. doi: 10.1186/1471-2288-5-35. BMC Med Res Methodol. 2005. PMID: 16269081 Free PMC article.
-
A systematic survey of the methods literature on the reporting quality and optimal methods of handling participants with missing outcome data for continuous outcomes in randomized controlled trials.J Clin Epidemiol. 2017 Aug;88:67-80. doi: 10.1016/j.jclinepi.2017.05.016. Epub 2017 Jun 1. J Clin Epidemiol. 2017. PMID: 28579378 Review.
-
Statistical analysis of two arm randomized pre-post designs with one post-treatment measurement.BMC Med Res Methodol. 2021 Jul 24;21(1):150. doi: 10.1186/s12874-021-01323-9. BMC Med Res Methodol. 2021. PMID: 34303343 Free PMC article. Review.
Cited by
-
Bone shaft bending strength index is unaffected by exercise and unloading in mice.J Anat. 2015 Mar;226(3):224-8. doi: 10.1111/joa.12277. Epub 2015 Feb 2. J Anat. 2015. PMID: 25645569 Free PMC article.
-
Methods for the design of vasomotor symptom trials: the menopausal strategies: finding lasting answers to symptoms and health network.Menopause. 2014 Jan;21(1):45-58. doi: 10.1097/GME.0b013e31829337a4. Menopause. 2014. PMID: 23760428 Free PMC article.
-
The TrueBlue model of collaborative care using practice nurses as case managers for depression alongside diabetes or heart disease: a randomised trial.BMJ Open. 2013 Jan 24;3(1):e002171. doi: 10.1136/bmjopen-2012-002171. BMJ Open. 2013. PMID: 23355671 Free PMC article.
-
Preliminary prediction of individual response to electroconvulsive therapy using whole-brain functional magnetic resonance imaging data.Neuroimage Clin. 2020;26:102080. doi: 10.1016/j.nicl.2019.102080. Epub 2019 Nov 6. Neuroimage Clin. 2020. PMID: 31735637 Free PMC article.
-
The correlation between baseline score and post-intervention score, and its implications for statistical analysis.Trials. 2019 Jan 11;20(1):43. doi: 10.1186/s13063-018-3108-3. Trials. 2019. PMID: 30635021 Free PMC article.
References
-
- Glorioso N, Troffa C, Filigheddu F, Dettori F, Soro A, Parpaglia PP, Collatina S, Pahor M. Effect of the HMG-CoA reductase inhibitors on blood pressure in patients with essential hypertension and primary hypercholesterolemia. Hypertension. 1999;34:1281–1286. - PubMed
-
- Messier SP, Loeser RF, Mitchell MN, Valle G, Morgan TP, Rejeski WJ, Ettinger WH. Exercise and weight loss in obese older adults with knee osteoarthritis: a preliminary study. J Am Geriatr Soc. 2000; 48:1062–1072. - PubMed
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical