Caution regarding the use of pilot studies to guide power calculations for study proposals
- PMID: 16651505
- DOI: 10.1001/archpsyc.63.5.484
Caution regarding the use of pilot studies to guide power calculations for study proposals
Abstract
Clinical researchers often propose (or review committees demand) pilot studies to determine whether a study is worth performing and to guide power calculations. The most likely outcomes are that (1) studies worth performing are aborted and (2) studies that are not aborted are underpowered. There are many excellent reasons for performing pilot studies. The argument herein is not meant to discourage clinical researchers from performing pilot studies (or review committees from requiring them) but simply to caution against their use for the objective of guiding power calculations.
Comment in
-
Pilot randomised controlled trial reporting should be focused.Anaesthesia. 2020 Nov;75(11):1550. doi: 10.1111/anae.15189. Epub 2020 Jul 3. Anaesthesia. 2020. PMID: 32621316 No abstract available.
Similar articles
-
Evaluation of Lowering the P Value Threshold for Statistical Significance From .05 to .005 in Previously Published Randomized Clinical Trials in Major Medical Journals.JAMA. 2018 Nov 6;320(17):1813-1815. doi: 10.1001/jama.2018.12288. JAMA. 2018. PMID: 30398593 Free PMC article.
-
Acknowledging and Overcoming Nonreproducibility in Basic and Preclinical Research.JAMA. 2017 Mar 14;317(10):1019-1020. doi: 10.1001/jama.2017.0549. JAMA. 2017. PMID: 28192565 No abstract available.
-
Ensuring quality in pharmaceutical studies.Am J Respir Crit Care Med. 2003 Oct 15;168(8):1010-1; author reply 1011-2. doi: 10.1164/ajrccm.168.8.952. Am J Respir Crit Care Med. 2003. PMID: 14555460 No abstract available.
-
Size of treatment effects and their importance to clinical research and practice.Biol Psychiatry. 2006 Jun 1;59(11):990-6. doi: 10.1016/j.biopsych.2005.09.014. Epub 2005 Dec 20. Biol Psychiatry. 2006. PMID: 16368078 Review.
-
How often should we expect to be wrong? Statistical power, P values, and the expected prevalence of false discoveries.Biochem Pharmacol. 2018 May;151:226-233. doi: 10.1016/j.bcp.2017.12.011. Epub 2017 Dec 14. Biochem Pharmacol. 2018. PMID: 29248599 Review.
Cited by
-
From ideas to efficacy: The ORBIT model for developing behavioral treatments for chronic diseases.Health Psychol. 2015 Oct;34(10):971-82. doi: 10.1037/hea0000161. Epub 2015 Feb 2. Health Psychol. 2015. PMID: 25642841 Free PMC article.
-
The Coping Cat program for children with anxiety and autism spectrum disorder: a pilot randomized controlled trial.J Autism Dev Disord. 2013 Jan;43(1):57-67. doi: 10.1007/s10803-012-1541-9. J Autism Dev Disord. 2013. PMID: 22588377 Free PMC article. Clinical Trial.
-
Clinical Trials in Neurovirology: Successes, Challenges, and Pitfalls.Neurotherapeutics. 2016 Jul;13(3):571-81. doi: 10.1007/s13311-016-0440-8. Neurotherapeutics. 2016. PMID: 27194073 Free PMC article. Review.
-
Ontological coaching among nursing undergraduates: a pilot randomized controlled (OCEAN) trial.Med Educ Online. 2024 Dec 31;29(1):2379109. doi: 10.1080/10872981.2024.2379109. Epub 2024 Jul 21. Med Educ Online. 2024. PMID: 39033532 Free PMC article. Clinical Trial.
-
Statistical evaluation of the use of concurrent controls in treatment screening studies.Clin Transl Sci. 2013 Aug;6(4):323-30. doi: 10.1111/cts.12042. Epub 2013 Apr 19. Clin Transl Sci. 2013. PMID: 23919371 Free PMC article.
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Medical