"Spin" in wound care research: the reporting and interpretation of randomized controlled trials with statistically non-significant primary outcome results or unspecified primary outcomes
- PMID: 24195770
- PMCID: PMC3832286
- DOI: 10.1186/1745-6215-14-371
"Spin" in wound care research: the reporting and interpretation of randomized controlled trials with statistically non-significant primary outcome results or unspecified primary outcomes
Abstract
Background: Spin in the reporting of randomized controlled trials, where authors report research in a way that potentially misrepresents results and mislead readers, has been demonstrated in the broader medical literature. We investigated spin in wound care trials with (a) no statistically significant result for the primary outcome and (b) no clearly specified primary outcome.
Methods: We searched the Cochrane Wounds Group Specialised Register of Trials for randomized controlled trials (RCTs). Eligible studies were: Parallel-group RCTs of interventions for foot, leg or pressure ulcers published in 2004 to 2009 (inclusive) with either a clearly identified primary outcome for which there was a statistically non-significant result (Cohort A) or studies that had no clear primary outcome (Cohort B).We extracted general study details. For both Cohorts A and B we then assessed for the presence of spin. For Cohort A we used a pre-defined process to assess reports for spin. For Cohort B we aimed to assess spin by recording the number of positive treatment effect claims made. We also compared the number of statistically significant and non-significant results reported in the main text and the abstract looking specifically for spin in the form of selective outcome reporting.
Results: Of the 71 eligible studies, 28 were eligible for Cohort A; of these, 71% (20/28) contained spin. Cohort B contained 43 studies; of these, 86% (37/43) had abstracts that claimed a favorable treatment claim. Whilst 74% (32/43) of main text results in Cohort B included at least one statistically non-significant result, this was not reflected in the abstract where only 28% contained (12/43) at least one statistically non-significant result.
Conclusions: Spin is a frequent phenomenon in reports of RCTs of wound treatments. Studies without statistically significant results for the primary outcome used spin in 71% of cases. Furthermore, 33% (43/132) of reports of wound RCTs did not specify a primary outcome and there was evidence of spin and selective outcome reporting in the abstracts of these. Readers should be wary of only reading the abstracts of reports of RCTs of wound treatments since they are frequently misleading regarding treatment effects.
Similar articles
-
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217. Cochrane Database Syst Rev. 2022. PMID: 36321557 Free PMC article.
-
Funding source and the quality of reports of chronic wounds trials: 2004 to 2011.Trials. 2014 Jan 14;15:19. doi: 10.1186/1745-6215-15-19. Trials. 2014. PMID: 24422753 Free PMC article. Review.
-
Dressings and topical agents for arterial leg ulcers.Cochrane Database Syst Rev. 2020 Jan 20;1(1):CD001836. doi: 10.1002/14651858.CD001836.pub4. Cochrane Database Syst Rev. 2020. PMID: 31978262 Free PMC article.
-
Organisation of health services for preventing and treating pressure ulcers.Cochrane Database Syst Rev. 2018 Dec 9;12(12):CD012132. doi: 10.1002/14651858.CD012132.pub2. Cochrane Database Syst Rev. 2018. PMID: 30536917 Free PMC article.
-
Misleading Reporting (Spin) in Noninferiority Randomized Clinical Trials in Oncology With Statistically Not Significant Results: A Systematic Review.JAMA Netw Open. 2021 Dec 1;4(12):e2135765. doi: 10.1001/jamanetworkopen.2021.35765. JAMA Netw Open. 2021. PMID: 34874407 Free PMC article.
Cited by
-
Linguistic spin in randomized controlled trials about age-related macular degeneration.Front Epidemiol. 2022 Oct 31;2:961996. doi: 10.3389/fepid.2022.961996. eCollection 2022. Front Epidemiol. 2022. PMID: 38455287 Free PMC article.
-
Overstatements in abstract conclusions claiming effectiveness of interventions in psychiatry: A meta-epidemiological investigation.PLoS One. 2017 Sep 13;12(9):e0184786. doi: 10.1371/journal.pone.0184786. eCollection 2017. PLoS One. 2017. PMID: 28902885 Free PMC article.
-
Analysis of Funding Source and Spin in the Reporting of Studies of Intravitreal Corticosteroid Therapy for Diabetic Macular Edema: A Systematic Review.Clin Ophthalmol. 2020 Aug 20;14:2383-2395. doi: 10.2147/OPTH.S262085. eCollection 2020. Clin Ophthalmol. 2020. PMID: 32903959 Free PMC article. Review.
-
Misrepresentation and distortion of research in biomedical literature.Proc Natl Acad Sci U S A. 2018 Mar 13;115(11):2613-2619. doi: 10.1073/pnas.1710755115. Proc Natl Acad Sci U S A. 2018. PMID: 29531025 Free PMC article.
-
A Perspective on the Principles of Integrity in Infectious Disease Research.J Patient Saf. 2016 Jun;12(2):57-62. doi: 10.1097/PTS.0000000000000265. J Patient Saf. 2016. PMID: 27010326 Free PMC article.
References
-
- Chan AW, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials. JAMA. 2005;291:2457–2465. - PubMed
-
- Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan A, Cronin E, Decullier E, Easterbrook PJ, Von Elm E, Gamble C, Ghersi D, Ioannidis JP, Simes J, Williamson PR. Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PloS ONE. 2008;3:e3081. doi: 10.1371/journal.pone.0003081. - DOI - PMC - PubMed
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical
Molecular Biology Databases