"Trend" Statement Use in the Orthopaedic Literature
- PMID: 38595127
- DOI: 10.5435/JAAOS-D-23-00770
"Trend" Statement Use in the Orthopaedic Literature
Abstract
Introduction: For research to effectively guide clinical decision making, appropriate interpretation of data is paramount. The P -value is a useful tool for guiding the interpretation of data. However, despite its utility, the P -value is not without limitations. Of particular concern is the use of "trend statements" to describe non-statistically significant findings, a practice which introduces subjectivity and variability into data interpretation and can lead to the drawing of undue conclusions.
Methods: An audit of original research articles published from January 2022 to December 2022 in four high-impact orthopaedic journals was conducted. The selected journals were queried to identify instances in which a non-statistically significant result was labeled as a "trend." The use of trend statements and associated information was recorded and analyzed.
Results: One thousand two hundred sixty articles were included in the analysis. 81 articles (6.4%) included a trend statement to describe a non-statistically significant result. Only two articles (2.5%) formally defined what constituted a trend. In 28.8% of cases, the associated P -value was > 0.10.
Discussion: Trend statements are used to describe non-statistically significant findings with moderate frequency in the orthopaedic literature. Given the potentially misleading effects of trend statements, efforts should be made to mitigate their use. If trend statements are to be used, attention should be paid to defining what constitutes a "trend", explicitly acknowledging the lack of statistical significance of the finding to which the trend statement refers, and avoiding drawing undue conclusions from non-statistically significant data.
Copyright © 2024 by the American Academy of Orthopaedic Surgeons.
References
-
- Biau DJ, Jolles BM, Porcher R: P value and the theory of hypothesis testing: An explanation for new researchers. Clin Orthop Relat Res 2010;468:885-892.
-
- Zaniletti I, Devick KL, Larson DR, Lewallen DG, Berry DJ, Maradit Kremers H: P-values and power in orthopedic research: Myths and reality. J Arthroplasty 2022;37:1945-1950.
-
- Halsey LG: The reign of the p-value is over: What alternative analyses could we employ to fill the power vacuum? Biol Lett 2019;15:20190174.
-
- Nead KT, Wehner MR, Mitra N: The Use of “trend” statements to describe statistically nonsignificant results in the oncology literature. JAMA Oncol 2018;4:1778-1779.
-
- Wood J, Freemantle N, King M, Nazareth I: Trap of trends to statistical significance: Likelihood of near significant P value becoming more significant with extra data. BMJ 2014;348:g2215.
MeSH terms
LinkOut - more resources
Full Text Sources
