Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2015 Jul-Aug;35(5):536-45.
doi: 10.1097/BPO.0000000000000324.

The Quality of Randomized Controlled Trials in Pediatric Orthopaedics: Are We Improving?

Emily Dodwell  1 , Shiv Dua, Sukhdeep K Dulai, Kristina Astone, Kishore Mulpuri
Affiliations

The Quality of Randomized Controlled Trials in Pediatric Orthopaedics: Are We Improving?

Emily Dodwell et al. J Pediatr Orthop. 2015 Jul-Aug.

Abstract

Purpose: The quality of randomized controlled trials (RCTs) in orthopaedics is a topic of considerable importance, as RCTs play a major role in guiding clinical practice. The quality of RCTs published between 1995 and 2005 has previously been documented. The purpose of the current study was to assess and describe the quality of pediatric orthopaedic RCTs published from 2005 to 2012, by identifying study characteristics associated with higher quality and outlining areas for improvement.

Methods: A standardized literature search was used to identify pediatric orthopaedic RCTs published in 7 well-recognized journals between September 2005 and July 2012 inclusive. The Detsky Quality Assessment Scale and the CONSORT checklist for Non-Pharmacologic Trials were used to assess the quality of the RCTs. Scores for the Detsky and CONSORT were calculated by 2 independent blinded orthopaedic surgeon reviewers with epidemiologic training.

Results: Forty RCTs were included in this analysis. The mean percentage score on the Detsky quality scale was 67%. Sixteen (40%) of the articles satisfied the threshold for a satisfactory level of methodological quality (Detsky >75%). Twenty-five (63%) of these studies were negative studies, concluding no difference between treatment arms. In 52% of the negative studies, an a priori sample size analysis was absent, and 28% were self-described as underpowered. In multiple variable regression analysis, only working with a statistician was significantly associated with higher Detsky percentage scores (P=0.01).

Conclusions: There is a trend for improving quality in pediatric orthopaedic RCTs. Compared with past reports, the mean Detsky score improved from 53% to 67%, and the proportion meeting an acceptable level of quality improved from 19% to 40%. One of the most concerning findings of this study was the lack of attention to sample size and power analysis, and the potential for underpowered studies. Ongoing efforts are necessary to improve the conduct and reporting of clinical trials in pediatric orthopaedics.

Significance: Pediatric orthopaedic surgeons, JPO, and POSNA are working toward improving levels of quality in pediatric orthopaedic research. This paper highlights progress that has been made, and addresses some high-yield areas for future improvement.

PubMed Disclaimer