Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2020 Mar;28(1):4-11.
doi: 10.5455/aim.2020.28.4-11.

Evaluation of Preclinical and Clinical Studies Published in Medical Journals of Bosnia and Herzegovina: Methodology Issues

Slobodan M Jankovic  1 , Izet Masic  2
Affiliations

Evaluation of Preclinical and Clinical Studies Published in Medical Journals of Bosnia and Herzegovina: Methodology Issues

Slobodan M Jankovic et al. Acta Inform Med. 2020 Mar.

Abstract

Introduction: Results of preclinical and clinical studies in medicine could be trusted only if their design and statistical analysis were appropriate.

Aim: The aim of our study was to investigate whether preclinical and clinical studies published in medical journals of Bosnia and Herzegovina satisfy basic requirements for appropriate design and statistical interpretation of data.

Methods: Preclinical and clinical studies published in medical journals of Bosnia and Herzegovina were retrieved from the PubMed database, and the sample for analysis was randomly chosen from the retrieved publications. Implementation rate of basic principles of experimental design (local control, randomization and replication) and rate of the most common errors in design of clinical/observational studies was established by careful reading of the sampled publications and their checking against predefined criteria.

Results: Our study showed that only a minority of experimental preclinical studies had basic principles of design completely implemented (7%), while implementation rate of single aspects of appropriate experimental design varied from as low as 12% to as high as 77%. Only one of the clinical/observational studies had none of the errors searched for (2%), and specific errors rates varied from 10% to 89%. Average impact factor of the surveyed studies was around one, and average publication date recent, less than 5 years ago.

Conclusion: Prevalence of preclinical studies that did not follow completely basic principles of research design, and that of clinical/observational studies with errors are high, raising suspicion to validity of their results. If incorrect and not protected against bias, results of published studies may adversely influence future research.

Keywords: bias; control experiments; errors; internal validity; randomization; replication.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflict of interest

References

    1. Auger JP, Chuzeville S, Roy D, Mathieu-Denoncourt A, Xu J, Grenier D, et al. The bias of experimental design, including strain background, in the determination of critical Streptococcus suis serotype 2 virulence factors. PloS One. 2017;12(7):e0181920. - PMC - PubMed
    1. Moorhead JE, Rao PV, Anusavice KJ. Guidelines for experimental studies. Dent Mater Off Publ Acad Dent Mater. 1994 Jan;10(1):45–51. - PubMed
    1. Morsink MC, Dukers DF. Teaching neurophysiology, neuropharmacology, and experimental design using animal models of psychiatric and neurological disorders. Adv Physiol Educ. 2009;33(1):46–52. - PubMed
    1. Vesterinen HM, Vesterinen HV, Egan K, Deister A, Schlattmann P, Macleod MR, et al. Systematic survey of the design, statistical analysis, and reporting of studies published in the 2008 vol. of the Journal of Cerebral Blood Flow and Metabolism. J Cereb Blood Flow Metab Off J Int Soc Cereb Blood Flow Metab. 2011 Apr;31(4):1064–1072. - PMC - PubMed
    1. Fry DJ. Teaching experimental design. ILAR J. 2014;55(3):457–471. - PubMed

LinkOut - more resources