Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2007;16(4):202-7.
doi: 10.1002/mpr.225.

Inconsistencies between reported test statistics and p-values in two psychiatry journals

David Berle  1 , Vladan Starcevic
Affiliations

Inconsistencies between reported test statistics and p-values in two psychiatry journals

David Berle et al. Int J Methods Psychiatr Res. 2007.

Abstract

A recent survey of the British Medical Journal (BMJ) and Nature revealed that inconsistencies in reported statistics were common. We sought to replicate that survey in the psychiatry literature. We checked the consistency of reported t-test, F-test and chi(2)-test values with their corresponding p-values in the 2005 issues of the Australian and New Zealand Journal of Psychiatry (ANZJP) and compared this with the issues of the ANZJP from 2000, and with a similar journal, Acta Psychiatrica Scandinavica (APS). A reported p-value was 'inconsistent' if it differed (at its reported number of decimal places) from our calculated p-values (using three different software packages), which we based on the reported test statistic and degrees of freedom. Of the 546 results that we checked, 78 (14.3%) of the p-values were inconsistent with the corresponding degrees of freedom and test statistic. Similar rates of inconsistency were found in APS and ANZJP, and when comparing the ANZJP between 2000 and 2005. The percentages of articles with at least one inconsistency were 8.5% for ANZJP 2005, 9.9% for ANZJP 2000 and 12.1% for APS. We conclude that inconsistencies in p-values are common and may reflect errors of analysis and rounding, typographic errors or typesetting errors. Suggestions for reducing the occurrence of such inconsistencies are provided.

PubMed Disclaimer

References

    1. Altman DG, Bland JM. Improving doctors' understanding of statistics. J R Stat Soc (Ser A) 1990; 154: 223–67.
    1. Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gotzsche PC, Lang T. The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Int Med 2001; 134: 663–94. - PubMed
    1. American Psychological Association . Publication Manual. Washington, DC: American Psychological Association, 2001.
    1. Avram MJ, Shanks CA, Dykes MH, Ronai AK, Stiers WM. Statistical methods in anesthesia articles: an evaluation of two American journals during two six‐month periods. Anesth Analg 1985; 64: 607–11. - PubMed
    1. Balon R. By whom and how is the quality of research data collection assured and checked? Psychother Psychosom 2005; 74: 331–35. - PubMed