Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Jun;31(2):e1910.
doi: 10.1002/mpr.1910. Epub 2022 Apr 1.

Sample size and precision of estimates in studies of depression screening tool accuracy: A meta-research review of studies published in 2018-2021

Elsa-Lynn Nassar  1   2 , Brooke Levis  1   3   4 , Marieke A Neyer  1 , Danielle B Rice  1   5 , Linda Booij  2   6   7 , Andrea Benedetti  4   8   9 , Brett D Thombs  1   2   4   5   8   10   11
Affiliations

Sample size and precision of estimates in studies of depression screening tool accuracy: A meta-research review of studies published in 2018-2021

Elsa-Lynn Nassar et al. Int J Methods Psychiatr Res. 2022 Jun.

Abstract

Objectives: Depression screening tool accuracy studies should be conducted with large enough sample sizes to generate precise accuracy estimates. We assessed the proportion of recently published depression screening tool diagnostic accuracy studies that reported sample size calculations; the proportion that provided confidence intervals (CIs); and precision, based on the width and lower bounds of 95% CIs for sensitivity and specificity. In addition, we assessed whether these results have improved since a previous review of studies published in 2013-2015.

Methods: MEDLINE was searched from January 1, 2018, through May 21, 2021.

Results: Twelve of 106 primary studies (11%) described a viable sample size calculation, which represented an improvement of 8% since the last review. Thirty-six studies (34%) provided reasonably accurate CIs. Of 103 studies where 95% CIs were provided or could be calculated, seven (7%) had sensitivity CI widths of ≤10%, whereas 58 (56%) had widths of ≥21%. Eighty-four studies (82%) had lower bounds of CIs <80% for sensitivity and 77 studies (75%) for specificity. These results were similar to those reported previously.

Conclusion: Few studies reported sample size calculations, and the number of included individuals in most studies was too small to generate reasonably precise accuracy estimates.

Keywords: bias; depression; diagnostic test accuracy; sample size; screening.

PubMed Disclaimer

Conflict of interest statement

All authors completed the International Committee of Medical Journal Editors uniform disclosure form and declared no support from any organization for the submitted work; no financial relationships with any organizations that might have an interest in the submitted work in the previous 3 years. All authors declare no other relationships or activities that could appear to have influenced the submitted work.

Figures

FIGURE 1
FIGURE 1
Flow diagram of selection of primary studies that evaluated the diagnostic accuracy of depression screening tools
See this image and copyright information in PMC

References

    1. Agresti, A. , & Coull, B. A . (1998). Approximate is better than "Exact" for interval estimation of Binomial Proportions. The American Statistician, 52(2), 119. 10.2307/2685469 - DOI
    1. Bhandari, P. M. , Levis, B. , Neupane, D. , Patten, S. B. , Shrier, I. , Thombs, B. D. , Benedetti, A. , & Depression Screening Data (DEPRESSD) EPDS Group. (2021). Data‐driven methods distort optimal cutoffs and accuracy estimates of depression screening tools: a simulation study using individual participant data. Journal of Clinical Epidemiology, 137, 137–147. 10.1016/j.jclinepi.2021.03.031 - DOI - PubMed
    1. Bossuyt, P. M. , Reitsma, J. B. , Bruns, D. E. , Gatsonis, C. A. , Glasziou, P. P. , Irwig, L. , Lijmer, J. G. , Moher, D. , Rennie, D. , Vet de , H. C. , Kressel, H. Y. , Rifai, N. , Golub, R. M. , Altman, D. G. , Hooft, L. , Korevaar, D. A. , Cohen, J. F ., & STARD Group. (2015). STARD 2015: An updated list of essential items for reporting diagnostic accuracy studies. Clinical Chemistry, 61(12), 1446–1452. 10.1373/clinchem.2015.246280 - DOI - PubMed
    1. Cox, J. L. , Holden, J. M. , & Sagovsky, R . (1987). Detection of postnatal depression: Development of the 10‐item Edinburgh postnatal depression scale. The British Journal of Psychiatry, 150(6), 782–786. 10.1192/bjp.150.6.782 - DOI - PubMed
    1. Joffres, M. , Jaramillo, A. , Dickinson, J. , Lewin, G. , Pottie, K. , Shaw, E. , Connor Gorber, S. , Tonelli, M. , & Canadian Task Force on Preventive Health Care. (2013). Recommendations on screening for depression in adults. Canadian Medical Association Journal, 185(9), 775–782. 10.1503/cmaj.130403 - DOI - PMC - PubMed

Publication types