External validation of a shortened screening tool using individual participant data meta-analysis: A case study of the Patient Health Questionnaire-Dep-4
- PMID: 34780986
- PMCID: PMC11719774
- DOI: 10.1016/j.ymeth.2021.11.005
External validation of a shortened screening tool using individual participant data meta-analysis: A case study of the Patient Health Questionnaire-Dep-4
Abstract
Shortened versions of self-reported questionnaires may be used to reduce respondent burden. When shortened screening tools are used, it is desirable to maintain equivalent diagnostic accuracy to full-length forms. This manuscript presents a case study that illustrates how external data and individual participant data meta-analysis can be used to assess the equivalence in diagnostic accuracy between a shortened and full-length form. This case study compares the Patient Health Questionnaire-9 (PHQ-9) and a 4-item shortened version (PHQ-Dep-4) that was previously developed using optimal test assembly methods. Using a large database of 75 primary studies (34,698 participants, 3,392 major depression cases), we evaluated whether the PHQ-Dep-4 cutoff of ≥ 4 maintained equivalent diagnostic accuracy to a PHQ-9 cutoff of ≥ 10. Using this external validation dataset, a PHQ-Dep-4 cutoff of ≥ 4 maximized the sum of sensitivity and specificity, with a sensitivity of 0.88 (95% CI 0.81, 0.93), 0.68 (95% CI 0.56, 0.78), and 0.80 (95% CI 0.73, 0.85) for the semi-structured, fully structured, and MINI reference standard categories, respectively, and a specificity of 0.79 (95% CI 0.74, 0.83), 0.85 (95% CI 0.78, 0.90), and 0.83 (95% CI 0.80, 0.86) for the semi-structured, fully structured, and MINI reference standard categories, respectively. While equivalence with a PHQ-9 cutoff of ≥ 10 was not established, we found the sensitivity of the PHQ-Dep-4 to be non-inferior to that of the PHQ-9, and the specificity of the PHQ-Dep-4 to be marginally smaller than the PHQ-9.
Keywords: Equivalence testing; Optimal test assembly; Self-report questionnaire; Sensitivity; Specificity.
Copyright © 2021 Elsevier Inc. All rights reserved.
Figures
References
-
- Kruyen PM, Emons WHM, Sijtsma K, On the Shortcomings of Shortened Tests: A Literature Review, Int. J. Test 13 (3) (2013) 223–248, 10.1080/15305058.2012.703734. - DOI
-
- Stanton PC, Sinar JM, Balzer EF, Smith WK, Issues and strategies for reducing the length of self-report scales, Pers. Psychol 55 (1) (2002) 167–194.
-
- Kroenke K, Spitzer RL, The PHQ-9: a new depression diagnostic and severity measure, SLACK Incorporated Thorofare, NJ, 2002.
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources