Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Mar 1:256:111108.
doi: 10.1016/j.drugalcdep.2024.111108. Epub 2024 Jan 24.

Test-retest reliability of DSM-5 substance use symptom checklists used in primary care and mental health care settings

Kevin A Hallgren  1 , Theresa E Matson  2 , Malia Oliver  3 , Xiaoming Wang  4 , Emily C Williams  5 , Katharine A Bradley  6
Affiliations

Test-retest reliability of DSM-5 substance use symptom checklists used in primary care and mental health care settings

Kevin A Hallgren et al. Drug Alcohol Depend. .

Abstract

Introduction: Substance use disorders (SUDs) are underdiagnosed in healthcare settings. The Substance Use Symptom Checklist (SUSC) is a practical, patient-report questionnaire that has been used to assess SUD symptoms based on Diagnostic and Statistical Manual of Mental Disorders-5th edition (DSM-5) criteria. This study evaluates the test-retest reliability of SUSCs completed in primary and mental health care settings.

Methods: We identified 1194 patients who completed two SUSCs 1-21 days apart as part of routine care after reporting daily cannabis use and/or any past-year other drug use on behavioral health screens. Test-retest reliability of SUSC scores was evaluated within the full sample, subsamples who completed both checklists in primary care (n=451) or mental health clinics (n=512) where SUSC implementation differed, and subgroups defined by sex, insurance status, age, and substance use reported on behavioral health screens.

Results: In the full sample, test-retest reliability was high for indices reflecting the number of SUD symptoms endorsed (ICC=0.75, 95% CI:0.72-0.77) and DSM-5 SUD severity (kappa=0.72, 95% CI:0.69-0.75). These reliability estimates were higher in primary care (ICC=0.81, 95% CI:0.77-0.84; kappa=0.79, 95% CI:0.75-0.82, respectively) than in mental health clinics (ICC=0.74, 95% CI:0.70-0.78; kappa=0.73, 95% CI:0.68-0.77). Reliability differed by age and substance use reported on behavioral health screens, but not by sex or insurance status.

Conclusions: The SUSC has good-to-excellent test-retest reliability when completed as part of routine primary or mental health care. Symptom checklists can reliably measure symptoms consistent with DSM-5 SUD criteria, which may aid SUD-related care in primary care and mental health settings.

Keywords: Assessment; Measurement-based care; Primary care; Substance use disorder; Symptom checklist.

PubMed Disclaimer

Conflict of interest statement

Declaration of Competing Interest All authors declare no conflicts of interest.

References

    1. American Psychiatric Association, 2013. Diagnostic and statistical manual of mental disorders (DSM-5®). American Psychiatric Pub.
    1. Babor TF, Higgins-Biddle JC, Saunders JB, Monteiro MG, World Health Organization, 2001. AUDIT: the alcohol use disorders identification test: guidelines for use in primary health care.
    1. Bobb JF, Lee AK, Lapham GT, Oliver M, Ludman E, Achtmeyer C, Parrish R, Caldeiro RM, Lozano P, Richards JE, Bradley KA, 2017. Evaluation of a Pilot Implementation to Integrate Alcohol-Related Care within Primary Care. Int J Environ Res Public Health 14. 10.3390/ijerph14091030 - DOI - PMC - PubMed
    1. Bradley KA, Caldeiro RM, Hallgren KA, Kivlahan DR, 2019. Making measurement-based care for addictions a reality in primary care. Addiction 114, 1355–1356. - PMC - PubMed
    1. Brown RL, Rounds LA, 1995. Conjoint screening questionnaires for alcohol and other drug abuse: criterion validity in a primary care practice. Wisconsin medical journal. - PubMed

MeSH terms