Screening for more with less: Validation of the Global Appraisal of Individual Needs Quick v3 (GAIN-Q3) screeners

Abstract

Multi-morbidity is the norm among adolescents and adults with substance use and other mental disorders and warrants a multi-pronged screening approach. However, the time constraints on assessment inherent in clinical practice often temper the desire for a full understanding of multi-morbidity problems. The 15- to 25-minute Global Appraisal of Individual Needs Quick version 3 (GAIN-Q3) includes screeners for 9 common clinical problems that are short (4 to 10 items) and provide dimensional measures of problem severity in each area that are also categorized to guide clinical decision making. The screeners are summed into a total score that represents a 10th screener for multi-morbidity. This paper provides background on the development of the GAIN-Q3 screeners, their psychometric behaviors, efficiency, and predictive power relative to the 1-2 h full GAIN-I. Based on literature showing differential item and scale functioning by age, analyses were conducted separately using data from 10,625 adolescent and 10,167 adult treatment clients. Despite the condensed lengths of the screening measures compared with their longer versions, the reliability estimates are within the good to excellent range (0.7 to 0.9) in terms of internal consistency for 6 of the 10 screeners for adolescents and 7 of the 10 screeners for adults. In addition, the part to whole correlation for all 10 comparisons for both adolescents and adults are excellent (0.82 to 0.96). Moreover, there is strong evidence for the measures' convergent and discriminant validity and efficiency (i.e., maximum information gathered in as few items possible) relative to the full-length scales as well as relative to other scales in the full GAIN-I. Analyses of the interpretive cut-scores provide accurate identification of cases with high sensitivity and specificity, thus supporting the screeners' capacity to triage. PUBLIC SIGNIFICANCE STATEMENT: This study reports on the ability (GAIN-Q3) to efficiently screen for multiple co-occurring substance use, mental health, and associated problems. Multi-problem presentation in the social service sector is the normal expectation, yet time constraints prevent broad assessment of potentially many problematic areas. The GAIN-Q3 showed convergent and discriminant validity relative to the full-length scales as well as other scales assessed in the GAIN-I. The GAIN-Q3 achieves the desired balance between broad coverage and measurement efficiency to provide ample information to identify the best course of action for an individual.

Keywords: Assessment; Behavioral health; Co-occurring; Mental health; Screening; Substance use.

Figure 1.

Receiver Operating Characteristics Curve for the Total Disorder Screener