Psychometric analysis and validity of the daily alcohol-related consequences and evaluations measure for young adults

Abstract

College students experience a variety of effects resulting from alcohol use and evaluate their experiences on a continuum from negative to positive. Using daily reports collected via cell phone, we examined the psychometric properties of alcohol use consequences and evaluations of those consequences. Participants were 349 undergraduate students (mean age 19.7 [SD = 1.26], 53.4% female). Data were analyzed using a multilevel factor analysis framework, incorporating binary items (consequences) and normally distributed items (evaluations). Our model converged on 2 factors-positive and negative-with similar loadings between- and within-persons. Intraclass correlation coefficients for positive consequences and their evaluations ranged from .30 to .40, whereas values for negative consequences were more variable. Intraclass correlation coefficients for negative evaluations were higher, suggesting evaluations were more trait-like compared to experience of consequences which may be context dependent. Generalizability coefficients on the whole were good to excellent, suggesting highly reliable scales at both person-mean and daily-mean levels. However, likely due to binary scale and infrequency, the generalizability coefficients for negative consequences at the daily level was somewhat low. Convergent validity was demonstrated by (a) positive associations between baseline Rutgers Alcohol Problem Index and Alcohol Use Disorders Identification Test scores with latent factors for daily positive and negative consequences, and (b) positive associations between daily drinking and daily consequences and evaluations of consequences. Overall, this measure demonstrated good psychometric properties for use in studies examining daily and lagged relationships between alcohol use and related consequences. (PsycINFO Database Record

Figure 1

Intraclass correlations (ICC) of positive and negative consequences and their evaluations.

Figure 2

Path diagram for the multilevel, multimodal confirmatory factor model. Note. Rectangles represent observed variables and circles/ovals represent latent variables. Labels beginning with a ‘c’ represent consequences and labels beginning with ‘e’ represent evaluations. Numbers within labels represent the items. The items are: 1 “Relaxed”, 2 “Hangover”, 3 “Sociable”, 4 “Aggressive”, 5 “Better Mood”, 6 “Vomit”, 7 “Injury”, 8 “Buzz”, 9 “Forget”, 12 “Energy”, 13 “Rude”, 14 “Express”, and 15 “Embarrass”.

Figure 3

Factor loadings and credible intervals for positive and negative consequences and their evaluations.

Figure 4

Factor correlations between positive and negative consequence and their evaluations.