Modern health worries: Deriving two measurement invariant short scales for cross-cultural research with Ant Colony Optimization

Abstract

Worries about possible harmful effects of new technologies (modern health worries) have intensely been investigated in the last decade. However, the comparability of translated self-report measures across countries is often problematic. This study aimed to overcome this problem by developing psychometrically sound brief versions of the widely used 25-item Modern Health Worries Scale (MHWS) suitable for multi-country use. Based on data of overall 5,176 individuals from four European countries (England, Germany, Hungary, Sweden), Ant Colony Optimization was used to identify the indicators that optimize model fit and measurement invariance across countries. Two scales were developed. A short (12-item) version of the MHWS that represents the four-factor structure of the original version and an ultra-short (4-item) scale that only measures the general construct. Both scales show that overall levels of health worries were highest in England and Hungary, but that the main reason for concern (e.g. electromagnetic radiation or food related fears) differs considerably between these countries. This study also shows that even if measurement invariance of translated self-report instruments across countries is problematic, it can be optimized by using adequate item selection procedures. Differences of modern health worries across countries and recommendations for cross-cultural research are discussed.

Fig 1. Higher-order model of the short scale.

Range of standardized parameters across countries under strict measurement invariance (CFI = .990; RMSEA = .078; see Table 3 for full list of loadings).

Fig 2. Factor means of the short scale across countries.

The factor means are standardized z-values. Factor means were effect coded for identification (i.e. sum of factor means across countries is zero). Error bars represent one standard error in both directions. Toxic interventions, Environmental pollution, Tainted food and Radiation means were derived based on the model with strict measurement invariance at the first-order factor level and configural measurement invariance at the second-order factor level. The general MHWs mean of the short scale was derived based on the 12-item model with strict measurement invariance at the first-order factor level and strict measurement invariance at the second-order factor level. The general MHWs mean of the ultra-short scale was derived based on the 4-item model with strict measurement invariance.