Electronic Health Literacy Scale-Web3.0 for Older Adults with Noncommunicable Diseases: Validation Study

Abstract

Background: In the current digital era, eHealth literacy plays an indispensable role in health care and self-management among older adults with noncommunicable diseases (NCDs). Measuring eHealth literacy appropriately and accurately ensures the successful implementation and evaluation of pertinent research and interventions. However, existing eHealth literacy measures focus mainly on individuals' abilities of accessing and comprehending eHealth information (Web1.0), whereas the capabilities for web-based interaction (Web2.0) and using eHealth information (Web3.0) have not been adequately evaluated.

Objective: This study aimed to examine the reliability, validity, and measurement invariance of the eHealth Literacy Scale-Web3.0 (eHLS-Web3.0) among older adults with NCDs.

Methods: A total of 642 Chinese older adults with NCDs (mean age 65.78, SD 3.91 years; 55.8% female) were recruited in the baseline assessment, of whom 134 (mean age 65.63, SD 3.99 years; 58.2% female) completed the 1-month follow-up assessment. Baseline measures included the Chinese version of the 24-item 3D eHLS-Web3.0, the Chinese version of the 8-item unidimensional eHealth Literacy Scale (eHEALS), and demographic information. Follow-up measures included the 24-item eHLS-Web3.0 and accelerometer-measured physical activity and sedentary behavior. A series of statistical analyses, for example, Cronbach α, composite reliability coefficient (CR), confirmatory factor analysis (CFA), and multigroup CFA, were performed to examine the internal consistency and test-retest reliabilities, as well as the construct, concurrent, convergent, discriminant, and predictive validities, and the measurement invariance of the eHLS-Web3.0 across gender, education level, and residence.

Results: Cronbach α and CR were within acceptable ranges of 0.89-0.94 and 0.90-0.97, respectively, indicating adequate internal consistency of the eHLS-Web3.0 and its subscales. The eHLS-Web3.0 also demonstrated cross-time stability, with baseline and follow-up measures showing a significant intraclass correlation of 0.81-0.91. The construct validity of the 3D structure model of the eHLS-Web3.0 was supported by confirmatory factor analyses. The eHLS-Web3.0 exhibited convergent validity with an average variance extracted value of 0.58 and a CR value of 0.97. Discriminant validity was supported by CFA results for a proposed 4-factor model integrating the 3 eHLS-Web3.0 subscales and eHEALS. The predictive validity of the eHLS-Web3.0 for health behaviors was supported by significant associations of the eHLS-Web3.0 with light physical activity (β=.36, P=.004), moderate to vigorous physical activity (β=.49, P<.001), and sedentary behavior (β=-.26, P=.002). Finally, the measurement invariance of the eHLS-Web3.0 across gender, education level, and residence was supported by the establishment of configural, metric, strong, and strict invariances.

Conclusions: The present study provides timely empirical evidence on the reliability, validity, and measurement invariance of the eHLS-Web3.0, suggesting that the 24-item 3D eHLS-Web3.0 is an appropriate and valid tool for measuring eHealth literacy among older adults with NCDs within the Web3.0 sphere.

Keywords: Electronic Health Literacy; NCD; Web 3.0; eHealth; eHealth literacy; health literacy; measurement; noncommunicable diseases; older adults; psychometric properties; reliability; validity.

Figure 1

Study process diagram.