Domain-Specific Evaluation of Exergame Metrics Among Older Adults With Mild Neurocognitive Disorder: Secondary Analysis of 2 Randomized Controlled Trials

Abstract

Background: Exergame-based training enhances physical and cognitive performance in older adults, including those with mild neurocognitive disorder (mNCD). In-game metrics generated from user interactions with exergames enable individualized adjustments. However, there is a need to systematically investigate how well such game metrics capture true cognitive and motor-cognitive performance to provide a more robust basis for personalized training.

Objective: The primary objective was to identify valid game metrics as indicators for in-game domain-specific cognitive performance during exergaming in individuals with mNCD. We also aimed to explore game metric performance changes over time during exergame-based training.

Methods: Data were analyzed from individuals with mNCD who completed a 12-week home-based, exergame-based intervention following the Brain-IT training concept. A cross-sectional analysis was conducted by correlating game metrics with standardized neurocognitive reference assessments. To confirm the alternative hypothesis, we predetermined the following criteria: (1) statistically significant correlation (P≤.05; uncorrected; 1-sided) with (2) a correlation coefficient (Pearson r or Spearman ρ) of ≥0.4. Visual and curve-fitting longitudinal analyses were conducted to explore game performance changes over time.

Results: Data were available from 31 participants (mean age 76.4, SD 7.5 y; n=9, 29% female). In total, 33% (6/18) of the game metrics were identified as valid indicators for in-game cognitive performance during exergaming. In the neurocognitive domain of learning and memory, these metrics included the mean reaction time (ρ=-0.747), the number of collected items (ρ=0.691), and the precision score (r=-0.607) for the game Shopping Tour (P<.001 in all cases), as well as the point rate (P=.008; r=0.471) for the game Simon. In addition, point rate was a valid indicator for executive function (P=.006; r=0.455) and visuospatial skills (P=.02; r=0.474) for the games Targets and Gears, respectively. The exploratory longitudinal analysis revealed high interindividual variability, with a general trend of the expected typical curvilinear curves of rapid initial improvements followed by a plateau in performance.

Conclusions: This study demonstrated that metrics reflecting the precision of responses generally performed better than metrics reflecting the speed of responses. These observations highlight the importance of selecting valid game metrics for implementation in exergame designs. Further research is needed to explore the potential of game metrics and identify factors contributing to individual variability in in-game performance and performance progression, as well as identifying and adopting strategies that facilitate individual learning success and thus promote effectiveness in improving health outcomes.

Keywords: cognition; exergaming; game metrics; neurocognitive disorder; older adults; performance progression.

Figure 1

Summary of the participant flow throughout the study. FS: feasibility study; ES: effectiveness study; N/A: not applicable.

Figure 2

Performance progression over gameplay time.

Figure 3

Performance progression over difficulty levels.