Utilizing Technology to Enhance the Ecological Validity of Cognitive and Functional Assessments in Schizophrenia: An Overview of the State-of-the-Art

Abstract

Cognitive impairment is a core feature of schizophrenia and a key determinant of functional outcome. Although conventional paper-and-pencil based cognitive assessments used in schizophrenia remained relatively static during most of the 20th century, this century has witnessed the emergence of innovative digital technologies that aim to enhance the ecological validity of performance-based assessments. This narrative review provides an overview of new technologies that show promise for enhancing the ecological validity of cognitive and functional assessments. We focus on 2 approaches that are particularly relevant for schizophrenia research: (1) digital functional capacity tasks, which use simulations to measure performance of important daily life activities (e.g., virtual shopping tasks), delivered both in-person and remotely, and (2) remote device-based assessments, which include self-administered cognitive tasks (e.g., processing speed test) or functionally-focused surveys regarding momentary activities and experiences (e.g., location, social context), as well as passive sensor-based metrics (e.g., actigraphy measures of activity), during daily life. For each approach, we describe the potential for enhancing ecological validity, provide examples of select measures that have been used in schizophrenia research, summarize available data on their feasibility and validity, and consider remaining challenges. Rapidly growing evidence indicates that digital technologies have the potential to enhance the ecological validity of cognitive and functional outcome assessments, and thereby advance research into the causes of, and treatments for, functional disability in schizophrenia.

Keywords: cognitive; ecological; enhance; functional; technology; validity.

Fig. 1.

Ecological validity of cognitive assessments.

Fig. 2.

miniSim driving simulator.

Fig. 3.

Screenshots and 12 objectives from the virtual reality functional capacity assessment tool (VRFCAT).

Fig. 4.

Image of the ATM task from the functional skills assessment and training system (FUNSAT).

Fig. 5.

Images from the VR cognition training system (VRCTS).

Fig. 6.

Screenshots of NeuroUX’s mobile cognitive tests: (A) memory list; (B) memory matrix; (C) matching pair; (D) quick tap 1; (E) quick tap 2; (F) odd one out; (G) CopyKat; (H) hand swype.