The Validity of a Smartphone-Based Application for Assessing Cognitive Function in the Elderly
- PMID: 39795620
- PMCID: PMC11719899
- DOI: 10.3390/diagnostics15010092
The Validity of a Smartphone-Based Application for Assessing Cognitive Function in the Elderly
Abstract
Background/Objectives: The early detection of individuals at risk of cognitive impairment is a clinical imperative. With the recent advancement of digital devices, smartphone application-based cognitive assessment is considered a promising tool for cognitive screening and monitoring inside and outside the clinic. This study examined whether a smartphone-based cognitive assessment, Brain OK, was valid for evaluating cognitive performance and identifying people at risk of cognitive impairment. Methods: We recruited 88 study participants aged over 60. They completed two cognitive tests with the Montreal Cognitive Assessment (MoCA), a validated paper-and-pencil cognitive screening tool, and Brain OK, a smartphone-based cognitive testing application. To examine convergent validity, we conducted analyses of Spearman correlations between MoCA and BrainOK, a Bland-Atman plot with regression analysis, and the area under the curve (AUC). Results: There was a significant positive association between Brain OK and the MoCA total score, with a coefficient of 0.9044 (SE = 0.057, t = 15.750, p < 0.001). The Bland-Altman plot represented a reasonable level of agreement between the two tests. We conducted the AUC analysis of Brain OK to compare the cognitively normal and impaired groups. The AUC value for the Brain OK score of 13.5 was the highest at 0.941. The sensitivity and specificity were 0.958 and 0.925, respectively. Conclusions: The smartphone app-based Brain OK test was feasible for assessing cognitive function and acceptable for identifying subjects with cognitive impairment. The results suggest Brain OK complements traditional in-person cognitive assessments and may help enhance cognitive health dialogue between doctors and patients.
Keywords: cognitive assessment; cognitive impairment; digitalized tool; feasibility; validation.
Conflict of interest statement
Jong-yoon Kim is the founder and CEO of Beluga Crop. Three other authors (Seungbo Lee, Yae-eun Seo, and Ye-jin Kim) are affiliated with Beluga Crop. and were involved in the development of the smartphone-based cognitive assessment tool Brain OK. Specifically, their roles included selecting and designing test items based on a comprehensive review of the existing literature and implementing the tool’s software framework. However, to ensure objectivity and minimize potential bias, none of the Beluga-affiliated authors participated in data collection, data analysis, or result interpretation in the current study. Their contributions were limited to tool development, while the research design, data acquisition, statistical analysis, and manuscript preparation were conducted independently by the other authors.
Figures




Similar articles
-
Discriminant Power of Smartphone-Derived Keystroke Dynamics for Mild Cognitive Impairment Compared to a Neuropsychological Screening Test: Cross-Sectional Study.J Med Internet Res. 2024 Oct 30;26:e59247. doi: 10.2196/59247. J Med Internet Res. 2024. PMID: 39475819 Free PMC article.
-
Reliability and Validity of Smartphone Cognitive Testing for Frontotemporal Lobar Degeneration.JAMA Netw Open. 2024 Apr 1;7(4):e244266. doi: 10.1001/jamanetworkopen.2024.4266. JAMA Netw Open. 2024. PMID: 38558141 Free PMC article.
-
Criterion and convergent validity of the Montreal cognitive assessment with screening and standardized neuropsychological testing.J Am Geriatr Soc. 2013 Dec;61(12):2181-2185. doi: 10.1111/jgs.12541. Epub 2013 Dec 9. J Am Geriatr Soc. 2013. PMID: 24320735
-
Is the Montreal Cognitive Assessment (MoCA) test better suited than the Mini-Mental State Examination (MMSE) in mild cognitive impairment (MCI) detection among people aged over 60? Meta-analysis.Psychiatr Pol. 2016 Oct 31;50(5):1039-1052. doi: 10.12740/PP/45368. Psychiatr Pol. 2016. PMID: 27992895 Review. English, Polish.
-
General health status measures for people with cognitive impairment: learning disability and acquired brain injury.Health Technol Assess. 2001;5(6):1-100. doi: 10.3310/hta5060. Health Technol Assess. 2001. PMID: 11319989 Review.
References
-
- United Nations, Department of Economic and Social Affairs . World Social Report 2023: Leaving No One Behind in an Ageing World. United Nations; New York, NY, USA: 2023. [(accessed on 22 November 2024)]. Available online: https://desapublications.un.org/publications/world-social-report-2023-le....
-
- Liss J., Seleri Assunção S., Cummings J., Atri A., Geldmacher D., Candela S., Devanand D., Fillit H., Susman J., Mintzer J. Practical recommendations for timely, accurate diagnosis of symptomatic Alzheimer’s disease (MCI and dementia) in primary care: A review and synthesis. J. Intern. Med. 2021;290:310–334. doi: 10.1111/joim.13244. - DOI - PMC - PubMed
Grants and funding
LinkOut - more resources
Full Text Sources