Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Meta-Analysis
. 2024 Dec 19;12(12):CD013725.
doi: 10.1002/14651858.CD013725.pub2.

Diagnostic test accuracy of self-administered cognitive assessment tools for dementia

Fariha Naeem  1 , Jenny McCleery  2 , Tuuli M Hietamies  1 , Fatene Abakar Ismail  1 , Stephanie Clinton  1 , Aoife O'Mahony  3 , Oscar J Ponce  4 , Terry J Quinn  1
Affiliations
Meta-Analysis

Diagnostic test accuracy of self-administered cognitive assessment tools for dementia

Fariha Naeem et al. Cochrane Database Syst Rev. .

Abstract

Background: Dementia is a chronic and progressive clinical syndrome that can present with a range of cognitive and behavioural symptoms. Global prevalence is projected to increase due to ageing populations, particularly in resource-limited settings, with significant associated health and social care costs. There is a critical need for accurate cognitive assessment as part of the diagnostic workup for dementia. Although self-administered cognitive assessment tools are not diagnostic, they can be used to assess cognition. The role of these tests is uncertain, and their diagnostic test accuracy remains unclear, but they may be useful tools in circumstances where face-to-face assessment may be difficult.

Objectives: Primary objective To assess the test accuracy of any self-administered cognitive assessment tool for the diagnosis of any form of dementia in any setting, including community and secondary health care. Secondary objectives To identify: the quality and quantity of the research evidence describing test accuracy of self-administered testing; sources of heterogeneity in the test accuracy described; and gaps in the evidence where further research is required.

Search methods: We searched MEDLINE (Ovid SP), Embase (Ovid), Web of Science - BIOSIS Citation Index, PsycINFO (Ovid), LILACS (BIREME), and CINAHL (EBSCO). The most recent searches were run on 2 November 2022.

Selection criteria: We included cross-sectional studies investigating the accuracy of a self-administered cognitive assessment tool. We included all settings, including community and secondary health care. The target condition of interest was a clinical diagnosis of dementia, therefore, we included only studies where the index test was administered alongside a reference standard clinical assessment. Our population of interest was any adult (over 18 years of age).

Data collection and analysis: Two review authors independently reviewed included studies, assessed risk of bias using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool, and extracted data. We obtained information on study design and participant characteristics, setting of index test, details of index text, reference standard used, and results reported as sensitivity and specificity. We performed a meta-analysis on three studies that used the same threshold score.

Main results: The review included 11 eligible studies, with a total of 2303 participants, which evaluated the diagnostic test accuracy of six different self-administered cognitive-assessment tools. The studies were conducted in Europe, North America, and South Korea within a variety of community and healthcare settings. Our quality assessment found that four studies had a low risk of bias across all domains. Six studies had a high or unclear risk of bias due to patient selection, with concerns around lack of a clear sampling strategy or exclusion criteria, or both. Six studies had a high or unclear risk of bias with regard to the index test due to lack of information about how the test was conducted and evaluated. For the diagnosis of dementia, sensitivity of self-administered cognitive assessment tools ranged from 55% to 100% and specificity ranged from 45% to 100%. Three studies described the diagnostic test accuracy of Test Your Memory at a threshold of 42/50. Quantitative meta-analysis estimated a summary point with 94% sensitivity (95% confidence interval (CI) 90% to 96%) and 66% specificity (95% CI 45% to 82%) at this threshold.

Authors' conclusions: There is insufficient evidence to recommend the use of any single self-administered cognitive assessment tool. The tools had test accuracy scores that are similar to the range seen with standard pencil and paper cognitive screening tests conducted by clinicians. Further research on the optimal test and threshold score, and how that may be impacted by setting, language, and educational level is needed.

PubMed Disclaimer

Conflict of interest statement

F Naeem: none known

J McCleery: none known

TM Hietamies: none known

F Abakar Ismail: none known

S Clinton: none known

A O'Mahony:none known

OJ Ponce: none known

TJ Quinn: has a role as a Cochrane Editor but has not been involved in the editorial process for this review.

Update of

  • doi: 10.1002/14651858.CD013725

Similar articles

See all similar articles

Cited by

References

References to studies included in this review

Ball 2001 {published data only}
    1. Ball LJ, Ogden A, Mandi D, Birge SJ. The validation of a mailed health survey for screening of dementia of the Alzheimer's type. Journal of the American Geriatrics Society 2001;49(6):798-802. [DOI: ] - PubMed
Breitve 2015 {published data only}
    1. Breitve MH, Chwiszczuk L, Hynninen M. A Norwegian pilot study of the TYM test (Test Your Memory). Norsk Psykologforening 2015;52(1):49-53.
Ferrero‐Arias 2016 {published data only}
    1. Ferrero-Arias J, Turrión-Rojo MÁ. Validation of a Spanish version of the Test Your Memory. Neurologia 2016;31(1):33-42. - PubMed
Groppell 2019 {published data only}
    1. Groppell S, Soto-Ruiz KM, Flores B, Dawkins W, Smith I, Eagleman DM, et al. A rapid, mobile neurocognitive screening test to aid in identifying cognitive impairment and dementia (BrainCheck): cohort study. JMIR Aging 2019;2(1):e12615. - PMC - PubMed
Hancock 2010 {published data only}
    1. Hancock P, Larner AJ. Test Your Memory test: diagnostic utility in a memory clinic population. International Journal of Geriatric Psychiatry 2011;25:976-80. - PubMed
Iatraki 2014 {published data only}
    1. Iatraki E, Simos PG, Lionis C, Zaganas I, Symvoulakis EK, Papastefanakis E, et al. Cultural adaptation, standardization and clinical validity of the Test Your Memory dementia screening instrument in Greek. Dementia and Geriatric Cognitive Disorders 2014;37:163-80. - PubMed
Kim 2019 {published data only}
    1. Kim A, Kim S, Park KW, Park KH, Youn YC, Lee DW, et al. Reliability and validity of a short form of the Korean Dementia Screening Questionnaire-Cognition. Journal of Clinical Neurology 2020;16(1):143-53. - PMC - PubMed
Mansbach 2020 {published data only (unpublished sought but not used)}
    1. Mansbach WE, Mace RA, Tanner MA, Simmons SP. A path to early diagnosis of mild cognitive impairment and dementia: validity and reliability of the myMemCheck® self-administered screening tool. Family Practice 2020;37(4):561-7. - PubMed
Postel‐Vinay 2014 {published data only}
    1. Postel-Vinay N, Hanon O, Clerson P, Brown JM, Ménard J, Paillaud E, et al. Validation of the Test Your Memory (F-TYM Test) in a French memory clinic population. Clinical Neuropsychologist 2014;28(6):994-1007. - PubMed
Scharre 2010 {published data only}
    1. Scharre DW, Chang SI, Murden RA, Lamb J, Beversdorf DQ, Kataki M, et al. Self-administered Gerocognitive Examination (SAGE): a brief cognitive assessment Instrument for mild cognitive impairment (MCI) and early dementia. Alzheimer Disease and Associated Disorders 2010;24(1):64-71. [DOI: 10.1097/WAD.0b013e3181b03277] [PMID: ] - DOI - PubMed
Scharre 2017 {published data only}
    1. Scharre DW, Chang SI, Nagaraja HN, Vrettos NE, Bornstein RA. Digitally translated Self-Administered Gerocognitive Examination (eSAGE): relationship with its validated paper version, neuropsychological evaluations, and clinical assessments. Alzheimer's Research and Therapy 2017;9(1):44. [DOI: 10.1186/s13195-017-0269-3] [PMID: ] - DOI - PMC - PubMed

References to studies excluded from this review

Brown 2017 {published data only}
    1. Brown JM, Lansdall CJ, Wiggins J, Dawson KE, Hunter K, Rowe JB, et al. The Test Your Memory for Mild Cognitive Impairment (TYM-MCI). Journal of Neurology, Neurosurgery and Psychiatry 2017;88(12):1045-51. - PMC - PubMed
Crane 2012 {published data only (unpublished sought but not used)}
    1. Crane M, Dougherty J, Cannon R. Use of the computer self-test to detect difference in cognitive patterns between AD and FTD. Dementia and Geriatric Cognitive Disorders 2012;34:235.
Dong 2019 {published data only (unpublished sought but not used)}
    1. Dong Y, Ling MT, Ng KE, Wang A, Wan EY, Merchant RA, et al. The clinical utility of the TYM and RBANS in a one-stop memory clinic in Singapore: a pilot study. Journal of Geriatric Psychiatry and Neurology 2019;32(2):68-73. - PubMed
Gallassia 2012 {published data only (unpublished sought but not used)}
    1. Gallassia R , Guttmannb S , Monaldinib C , De Matteisa M, Gallassia V, Sambatia L. Symptoms of dementia screener: is it a useful questionnaire for cognitive impairment screening? Journal of Alzheimer's Disease 2012;29(Supp 1):67-8.
Galvin 2007 {published data only}
    1. Galvin JE, Roe CM, Coats MA, Morris JC. Patient's rating of cognitive ability: using the AD8, a brief informant interview, as a self-rating tool to detect dementia. Archives of Neurology 2007;64:725-30. - PubMed
Jorgensen 2020 {published data only}
    1. Jorgensen K, Nielsen TR, Nielsen A, Waldorff FB, Waldemar G. Brief Assessment of Impaired Cognition Questionnaire (BASIC-Q) - development and validation of a new tool for identification of cognitive impairment in community settings. International Journal of Geriatric Psychiatry 2020;35:693-701. - PMC - PubMed
Larner 2015 {published data only}
    1. Larner AJ. Hard-TYM: a pragmatic study. International Journal of Geriatric Psychiatry 2015;30(3):330-1. - PubMed
Miyamae 2016 {published data only}
    1. Miyamae F. The developement of a self-administered dementia checklist: the examination of concurrent validity and discriminant validity. Japanese Journal of Geriatrics 2016;53(4):354-62. - PubMed
Saunders 2008 {published data only}
    1. Saunders LV. Validation of a self-administered computerized screening test for cognitive impairment and dementia. Neurology 2008;70(11, Supp 1):A184-5.
Tsai 2018 {published data only}
    1. Tsai PH, Liu JL, Lin KN, Chang CC, Pai MC, Wang WF, et al. Development and validation of a dementia screening tool for primary care in Taiwan: Brain Health Test. PLOS One 2018;13(4):e0196214. - PMC - PubMed
Van Mierlo 2017 {published data only}
    1. Van Mierlo LD. Screening for mild cognitive impairment and dementia with automated, anonymous online and telephone cognitive self-tests. Journal of Alzheimer's Disease 2017;56:249-59. - PMC - PubMed

Additional references

Alzheimer's Disease International 2020
    1. Alzheimer's Disease International. Dementia statistics. www.alz.co.uk/research/statistics (accessed prior to 8 September 2020).
APA 2013
    1. American Psychiatric Association, DSM-5 Task Force. Diagnostic and statistical manual of mental disorders: DSM-5. 5th edition. Vol. xliv. Washington, DC: American Psychiatric Association, 2013.
Barth 2018
    1. Barth J, Nickel F. Diagnosis of cognitive decline and dementia in rural areas - a scoping review. Journal of Geriatric Psychiatry 2018;33(3):459-74. - PubMed
Beishon 2019
    1. Beishon LC, Batterham AP, Quinn TJ, Nelson CP, Panerai RB, Robinson T, et al. Addenbrooke's Cognitive Examination III (ACE‐III) and mini‐ACE for the detection of dementia and mild cognitive impairment. Cochrane Database of Systematic Reviews 2019, Issue 12. Art. No: CD013282. [DOI: 10.1002/14651858.CD013282.pub2] - DOI - PMC - PubMed
Beishon 2022
    1. Beishon LC, Elliott E, Hietamies TM, McArdle R, O'Mahony A, Elliott AR, et al. Diagnostic test accuracy of remote, multidomain cognitive assessment (telephone and video call) for dementia. Cochrane Database of Systematic Reviews 2022, Issue 4. Art. No: CD013724. [DOI: 10.1002/14651858.CD013724.pub2] - DOI - PMC - PubMed
Brown 2009
    1. Brown J, Pengas G, Dawson K, Brown LA, Clatworthy P. Self administered cognitive screening test (TYM) for detection of Alzheimer’s disease: cross sectional study. BMJ 2009;338:b2030. [DOI: 10.1136/bmj.b2030] - DOI - PMC - PubMed
Charalambous 2020
    1. Charalambous AP, Pye A, Yeung WK, Leroi I, Neil M, Thodi C, et al. Tools for app- and web-based self-testing of cognitive impairment: systematic search and evaluation. Journal of Medical Internet Research 2020;22(1):e14451. - PMC - PubMed
Covidence 2020 [Computer program]
    1. Covidence. Melbourne, Australia: Veritas Health Innovation, 2020. Available at www.covidence.org.
Creavin 2016
    1. Creavin ST, Wisniewski S, Noel-Storr AH, Trevelyan CM, Hampton T, Rayment D, et al. Mini-Mental State Examination (MMSE) for the detection of dementia in clinically unevaluated people aged 65 and over in community and primary care populations. Cochrane Database of Systematic Reviews 2016, Issue 1. Art. No: CD011145. [DOI: 10.1002/14651858.CD011145.pub2] - DOI - PMC - PubMed
Davis 2013
    1. Davis DH, Creavin ST, Noel-Storr A, Quinn TJ, Smailagic N, Hyde C, et al. Neuropsychological tests for the diagnosis of Alzheimer’s disease dementia and other dementias: a generic protocol for cross-sectional and delayed-verification studies. Cochrane Database of Systematic Reviews 2013, Issue 3. Art. No: CD010460. [DOI: 10.1002/14651858.CD010460] - DOI - PMC - PubMed
Davis 2015
    1. Davis DH, Creavin ST, Yip JL, Noel-Storr AH, Brayne C, Cullum S. Montreal Cognitive Assessment for the diagnosis of Alzheimer’s disease and other dementias. Cochrane Database of Systematic Reviews 2015, Issue 10. Art. No: CD010775. [DOI: 10.1002/14651858.CD010775.pub2] - DOI - PMC - PubMed
Deeks 2001
    1. Deeks JJ. Systematic reviews in health care: systematic reviews of evaluations of diagnostic and screening tests. BMJ 2001;323:157-62. - PMC - PubMed
Harrison 2015
    1. Harrison JK, Fearon P, Noel‐Storr AH, McShane R, Stott DJ, Quinn TJ. Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) for the diagnosis of dementia within a secondary care setting. Cochrane Database of Systematic Reviews 2015, Issue 3. Art. No: CD123456. [DOI: 10.1002/14651858.CD123456] - DOI - PubMed
Hendry 2016
    1. Hendry K, Quinn TJ, Evans J, Scortichini V, Miller H, Burns J, et al. Evaluation of delirium screening tools in geriatric medical inpatients: a diagnostic test accuracy study. Age and Ageing 2016;45:832-7. [DOI: 10.1093/ageing/afw130] - DOI - PubMed
Hendry 2019
    1. Hendry K, Green C, McShane R, Noel-Storr AH, Stott DJ, Anwer S, et al. AD-8 for detection of dementia across a variety of healthcare settings. Cochrane Database of Systematic Reviews 2019, Issue 3. Art. No: CD123456. [DOI: 10.1002/14651858.CD123456] - DOI - PMC - PubMed
Koo 2019
    1. Koo BM, Vizer LM. Mobile technology for cognitive assessment of older adults: a scoping review. Innovation in Aging 2019;3(1):1-14. - PMC - PubMed
Langa 2014
    1. Langa KM, Levine DA. The diagnosis and management of mild cognitive impairment. JAMA 2014;312:2551-61. - PMC - PubMed
Lees 2012
    1. Lees R, Fearon P, Harrison JK, Broomfield NK, Quinn TJ. Cognitive and mood assessment in stroke research: focused review of contemporary studies. Stroke 2012;43(6):1678-80. - PubMed
Lees 2017
    1. Lees RA, Hendry K, Broomfield N, Stott DJ, Larner AJ, Quinn TJ. Cognitive assessment in stroke: feasibility and test properties using differing approaches to scoring of incomplete items. International Journal of Geriatric Psychiatry 2017;32:1072-8. - PubMed
Lin 2013
    1. Lin JS, O’Connor E, Rossom RC, Perdue LA, Eckstrom E. Screening for cognitive impairment in older adults: a systematic review for the US Preventive Services Task Force. Annals of Internal Medicine 2013;159(9):601-12. - PubMed
McCleery 2021
    1. McCleery J, Laverty J, Quinn TJ. Diagnostic test accuracy of telehealth assessment for dementia and mild cognitive impairment. Cochrane Database of Systematic Reviews 2021, Issue 7. Art. No: CD013786. [DOI: 10.1002/14651858.CD013786.pub2] [PMID: ] - DOI - PMC - PubMed
Noel‐Storr 2012
    1. Noel-Storr AH, McCleery JM, Richard E, Ritchie CW, Flicker L, Cullum SJ, et al. Reporting standards for studies of diagnostic test accuracy in dementia: the STARDdem Initiative. Neurology 2012;83(4):364-73. - PMC - PubMed
Patel 2020
    1. Patel A, Cooper N, Freeman S, Sutton A. Graphical enhancements to summary receiver operating characteristic plots to facilitate the analysis and reporting of meta-analysis of diagnostic test accuracy data. Research Synthesis Methods 2020;12(1):34-44. [DOI: ] - PubMed
RevMan 2024 [Computer program]
    1. Review Manager (RevMan). Version 7.14.1. The Cochrane Collaboration, 2024. Available at revman.cochrane.org.
Ritchie 2015
    1. Ritchie CW, Terrera GM, Quinn TJ. Dementia trials and dementia tribulations: methodological and analytical challenges in dementia research. Alzheimer's Research & Therapy 2015;7(1):31. - PMC - PubMed
Robinson 2015
    1. Robinson L, Tang E, Taylor JP. Dementia: timely diagnosis and early intervention. BMJ 2015;350:h3029. - PMC - PubMed
Takwoingi 2018
    1. Takwoingi Y, Quinn TJ. Review of Diagnostic Test Accuracy (DTA) studies in older people. Age and Ageing 2018;47:349-55. - PubMed
van Enst 2014
    1. Enst AW, Ochodo E, Scholten RJ, Hooft L, Leeflang MM. Investigation of publication bias in meta-analyses of diagnostic test accuracy: a meta-epidemiological study. BMC Medical Research Methodology 2014;14:70. - PMC - PubMed
Whiting 2008
    1. Whiting P, Westwood M, Burke M, Sterne J, Glanville J. Systematic reviews of test accuracy should search a range of databases to identify primary studies. Journal of Clinical Epidemiology 2008;41(4):357-64. - PubMed
Whiting 2011
    1. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, Leeflang MM, Sterne JA, Bossuyt PM, . QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 18 Oct 2011;155(8):529-36. [DOI: 10.7326/0003-4819-155-8-201110180-00009] - DOI - PubMed
WHO 2010
    1. World Health Organization. International Statistical Classification of Diseases and Related Health Problems (ICD). Vol. 2. Geneva: World Health Organization, 2010.
Wilson 2015
    1. Wilson C, Kerr D, Noel‐Storr A, Quinn TJ. Associations with publication and assessing publication bias in dementia diagnostic test accuracy studies. International Journal of Geriatric Psychiatry 2015;30(12):1250-6. - PubMed
Yang 2017
    1. Yang S, Flores B, Magal R, Harris K, Gross J, Ewbank A, et al. Diagnostic accuracy of tablet-based software for the detection of concussion. PLOS One 2017;12(7):e0179352. - PMC - PubMed

References to other published versions of this review

Quinn 2020
    1. Quinn TJ, McCleery J, Hietamies TM, Abakar Ismail F. Diagnostic test accuracy of self‐administered cognitive assessment questionnaires for dementia. Cochrane Database of Systematic Reviews 2020, Issue 9. Art. No: CD013725. [DOI: 10.1002/14651858.CD013725] - DOI - PMC - PubMed

LinkOut - more resources