Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2016 Jan;22(1):24-37.
doi: 10.1017/S1355617715001101.

Prospective, Head-to-Head Study of Three Computerized Neurocognitive Assessment Tools (CNTs): Reliability and Validity for the Assessment of Sport-Related Concussion

Lindsay D Nelson  1 , Ashley A LaRoche  1 , Adam Y Pfaller  1 , E Brooke Lerner  1 , Thomas A Hammeke  1 , Christopher Randolph  2 , William B Barr  3 , Kevin Guskiewicz  4 , Michael A McCrea  1
Affiliations

Prospective, Head-to-Head Study of Three Computerized Neurocognitive Assessment Tools (CNTs): Reliability and Validity for the Assessment of Sport-Related Concussion

Lindsay D Nelson et al. J Int Neuropsychol Soc. 2016 Jan.

Abstract

Limited data exist comparing the performance of computerized neurocognitive tests (CNTs) for assessing sport-related concussion. We evaluated the reliability and validity of three CNTs-ANAM, Axon Sports/Cogstate Sport, and ImPACT-in a common sample. High school and collegiate athletes completed two CNTs each at baseline. Concussed (n=165) and matched non-injured control (n=166) subjects repeated testing within 24 hr and at 8, 15, and 45 days post-injury. Roughly a quarter of each CNT's indices had stability coefficients (M=198 day interval) over .70. Group differences in performance were mostly moderate to large at 24 hr and small by day 8. The sensitivity of reliable change indices (RCIs) was best at 24 hr (67.8%, 60.3%, and 47.6% with one or more significant RCIs for ImPACT, Axon, and ANAM, respectively) but diminished to near the false positive rates thereafter. Across time, the CNTs' sensitivities were highest in those athletes who became asymptomatic within 1 day before neurocognitive testing but was similar to the tests' false positive rates when including athletes who became asymptomatic several days earlier. Test-retest reliability was similar among these three CNTs and below optimal standards for clinical use on many subtests. Analyses of group effect sizes, discrimination, and sensitivity and specificity suggested that the CNTs may add incrementally (beyond symptom scores) to the identification of clinical impairment within 24 hr of injury or within a short time period after symptom resolution but do not add significant value over symptom assessment later. The rapid clinical recovery course from concussion and modest stability probably jointly contribute to limited signal detection capabilities of neurocognitive tests outside a brief post-injury window. (JINS, 2016, 22, 24-37).

Keywords: ANAM; Axon Sports; Computerized testing; Concussion; ImPACT; Sport.

PubMed Disclaimer

References

    1. Belanger HG, Vanderploeg RD. The neuropsychological impact of sports-related concussion: A meta-analysis. Journal of the International Neuropsychological Society. 2005;11:345–357. - PubMed
    1. Benjamini Y, Hochberg Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B (Statistical Mehodology) 1995;57:289–300.
    1. Benjamini Y, Yekutieli D. The control of the false discovery rate in multiple testing under dependency. The Annals of Statistics. 2001;29:1165–1188.
    1. Bleiberg J, Cernich AN, Cameron K, Sun W, Peck K, Ecklund PJ, et al. Warden DL. Duration of cognitive impairment after sports concussion. Neurosurgery. 2004;54:1073–1078. - PubMed
    1. Broglio SP, Ferrara MS, Macciocchi SN, Baumgartner TA, Elliott R. Test-retest reliability of computerized concussion assessment programs. Journal of Athletic Training. 2007;42:509–514. - PMC - PubMed

Publication types