Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Comparative Study
. 2007 Oct-Dec;42(4):509-14.

Test-retest reliability of computerized concussion assessment programs

Steven P Broglio  1 , Michael S Ferrara, Stephen N Macciocchi, Ted A Baumgartner, Ronald Elliott
Affiliations
Comparative Study

Test-retest reliability of computerized concussion assessment programs

Steven P Broglio et al. J Athl Train. 2007 Oct-Dec.

Abstract

Context: Computer-based neurocognitive assessment programs commonly are used to assist in concussion diagnosis and management. These tests have been adopted readily by many clinicians based on existing test-retest reliability data provided by test developers.

Objective: To examine the test-retest reliability of 3 commercially available computer-based neurocognitive assessments using clinically relevant time frames.

Design: Repeated-measures design.

Setting: Research laboratory.

Patients or other participants: 118 healthy student volunteers.

Main outcome measure(s): The participants completed the ImPACT, Concussion Sentinel, and Headminder Concussion Resolution Index tests on 3 days: baseline, day 45, and day 50. Each participant also completed the Green Memory and Concentration Test to evaluate effort. Intraclass correlation coefficients were calculated for all output scores generated by each computer program as an estimate of test-retest reliability.

Results: The intraclass correlation coefficient estimates from baseline to day 45 assessments ranged from .15 to .39 on the ImPACT, .23 to .65 on the Concussion Sentinel, and .15 to .66 on the Concussion Resolution Index. The intraclass correlation coefficient estimates from the day 45 to day 50 assessments ranged from .39 to .61 on the ImPACT, .39 to .66 on the Concussion Sentinel, and .03 to .66 on the Concussion Resolution Index. All participants demonstrated high levels of effort on all days of testing, according to Memory and Concentration Test interpretive guidelines.

Conclusions: Three contemporary computer-based concussion assessment programs evidenced low to moderate test-retest reliability coefficients. Our findings do not appear to be due to suboptimal effort or other factors related to poor test performance, because persons identified by individual programs as having poor baseline data were excluded from the analyses. The neurocognitive evaluation should continue to be part of a multifaceted concussion assessment program, with priority given to those scores showing the highest reliability.

Keywords: Concussion Resolution Index; Concussion Sentinel; ImPACT; effort; intraclass correlation coefficient.

PubMed Disclaimer

Comment in

References

    1. Langlios JA, Rutland-Brown W, Wald MM. The epidemiology and impact of traumatic brain injury: a brief overview. J Head Trauma Rehabil. 2006;21:375–378. - PubMed
    1. Peterson CL, Ferrara MS, Mrazik M, Piland SG, Elliot R. Evaluation of neuropsychological domain scores and postural stability following cerebral concussion in sports. Clin J Sport Med. 2003;13:230–237. - PubMed
    1. Guskiewicz KM, Riemann BL, Perrin DH, Nashner LM. Alternative approaches to the assessment of mild head injury in athletes. Med Sci Sports Exerc. 1997;29:S-213–S-221. (suppl 7) - PubMed
    1. Guskiewicz KM, Ross SE, Marshall SW. Postural stability and neuropsychological deficits after concussion in collegiate athletes. J Athl Train. 2001;36:263–273. - PMC - PubMed
    1. Collins MW, Grindel SH, Lovell MR. Relationship between concussion and neuropsychological performance in college football players. JAMA. 1999;282:964–970. et al. - PubMed

Publication types