Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2018 Jun 1;75(6):697-703.
doi: 10.1001/jamaneurol.2018.0031.

Prevalence of Invalid Performance on Baseline Testing for Sport-Related Concussion by Age and Validity Indicator

Christopher A Abeare  1 , Isabelle Messa  1 , Brandon G Zuccato  1 , Bradley Merker  2 , Laszlo Erdodi  1
Affiliations

Prevalence of Invalid Performance on Baseline Testing for Sport-Related Concussion by Age and Validity Indicator

Christopher A Abeare et al. JAMA Neurol. .

Abstract

Importance: Estimated base rates of invalid performance on baseline testing (base rates of failure) for the management of sport-related concussion range from 6.1% to 40.0%, depending on the validity indicator used. The instability of this key measure represents a challenge in the clinical interpretation of test results that could undermine the utility of baseline testing.

Objectives: To determine the prevalence of invalid performance on baseline testing and to assess whether the prevalence varies as a function of age and validity indicator.

Design, setting, and participants: This retrospective, cross-sectional study included data collected between January 1, 2012, and December 31, 2016, from a clinical referral center in the Midwestern United States. Participants included 7897 consecutively tested, equivalently proportioned male and female athletes aged 10 to 21 years, who completed baseline neurocognitive testing for the purpose of concussion management.

Interventions: Baseline assessment was conducted with the Immediate Postconcussion Assessment and Cognitive Testing (ImPACT), a computerized neurocognitive test designed for assessment of concussion.

Main outcomes and measures: Base rates of failure on published ImPACT validity indicators were compared within and across age groups. Hypotheses were developed after data collection but prior to analyses.

Results: Of the 7897 study participants, 4086 (51.7%) were male, mean (SD) age was 14.71 (1.78) years, 7820 (99.0%) were primarily English speaking, and the mean (SD) educational level was 8.79 (1.68) years. The base rate of failure ranged from 6.4% to 47.6% across individual indicators. Most of the sample (55.7%) failed at least 1 of 4 validity indicators. The base rate of failure varied considerably across age groups (117 of 140 [83.6%] for those aged 10 years to 14 of 48 [29.2%] for those aged 21 years), representing a risk ratio of 2.86 (95% CI, 2.60-3.16; P < .001).

Conclusions and relevance: The results for base rate of failure were surprisingly high overall and varied widely depending on the specific validity indicator and the age of the examinee. The strong age association, with 3 of 4 participants aged 10 to 12 years failing validity indicators, suggests that the clinical interpretation and utility of baseline testing in this age group is questionable. These findings underscore the need for close scrutiny of performance validity indicators on baseline testing across age groups.

PubMed Disclaimer

Conflict of interest statement

Conflict of Interest Disclosures: None reported.

Figures

Figure.
Figure.. Base Rate of Failure for 7897 Athletes by Age and Embedded Validity Indicator (EVI)
ImPACT indicates Immediate Postconcussion and Cognitive Testing.
See this image and copyright information in PMC

References

    1. Bryan MA, Rowhani-Rahbar A, Comstock RD, Rivara F; Seattle Sports Concussion Research Collaborative . Sports- and recreation-related concussions in US youth. Pediatrics. 2016;138(1):e20154635. - PubMed
    1. Gardner A, Kay-Lambkin F, Stanwell P, et al. A systematic review of diffusion tensor imaging findings in sports-related concussion. J Neurotrauma. 2012;29(16):2521-2538. - PubMed
    1. Gardner A, Iverson GL, McCrory P. Chronic traumatic encephalopathy in sport: a systematic review. Br J Sports Med. 2014;48(2):84-90. - PubMed
    1. McCrory P, Meeuwisse W, Dvořák J, et al. Consensus statement on concussion in sport-the 5th international conference on concussion in sport held in Berlin, October 2016. Br J Sports Med. 2017;51(11):838-847. doi: 10.1136/bjsports-2017-097699 - DOI - PubMed
    1. West TA, Marion DW. Current recommendations for the diagnosis and treatment of concussion in sport: a comparison of three new guidelines. J Neurotrauma. 2014;31(2):159-168. - PMC - PubMed