Diagnosis of Sports-Related Concussion Using Symptom Report or Standardized Assessment of Concussion

Abstract

Importance: The Sports Concussion Assessment Tool-5 (SCAT5) has been recommended for concussion evaluation and utilizes both a subjective reported symptom grading scale and objective measures of concussion including a cognitive evaluation: the Standardized Assessment of Concussion (SAC). The SAC includes testing for orientation, immediate memory, concentration, and delayed recall; a 10-word list is used to assess immediate memory and delayed recall.

Objective: To determine the diagnostic accuracy of components of the SCAT5 and to provide a framework for clinical interpretation.

Design, setting, and participants: This prospective case-control study of National Collegiate Athletic Association Division I athletes from any sport was conducted from July 2020 to December 2022 at 4 universities. Athletes completed baseline SCAT5 testing using the 10-word list. When an athlete presented acutely with suspected concussion (sideline or within 2 days), the tests were repeated. If a concussion was diagnosed, a control athlete underwent the same tests. Controls were identified and matched on comorbid conditions, sex and gender, sport, season, and baseline scores. Data analysis was conducted from August to October 2023.

Main outcomes and measures: The primary outcomes were area under the receiver operating characteristic curve (AUC), sensitivity, specificity, positive and negative predictive value, and test-retest reliability of the symptom score; symptom severity score; the total SAC score; and the orientation, immediate memory, concentration, and delayed memory subcomponent scores on the SCAT5 compared with clinical diagnosis of concussion.

Results: Baseline and postinjury data were collected on 92 athletes with concussion and 92 matched control athletes (96 men [52%] and 88 women [48%]; 110 who played a sport other than football [59%]). Diagnostic utility was considered excellent for symptom score (AUC, 0.93; 95% CI, 0.89-0.96) and symptom severity score (AUC, 0.94; 95% CI, 0.90-0.97). An increase of 2 points on the symptom score was associated with a sensitivity of 86% (95% CI, 78%-92%), specificity of 80% (95% CI, 70%-87I%), and positive predictive value of 81% (95% CI, 72%-88%). The total SAC score had poor to fair diagnostic utility (AUC, 0.70; 95% CI, 0.63-0.77); however, 41 athletes with concussion (45%) had a total SAC score at or above their baseline score (ie, within normal limits). The diagnostic utility was poor to fair for immediate memory (AUC, 0.68, 95%CI, 0.61-0.75) and delayed recall (AUC, 0.69; 95% CI, 0.62-0.77) and not useful for orientation (AUC, 0.49; 95% CI, 0.43-0.56) and concentration (AUC, 0.52 95% CI, 0.44-0.61). Test-retest reliability was fair for total SAC and poor for immediate memory and delayed recall, orientation, and concentration.

Conclusions and relevance: In this case-control study of the diagnostic accuracy of reported symptoms and the SAC, reported symptoms were the most accurate indicator of concussion while the 10-word SAC had limited sensitivity. These findings suggest that understanding the properties of the SAC is important when making the diagnosis of concussion.

Figure.. Receiver-Operator Characteristic Curves

The figure shows receiver-operator characteristic curves for total SAC, total symptoms, and symptom severity (A); orientation, immediate memory, concentration, and delayed recall (B); immediate evaluation (≤2 hours), evaluation between 2 and 8 hours, evaluation between 8 and 24 hours, and evaluation between 24 and 48 hours (C); and total SAC, total symptoms, and total SAC + total symptoms (D). AUC indicates area under the receiver-operator characteristic curve; SAC, Standardized Assessment of Concussion.