Validity of Research Based on Publicly Obtained Data in Sports Medicine: A Quantitative Assessment of Concussions in the National Football League
- PMID: 37029663
- PMCID: PMC10293571
- DOI: 10.1177/19417381231167333
Validity of Research Based on Publicly Obtained Data in Sports Medicine: A Quantitative Assessment of Concussions in the National Football League
Abstract
Context: Numerous researchers have leveraged publicly available internet sources to publish clinical research concerning incidence and recovery from injuries in National Football League (NFL) players.
Objective: This study aims to (1) provide a comprehensive systematic review of all publicly obtained data studies (PODS) regarding concussions in NFL athletes and (2) quantify the percentage of injuries identified by these studies in comparison with published concussion data from the NFL injury database.
Study selection: A systematic review was conducted in accordance with PRISMA guidelines to identify all published studies utilizing publicly obtained data regarding concussions in NFL athletes.
Study design: Systematic review.
Level of evidence: Level 4.
Data extraction: Manuscript details, factors related to the athletes of interest (eg, study period, positions included), and results (eg, concussion rate, number of total concussions, return-to-play data) were extracted independently by 2 authors. Results were compared with incident concussions reported from 2015 to 2019 by each medical staff member to the NFL database linked to the League's electronic health record (EHR).
Results: A total of 20 concussion-focused manuscripts based on PODS were identified from 2014 to 2020. PODS captured between 20% and 90% of concussions (mean, 70%) reported by medical staff to the injury database. PODS reported that 55% of concussions occurred on offensive plays, 45% on defensive plays and <1% occurred during special teams plays, compared with 44%, 37%, and 18%, respectively, as indicated by published data from the NFL injury database. When analyzed by position groups, running backs and quarterbacks comprised the most over-represented positions concussed in PODS, while offensive linemen, defensive backs, and linebackers comprised the most under-represented positions.
Conclusion: PODS captured approximately 70% of concussions reported by NFL medical staff to the NFL injury database. There is heterogeneity in the degree to which PODS were able to identify concussions, with a bias toward concussions among players at higher profile positions.
Keywords: National Football League; concussion; epidemiology; team sports.
Conflict of interest statement
The following authors declared potential conflicts of interest: C.M. is a full-time employee of IQVIA, which is a paid research consultant of the National Football League. G.S.S. is a paid consultant for the National Football League. M.J.M. is a paid consultant for Pacira Pharamceuticals and Heron Therapeutics, and received educational support from Elite Orthopaedics/Apollo Orthopaedics and Arthrex.
Figures


Similar articles
-
Validity of Research Based on Public Data in Sports Medicine: A Quantitative Assessment of Anterior Cruciate Ligament Injuries in the National Football League.Am J Sports Med. 2022 May;50(6):1717-1726. doi: 10.1177/03635465211015435. Epub 2021 Jun 24. Am J Sports Med. 2022. PMID: 34166138
-
Epidemiology of Concussion in the National Football League, 2015-2019.Sports Health. 2021 Sep-Oct;13(5):423-430. doi: 10.1177/19417381211011446. Epub 2021 Apr 19. Sports Health. 2021. PMID: 33872087 Free PMC article.
-
Concussion Nondisclosure During Professional Career Among a Cohort of Former National Football League Athletes.Am J Sports Med. 2018 Jan;46(1):22-29. doi: 10.1177/0363546517728264. Epub 2017 Sep 25. Am J Sports Med. 2018. PMID: 28942673
-
Concussion Incidence in Professional Football: Position-Specific Analysis With Use of a Novel Metric.Orthop J Sports Med. 2016 Jan 27;4(1):2325967115622621. doi: 10.1177/2325967115622621. eCollection 2016 Jan. Orthop J Sports Med. 2016. PMID: 26848481 Free PMC article.
-
American Medical Society for Sports Medicine position statement: concussion in sport.Br J Sports Med. 2013 Jan;47(1):15-26. doi: 10.1136/bjsports-2012-091941. Br J Sports Med. 2013. PMID: 23243113 Review.
Cited by
-
Health consultations at a performing arts health centre among classical music students based on electronic health record data: a cross-sectional study.Front Psychol. 2024 Apr 2;15:1245505. doi: 10.3389/fpsyg.2024.1245505. eCollection 2024. Front Psychol. 2024. PMID: 38629032 Free PMC article.
-
Publicly available data sources in sport-related concussion research: a caution for missing data.Inj Epidemiol. 2024 Jan 30;11(1):3. doi: 10.1186/s40621-024-00484-7. Inj Epidemiol. 2024. PMID: 38291513 Free PMC article.
-
Ensuring Scientific Rigor in Research: Why Sports-Related Publicly Obtained Data Fall Short.Foot Ankle Orthop. 2025 May 20;10(2):24730114251337282. doi: 10.1177/24730114251337282. eCollection 2025 Apr. Foot Ankle Orthop. 2025. PMID: 40400647 Free PMC article. No abstract available.
References
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Medical
Research Materials