Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2019 May;26(5):552-555.
doi: 10.1111/acem.13665. Epub 2018 Dec 28.

Inter-rater Reliability of the HEART Score

Colin A Gershon  1 , Annick N Yagapen  1 , Amber Lin  1 , David Yanez  1 , Benjamin C Sun  1
Affiliations

Inter-rater Reliability of the HEART Score

Colin A Gershon et al. Acad Emerg Med. 2019 May.

Abstract

Background: The HEART score is a risk stratification tool for suspected acute coronary syndrome and contains several subjective components. A single previous study found good inter-rater reliability. Our objective was to assess the inter-rater reliability of the HEART score in an external prospective cohort.

Methods: We prospectively collected paired, independent physician ratings of the HEART score for patients > 20 years of age presenting to the emergency department with chest pain for which an ECG and troponin were ordered. Two emergency physicians independently provided HEART scores for each unique patient. The primary outcome, the HEART score, was dichotomized by low risk (0–3) vs non- low risk (4–10). Additional outcomes included the HEART score across the entire scale (0–10) and subcomponents of the HEART score (e.g., history, electrocardiogram, risk factors; score of 0–2 for each). We calculated kappa statistics and percent agreement for all outcomes.

Results: We collected paired physician HEART score ratings on 311 patients from October 2017 to April 2018. The mean HEART score was 3.5 (SD 1.9). About half (49.2%) of our patients had a HEART score of ≤ 3, and 50.8% had a HEART score > 3. The kappa score for “low risk” (HEART ≤ 3) was 0.68 (95%CI: 0.60 – 0.77). There was 84.2% agreement between physicians on this variable.

Conclusions: Our study demonstrates there is substantial inter-rater reliability among emergency department physicians in identifying patients at low risk of acute coronary syndrome using the HEART score.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: None

Figures

None
Point estimates and 95% confidence intervals for agreement statistics: kappa statistic for HEART (moderate risk and higher, 4+) and weighted kappa statistics for history, EKG, risk factors and troponin
See this image and copyright information in PMC

References

    1. Vedanthan R, Seligman B, Fuster V. Global perspective on acute coronary syndrome: a burden on the young and poor. Circ Res 2014;114:1959–75. - PMC - PubMed
    1. CDC. National Hospital Ambulatory Medical Care Survey: 2010 Emergency Department Summary Tables 2010.
    1. Amsterdam EA, Wenger NK, Brindis RG, et al. 2014 AHA/ACC Guideline for the Management of Patients with Non-ST-Elevation Acute Coronary Syndromes: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol 2014;64:e139–e228. - PubMed
    1. Six AJ, Cullen L, Backus BE, et al. The HEART score for the assessment of patients with chest pain in the emergency department: a multinational validation study. Critical pathways in cardiology 2013;12:121–6. - PubMed
    1. Backus BE, Six AJ, Kelder JC, et al. A prospective validation of the HEART score for chest pain patients at the emergency department. International journal of cardiology 2013;168:2153–8. - PubMed

Publication types