Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Jun;54(6):1587-1592.
doi: 10.1161/STROKEAHA.122.042145. Epub 2023 May 8.

Interobserver Agreement on Intracranial Hemorrhage on Magnetic Resonance Imaging in Patients With Ischemic Stroke

Nadinda A M van der Ende  1   2 , Sven P R Luijten  1   2 , Leo Kluijtmans  3 , Alida A Postma  4 , Sandra A Cornelissen  2 , Antonius M G van Hattem  2 , Geert J Lycklama À Nijeholt  5 , Reinoud P H Bokkers  6 , Lars Thomassen  7 , Ulrike Waje-Andreassen  7 , Nicola Logallo  8 , Serge Bracard  9 , Benjamin Gory  9 , Bob Roozenbeek  1   2 , Diederik W J Dippel  1 , Aad van der Lugt  2
Affiliations

Interobserver Agreement on Intracranial Hemorrhage on Magnetic Resonance Imaging in Patients With Ischemic Stroke

Nadinda A M van der Ende et al. Stroke. 2023 Jun.

Abstract

Background: The Heidelberg Bleeding Classification, developed for computed tomography, is also frequently used to classify intracranial hemorrhage (ICH) on magnetic resonance imaging. Additionally, the presence of any ICH is frequently used as (safety) outcome measure in clinical stroke trials that evaluate acute interventions. We assessed the interobserver agreement on the presence of any ICH and the type of ICH according to the Heidelberg Bleeding Classification on magnetic resonance imaging in patients treated with reperfusion therapy.

Methods: We used 300 magnetic resonance imaging scans including susceptibility-weighted imaging or T2*-weighted gradient echo imaging of ischemic stroke patients within 1 week after reperfusion therapy. Six observers, blinded to clinical characteristics except for suspected location of the infarction, independently rated ICH according to the Heidelberg Bleeding Classification in random pairs. Percent agreement and Cohen's kappa (κ) were estimated for the presence of any ICH (yes/no), and for agreement on the Heidelberg Bleeding Classification class 1 and 2. For the Heidelberg Bleeding Classification class 1 and 2, weighted κ was estimated to take the degree of disagreement into account.

Results: In 297 of 300 scans, the quality of scans was sufficient to score ICH. Observers agreed on the presence or absence of any ICH in 264 of 297 scans (88.9%; κ 0.78 [95% CI, 0.71-0.85]). There was agreement on the Heidelberg Bleeding Classification class 1 and 2 and no ICH in class 1 and 2 in 226 of 297 scans (76.1%; κ 0.63 [95% CI, 0.56-0.69]; weighted κ 0.90 [95% CI, 0.87-0.93]).

Conclusions: The presence of any ICH can be reliably scored on magnetic resonance imaging and can, therefore, be used as (safety) outcome measure in clinical stroke trials that evaluate acute interventions. Agreement of ICH types according to the Heidelberg Bleeding Classification is substantial and disagreements are small.

Keywords: interobserver agreement; intracranial hemorrhage; ischemic stroke; magnetic resonance imaging.

PubMed Disclaimer

Conflict of interest statement

Disclosures Drs Dippel and van der Lugt report funding from the Dutch Heart Foundation, Brain Foundation Netherlands, The Netherlands Organization for Health Research and Development, Health Holland Top Sector Life Sciences and Health, and unrestricted grants from Penumbra Inc., Stryker, Medtronic, Thrombolytic Science, LLC and Cerenovus for research, all paid to institution. Dr van der Lugt additionally reports grants from Siemens Medical Solutions USA, Inc, Philips, and GE Healthcare. Dr Postma reports institutional grants from Siemens healthineers and Bayer healthcare. Dr Waje-Andreassen report funding from “Helse-Vest” and from the University of Bergen for research projects. The other authors report no conflicts.

Publication types

LinkOut - more resources