Observer variability of absolute and relative thrombus density measurements in patients with acute ischemic stroke

Abstract

Introduction: Thrombus density may be a predictor for acute ischemic stroke treatment success. However, only limited data on observer variability for thrombus density measurements exist. This study assesses the variability and bias of four common thrombus density measurement methods by expert and non-expert observers.

Methods: For 132 consecutive patients with acute ischemic stroke, three experts and two trained observers determined thrombus density by placing three standardized regions of interest (ROIs) in the thrombus and corresponding contralateral arterial segment. Subsequently, absolute and relative thrombus densities were determined using either one or three ROIs. Intraclass correlation coefficient (ICC) was determined, and Bland-Altman analysis was performed to evaluate interobserver and intermethod agreement. Accuracy of the trained observer was evaluated with a reference expert observer using the same statistical analysis.

Results: The highest interobserver agreement was obtained for absolute thrombus measurements using three ROIs (ICCs ranging from 0.54 to 0.91). In general, interobserver agreement was lower for relative measurements, and for using one instead of three ROIs. Interobserver agreement of trained non-experts and experts was similar. Accuracy of the trained observer measurements was comparable to the expert interobserver agreement and was better for absolute measurements and with three ROIs. The agreement between the one ROI and three ROI methods was good.

Conclusion: Absolute thrombus density measurement has superior interobserver agreement compared to relative density measurement. Interobserver variation is smaller when multiple ROIs are used. Trained non-expert observers can accurately and reproducibly assess absolute thrombus densities using three ROIs.

Keywords: Brain ischemia; Computed tomography; Observer agreements; Thromboembolism; X-ray.

Fig. 1

Illustration of the thrombus and contralateral ROI placements on registered NCCT (top) and CTA (bottom). The white arrows are indicating the locations of the thrombus ROIs (blue spheres) and the contralateral ROIs (green spheres)