Interobserver variability in ultrasound assessment of thyroid nodules

Abstract

The first diagnostic tool for thyroid disease management is ultrasound. Despite its importance, ultrasound is an extremely subjective procedure that requires a high level of performance skill. Few studies have assessed thyroid ultrasound performance and its effectiveness, particularly the variability between observers in the assessment of ultrasound images. This study evaluated the variability in ultrasound assessments and diagnoses of thyroid nodules between 2 radiologists. In this retrospective study, 75 thyroid nodules in 39 patients were reviewed by 2 experienced radiologists. The nodule composition, margin, shape, calcification, and vasculitis were determined using echogenicity. The study evaluation included these 5 assessments and the final diagnosis. Interobserver variation was determined using Cohen kappa statistics. The interobserver agreements in the interpretation of echogenicity, shape, and margin were fair (κ = 0.21-0.40), whereas there were substantial agreements for vascularity and calcification (κ = 0.62-0.78). The agreements between the observers for individual ultrasound features in this study were the highest for vascularity and the presence/absence of calcification. The interobserver reproducibility for thyroid nodule ultrasound reporting was adequate, but the diagnostic evaluation ability of the observers was inconsistent. The variability in the interpretation of sonographic features could influence the level of suspicion of thyroid malignancy. This study emphasizes the need for consistency in the training of sonographic interpretation of thyroid nodules, particularly for echogenicity, shape, and margin.

Figure 1.

A 56-year-old woman with papillary thyroid carcinoma. Ultrasound images (A and B) show a heterogeneous nodule in the right thyroid lobe with high vascularity. This nodule was interpreted similarly by both observers and has a substantial agreement for US features.