Testing the effect of computer-assisted detection on interpretive performance in screening mammography

Abstract

Objective: The objective of our study was to test whether the use of computer-assisted detection (CAD) improves sensitivity at no cost to specificity for the detection of breast cancer and enables more accurate assessment of fatty breast tissue compared with dense breast tissue.

Materials and methods: We created a stratified random sample of screening mammograms weighted with difficult cases split evenly among women with fatty breast tissue and those with dense breast tissue: 114 patients were cancer-free, 114 had cancer 1 year after screening, and 113 had cancer 13-24 months after screening. In test settings 6 months apart, 19 community radiologists interpreted 341 bilateral screening mammograms with and without CAD. We compared the sensitivity and specificity using regression models adjusting for repeated measures.

Results: CAD assistance did not affect overall sensitivity (cancer by 1 year: 63.2% without CAD and 62.0% with CAD; cancer in 13-24 months: 33.5% without CAD and 32.3% with CAD), but its effect differed for visible masses that were marked by CAD compared with those that were not marked by CAD (hereafter referred to as "unmarked"). CAD was associated with improved sensitivity for marked visible cancers and decreased sensitivity for unmarked visible masses; the sensitivities without and with CAD, respectively, were as follows: marked cancer by 1 year, 82.7% versus 83.1%; marked cancer in 13-24 months, 44.2% versus 57.9%; unmarked cancer by 1 year, 37.4% versus 30.1%; unmarked cancer in 13-24 months, 29.7% versus 23.0% (p < 0.03 for both interactions between assistance and CAD marking for cancer by 1 year and cancer in 13-24 months). CAD marked 77% (70/91) of the visible cancers by 1 year and 67.3% (37/55) of the visible cancers in 13-24 months. CAD marked more visible calcified lesions (86%) than masses and asymmetric densities (67%) (p < 0.05). Overall specificity was 72% without and 75% with CAD (p < 0.02). CAD had a greater effect on both specificity (p < 0.02) and sensitivity (p < 0.03) among radiologists who interpret more than 50 mammograms per week. The results were the same for fatty breast tissue and dense breast tissue.

Conclusion: In this experiment, CAD increased interpretive specificity but did not affect sensitivity because visible noncalcified lesions that went unmarked by CAD were less likely to be assessed as abnormal by radiologists. Breast density did not affect CAD's performance.