Experience of Implementing Deep Learning-Based Automatic Contouring in Breast Radiation Therapy Planning: Insights From Over 2000 Cases

Abstract

Purpose: This study evaluated the impact and clinical utility of an auto-contouring system for radiation therapy treatments.

Methods and materials: The auto-contouring system was implemented in 2019. We evaluated data from 2428 patients who underwent adjuvant breast radiation therapy before and after the system's introduction. We collected the treatment's finalized contours, which were reviewed and revised by a multidisciplinary team. After implementation, the treatment contours underwent a finalization process that involved manual review and adjustment of the initial auto-contours. For the preimplementation group (n = 369), auto-contours were generated retrospectively. We compared the auto-contours and final contours using the Dice similarity coefficient (DSC) and the 95% Hausdorff distance (HD95).

Results: We analyzed 22,215 structures from final and corresponding auto-contours. The final contours were generally larger, encompassing more slices in the superior or inferior directions. Among organs at risk (OAR), the heart, esophagus, spinal cord, and contralateral breast demonstrated significantly increased DSC and decreased HD95 postimplementation (all P < .05), except for the lungs, which presented inaccurate segmentation. Among target volumes, CTVn_L2, L3, L4, and the internal mammary node showed increased DSC and decreased HD95 postimplementation (all P < .05), although the increase was less pronounced than the OAR outcomes. The analysis also covered factors contributing to significant differences, pattern identification, and outlier detection.

Conclusions: In our study, the adoption of an auto-contouring system was associated with an increased reliance on automated settings, underscoring its utility and the potential risk of automation bias. Given these findings, we underscore the importance of considering the integration of stringent risk assessments and quality management strategies as a precautionary measure for the optimal use of such systems.