Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2010 Dec;97(3):572-8.
doi: 10.1016/j.radonc.2010.06.009. Epub 2010 Aug 11.

Tools for consensus analysis of experts' contours for radiotherapy structure definitions

Rawan Allozi  1 , X Allen Li, Julia White, Aditya Apte, An Tai, Jeff M Michalski, Walter R Bosch, Issam El Naqa
Affiliations

Tools for consensus analysis of experts' contours for radiotherapy structure definitions

Rawan Allozi et al. Radiother Oncol. 2010 Dec.

Abstract

Background and purpose: To demonstrate and examine the ability of a newly developed software tool to estimate and analyze consensus contours from manually created contours by expert radiation oncologists.

Material and methods: Several statistical methods and a graphical user interface were developed. For evaluation purposes, we used three breast cancer CT scans from the RTOG Breast Cancer Atlas Project. Specific structures were contoured before and after the experts' consensus panel meeting. Differences in the contours were evaluated qualitatively and quantitatively by the consensus software tool. Estimates of consensus contours were analyzed for the different structures and Dice-similarity and Dice-Jaccard coefficients were used for comparative evaluation.

Results: Based on kappa statistics, highest levels of agreement were seen in the left-breast, lumpectomy, and heart. Significant improvements between pre- and post-consensus contours were seen in delineation of the chestwall and breasts while significant variations were noticed in the supraclavicular and internal mammary nodes. Dice calculations for all pre-consensus STAPLE estimations and final consensus panel structures reached 0.80 or greater for the heart, left/right-breast, case-A lumpectomy, and chestwall.

Conclusions: Using the consensus software tool incorporating STAPLE estimates provided the ability to create contours similar to the ones generated by expert physicians.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Workflow of the consensus tool.
Figure 2
Figure 2
(a) Case-A pre-consensus contours of the heart, left-breast, and lumpectomy with 95% STAPLE estimations (red) (b) Case-A post-consensus contours of the heart, left-breast, and lumpectomy with final consensus panel contours (red) (c) Case-B pre-consensus contours of the chestwall and supraclavicular nodes with 95% STAPLE estimations (red) (d) Case-B post-consensus contours of the chestwall and SVC nodes with final consensus panel contours (red) (e) Case-C pre-consensus contours of the right-breast, axillary apex, and SVC nodes with 95% STAPLE estimations (red) (f) Case-C post-consensus contours of the right breast, axillary apex, and SVC nodes with final consensus panel contours (red).
Figure 3
Figure 3
Comparison analysis of case-A using DSC and DJC with pre-consensus at different confidence levels and final consensus panel contours.
Figure 4
Figure 4
Comparison analysis of case-B using DSC and DJC with pre-consensus at different confidence levels and final consensus panel contours.
Figure 5
Figure 5
Comparison analysis of case-C using DSC and DJC with pre-consensus at different confidence levels and final consensus panel contours.
See this image and copyright information in PMC

References

    1. Price GJ, Moore CJ. A method to calculate coverage probability from uncertainties in radiotherapy via a statistical shape model. Phys Med Biol. 2007;52:1947–1965. - PubMed
    1. van de Water TA, Bijl HP, Westerlaan HE, Langendijk JA. Delineation guidelines for organs at risk involved in radiation-induced salivary dysfunction and xerostomia. Radiother Oncol. 2009;93:545–552. - PubMed
    1. van Mourik AM, Elkhuizen PH, Minkema D, Duppen JC, van Vliet-Vroegindeweij C. Multiinstitutional study on target volume delineation variation in breast radiotherapy in the presence of guidelines. Radiother Oncol. 2010;94:286–291. - PubMed
    1. Vorwerk H, Beckmann G, Bremer M, et al. The delineation of target volumes for radiotherapy of lung cancer patients. Radiother Oncol. 2009;91:455–460. - PubMed
    1. International Commission on Radiation Units and Measurements (ICRU) Prescribing, Recording, and Reporting Photon Beam Therapy (Supplement to ICRU Report 50) Bethesda, MD: 1999.

Publication types