Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Jul;49(7):4780-4793.
doi: 10.1002/mp.15683. Epub 2022 May 4.

Development of a Monte Carlo based robustness calculation and evaluation tool

Affiliations

Development of a Monte Carlo based robustness calculation and evaluation tool

Hannes A Loebner et al. Med Phys. 2022 Jul.

Abstract

Background: Evaluating plan robustness is a key step in radiotherapy.

Purpose: To develop a flexible Monte Carlo (MC)-based robustness calculation and evaluation tool to assess and quantify dosimetric robustness of intensity-modulated radiotherapy (IMRT) treatment plans by exploring the impact of systematic and random uncertainties resulting from patient setup, patient anatomy changes, and mechanical limitations of machine components.

Methods: The robustness tool consists of two parts: the first part includes automated MC dose calculation of multiple user-defined uncertainty scenarios to populate a robustness space. An uncertainty scenario is defined by a certain combination of uncertainties in patient setup, rigid intrafraction motion and in mechanical steering of the following machine components: angles of gantry, collimator, table-yaw, table-pitch, table-roll, translational positions of jaws, multileaf-collimator (MLC) banks, and single MLC leaves. The Swiss Monte Carlo Plan (SMCP) is integrated in this tool to serve as the backbone for the MC dose calculations incorporating the uncertainties. The calculated dose distributions serve as input for the second part of the tool, handling the quantitative evaluation of the dosimetric impact of the uncertainties. A graphical user interface (GUI) is developed to simultaneously evaluate the uncertainty scenarios according to user-specified conditions based on dose-volume histogram (DVH) parameters, fast and exact gamma analysis, and dose differences. Additionally, a robustness index (RI) is introduced with the aim to simultaneously evaluate and condense dosimetric robustness against multiple uncertainties into one number. The RI is defined as the ratio of scenarios passing the conditions on the dose distributions. Weighting of the scenarios in the robustness space is possible to consider their likelihood of occurrence. The robustness tool is applied on IMRT, a volumetric modulated arc therapy (VMAT), a dynamic trajectory radiotherapy (DTRT), and a dynamic mixed beam radiotherapy (DYMBER) plan for a brain case to evaluate the robustness to uncertainties of gantry-, table-, collimator angle, MLC, and intrafraction motion. Additionally, the robustness of the IMRT, VMAT, and DTRT plan against patient setup uncertainties are compared. The robustness tool is validated by Delta4 measurements for scenarios including all uncertainty types available.

Results: The robustness tool performs simultaneous calculation of uncertainty scenarios, and the GUI enables their fast evaluation. For all evaluated plans and uncertainties, the planning target volume (PTV) margin prevented major clinical target volume (CTV) coverage deterioration (maximum observed standard deviation of D 98 % CTV $D98{\% _{{\rm{CTV}}}}$ was 1.3 Gy). OARs close to the PTV experienced larger dosimetric deviations (maximum observed standard deviation of D 2 % chiasma $D2{\% _{{\rm{chiasma}}}}$ was 14.5 Gy). Robustness comparison by RI evaluation against patient setup uncertainties revealed better dosimetric robustness of the VMAT and DTRT plans as compared to the IMRT plan. Delta4 validation measurements agreed with calculations by >96% gamma-passing rate (3% global/2 mm).

Conclusions: The robustness tool was successfully implemented. Calculation and evaluation of uncertainty scenarios with the robustness tool were demonstrated on a brain case. Effects of patient and machine-specific uncertainties and the combination thereof on the dose distribution are evaluated in a user-friendly GUI to quantitatively assess and compare treatment plans and their robustness.

Keywords: Monte Carlo; plan evaluation; robustness (to patient and machine-related uncertainties).

PubMed Disclaimer

Conflict of interest statement

The authors have no relevant conflicts of interest to disclose.

Figures

FIGURE 1
FIGURE 1
Workflow for the robustness tool. Preparation: The treatment plan is created in a treatment planning system (TPS) based on the CT and structure set. To include logfile and time‐resolved information, the created treatment plan must be delivered first and the logfile recorded. Part 1, Calculation: user defines the robustness space in terms of uncertainty scenarios. Subsequently, the respective dose distributions incorporating the desired uncertainties are calculated (see Section 2.4). Part 2, Evaluation: evaluation of the dose distributions of the robustness space (see Section 2.5)
FIGURE 2
FIGURE 2
Right‐sided glioblastoma brain case. The PTV is shown in red, the OARs in color
FIGURE 3
FIGURE 3
Main GUI of the robustness evaluation tool. Top left, 1: DVH viewer with DVH bands of all scenarios of the robustness space of the DTRT plan (Table 2, application 8). Top right, 2: Robustness map displaying 2D plane of the robustness space and pop‐up metric window to change the metric if needed, Bottom left, 3: Axes selection window to select a plane in the robustness space for closer inspection. Bottom left, 4: Specification of parameters gamma passing rate calculation. Bottom right, 5: Conditions meter for evaluating structure‐specific conditions; 6 and 7: Open pop‐up windows: conditions list (definition of robustness conditions), dose window (shows dose distribution and dose difference), and statistics window (summarizes key quantities of the robustness space)
FIGURE 4
FIGURE 4
Conditions list opened by Figure 3, number 6. 1: Select structure, 2: Select parameter, 3: Add to evaluation
FIGURE 5
FIGURE 5
The dose window (opened by Figure 3, number 6) displays dose distributions superimposed on the CT. Structures are indicated by the fine lines (PTV and CTV in red and orange here). 1: Dose of current scenario. 2: Reference dose. 3: Dose difference between reference and current doses, includes a user‐defined threshold to visualize relevant dose ranges. 4: View control to switch through transversal, coronal, and sagittal planes. The red cross serves as a guideline when switching planes from transversal (shown here) to coronal or sagittal
FIGURE 6
FIGURE 6
Statistics window (opened by Figure 3, number 7) displays key quantities and robustness index (RI) for all selected structures in the current evaluation range
FIGURE 7
FIGURE 7
1: Robustness map of robustness space with SD, with scenarios at every other combination (white dots). 2: Robustness map of robustness space with GD. 3: Zoom functionality: doubles resolution of scenarios in this slice and interpolates on all inserted scenarios
FIGURE 8
FIGURE 8
DVH bands for the IMRT, VMAT, and DTRT plans, including random uncertainties G(0,σx,y,z=0,0.1,0.2,0.3,0.5 cm), in patient setup

References

    1. Hernandez V, Hansen CR, Widesott L, et al. What is plan quality in radiotherapy? The importance of evaluating dose metrics, complexity, and robustness of treatment plans. Radiother Oncol. 2020;153:26‐33. 10.1016/j.radonc.2020.09.038 - DOI - PubMed
    1. Schmidhalter D, Malthaner M, Born EJ, et al. Assessment of patient setup errors in IGRT in combination with a six degrees of freedom couch. Z Med Phys. 2014;24(2):112‐122. 10.1016/j.zemedi.2013.11.002 - DOI - PubMed
    1. Kerns JR, Childress N, Kry SF. A multi‐institution evaluation of MLC log files and performance in IMRT delivery. Radiat Oncol. 2014;9(1):176. 10.1186/1748-717X-9-176 - DOI - PMC - PubMed
    1. Yock AD, Mohan R, Flampouri S, et al. Robustness analysis for external beam radiation therapy treatment plans: describing uncertainty scenarios and reporting their dosimetric consequences. Pract Radiat Oncol. 2019;9(4):200‐207. 10.1016/j.prro.2018.12.002 - DOI - PMC - PubMed
    1. Teoh M, Clark CH, Wood K, Whitaker S, Nisbet A. Volumetric modulated arc therapy: a review of current literature and clinical use in practice. Br J Radiol. 2011;84(1007):967‐996. 10.1259/bjr/22373346 - DOI - PMC - PubMed

Grants and funding