Performance variations among clinically available deformable image registration tools in adaptive radiotherapy - how should we evaluate and interpret the result?

A fully automated machine-learning-based workflow for radiation treatment planning in prostate cancer

Introduction

The integration of artificial intelligence into radiotherapy planning for prostate cancer has demonstrated promise in enhancing efficiency and consistency. In this study, we assess the clinical feasibility of a fully automated machine learning (ML)-based "one-click" workflow that combines ML-based segmentation and treatment planning. The proposed workflow was designed to create a clinically acceptable radiotherapy plan within the inter-observer variation of conventional plans.

Methods

We evaluated the fully-automated workflow on five low-risk prostate cancer patients treated with external beam radiotherapy and compared the results with conventional optimized and inverse planned radiotherapy plans based on the contours of six different experienced radiation oncologists. Both qualitative and quantitative metrics were analyzed. Additionally, we evaluated the dose distribution of the ML-based and conventional radiation treatment plans on the different segmentations (manual vs. manual and manual vs. automation).

Results

The automatic deep-learning segmentation of the target volume revealed a close agreement between the deep-learning based and expert contours referring to Dice Similarity- and Hausdorff index. However, the deep-learning based CTVs had a significantly smaller volume than the expert CTVs (47.1 cm3 vs. 62.6 cm3). The fully automated ML-based plans provide clinically acceptable dose coverage within the range of inter-observer variability observed in the manual plans. Due to the smaller segmentation of the CTV the dose coverage of the CTV and PTV (expert contours) were significantly lower than that of the manual plans.

Conclusion

Our study indicates that the tested fully automated ML-based workflow is clinically feasible and leads to comparable results to conventional radiation treatment plans. This represents a promising step towards efficient and standardized prostate cancer treatment. Nevertheless, in the evaluated cohort, auto segmentation was associated with smaller target volumes compared to manual contours, highlighting the necessity of improving segmentation models and prospective testing of automation in radiation therapy.

Practice Patterns of Reirradiation for Brain and Spinal Tumors-An International Survey From the Reirradiation Collaborative Group (ReCOG)

PURPOSE

An international workshop was convened by the Reirradiation Collaborative Group. We conducted a survey among the invited attendants to assess practice patterns of reirradiation for central nervous system tumors.

METHODS AND MATERIALS

A web-based survey regarding central nervous system reirradiation was distributed to an international group of radiation oncologists and medical physicists via email.

RESULTS

Sixty-six respondents from 20 countries completed at least one section of the survey. The most important clinical considerations were treatment goal, degree of overlap, and cumulative dose. Among technical challenges, uncertainties in tolerance of organs at risk (OARs), tissue recovery factors (TRFs) and dose accumulation ranked the highest. Most respondents (68%) used a planning OAR volume with 0 to 3 mm margin. Highly conformal radiation techniques were preferred, including stereotactic body radiation therapy for spine (85%), intensity modulated radiation therapy for adult primary brain tumors (93%), and intensity modulated radiation therapy (100%) and proton therapy (83%) for pediatric cases. Most performed dose accumulation (65%) and evaluated cumulative biological (ie, equieffective) dose (88%). Sixty-one percent preferred rigid registration, whereas 35% used deformable registration, most commonly in pediatric cases (67%). The most frequently used α/β value for OARs was 2 Gy (76%). There was no clear consensus on OAR tolerance for any disease site. Different dose metrics were used for evaluation, including Dmax (48%) and D0.1cc (48%). Most (79%) considered time intervals between radiation courses. For adult primary brain tumors and brain metastasis, 50% and 46% recommended against reirradiation within a short interval (3-6 months). Most respondents (52%) used time dependent TRFs.

CONCLUSIONS

Among respondents, there are substantial variations in approaches to reirradiation (eg, addition of systemic therapy) and uncertainties in technical implementation (eg, OAR tolerance, TRF, and dose accumulation). Future collaborative registry-based and prospective studies should help address these uncertainties.

Adaptive radiotherapy triggering for nasopharyngeal cancer based on bayesian decision model

Objective.To develop a Bayesian decision model for adaptive radiotherapy (ART) in nasopharyngeal cancer (NPC) that balances clinical capacity of ART and inter-fraction dosimetric changes.Approach.A retrospective analysis was conducted on 84 fractions from 17 NPC patients treated with intensity-modulated radiotherapy using a CT-Linac. Fourteen patients were included for the model construction, and three for validation. Daily diagnostic-level CT images were rigidly registered to the planning CT for regions of interest and treatment plan propagation. The propagated contours were reviewed and refined by radiation oncologists. For each daily CT, percentage differences in 27 dose metrics were compared to the original plan. Composite scores of dose differences were developed using factor analysis on planning target volume (PTV) and organ at risk (OAR) dose metrics. These scores were integrated into a Bayesian decision model, which incorporated a subjective trigger rate to determine the initiation of ART.Main results.The model generated individualized re-plan strategies based on composite scores for PTV or OAR, with trigger rates ranging from 10% to 60%. In the validation with 14 fractions, significant anatomical and dosimetric variations were identified. At a 30% trigger rate, only one fraction was misclassified.Significance.It is feasible to employ a Bayesian decision model for ART, merging subjective clinical insights with objective dosimetric data to refine re-planning decisions.

Evaluation of cumulative dose distributions from external beam radiation therapy using CT-to-CBCT deformable image registration (DIR) for cervical cancer patients

PURPOSE

To investigate dose differences between the planning CT (pCT) and dose calculated on pre-treatment verification CBCTs using DIR and dose summation for cervical cancer patients.

METHODS

Cervical cancer patients treated at our institution with 45 Gy EBRT undergo a pCT and 5 CBCTs, once every five fractions of treatment. A free-form intensity-based DIR in MIM was performed between the pCT and each CBCT using the "Merged CBCT" feature to generate an extended FOV-CBCT (mCBCT). DIR-generated bladder and rectum contours were adjusted by a physician, and dice similarity coefficients (DSC) were calculated. After deformation, the investigated doses were (1) recalculated in Eclipse using original plan parameters (ecD), and (2) deformed from planning dose (pD) using the deformation matrix in MIM (mdD). Dose summation was performed to the first week's mCBCT. Dose distributions were compared for the bladder, rectum, and PTV in terms of percent dose difference, dose volume histograms (DVHs), and gamma analysis between the calculated doses.

RESULTS

For the 20 patients, the mean DSC was 0.68 ± 0.17 for bladder and 0.79 ± 0.09 for rectum. Most patients were within 5% of pD for D2cc (19/20), Dmax (17/20), and Dmean (16/20). All patients demonstrated a percent difference > 5% for bladder V45 due to variations in bladder volume from the pCT. D90 showed fewer differences with 19/20 patients within 2% of pD. Gamma rates between pD and ecD averaged 94% for bladder and 94% for rectum, while pD and mdD exhibited slightly better performance for bladder (93%) and lower for rectum (85%).

CONCLUSION

Using DIR with weekly CBCT images, the MIM deformed dose (mdD) was found to be in close agreement with the Eclipse calculated dose (ecD). The proposed workflow should be used on a case-by-case basis when the weekly CBCT shows marked difference in organs-at-risk from the planning CT.

Clinical Experience With an Offline Adaptive Radiation Therapy Head and Neck Program: Dosimetric Benefits and Opportunities for Patient Selection

PURPOSE

The objective of this study was to develop a linear accelerator (LINAC)-based adaptive radiation therapy (ART) workflow for the head and neck that is informed by automated image tracking to identify major anatomic changes warranting adaptation. In this study, we report our initial clinical experience with the program and an investigation into potential trigger signals for ART.

METHODS AND MATERIALS

Offline ART was systematically performed on patients receiving radiation therapy for head and neck cancer on C-arm LINACs. Adaptations were performed at a single time point during treatment with resimulation approximately 3 weeks into treatment. Throughout treatment, all patients were tracked using an automated image tracking system called the Automated Watchdog for Adaptive Radiotherapy Environment (AWARE). AWARE measures volumetric changes in gross tumor volumes (GTVs) and selected normal tissues via cone beam computed tomography scans and deformable registration. The benefit of ART was determined by comparing adaptive plan dosimetry and normal tissue complication probabilities against the initial plans recalculated on resimulation computed tomography scans. Dosimetric differences were then correlated with AWARE-measured volume changes to identify patient-specific triggers for ART. Candidate trigger variables were evaluated using receiver operator characteristic analysis.

RESULTS

In total, 46 patients received ART in this study. Among these patients, we observed a significant decrease in dose to the submandibular glands (mean ± standard deviation: -219.2 ± 291.2 cGy, P < 10-5), parotids (-68.2 ± 197.7 cGy, P = .001), and oral cavity (-238.7 ± 206.7 cGy, P < 10-5) with the adaptive plan. Normal tissue complication probabilities for xerostomia computed from mean parotid doses also decreased significantly with the adaptive plans (P = .008). We also observed systematic intratreatment volume reductions (ΔV) for GTVs and normal tissues. Candidate triggers were identified that predicted significant improvement with ART, including parotid ΔV = 7%, neck ΔV = 2%, and nodal GTV ΔV = 29%.

CONCLUSIONS

Systematic offline head and neck ART was successfully deployed on conventional LINACs and reduced doses to critical salivary structures and the oral cavity. Automated cone beam computed tomography tracking provided information regarding anatomic changes that may aid patient-specific triggering for ART.

Adaptive radiotherapy for head and neck cancer: Pitfalls and possibilities from the radiation oncologist's point of view

BACKGROUND

Patients with head and neck cancer (HNC) may experience substantial anatomical changes during the course of radiotherapy treatment. The implementation of adaptive radiotherapy (ART) proves effective in managing the consequent impact on the planned dose distribution.

METHODS

This narrative literature review comprehensively discusses the diverse strategies of ART in HNC and the documented dosimetric and clinical advantages associated with these approaches, while also addressing the current challenges for integration of ART into clinical practice.

RESULTS AND CONCLUSION

Although based on mainly non-randomized and retrospective trials, there is accumulating evidence that ART has the potential to reduce toxicity and improve quality of life and tumor control in HNC patients treated with RT. However, several questions remain regarding accurate patient selection, the ideal frequency and timing of replanning, and the appropriate way for image registration and dose calculation. Well-designed randomized prospective trials, with a predetermined protocol for both image registration and dose summation, are urgently needed to further investigate the dosimetric and clinical benefits of ART.

Dosimetrically triggered adaptive radiotherapy for head and neck cancer: Considerations for the implementation of clinical protocols

PURPOSE

Defining dosimetric rules to automatically detect patients requiring adaptive radiotherapy (ART) is not straightforward, and most centres perform ad-hoc ART with no specific protocol. This study aims to propose and analyse different steps to design a protocol for dosimetrically triggered ART of head and neck (H&N) cancer. As a proof-of-concept, the designed protocol was applied to patients treated in TomoTherapy units, using their available software for daily MVCT image and dose accumulation.

METHODS

An initial protocol was designed by a multidisciplinary team, with a set of flagging criteria based only on dose-volume metrics, including two action levels: (1) surveillance (orange flag), and (2) immediate verification (red flag). This protocol was adapted to the clinical needs following an iterative process. First, the protocol was applied to 38 H&N patients with daily imaging. Automatic software generated the daily contours, recomputed the daily dose and flagged the dosimetric differences with respect to the planning dose. Second, these results were compared, by a sensitivity/specificity test, to the answers of a physician. Third, the physician, supported by the multidisciplinary team, performed a self-analysis of the provided answers and translated them into mathematical rules in order to upgrade the protocol. The upgraded protocol was applied to different definitions of the target volume (i.e. deformed CTV + 0, 2 and 4 mm), in order to quantify how the number of flags decreases when reducing the CTV-to-PTV margin.

RESULTS

The sensitivity of the initial protocol was very low, specifically for the orange flags. The best values were 0.84 for red and 0.15 for orange flags. After the review and upgrade process, the sensitivity of the upgraded protocol increased to 0.96 for red and 0.84 for orange flags. The number of patients flagged per week with the final (upgraded) protocol decreased in median by 26% and 18% for red and orange flags, respectively, when reducing the CTV-to-PTV margin from 4 to 2 mm. This resulted in only one patient flagged at the last fraction for both red and orange flags.

CONCLUSION

Our results demonstrate the value of iterative protocol design with retrospective data, and shows the feasibility of automatically-triggered ART using simple dosimetric rules to mimic the physician's decisions. Using a proper target volume definition is important and influences the flagging rate, particularly when decreasing the CTV-to-PTV margin.

Assessment of CT to CBCT contour mapping for radiomic feature analysis in prostate cancer

This study provides a quantitative assessment of the accuracy of a commercially available deformable image registration (DIR) algorithm to automatically generate prostate contours and additionally investigates the robustness of radiomic features to differing contours. Twenty-eight prostate cancer patients enrolled on an institutional review board (IRB) approved protocol were selected. Planning CTs (pCTs) were deformably registered to daily cone-beam CTs (CBCTs) to generate prostate contours (auto contours). The prostate contours were also manually drawn by a physician. Quantitative assessment of deformed versus manually drawn prostate contours on daily CBCT images was performed using Dice similarity coefficient (DSC), mean distance-to-agreement (MDA), difference in center-of-mass position (ΔCM) and difference in volume (ΔVol). Radiomic features from 6 classes were extracted from each contour. Lin’s concordance correlation coefficient (CCC) and mean absolute percent difference in radiomic feature-derived data (mean |%Δ|RF) between auto and manual contours were calculated. The mean (± SD) DSC, MDA, ΔCM and ΔVol between the auto and manual prostate contours were 0.90 ± 0.04, 1.81 ± 0.47 mm, 2.17 ± 1.26 mm and 5.1 ± 4.1% respectively. Of the 1,010 fractions under consideration, 94.8% of DIRs were within TG-132 recommended tolerance. 30 radiomic features had a CCC > 0.90 and 21 had a mean |%∆|RF < 5%. Auto-propagation of prostate contours resulted in nearly 95% of DIRs within tolerance recommendations of TG-132, leading to the majority of features being regarded as acceptably robust. The use of auto contours for radiomic feature analysis is promising but must be done with caution.

Dose Summation Strategies for External Beam Radiation Therapy and Brachytherapy in Gynecologic Malignancy: A Review from the NRG Oncology and NCTN Medical Physics Subcommittees

Definitive, nonsurgical management of gynecologic malignancies involves external beam radiation therapy (EBRT) and/or brachytherapy (BT). Summation of the cumulative dose is critical to assess the total biologic effective dose to targets and organs at risk. Cumulative dose calculation from EBRT and BT can be performed with or without image registration (IR) and biologic dose summation. Among these dose summation strategies, linear addition of dose-volume histogram (DVH) parameters without IR is the global standard for composite dose reporting. This approach stems from an era without image guidance and simple external beam and brachytherapy treatment approaches. With technological advances, EBRT and high-dose-rate BT have evolved to allow for volume-based treatment planning and delivery. Modern conformal therapeutic radiation involves volumetric or intensity modulated EBRT, capable of simultaneously treating multiple targets at different specified dose levels. Therefore, given the complexity of modern radiation treatment, the linear addition of DVH parameters from EBRT and high-dose-rate BT is challenging to represent the combined dose distribution. Deformable image registration (DIR) between EBRT and image guided brachytherapy (IGBT) data sets may provide a more nuanced calculation of multimodal dose accumulation. However, DIR is still nascent in this regard, and needs further development for accuracy and efficiency for clinical use. Biologic dose summation can combine physical dose maps from EBRT and each IGBT fraction, thereby generating a composite DVH from the biologic effective dose. However, accurate radiobiologic parameters are tissue-dependent and not well characterized. A combination of voxel-based DIR and biologic weighted dose maps may be the best approximation of dose accumulation but remains invalidated. The purpose of this report is to review dose summation strategies for EBRT and BT, including conventional equivalent dose in 2-Gy fractions dose summation without image registration, physical dose summation using 3-dimensional rigid IR and DIR, and biologic dose summation. We also provide general clinical workflows for IGBT with a focus on cervical cancer.

Difference in VMAT dose distribution for prostate cancer with/without rectal gas removal and/or adaptive replanning

We investigated differences in the volumetric-modulated arc therapy (VMAT) dose distribution in prostate cancer patients treated by rectal gas removal and/or adaptive replanning. Cone-beam computed tomography (CBCT) scans were performed daily for 22 treatments in eight prostate cancer patients with excessive rectal gas, and the CBCT images were analyzed. Rectal gas removal was performed, and irradiation was delivered after prostate matching. We compared dose-volume histograms for the daily CBCT images before and after rectal gas removal. Plan A was the original plan on CBCT images before rectal gas removal. Plan B was a single reoptimized plan on CBCT images before rectal gas removal. Plan C was the original plan on CBCT images after rectal gas removal. Plan D was a single reoptimized plan on CBCT images after rectal gas removal. D95 of the planning target volume (PTV) minus the rectum of Plan C (94.7% ± 6.6%) was significantly higher than that of Plan A (88.5% ± 10.4%). All dosimetric parameters of Plan C were improved by rectal gas removal compared with Plan A, regardless of the initial rectal gas volume. Dosimetric parameters of PTV minus the rectum of Plan B were significantly improved compared with Plan C. Additionally, the V78 of the rectal wall of Plan B (0.2% ± 0.5%) was significantly improved compared with Plan C (3.9% ± 6.3%, p = 0.003). The dosimetric parameters of Plan D were not significantly different from Plan B. The dose distribution of prostate VMAT was improved by rectal gas removal and/or adaptive replanning. An adaptive replanning on daily CBCT images might be a better method than rectal gas removal for prostate cancer patients with excessive rectal gas.

Rigid and Deformable Image Registration for Radiation Therapy: A Self-Study Evaluation Guide for NRG Oncology Clinical Trial Participation

PURPOSE

The registration of multiple imaging studies to radiation therapy computed tomography simulation, including magnetic resonance imaging, positron emission tomography-computed tomography, etc. is a widely used strategy in radiation oncology treatment planning, and these registrations have valuable roles in image guidance, dose composition/accumulation, and treatment delivery adaptation. The NRG Oncology Medical Physics subcommittee formed a working group to investigate feasible workflows for a self-study credentialing process of image registration commissioning.

METHODS AND MATERIALS

The American Association of Physicists in Medicine (AAPM) Task Group 132 (TG132) report on the use of image registration and fusion algorithms in radiation therapy provides basic guidelines for quality assurance and quality control of the image registration algorithms and the overall clinical process. The report recommends a series of tests and the corresponding metrics that should be evaluated and reported during commissioning and routine quality assurance, as well as a set of recommendations for vendors. The NRG Oncology medical physics subcommittee working group found incompatibility of some digital phantoms with commercial systems. Thus, there is still a need to provide further recommendations in terms of compatible digital phantoms, clinical feasible workflow, and achievable thresholds, especially for future clinical trials involving deformable image registration algorithms. Nine institutions participated and evaluated 4 commonly used commercial imaging registration software and various versions in the field of radiation oncology.

RESULTS AND CONCLUSIONS

The NRG Oncology Working Group on image registration commissioning herein provides recommendations on the use of digital phantom/data sets and analytical software access for institutions and clinics to perform their own self-study evaluation of commercial imaging systems that might be employed for coregistration in radiation therapy treatment planning and image guidance procedures. Evaluation metrics and their corresponding values were given as guidelines to establish practical tolerances. Vendor compliance for image registration commissioning was evaluated, and recommendations were given for future development.

A validation framework to assess performance of commercial deformable image registration in lung radiotherapy

INTRODUCTION

Deformable image registration (DIR) can play an important role in the context of adaptive radiotherapy. The AAPM Task Group 132 (TG-132) has described several quantitative measures for DIR error assessment but they can only be accurately defined when there is a ground-truth present in high-contrast regions. This work aims to set out a framework to obtain optimal results for CT-CT lung DIR in clinical setting for a commercially available system by quantifying the DIR performance in both low- and high-contrast regions.

METHODS

Five publicly available thorax datasets were used to assess the DIR quality. A "Ghost fiducial" method was implemented by windowing the contrast in a new feature provided by Varian Velocity v4.1. Target registration error (TRE) of the landmarks and Dice-similarity coefficient of the tumour were calculated at three different contrast settings to assess the algorithm in high- and low-contrast scenarios.

RESULTS

For the original unedited dataset, higher resolution DIR methods showed best performance acceptable within the recommended limit according to TG-132, when actual displacements were less than 10 mm. The relation of the actual displacement of the landmarks and TRE shows the limited capacity of the algorithm to deal with movements larger than 10 mm.

CONCLUSION

This work found the performance of DIR methods and settings available in Varian Velocity v4.1 to be a function of contrast level as well as extent of motion. This highlights the need for multiple metrics to assess different aspects of DIR performance for various applications related to low-contrast and/or high-contrast regions.

Clinical use, challenges, and barriers to implementation of deformable image registration in radiotherapy - the need for guidance and QA tools

OBJECTIVE

The aim of this study was to evaluate the current status of the clinical use of deformable image registration (DIR) in radiotherapy and to gain an understanding of the challenges faced by centres in clinical implementation of DIR, including commissioning and quality assurance (QA), and to determine the barriers faced. The goal was to inform whether additional guidance and QA tools were needed.

METHODS

A survey focussed on clinical use, metrics used, how centres would like to use DIR in the future and challenges faced, was designed and sent to 71 radiotherapy centres in the UK. Data were gathered specifically on which centres we using DIR clinically, which applications were being used, what commissioning and QA tests were performed, and what barriers were preventing the integration of DIR into the clinical workflow. Centres that did not use DIR clinically were encouraged to fill in the survey and were asked if they have any future plans and in what timescale.

RESULTS

51 out of 71 (70%) radiotherapy centres responded. 47 centres reported access to a commercial software that could perform DIR. 20 centres already used DIR clinically, and 22 centres had plans to implement an application of DIR within 3 years of the survey. The most common clinical application of DIR was to propagate contours from one scan to another (19 centres). In each of the applications, the types of commissioning and QA tests performed varied depending on the type of application and between centres. Some of the key barriers were determining when a DIR was satisfactory including which metrics to use, and lack of resources.

CONCLUSION

The survey results highlighted that there is a need for additional guidelines, training, better tools for commissioning DIR software and for the QA of registration results, which should include developing or recommending which quantitative metrics to use.

ADVANCES IN KNOWLEDGE

This survey has given a useful picture of the clinical use and lack of use of DIR in UK radiotherapy centres. The survey provided useful insight into how centres commission and QA DIR applications, especially the variability among centres. It was also possible to highlight key barriers to implementation and determine factors that may help overcome this which include the need for additional guidance specific to different applications, better tools and metrics.

Validation of accuracy deformable image registration contour propagation using a benchmark virtual HN phantom dataset

Virtual anatomic phantoms offer precise voxel mapping of the variation of anatomy with ground truth deformation vector fields (DVFs). Dice similarity coefficient (DSC) and mean distance to agreement (MDA) are the standard metrics for evaluating geometric contour congruence when testing deformable registration (DIR) algorithms. A HN virtual patient phantom data set was used for a kVCT‐kVCT automatic propagation contour validation study employing the Accuray DIR algorithm. Furthermore, since TomoTherapy uses MVCT images of the relevant anatomy for adaptive monitoring, the kVCT image data set quality was transformed to an MVCT image data set quality to study intermodal kVCT‐MVCT DIR accuracy. The results of the study indicate that the Accuray DIR algorithm can be expected to autopropagate HN contours adequately, on average, within tolerances recommended by TG‐132 (DSC 0.8‐0.9, MDA within voxel width). However, contours critical to dosimetric planning should always be visually proofed for accuracy. Using standard reconstruction MVCT image quality causes slightly less, but acceptable, agreement with ground truth contours.

A multivariable study of deformable image registration evaluation metrics in 4DCT of thoracic cancer patients

Deformable image registration (DIR) accuracy is often validated using manually identified landmarks or known deformations generated using digital or physical phantoms. In daily practice, the application of these approaches is limited since they are time-consuming or require additional equipment. An alternative is the use of metrics automatically derived from the registrations, but their interpretation is not straightforward. In this work we aim to determine the suitability of DIR-derived metrics to validate the accuracy of 4 commonly used DIR algorithms. First, we investigated the DIR accuracy using a landmark-based metric (target registration error (TRE)) and a digital phantom-based metric (known deformation recovery error (KDE)). 4DCT scans of 16 thoracic cancer patients along with corresponding pairwise anatomical landmarks (AL) locations were collected from two public databases. Digital phantoms with known deformations were generated by each DIR algorithm to test all other algorithms and compute KDE. TRE and KDE were evaluated at AL. KDE was additionally quantified in coordinates randomly sampled (RS) inside the lungs. Second, we investigated the associations of 5 DIR-derived metrics (distance discordance metric (DDM), inverse consistency error (ICE), transitivity (TE), spatial (SS) and temporal smoothness (TS)) with DIR accuracy through uni- and multivariable linear regression models. TRE values were found higher compared to KDE values and these varied depending on the phantom used. The algorithm with the best accuracy achieved average values of TRE = 1.1 mm and KDE ranging from 0.3 to 0.8 mm. DDM was the best predictor of DIR accuracy, with moderate correlations (R ² < 0.61). Poor correlations were obtained at AL for algorithms with better accuracy, which improved when evaluated at RS. Only slight correlation improvement was obtained with a multivariable analysis (R ² < 0.64). DDM can be a useful metric to identify inaccuracies for different DIR algorithms without employing landmarks or digital phantoms.

Assessing cumulative dose distributions in combined external beam radiotherapy and intracavitary brachytherapy for cervical cancer by treatment planning based on deformable image registration

BACKGROUND

This study aimed to validate the feasibility of deformable image registration (DIR) in assessing the cumulative dose distributions in combined external beam radiotherapy (EBRT) and intracavitary brachytherapy (ICBT) for cervical cancer.

METHODS

This retrospective study included 23 patients with stage IIB disease treated with combined EBRT to the whole pelvis (50.4 Gy in 28 fractions) using an intensity-modulated radiotherapy technique with 6-MV X-ray, followed by three-dimensional (3D) ICBT (28 Gy in 4 fractions). Tumor gross target volume at diagnosis (GTV-Tinit), tumor gross target volume before brachytherapy, high-risk clinical target volume (HR-CTV), intermediate-risk clinical target volume (IR-CTV), and parametrium and organs at risk were recontoured on computed tomography images of EBRT and ICBT, respectively. The dose-volume parameters were also determined. The DIR results were reviewed using MIM Maestro (Reg Review) and modified by function (Reg Refine). To evaluate the accuracy of DIR, DIR-based cumulative dose-volume histogram (DVH) parameters and simple DVH parameter addition were compared using Wilcoxon rank-sum tests.

RESULTS

The cumulative dose distributions of EBRT and four ICBT sessions were successfully illustrated using DIR. The mean tumor diameters were 68.35 cm3 at diagnosis and 29.63 cm3 at ICBT initiation. The mean tumor regression was 56.6%. The median minimum dose covering 90% (D90) of HR-CTV, GTV-Tinit, IR-CTV, and parametrium were 69.58±4.94, 68.81±7.98, 59.28±3.78, and 60.97±1.1 Gyα/β=10, respectively, for DIR and 69.11±5.68, 68.49±8.62, 58.89±3.59, and 61±1.49 Gyα/β=10, respectively, with conventional simple DVH parameter addition.No statistically significant differences in dosimetric parameters were observed between the two methods.

CONCLUSIONS

Although there were limitations in the DIR accuracy, DIR-based dose accumulation was significantly beneficial in visually showing the cumulative dose distribution in the target area to clinicians in combined radiotherapy for cervical cancer in routine clinical practice.

Free-to-use DIR solutions in radiotherapy: Benchmark against commercial platforms through a contour-propagation study

PURPOSE

A contour propagation study has been conducted to benchmark three algorithms for Deformable Image Registration (DIR) freely available online against well-established commercial solutions.

METHODS

ElastiX, BRAINS and Plastimach, available as modules in the open source platform 3DSlicer, were tested as the recent AAPM Task group 132 guidelines proposes. The overlap of the DIR-mapped ROIs in four computational anthropomorphic phantoms was measured. To avoid bias every algorithm was left to run without any human interaction nor particular registration strategy. The accuracy of the algorithms was measured using the Dice Similarity Coefficient (DSC) and Mean Distance to Conformity (MDC) metrics. The registration quality was compared to the recommended geometrical accuracy suggested by AAPM TG132 and to the results of a large population-based study performed with commercial DIR solutions.

RESULTS

The considered free-to-use DIR solutions generally meet acceptable accuracy and good overlap (DSC > 0.85). Mild failures (DSC < 0.75) were detected only for the smallest structures. In case of extremely severe deformations acceptable accuracy was not met (MDC > 3 mm). The morphing capability of the tested algorithms equals those of commercial systems when the user interaction is avoided. Underperformances were detected only in cases where a specific registration strategy is mandatory to obtain a satisfying match.

CONCLUSIONS

All of the considered algorithms show performances not inferior to previously published data and have the potential to be good candidates for use in the clinical routine. The results and conclusions only apply to the considered phantoms and should not be considered to be generally applicable and extendable to patient cases.

Influence of different urinary bladder filling levels and controlling regions of interest selection on deformable image registration algorithms

PURPOSE

Evaluation of Raystation ANAtomically CONstrained Deformation Algorithm (ANACONDA) performance to different urinary bladder filling levels in male pelvis anatomic site varying the controlling Regions Of Interest (ROIs).

METHODS

Different image datasets were obtained with ImSimQA (Oncology System Limited, Shrewsbury, UK) to evaluate ANACONDA performances (RaySearch Laboratories, Stockholm, Sweden). Deformation vector fields were applied to a synthetic man pelvis and a real patient computed tomography (CT) dataset (reference CTs) resulting in deformed CTs (target CTs) with various bladder filling levels. Different deformable image registrations (DIRs) were generated between each target CTs and reference CTs varying the controlling ROIs subset. Deformed ROIs were mapped from target CT to reference CT and then compared to reference ROIs. Evaluation was performed by Dice Similarity Coefficient (DSC), Correlation Coefficient (CC), Mean Distance to Agreement (MDA), maximum Distance to Agreement (maxDA) and with the introduction of global DSC (global_DSC) and global CC (global_CC) parameters.

RESULTS

In both synthetic and real patient CT cases, DSC scored less than 0.75 and MDA greater than 3 mm when no ROIs or only bladder were exploited as controlling ROI. DSC and CC increased by increasing the number of controlling ROIs selected whereas, an opposite behavior was observed for MDA and maxDA.

CONCLUSIONS

ANACONDA performances can be influenced by bladder filling fluctuation if no controlling ROIs are selected. Global_DSC and global_CC are useful parameters to quantitatively compare DIR algorithms. DIR performances improve by increasing the number of controlling ROIs selected, reaching a saturation level after a defined ROIs subset selection.

Dosimetric impact of organ at risk daily variation during prostate stereotactic ablative radiotherapy

OBJECTIVE

Prostate stereotactic ablative radiotherapy (SABR) delivers large doses using a fast dose rate. This amplifies the effect geometric uncertainties have on normal tissue dose. The aim of this study was to determine whether the treatment dose-volume histogram (DVH) agrees with the planned dose to organs at risk (OAR).

METHODS

41 low-intermediate risk prostate cancer patients were treated with SABR using a linac based technique. Dose prescribed was 35 Gy in five fractions delivered on alternate days, planned using volumetric modulated arc therapy (VMAT) with 10X flattening filter free (FFF). On treatment, prostate was matched to fiducial markers on cone beam CT (CBCT). OAR were retrospectively delineated on 205 pre-treatment CBCT images. Daily CBCT contours were overlaid on the planning CT for dosimetric analysis. Verification plan used to evaluate the daily DVH for each structure. The daily doses received by OAR were recorded using the D%.

RESULTS

The median rectum and bladder volumes at planning were 67.1 cm3 (interquartile range 56.4-78.2) and 164.4 cm3 (interquartile range 120.3-213.4) respectively. There was no statistically significant difference in median rectal volume at each of the five treatment scans compared to the planning scan (p = 0.99). This was also the case for median bladder volume (p = 0.79). The median dose received by rectum and bladder at each fraction was higher than planned, at the majority of dose levels. For rectum the increase ranged from 0.78-1.64Gy and for bladder 0.14-1.07Gy. The percentage of patients failing for rectum D35% < 18 Gy (p = 0.016), D10% < 28 Gy (p = 0.004), D5% < 32 Gy (p = 0.0001), D1% < 35 Gy (p = 0.0001) and bladder D1% < 35 Gy (p = 0.001) at treatment were all statistically significant.

CONCLUSION

In this cohort of prostate SABR patients, we estimate the OAR treatment DVH was higher than planned. This was due to rectal and bladder organ variation.

ADVANCES IN KNOWLEDGE

OAR variation in prostate SABR using a FFF technique, may cause the treatment DVH to be higher than planned.

[Improvement Prediction on Contour Deformation Accuracy Using Deformable Image Registration Results Compared to Rigid Image Registration Results]

PURPOSE

The aim of this study was to analyze improvement prediction on contour deformation accuracy using deformable image registration (DIR) results compared to rigid image registration (RIR) results.

METHOD

Radiotherapy plans for 31 cases (seven head and neck cases, 10 chest cases, six abdomen cases and eight female pelvis cases) from the privately open database for DIR were used. These cases used at least two radiotherapy plans, and registration was performed using two plans, not only for one case but also for different cases. The DIR and RIR were performed using the DIR software MIM Maestro (MIM software Inc., Cleveland, USA). The registration results for the following organs were analyzed: eye balls, optic nerves, brain stem, spinal cord and right and left parotid glands for head and neck; right and left lungs for chest; liver and right and left kidneys for abdomen; and rectum and bladder for pelvis. Dice similarity coefficient (DSC) for the organs was calculated from the results of RIR and DIR. The improvement in the DSC was observed.

RESULTS AND DISCUSSION

DIR improved the DSC values by more than 0.2 for simple shapes, well-defined boundaries and large volumes such as eye balls, brain stem, lungs and liver. The minimum DSC for these organs was approximately 0.7. The improvement in DSC for the organs eye balls, brain stem, lungs and liver had ceiling values 0.95, 0.90, 1.0 and 1.0, respectively. DSC for the spinal cord, parotid gland, bladder and kidney also improved by DIR compared to RIR; however, DIR could not improve the DSC value for rectum compared to RIR because of a large difference in the position, shape and size due to stool and gas.

Comparison of rigid and deformable image registration for nasopharyngeal carcinoma radiotherapy planning with diagnostic position PET/CT

PURPOSE

This observer study aimed to compare rigid image registration (RIR) with deformable image registration (DIR) for diagnostic position (DP) positron emission tomography/computed tomography (PET/CT) images in the delineation of gross tumor volumes (GTVs) in nasopharyngeal carcinoma (NPC) radiotherapy planning.

MATERIALS AND METHODS

Four radiation oncologists individually delineated the GTVs, GTV_RIR, and GTV_DIR, on planning CT (pCT) images registered with DP-PET/CT images using RIR and B-spline-based DIR, respectively. Reference GTVs were independently delineated by all radiation oncologists using radiotherapy position (RP)-PET/CT images. DP- and RP-PET/CT images for 14 patients with NPC were acquired using early and delayed scans, respectively. Dice's similarity coefficient (DSC), mean distance to agreement, and volume agreement with reference GTVs were compared by considering the interobserver variability in reference contours.

RESULTS

The average DSCs for GTV_RIR and GTV_DIR were 0.77 and 0.77, which were acceptable for GTV delineation. There were no statistically significant differences between GTV_RIR and GTV_DIR in all evaluation indexes (p > 0.05). Furthermore, the correlation between neck flexion angle differences and GTV accuracy was not statistically significant (p > 0.05).

CONCLUSION

RIR was a feasible choice compared with the B-spline-based DIR in GTV delineation for NPC under variations of neck flexion angle.

Computed Tomography to Cone Beam Computed Tomography Deformable Image Registration for Contour Propagation Using Head and Neck, Patient-Based Computational Phantoms: A Multicenter Study

PURPOSE

To investigate the performance of various algorithms for deformable image registration (DIR) for propagating regions of interest (ROIs) using multiple commercial platforms, from computed tomography to cone beam computed tomography (CBCT) and megavoltage computed tomography.

METHODS AND MATERIALS

Fourteen institutions participated in the study using 5 commercial platforms: RayStation (RaySearch Laboratories, Stockholm, Sweden), MIM (Cleveland, OH), VelocityAI and SmartAdapt (Varian Medical Systems, Palo Alto, CA), and ABAS (Elekta AB, Stockholm, Sweden). Algorithms were tested on synthetic images generated with the ImSimQA (Oncology Systems Limited, Shrewsbury, UK) package by applying 2 specific deformation vector fields (DVF) to real head and neck patient datasets. On-board images from 3 systems were used: megavoltage computed tomography from Tomotherapy and 2 kinds of CBCT from a clinical linear accelerator. Image quality of the system was evaluated. The algorithms' accuracy was assessed by comparing the DIR-mapped ROIs returned by each center with those of the reference, using the Dice similarity coefficient and mean distance to conformity metrics. Statistical inference on the validation results was carried out to identify the prognostic factors of DIR performance.

RESULTS

Analyzing 840 DIR-mapped ROIs returned by the centers, it was demonstrated that DVF intensity and image quality were significant prognostic factors of DIR performance. The accuracy of the propagated contours was generally high, and acceptable DIR performance can be obtained with lower-dose CBCT image protocols.

CONCLUSIONS

The performance of the systems proved to be image quality specific, depending on the DVF type and only partially on the platforms. All systems proved to be robust against image artifacts and noise, except the demon-based software.

A multiparametric method to assess the MIM deformable image registration algorithm

A quantitative evaluation of the performances of the deformable image registration (DIR) algorithm implemented in MIM-Maestro was performed using multiple similarity indices. Two phantoms, capable of mimicking different anatomical bending and tumor shrinking were built and computed tomography (CT) studies were acquired after applying different deformations. Three different contrast levels between internal structures were artificially created modifying the original CT values of one dataset. DIR algorithm was applied between datasets with increasing deformations and different contrast levels and manually refined with the Reg Refine tool. DIR algorithm ability in reproducing positions, volumes, and shapes of deformed structures was evaluated using similarity indices such as: landmark distances, Dice coefficients, Hausdorff distances, and maximum diameter differences between segmented structures. Similarity indices values worsen with increasing bending and volume difference between reference and target image sets. Registrations between images with low contrast (40 HU) obtain scores lower than those between images with high contrast (970 HU). The use of Reg Refine tool leads generally to an improvement of similarity parameters values, but the advantage is generally less evident for images with low contrast or when structures with large volume differences are involved. The dependence of DIR algorithm on image deformation extent and different contrast levels is well characterized through the combined use of multiple similarity indices.

The evaluation of a hybrid biomechanical deformable registration method on a multistage physical phantom with reproducible deformation

BACKGROUND

Advanced clinical applications, such as dose accumulation and adaptive radiation therapy, require deformable image registration (DIR) algorithms capable of voxel-wise accurate mapping of treatment dose or functional imaging. By utilizing a multistage deformable phantom, the authors investigated scenarios where biomechanical refinement method (BM-DIR) may be better than the pure image intensity based deformable registration (IM-DIR).

METHODS

The authors developed a biomechanical-model based DIR refinement method (BM-DIR) to refine the deformable vector field (DVF) from any initial intensity-based DIR (IM-DIR). The BM-DIR method was quantitatively evaluated on a novel phantom capable of ten reproducible gradually-increasing deformation stages using the urethra tube as a surrogate. The internal DIR accuracy was inspected in term of the Dice similarity coefficient (DSC), Hausdorff and mean surface distance as defined in of the urethra structure inside the phantom and compared with that of the initial IM-DIR under various stages of deformation. Voxel-wise deformation vector discrepancy and Jacobian regularity were also inspected to evaluate the output DVFs. In addition to phantom, two pairs of Head&Neck patient MR images with expert-defined landmarks inside parotids were utilized to evaluate the BM-DIR accuracy with target registration error (TRE).

RESULTS

The DSC and surface distance measures of the inner urethra tube indicated the BM-DIR method can improve the internal DVF accuracy on masked MR images for the phases of a large degree of deformation. The smoother Jacobian distribution from the BM-DIR suggests more physically-plausible internal deformation. For H&N cancer patients, the BM-DIR improved the TRE from 0.339 cm to 0.210 cm for the landmarks inside parotid on the masked MR images.

CONCLUSIONS

We have quantitatively demonstrated on a multi-stage physical phantom and limited patient data that the proposed BM-DIR can improve the accuracy inside solid organs with large deformation where distinctive image features are absent.

Practical quantification of image registration accuracy following the AAPM TG-132 report framework

The AAPM TG 132 Report enumerates important steps for validation of the medical image registration process. While the Report outlines the general goals and criteria for the tests, specific implementation may be obscure to the wider clinical audience. We endeavored to provide a detailed step‐by‐step description of the quantitative tests’ execution, applied as an example to a commercial software package (Mirada Medical, Oxford, UK), while striving for simplicity and utilization of readily available software. We demonstrated how the rigid registration data could be easily extracted from the DICOM registration object and used, following some simple matrix math, to quantify accuracy of rigid translations and rotations. The options for validating deformable image registration (DIR) were enumerated, and it was shown that the most practically viable ones are comparison of propagated internal landmark points on the published datasets, or of segmented contours that can be generated locally. The multimodal rigid registration in our example did not always result in the desired registration error below ½ voxel size, but was considered acceptable with the maximum errors under 1.3 mm and 1°. The DIR target registration errors in the thorax based on internal landmarks were far in excess of the Report recommendations of 2 mm average and 5 mm maximum. On the other hand, evaluation of the DIR major organs’ contours propagation demonstrated good agreement for lung and abdomen (Dice Similarity Coefficients, DSC, averaged over all cases and structures of 0.92 ± 0.05 and 0.91 ± 0.06, respectively), and fair agreement for Head and Neck (average DSC = 0.73 ± 0.14). The average for head and neck is reduced by small volume structures such as pharyngeal constrictor muscles. Even these relatively simple tests show that commercial registration algorithms cannot be automatically assumed sufficiently accurate for all applications. Formalized task‐specific accuracy quantification should be expected from the vendors.

The impact of robustness of deformable image registration on contour propagation and dose accumulation for head and neck adaptive radiotherapy

Deformable image registration (DIR) is the key process for contour propagation and dose accumulation in adaptive radiation therapy (ART). However, currently, ART suffers from a lack of understanding of “robustness” of the process involving the image contour based on DIR and subsequent dose variations caused by algorithm itself and the presetting parameters. The purpose of this research is to evaluate the DIR caused variations for contour propagation and dose accumulation during ART using the RayStation treatment planning system. Ten head and neck cancer patients were selected for retrospective studies. Contours were performed by a single radiation oncologist and new treatment plans were generated on the weekly CT scans for all patients. For each DIR process, four deformation vector fields (DVFs) were generated to propagate contours and accumulate weekly dose by the following algorithms: (a) ANACONDA with simple presetting parameters, (b) ANACONDA with detailed presetting parameters, (c) MORFEUS with simple presetting parameters, and (d) MORFEUS with detailed presetting parameters. The geometric evaluation considered DICE coefficient and Hausdorff distance. The dosimetric evaluation included D₉₅, D_max, D_mean, D_min, and Homogeneity Index. For geometric evaluation, the DICE coefficient variations of the GTV were found to be 0.78 ± 0.11, 0.96 ± 0.02, 0.64 ± 0.15, and 0.91 ± 0.03 for simple ANACONDA, detailed ANACONDA, simple MORFEUS, and detailed MORFEUS, respectively. For dosimetric evaluation, the corresponding Homogeneity Index variations were found to be 0.137 ± 0.115, 0.006 ± 0.032, 0.197 ± 0.096, and 0.006 ± 0.033, respectively. The coherent geometric and dosimetric variations also consisted in large organs and small organs. Overall, the results demonstrated that the contour propagation and dose accumulation in clinical ART were influenced by the DIR algorithm, and to a greater extent by the presetting parameters. A quality assurance procedure should be established for the proper use of a commercial DIR for adaptive radiation therapy.

Technical Note: The impact of deformable image registration methods on dose warping

PURPOSE

The purpose of this study was to investigate the clinical-relevant discrepancy between doses warped by pure image based deformable image registration (IM-DIR) and by biomechanical model based DIR (BM-DIR) on intensity-homogeneous organs.

METHODS AND MATERIALS

Ten patients (5Head&Neck, 5Prostate) were included. A research DIR tool (ADMRIE_v1.12) was utilized for IM-DIR. After IM-DIR, BM-DIR was carried out for organs (parotids, bladder, and rectum) which often encompass sharp dose gradient. Briefly, high-quality tetrahedron meshes were generated and deformable vector fields (DVF) from IM-DIR were interpolated to the surface nodes of the volume meshes as boundary condition. Then, a FEM solver (ABAQUS_v6.14) was used to simulate the displacement of internal nodes, which were then interpolated to image-voxel grids to get the more physically plausible DVF. Both geometrical and subsequent dose warping discrepancies were quantified between the two DIR methods. Target registration discrepancy(TRD) was evaluated to show the geometry difference. The re-calculated doses on second CT were warped to the pre-treatment CT via two DIR. Clinical-relevant dose parameters and γ passing rate were compared between two types of warped dose. The correlation was evaluated between parotid shrinkage and TRD/dose discrepancy.

RESULT

The parotid shrunk to 75.7% ± 9% of its pre-treatment volume and the percentage of volume with TRD>1.5 mm) was 6.5% ± 4.7%. The normalized mean-dose difference (NMDD) of IM-DIR and BM-DIR was -0.8% ± 1.5%, with range (-4.7% to 1.5%). 2 mm/2% passing rate was 99.0% ± 1.4%. A moderate correlation was found between parotid shrinkage and TRD and NMDD. The bladder had a NMDD of -9.9% ± 9.7%, with BM-DIR warped dose systematically higher. Only minor deviation was observed for rectum NMDD (0.5% ± 1.1%).

CONCLUSION

Impact of DIR method on treatment dose warping is patient and organ-specific. Generally, intensity-homogeneous organs, which undergo larger deformation/shrinkage during treatment and encompass sharp dose gradient, will have greater dose warping uncertainty. For these organs, BM-DIR could be beneficial to the evaluation of DIR/dose-warping uncertainty.

Construction of a biomechanical head and neck motion model as a guide to evaluation of deformable image registration

The use of deformable image registration methods in the context of adaptive radiotherapy leads to uncertainties in the simulation of the administered dose distributions during the treatment course. Evaluation of these methods is a prerequisite to decide if a plan adaptation will improve the individual treatment. Current approaches using manual references limit the validity of evaluation, especially for low-contrast regions. In particular, for the head and neck region, the highly flexible anatomy and low soft tissue contrast in control images pose a challenge to image registration and its evaluation. Biomechanical models promise to overcome this issue by providing anthropomorphic motion modelling of the patient. We introduce a novel biomechanical motion model for the generation and sampling of different postures of the head and neck anatomy. Motion propagation behaviour of the individual bones is defined by an underlying kinematic model. This model interconnects the bones by joints and thus is capable of providing a wide range of motion. Triggered by the motion of the individual bones, soft tissue deformation is described by an extended heterogeneous tissue model based on the chainmail approach. This extension, for the first time, allows the propagation of decaying rotations within soft tissue without the necessity for explicit tissue segmentation. Overall motion simulation and sampling of deformed CT scans including a basic noise model is achieved within 30 s. The proposed biomechanical motion model for the head and neck site generates displacement vector fields on a voxel basis, approximating arbitrary anthropomorphic postures of the patient. It was developed with the intention of providing input data for the evaluation of deformable image registration.

Analysis of GTV reduction during radiotherapy for oropharyngeal cancer: Implications for adaptive radiotherapy

BACKGROUND AND PURPOSE

Adaptive field size reduction based on gross tumor volume (GTV) shrinkage imposes risk on coverage. Fiducial markers were used as surrogate for behavior of tissue surrounding the GTV edge to assess this risk by evaluating if GTVs during treatment are dissolving or actually shrinking.

MATERIALS AND METHODS

Eight patients with oropharyngeal tumors treated with chemo-radiation were included. Before treatment, fiducial markers (0.035×0.2cm², n=40) were implanted at the edge of the primary tumor. All patients underwent planning-CT, daily cone beam CT (CBCT) and MRIs (pre-treatment, weeks 3 and 6). Marker displacement on CBCT was compared to local GTV surface displacement on MRIs. Additionally, marker displacement relative to the GTV surfaces during treatment was measured.

RESULTS

GTV surface displacement derived from MRI was larger than derived from fiducial markers (average difference: 0.1cm in week 3). During treatment, the distance between markers and GTV surface on MRI in week 3 increased in 33%>0.3cm and in 10%>0.5cm. The MRI-GTV shrank faster than the surrounding tissue represented by the markers, i.e. adapting to GTV shrinkage may cause under-dosage of microscopic disease.

CONCLUSIONS

We showed that adapting to primary tumor GTV shrinkage on MRI mid-treatment is potentially not safe since at least part of the GTV is likely to be dissolving. Adjustment to clear anatomical boundaries, however, may be done safely.