Deformable image registration for dose mapping between external beam radiotherapy and brachytherapy images of cervical cancer

Improving hybrid image and structure-based deformable image registration for large internal deformations

Objective.Deformable image registration (DIR) is a widely used technique in radiotherapy. Complex deformations, resulting from large anatomical changes, are a regular challenge. DIR algorithms generally seek a balance between capturing large deformations and preserving a smooth deformation vector field (DVF). We propose a novel structure-based term that can enhance the registration efficacy while ensuring a smooth DVF.Approach.The proposed novel similarity metric for controlling structures was introduced as a new term into a commercially available algorithm. Its performance was compared to the original algorithm using a dataset of 46 patients who received pelvic re-irradiation, many of which exhibited complex deformations.Main results.The mean Dice Similarity Coefficient (DSC) under the improved algorithm was 0.96, 0.94, 0.76, and 0.91 for bladder, rectum, colon, and bone respectively, compared to 0.69, 0.89, 0.62, and 0.88 for the original algorithm. The improvement was more pronounced for complex deformations.Significance.With this work, we have demonstrated that the proposed term is able to improve registration accuracy for complex cases while maintaining realistic deformations.

QUIZ: An arbitrary volumetric point matching method for medical image registration

Rigid pre-registration involving local-global matching or other large deformation scenarios is crucial. Current popular methods rely on unsupervised learning based on grayscale similarity, but under circumstances where different poses lead to varying tissue structures, or where image quality is poor, these methods tend to exhibit instability and inaccuracies. In this study, we propose a novel method for medical image registration based on arbitrary voxel point of interest matching, called query point quizzer (QUIZ). QUIZ focuses on the correspondence between local-global matching points, specifically employing CNN for feature extraction and utilizing the Transformer architecture for global point matching queries, followed by applying average displacement for local image rigid transformation.We have validated this approach on a large deformation dataset of cervical cancer patients, with results indicating substantially smaller deviations compared to state-of-the-art methods. Remarkably, even for cross-modality subjects, it achieves results surpassing the current state-of-the-art.

Feasibility of quantitative diffusion-weighted imaging during intra-procedural MRI-guided brachytherapy of locally advanced cervical and vaginal cancers

PURPOSE

To determine the feasibility of quantitative apparent diffusion coefficient (ADC) acquisition during magnetic resonance imaging-guided brachytherapy (MRgBT) using reduced field-of-view (rFOV) diffusion-weighted imaging (DWI).

METHODS AND MATERIALS

T2-weighted (T2w) MR and full-FOV single-shot echo planar (ssEPI) DWI were acquired in 7 patients with cervical or vaginal malignancy at baseline and prior to brachytherapy, while rFOV-DWI was acquired during MRgBT following brachytherapy applicator placement. The gross target volume (GTV) was contoured on the T2w images and registered to the ADC map. Voxels at the GTV's maximum Maurer distance comprised a central sub-volume (GTVcenter). Contour ADC mean and standard deviation were compared between timepoints using repeated measures ANOVA.

RESULTS

ssEPI-DWI mean ADC increased between baseline and prebrachytherapy from 1.03 ± 0.18 10-3 mm2/s to 1.34 ± 0.28 10-3 mm2/s for the GTV (p = 0.06) and from 0.84 ± 0.13 10-3 mm2/s to 1.26 ± 0.25 10-3 mm2/s at the level of the GTVcenter (p = 0.03), consistent with early treatment response. rFOV-DWI during MRgBT demonstrated mean ADC values of 1.28 ± 0.14 10-3 mm2/s and 1.28 ± 0.19 10-3 mm2/s for the GTV and GTVcenter, respectively (p = 0.02 and p = 0.03 relative to baseline). No significant differences were observed between ssEPI-DWI and rFOV-DWI ADC measurements.

CONCLUSIONS

Quantitative ADC measurement in the setting of MRI guided brachytherapy implant placement for cervical and vaginal cancers is feasible using rFOV-DWI, with comparable mean ADC comparable to prebrachytherapy ssEPI-DWI, and may enable MRI-guided radiotherapy targeting of low ADC, radiation resistant sub-volumes of tumor.

Contour-guided deep learning based deformable image registration for dose monitoring during CBCT-guided radiotherapy of prostate cancer

PURPOSE

To evaluate deep learning (DL)-based deformable image registration (DIR) for dose accumulation during radiotherapy of prostate cancer patients.

METHODS AND MATERIALS

Data including 341 CBCTs (209 daily, 132 weekly) and 23 planning CTs from 23 patients was retrospectively analyzed. Anatomical deformation during treatment was estimated using free-form deformation (FFD) method from Elastix and DL-based VoxelMorph approaches. The VoxelMorph method was investigated using anatomical scans (VMorph_Sc) or label images (VMorph_Msk), or the combination of both (VMorph_Sc_Msk). Accumulated doses were compared with the planning dose.

RESULTS

The DSC ranges, averaged for prostate, rectum and bladder, were 0.60-0.71, 0.67-0.79, 0.93-0.98, and 0.89-0.96 for the FFD, VMorph_Sc, VMorph_Msk, and VMorph_Sc_Msk methods, respectively. When including both anatomical and label images, VoxelMorph estimated more complex deformations resulting in heterogeneous determinant of Jacobian and higher percentage of deformation vector field (DVF) folding (up to a mean value of 1.90% in the prostate). Large differences were observed between DL-based methods regarding estimation of the accumulated dose, showing systematic overdosage and underdosage of the bladder and rectum, respectively. The difference between planned mean dose and accumulated mean dose with VMorph_Sc_Msk reached a median value of +6.3 Gy for the bladder and -5.1 Gy for the rectum.

CONCLUSION

The estimation of the deformations using DL-based approach is feasible for male pelvic anatomy but requires the inclusion of anatomical contours to improve organ correspondence. High variability in the estimation of the accumulated dose depending on the deformable strategy suggests further investigation of DL-based techniques before clinical deployment.

Applying Multi-Metric Deformable Image Registration for Dose Accumulation in Combined Cervical Cancer Radiotherapy

(1) Purpose: Challenges remain in dose accumulation for cervical cancer radiotherapy combined with external beam radiotherapy (EBRT) and brachytherapy (BT) as there are many large and complex organ deformations between different treatments. This study aims to improve deformable image registration (DIR) accuracy with the introduction of multi-metric objectives for dose accumulation of EBRT and BT. (2) Materials and methods: Twenty cervical cancer patients treated with EBRT (45-50 Gy/25 fractions) and high-dose-rate BT (≥20 Gy in 4 fractions) were included for DIR. The multi-metric DIR algorithm included an intensity-based metric, three contour-based metrics, and a penalty term. Nonrigid B-spine transformation was used to transform the planning CT images from EBRT to the first BT, with a six-level resolution registration strategy. To evaluate its performance, the multi-metric DIR was compared with a hybrid DIR provided by commercial software. The DIR accuracy was measured by the Dice similarity coefficient (DSC) and Hausdorff distance (HD) between deformed and reference organ contours. The accumulated maximum dose of 2 cc (D_2cc) of the bladder and rectum was calculated and compared to simply addition of D_2cc from EBRT and BT (ΔD_2cc). (3) Results: The mean DSC of all organ contours for the multi-metric DIR were significantly higher than those for the hybrid DIR (p ≤ 0.011). In total, 70% of patients had DSC > 0.8 using the multi-metric DIR, while 15% of patients had DSC > 0.8 using the commercial hybrid DIR. The mean ΔD_2cc of the bladder and rectum for the multi-metric DIR were 3.25 ± 2.29 and 3.54 ± 2.02 Gy_EQD2, respectively, whereas those for the hybrid DIR were 2.68 ± 2.56 and 2.32 ± 3.25 Gy_EQD2, respectively. The multi-metric DIR resulted in a much lower proportion of unrealistic D_2cc than the hybrid DIR (2.5% vs. 17.5%). (4) Conclusions: Compared with the commercial hybrid DIR, the introduced multi-metric DIR significantly improved the registration accuracy and resulted in a more reasonable accumulated dose distribution.

Segmentation of Clinical Target Volume From CT Images for Cervical Cancer Using Deep Learning

Introduction: Segmentation of clinical target volume (CTV) from CT images is critical for cervical cancer brachytherapy, but this task is time-consuming, laborious, and not reproducible. In this work, we aim to propose an end-to-end model to segment CTV for cervical cancer brachytherapy accurately. Methods: In this paper, an improved M-Net model (Mnet_IM) is proposed to segment CTV of cervical cancer from CT images. An input and an output branch are both proposed to attach to the bottom layer to deal with CTV locating challenges due to its lower contrast than surrounding organs and tissues. A progressive fusion approach is then proposed to recover the prediction results layer by layer to enhance the smoothness of segmentation results. A loss function is defined on each of the multiscale outputs to form a deep supervision mechanism. Numbers of feature map channels that are directly connected to inputs are finally homogenized for each image resolution to reduce feature redundancy and computational burden. Result: Experimental results of the proposed model and some representative models on 5438 image slices from 53 cervical cancer patients demonstrate advantages of the proposed model in terms of segmentation accuracy, such as average surface distance, 95% Hausdorff distance, surface overlap, surface dice, and volumetric dice. Conclusion: A better agreement between the predicted CTV from the proposed model Mnet_IM and manually labeled ground truth is obtained compared to some representative state-of-the-art models.

Contemporary image-guided cervical cancer brachytherapy: Consensus imaging recommendations from the Society of Abdominal Radiology and the American Brachytherapy Society

PURPOSE

To present recommendations for the use of imaging for evaluation and procedural guidance of brachytherapy for cervical cancer patients.

METHODS

An expert panel comprised of members of the Society of Abdominal Radiology Uterine and Ovarian Cancer Disease Focused Panel and the American Brachytherapy Society jointly assessed the existing literature and provide data-driven guidance on imaging protocol development, interpretation, and reporting.

RESULTS

Image-guidance during applicator implantation reduces rates of uterine perforation by the tandem. Postimplant images may be acquired with radiography, computed tomography (CT), or magnetic resonance imaging (MRI), and CT or MRI are preferred due to a decrease in severe complications. Pre-brachytherapy T2-weighted MRI may be used as a reference for contouring the high-risk clinical target volume (HR-CTV) when CT is used for treatment planning. Reference CT and MRI protocols are provided for reference.

CONCLUSIONS

Image-guided brachytherapy in locally advanced cervical cancer is essential for optimal patient management. Various imaging modalities, including orthogonal radiographs, ultrasound, computed tomography, and magnetic resonance imaging, remain integral to the successful execution of image-guided brachytherapy.

Development of a Machine Learning Model for Optimal Applicator Selection in High-Dose-Rate Cervical Brachytherapy

Purpose

To develop and validate a preliminary machine learning (ML) model aiding in the selection of intracavitary (IC) versus hybrid interstitial (IS) applicators for high-dose-rate (HDR) cervical brachytherapy.

Methods

From a dataset of 233 treatments using IC or IS applicators, a set of geometric features of the structure set were extracted, including the volumes of OARs (bladder, rectum, sigmoid colon) and HR-CTV, proximity of OARs to the HR-CTV, mean and maximum lateral and vertical HR-CTV extent, and offset of the HR-CTV centre-of-mass from the applicator tandem axis. Feature selection using an ANOVA F-test and mutual information removed uninformative features from this set. Twelve classification algorithms were trained and tested over 100 iterations to determine the highest performing individual models through nested 5-fold cross-validation. Three models with the highest accuracy were combined using soft voting to form the final model. This model was trained and tested over 1,000 iterations, during which the relative importance of each feature in the applicator selection process was determined.

Results

Feature selection indicated that the mean and maximum lateral and vertical extent, volume, and axis offset of the HR-CTV were the most informative features and were thus provided to the ML models. Relative feature importances indicated that the HR-CTV volume and mean lateral extent were most important for applicator selection. From the comparison of the individual classification algorithms, it was found that the highest performing algorithms were tree-based ensemble methods – AdaBoost Classifier (ABC), Gradient Boosting Classifier (GBC), and Random Forest Classifier (RFC). The accuracy of the individual models was compared to the voting model for 100 iterations (ABC = 91.6 ± 3.1%, GBC = 90.4 ± 4.1%, RFC = 89.5 ± 4.0%, Voting Model = 92.2 ± 1.8%) and the voting model was found to have superior accuracy. Over the final 1,000 evaluation iterations, the final voting model demonstrated a high predictive accuracy (91.5 ± 0.9%) and F1 Score (90.6 ± 1.1%).

Conclusion

The presented model demonstrates high discriminative performance, highlighting the potential for utilization in informing applicator selection prospectively following further clinical validation.

Accuracy of registrations between cone-beam computed tomography and conventional computed tomography images and dose mapping methods in RaySearch software for the bladder during brachytherapy of cervical cancer patients

Purpose

The aim of the study was to assess selected methods of image registration available in the RaySearch software and their impact on the accuracy of mapping of doses deposited in the bladder during brachytherapy (BRT) of cervical cancer in images used during external beam radiotherapy (EBRT).

Material and methods

The study was based on data from ten patients. Cone-beam computed tomography (CBCT) images (BRT) were aligned with CT images (EBRT) using four registration methods: Reg_1 (rigid), Reg_2a, Reg_2b (hybrid), and Reg_3 (biomechanical). Image mapping accuracy was evaluated based on bladder’s anatomy. Sørensen-Dice coefficient (DSC) values were analyzed for all the registrations. Discrepancies between triangular mesh points set on the basis of bladder contours were analyzed. Dose distributions from BRT were transformed according to registration results and mapped on CT images. Original BRT doses deposited in 2 cm³ volume of the bladder were compared to those transformed and associated with bladder’s volume determined on CT images.

Results

Mean DSC values amounted to 0.36 (Reg_1), 0.87 and 0.88 (Reg_2a and Reg_2b), and 0.97 (Reg_3). Significant differences were found between DSC for the following comparisons: Reg_3/Reg_1 (p = 0.001), Reg_2a/Reg_1 (p = 0.011), and Reg_2b/Reg_1 (p = 0.014). The lowest discrepancies between triangular mesh points were for Reg_3 (p < 0.001, Reg_3 vs. Reg_1, and p = 0.039, Reg_3 vs. Reg_2b). Finally, the lowest discrepancies between the original and transformed doses were found for Reg_3. Nevertheless, only 5 out of 10 observations for Reg_3 yielded error of less than 5%.

Conclusions

Biomechanical registration (Reg_3) enabled the most accurate alignment between CBCT and CT images. Satisfactory registration results of anatomical structures do not guarantee a correct mapping of primary BRT doses on the bladder delineated on CT images during EBRT. The results of dose transformation based on biomechanical registration had an error of less than 5% for only 50% of the observations.

An international survey on the clinical use of rigid and deformable image registration in radiotherapy

OBJECTIVES

Rigid image registration (RIR) and deformable image registration (DIR) are widely used in radiotherapy. This project aims to capture current international approaches to image registration.

METHODS

A survey was designed to identify variations in use, resources, implementation, and decision-making criteria for clinical image registration. This was distributed to radiotherapy centers internationally in 2018.

RESULTS

There were 57 responses internationally, from the Americas (46%), Australia/New Zealand (32%), Europe (12%), and Asia (10%). Rigid image registration and DIR were used clinically for computed tomography (CT)-CT registration (96% and 51%, respectively), followed by CT-PET (81% and 47%), CT-CBCT (84% and 19%), CT-MR (93% and 19%), MR-MR (49% and 5%), and CT-US (9% and 0%). Respondent centers performed DIR using dedicated software (75%) and treatment planning systems (29%), with 84% having some form of DIR software. Centers have clinically implemented DIR for atlas-based segmentation (47%), multi-modality treatment planning (65%), and dose deformation (63%). The clinical use of DIR for multi-modality treatment planning and accounting for retreatments was considered to have the highest benefit-to-risk ratio (69% and 67%, respectively).

CONCLUSIONS

This survey data provides useful insights on where, when, and how image registration has been implemented in radiotherapy centers around the world. DIR is mainly in clinical use for CT-CT (51%) and CT-PET (47%) for the head and neck (43-57% over all use cases) region. The highest benefit-risk ratio for clinical use of DIR was for multi-modality treatment planning and accounting for retreatments, which also had higher clinical use than for adaptive radiotherapy and atlas-based segmentation.

Modeling Complex Deformations of the Sigmoid Colon Between External Beam Radiation Therapy and Brachytherapy Images of Cervical Cancer

PURPOSE

In this study, we investigated registration methods for estimating the large interfractional sigmoid deformations that occur between external beam radiation therapy (EBRT) and brachytherapy (BT) for cervical cancer.

METHODS AND MATERIALS

Sixty-three patients were retrospectively analyzed. The sigmoid colon was delineated on 2 computed tomography images acquired during EBRT (without applicator) and BT (with applicator) for each patient. Five registration approaches were compared to propagate the contour of the sigmoid from BT to EBRT anatomies: rigid registration, commercial hybrid (ANAtomically CONstrained Deformation Algorithm), controlling ROI surface projection of RayStation, and the classical and constrained symmetrical thin-plate spline robust point matching (sTPS-RPM) methods. Deformation of the sigmoid due to insertion of the BT applicator was reported. Registration performance was compared by using the Dice similarity coefficient (DSC), distance to agreement, and Hausdorff distance. The 2 sTPS-RPM methods were compared by using surface triangle quality criteria between deformed surfaces. Using the deformable approaches, the BT dose of the sigmoid was deformed toward the EBRT anatomy. The displacement and discrepancy between the deformable methods to propagate the planned D1cm³ and D2cm³ of the sigmoid from BT to EBRT anatomies were reported for 55 patients.

RESULTS

Large and complex deformations of the sigmoid were observed for each patient. Rigid registration resulted in poor sigmoid alignment with a mean DSC of 0.26. Using the contour to drive the deformation, ANAtomically CONstrained Deformation Algorithm was able to slightly improve the alignment of the sigmoid with a mean DSC of 0.57. Using only the sigmoid surface as controlling ROI, the mean DSC was improved to 0.79. The classical and constrained sTPS-RPM methods provided mean DSCs of 0.95 and 0.96, respectively, with an average inverse consistency error <1 mm. The constrained sTPS-RPM provided more realistic deformations and better surface topology of the deformed sigmoids. The planned mean (range) D1cm³ and D2cm³ of the sigmoid were 13.4 Gy (1-24.1) and 12.2 Gy (1-21.5) on the BT anatomy, respectively. Using the constrained sTPS-RPM to deform the sigmoid from BT to EBRT anatomies, these hotspots had a mean (range) displacement of 27.1 mm (6.8-81).

CONCLUSIONS

Large deformations of the sigmoid were observed between the EBRT and BT anatomies, suggesting that the D1cm³ and D2cm³ of the sigmoid would unlikely to be at the same position throughout treatment. The proposed constrained sTPS-RPM seems to be the preferred approach to manage the large deformation due to BT applicator insertion. Such an approach could be used to map the EBRT dose to the BT anatomy for personalized BT planning optimization.