Detection of vessel bifurcations in CT scans for automatic objective assessment of deformable image registration accuracy

A Vessel Bifurcation Landmark Pair Dataset for Abdominal CT Deformable Image Registration (DIR) Validation

Purpose

Deformable image registration (DIR) is an enabling technology in many diagnostic and therapeutic tasks. Despite this, DIR algorithms have limited clinical use, largely due to a lack of benchmark datasets for quality assurance during development. DIRs of intra-patient abdominal CTs are among the most challenging registration scenarios due to significant organ deformations and inconsistent image content. To support future algorithm development, here we introduce our first-of-its-kind abdominal CT DIR benchmark dataset, comprising large numbers of highly accurate landmark pairs on matching blood vessel bifurcations.

Acquisition and Validation Methods

Abdominal CT image pairs of 30 patients were acquired from several publicly available repositories as well as the authors' institution with IRB approval. The two CTs of each pair were originally acquired for the same patient but on different days. An image processing workflow was developed and applied to each CT image pair: 1) Abdominal organs were segmented with a deep learning model, and image intensity within organ masks was overwritten. 2) Matching image patches were manually identified between two CTs of each image pair. 3) Vessel bifurcation landmarks were labeled on one image of each image patch pair. 4) Image patches were deformably registered, and landmarks were projected onto the second image 5) Landmark pair locations were refined manually or with an automated process. This workflow resulted in 1895 total landmark pairs, or 63 per case on average. Estimates of the landmark pair accuracy using digital phantoms were 0.7mm +/- 1.2 mm.

Data Format and Usage Notes

The data is published in Zenodo at https://doi.org/10.5281/zenodo.14362785. Instructions for use can be found at https://github.com/deshanyang/Abdominal-DIR-QA.

Potential Applications

This dataset is a first-of-its-kind for abdominal DIR validation. The number, accuracy, and distribution of landmark pairs will allow for robust validation of DIR algorithms with precision beyond what is currently available.

A vessel bifurcation liver CT landmark pair dataset for evaluating deformable image registration algorithms

PURPOSE

Evaluating deformable image registration (DIR) algorithms is vital for enhancing algorithm performance and gaining clinical acceptance. However, there is a notable lack of dependable DIR benchmark datasets for assessing DIR performance except for lung images. To address this gap, we aim to introduce our comprehensive liver computed tomography (CT) DIR landmark dataset library. This dataset is designed for efficient and quantitative evaluation of various DIR methods for liver CTs, paving the way for more accurate and reliable image registration techniques.

ACQUISITION AND VALIDATION METHODS

Forty CT liver image pairs were acquired from several publicly available image archives and authors' institutions under institutional review board (IRB) approval. The images were processed with a semi-automatic procedure to generate landmark pairs: (1) for each case, liver vessels were automatically segmented on one image; (2) landmarks were automatically detected at vessel bifurcations; (3) corresponding landmarks in the second image were placed using two deformable image registration methods to avoid algorithm-specific biases; (4) a comprehensive validation process based on quantitative evaluation and manual assessment was applied to reject outliers and ensure the landmarks' positional accuracy. This workflow resulted in an average of ∼56 landmark pairs per image pair, comprising a total of 2220 landmarks for 40 cases. The general landmarking accuracy of this procedure was evaluated using digital phantoms and manual landmark placement. The landmark pair target registration errors (TRE) on digital phantoms were 0.37 ± 0.26 and 0.55 ± 0.34 mm respectively for the two selected DIR algorithms used in our workflow, with 97% of landmark pairs having TREs below 1.5 mm. The distances from the calculated landmarks to the averaged manual placement were 1.27 ± 0.79 mm.

DATA FORMAT AND USAGE NOTES

All data, including image files and landmark information, are publicly available at Zenodo (https://zenodo.org/records/13738577). Instructions for using our data can be found on our GitHub page at https://github.com/deshanyang/Liver-DIR-QA.

POTENTIAL APPLICATIONS

The landmark dataset generated in this work is the first collection of large-scale liver CT DIR landmarks prepared on real patient images. This dataset can provide researchers with a dense set of ground truth benchmarks for the quantitative evaluation of DIR algorithms within the liver.

Tools and recommendations for commissioning and quality assurance of deformable image registration in radiotherapy

Multiple tools are available for commissioning and quality assurance of deformable image registration (DIR), each with their own advantages and disadvantages in the context of radiotherapy. The selection of appropriate tools should depend on the DIR application with its corresponding available input, desired output, and time requirement. Discussions were hosted by the ESTRO Physics Workshop 2021 on Commissioning and Quality Assurance for DIR in Radiotherapy. A consensus was reached on what requirements are needed for commissioning and quality assurance for different applications, and what combination of tools is associated with this. For commissioning, we recommend the target registration error of manually annotated anatomical landmarks or the distance-to-agreement of manually delineated contours to evaluate alignment. These should be supplemented by the distance to discordance and/or biomechanical criteria to evaluate consistency and plausibility. Digital phantoms can be useful to evaluate DIR for dose accumulation but are currently only available for a limited range of anatomies, image modalities and types of deformations. For quality assurance of DIR for contour propagation, we recommend at least a visual inspection of the registered image and contour. For quality assurance of DIR for warping quantitative information such as dose, Hounsfield units or positron emission tomography-data, we recommend visual inspection of the registered image together with image similarity to evaluate alignment, supplemented by an inspection of the Jacobian determinant or bending energy to evaluate plausibility, and by the dose (gradient) to evaluate relevance. We acknowledge that some of these metrics are still missing in currently available commercial solutions.

Ablative margin quantification using deformable versus rigid image registration in colorectal liver metastasis thermal ablation: a retrospective single-center study

PURPOSE

To investigate the correlation of minimal ablative margin (MAM) quantification using biomechanical deformable (DIR) versus intensity-based rigid image registration (RIR) with local outcomes following colorectal liver metastasis (CLM) thermal ablation.

METHODS

This retrospective single-institution study included consecutive patients undergoing thermal ablation between May 2016 and October 2021. Patients who did not have intraprocedural pre- and post-ablation contrast-enhanced CT images for MAM quantification or follow-up period less than 1 year without residual tumor or local tumor progression (LTP) were excluded. DIR and RIR methods were used to quantify the MAM. The registration accuracy was compared using Dice similarity coefficient (DSC). Area under the receiver operating characteristic curve (AUC) was used to test MAM in predicting local tumor outcomes.

RESULTS

A total of 72 patients (mean age 57; 44 men) with 139 tumors (mean diameter 1.5 cm ± 0.8 (SD)) were included. During a median follow-up of 29.4 months, there was one residual unablated tumor and the LTP rate was 17% (24/138). The ranges of DSC were 0.96-0.98 and 0.67-0.98 for DIR and RIR, respectively (p < 0.001). When using DIR, 27 (19%) tumors were partially or totally registered outside the liver, compared to 46 (33%) with RIR. Using DIR versus RIR, the corresponding median MAM was 4.7 mm versus 4.0 mm, respectively (p = 0.5). The AUC in predicting residual tumor and 1-year LTP for DIR versus RIR was 0.89 versus 0.72, respectively (p < 0.001).

CONCLUSION

Ablative margin quantified on intra-procedural CT imaging using DIR method outperformed RIR for predicting local outcomes of CLM thermal ablation.

CLINICAL RELEVANCE STATEMENT

The study supports the role of biomechanical deformable image registration as the preferred image registration method over rigid image registration for quantifying minimal ablative margins using intraprocedural contrast-enhanced CT images.

KEY POINTS

• Accurate and reproducible image registration is a prerequisite for clinical application of image-based ablation confirmation methods. • When compared to intensity-based rigid image registration, biomechanical deformable image registration for minimal ablative margin quantification was more accurate for liver registration using intraprocedural contrast-enhanced CT images. • Biomechanical deformable image registration outperformed intensity-based rigid image registration for predicting local tumor outcomes following colorectal liver metastasis thermal ablation.

Quantification of Resection Margin following Sublobar Resection in Lung Cancer Patients through Pre- and Post-Operative CT Image Comparison: Utilizing a CT-Based 3D Reconstruction Algorithm

Sublobar resection has emerged as a standard treatment option for early-stage peripheral non-small cell lung cancer. Achieving an adequate resection margin is crucial to prevent local tumor recurrence. However, gross measurement of the resection margin may lack accuracy due to the elasticity of lung tissue and interobserver variability. Therefore, this study aimed to develop an objective measurement method, the CT-based 3D reconstruction algorithm, to quantify the resection margin following sublobar resection in lung cancer patients through pre- and post-operative CT image comparison. An automated subvascular matching technique was first developed to ensure accuracy and reproducibility in the matching process. Following the extraction of matched feature points, another key technique involves calculating the displacement field within the image. This is particularly important for mapping discontinuous deformation fields around the surgical resection area. A transformation based on thin-plate spline is used for medical image registration. Upon completing the final step of image registration, the distance at the resection margin was measured. After developing the CT-based 3D reconstruction algorithm, we included 12 cases for resection margin distance measurement, comprising 4 right middle lobectomies, 6 segmentectomies, and 2 wedge resections. The outcomes obtained with our method revealed that the target registration error for all cases was less than 2.5 mm. Our method demonstrated the feasibility of measuring the resection margin following sublobar resection in lung cancer patients through pre- and post-operative CT image comparison. Further validation with a multicenter, large cohort, and analysis of clinical outcome correlation is necessary in future studies.

A comprehensive lung CT landmark pair dataset for evaluating deformable image registration algorithms

PURPOSE

Deformable image registration (DIR) is a key enabling technology in many diagnostic and therapeutic tasks, but often does not meet the required robustness and accuracy for supporting clinical tasks. This is in large part due to a lack of high-quality benchmark datasets by which new DIR algorithms can be evaluated. Our team was supported by the National Institute of Biomedical Imaging and Bioengineering to develop DIR benchmark dataset libraries for multiple anatomical sites, comprising of large numbers of highly accurate landmark pairs on matching blood vessel bifurcations. Here we introduce our lung CT DIR benchmark dataset library, which was developed to improve upon the number and distribution of landmark pairs in current public lung CT benchmark datasets.

ACQUISITION AND VALIDATION METHODS

Thirty CT image pairs were acquired from several publicly available repositories as well as authors' institution with IRB approval. The data processing workflow included multiple steps: (1) The images were denoised. (2) Lungs, airways, and blood vessels were automatically segmented. (3) Bifurcations were directly detected on the skeleton of the segmented vessel tree. (4) Falsely identified bifurcations were filtered out using manually defined rules. (5) A DIR was used to project landmarks detected on the first image onto the second image of the image pair to form landmark pairs. (6) Landmark pairs were manually verified. This workflow resulted in an average of 1262 landmark pairs per image pair. Estimates of the landmark pair target registration error (TRE) using digital phantoms were 0.4 mm ± 0.3 mm.

DATA FORMAT AND USAGE NOTES

The data is published in Zenodo at https://doi.org/10.5281/zenodo.8200423. Instructions for use can be found at https://github.com/deshanyang/Lung-DIR-QA.

POTENTIAL APPLICATIONS

The dataset library generated in this work is the largest of its kind to date and will provide researchers with a new and improved set of ground truth benchmarks for quantitatively validating DIR algorithms within the lung.

Fully automated deep learning based auto-contouring of liver segments and spleen on contrast-enhanced CT images

Manual delineation of liver segments on computed tomography (CT) images for primary/secondary liver cancer (LC) patients is time-intensive and prone to inter/intra-observer variability. Therefore, we developed a deep-learning-based model to auto-contour liver segments and spleen on contrast-enhanced CT (CECT) images. We trained two models using 3d patch-based attention U-Net ([Formula: see text] and 3d full resolution of nnU-Net ([Formula: see text] to determine the best architecture ([Formula: see text]. BA was used with vessels ([Formula: see text] and spleen ([Formula: see text] to assess the impact on segment contouring. Models were trained, validated, and tested on 160 ([Formula: see text]), 40 ([Formula: see text]), 33 ([Formula: see text]), 25 (CCH) and 20 (CPVE) CECT of LC patients. [Formula: see text] outperformed [Formula: see text] across all segments with median differences in Dice similarity coefficients (DSC) ranging 0.03-0.05 (p < 0.05). [Formula: see text], and [Formula: see text] were not statistically different (p > 0.05), however, both were slightly better than [Formula: see text] by DSC up to 0.02. The final model, [Formula: see text], showed a mean DSC of 0.89, 0.82, 0.88, 0.87, 0.96, and 0.95 for segments 1, 2, 3, 4, 5-8, and spleen, respectively on entire test sets. Qualitatively, more than 85% of cases showed a Likert score [Formula: see text] 3 on test sets. Our final model provides clinically acceptable contours of liver segments and spleen which are usable in treatment planning.

Quantifying the Effect of 4-Dimensional Computed Tomography-Based Deformable Dose Accumulation on Representing Radiation Damage for Patients with Locally Advanced Non-Small Cell Lung Cancer Treated with Standard-Fractionated Intensity-Modulated Radiation Therapy

PURPOSE

The aim of this study was to investigate the dosimetric and clinical effects of 4-dimensional computed tomography (4DCT)-based longitudinal dose accumulation in patients with locally advanced non-small cell lung cancer treated with standard-fractionated intensity-modulated radiation therapy (IMRT).

METHODS AND MATERIALS

Sixty-seven patients were retrospectively selected from a randomized clinical trial. Their original IMRT plan, planning and verification 4DCTs, and ∼4-month posttreatment follow-up CTs were imported into a commercial treatment planning system. Two deformable image registration algorithms were implemented for dose accumulation, and their accuracies were assessed. The planned and accumulated doses computed using average-intensity images or phase images were compared. At the organ level, mean lung dose and normal-tissue complication probability (NTCP) for grade ≥2 radiation pneumonitis were compared. At the region level, mean dose in lung subsections and the volumetric overlap between isodose intervals were compared. At the voxel level, the accuracy in estimating the delivered dose was compared by evaluating the fit of a dose versus radiographic image density change (IDC) model. The dose-IDC model fit was also compared for subcohorts based on the magnitude of NTCP difference (|ΔNTCP|) between planned and accumulated doses.

RESULTS

Deformable image registration accuracy was quantified, and the uncertainty was considered for the voxel-level analysis. Compared with planned doses, accumulated doses on average resulted in <1-Gy lung dose increase and <2% NTCP increase (up to 8.2 Gy and 18.8% for a patient, respectively). Volumetric overlap of isodose intervals between the planned and accumulated dose distributions ranged from 0.01 to 0.93. Voxel-level dose-IDC models demonstrated a fit improvement from planned dose to accumulated dose (pseudo-R2 increased 0.0023) and a further improvement for patients with ≥2% |ΔNTCP| versus for patients with <2% |ΔNTCP|.

CONCLUSIONS

With a relatively large cohort, robust image registrations, multilevel metric comparisons, and radiographic image-based evidence, we demonstrated that dose accumulation more accurately represents the delivered dose and can be especially beneficial for patients with greater longitudinal response.

Optimization of mesh generation for geometric accuracy, robustness, and efficiency of biomechanical-model-based deformable image registration

BACKGROUND

Successful generation of biomechanical-model-based deformable image registration (BM-DIR) relies on user-defined parameters that dictate surface mesh quality. The trial-and-error process to determine the optimal parameters can be labor-intensive and hinder DIR efficiency and clinical workflow.

PURPOSE

To identify optimal parameters in surface mesh generation as boundary conditions for a BM-DIR in longitudinal liver and lung CT images to facilitate streamlined image registration processes.

METHODS

Contrast-enhanced CT images of 29 colorectal liver cancer patients and end-exhale four-dimensional CT images of 26 locally advanced non-small cell lung cancer patients were collected. Different combinations of parameters that determine the triangle mesh quality (voxel side length and triangle edge length) were investigated. The quality of DIRs generated using these parameters was evaluated with metrics for geometric accuracy, robustness, and efficiency. Metrics for geometric accuracy included target registration error (TRE) of internal vessel bifurcations, dice similar coefficient (DSC), mean distance to agreement (MDA), Hausdorff distance (HD) for organ contours, and number of vertices in the triangle mesh. American Association of Physicists in Medicine Task Group 132 was used to ensure parameters met TRE, DSC, MDA recommendations before the comparison among the parameters. Robustness was evaluated as the success rate of DIR generation, and efficiency was evaluated as the total time to generate boundary conditions and compute finite element analysis.

RESULTS

Voxel side length of 0.2 cm and triangle edge length of 3 were found to be the optimal parameters for both liver and lung, with success rate of 1.00 and 0.98 and average DIR computation time of 100 and 143 s, respectively. For this combination, the average TRE, DSC, MDA, and HD were 0.38-0.40, 0.96-0.97, 0.09-0.12, and 0.87-1.17 mm, respectively.

CONCLUSION

The optimal parameters were found for the analyzed patients. The decision-making process described in this study serves as a recommendation for BM-DIR algorithms to be used for liver and lung. These parameters can facilitate consistence in the evaluation of published studies and more widespread utilization of BM-DIR in clinical practice.

Leveraging deep learning-based segmentation and contours-driven deformable registration for dose accumulation in abdominal structures

Purpose

Discrepancies between planned and delivered dose to GI structures during radiation therapy (RT) of liver cancer may hamper the prediction of treatment outcomes. The purpose of this study is to develop a streamlined workflow for dose accumulation in a treatment planning system (TPS) during liver image-guided RT and to assess its accuracy when using different deformable image registration (DIR) algorithms.

Materials and Methods

Fifty-six patients with primary and metastatic liver cancer treated with external beam radiotherapy guided by daily CT-on-rails (CTOR) were retrospectively analyzed. The liver, stomach and duodenum contours were auto-segmented on all planning CTs and daily CTORs using deep-learning methods. Dose accumulation was performed for each patient using scripting functionalities of the TPS and considering three available DIR algorithms based on: (i) image intensities only; (ii) intensities + contours; (iii) a biomechanical model (contours only). Planned and accumulated doses were converted to equivalent dose in 2Gy (EQD2) and normal tissue complication probabilities (NTCP) were calculated for the stomach and duodenum. Dosimetric indexes for the normal liver, GTV, stomach and duodenum and the NTCP values were exported from the TPS for analysis of the discrepancies between planned and the different accumulated doses.

Results

Deep learning segmentation of the stomach and duodenum enabled considerable acceleration of the dose accumulation process for the 56 patients. Differences between accumulated and planned doses were analyzed considering the 3 DIR methods. For the normal liver, stomach and duodenum, the distribution of the 56 differences in maximum doses (D2%) presented a significantly higher variance when a contour-driven DIR method was used instead of the intensity only-based method. Comparing the two contour-driven DIR methods, differences in accumulated minimum doses (D98%) in the GTV were >2Gy for 15 (27%) of the patients. Considering accumulated dose instead of planned dose in standard NTCP models of the duodenum demonstrated a high sensitivity of the duodenum toxicity risk to these dose discrepancies, whereas smaller variations were observed for the stomach.

Conclusion

This study demonstrated a successful implementation of an automatic workflow for dose accumulation during liver cancer RT in a commercial TPS. The use of contour-driven DIR methods led to larger discrepancies between planned and accumulated doses in comparison to using an intensity only based DIR method, suggesting a better capability of these approaches in estimating complex deformations of the GI organs.