Comparison of CBCT-based dose calculation methods in head and neck cancer radiotherapy: from Hounsfield unit to density calibration curve to deep learning

Feature-targeted deep learning framework for pulmonary tumorous Cone-beam CT (CBCT) enhancement with multi-task customized perceptual loss and feature-guided CycleGAN

Thoracic Cone-beam computed tomography (CBCT) is routinely collected during image-guided radiation therapy (IGRT) to provide updated patient anatomy information for lung cancer treatments. However, CBCT images often suffer from streaking artifacts and noise caused by under-rate sampling projections and low-dose exposure, resulting in loss of lung anatomy which contains crucial pulmonary tumorous and functional information. While recent deep learning-based CBCT enhancement methods have shown promising results in suppressing artifacts, they have limited performance on preserving anatomical details containing crucial tumorous information due to lack of targeted guidance. To address this issue, we propose a novel feature-targeted deep learning framework which generates ultra-quality pulmonary imaging from CBCT of lung cancer patients via a multi-task customized feature-to-feature perceptual loss function and a feature-guided CycleGAN. The framework comprises two main components: a multi-task learning feature-selection network (MTFS-Net) for building up a customized feature-to-feature perceptual loss function (CFP-loss); and a feature-guided CycleGan network. Our experiments showed that the proposed framework can generate synthesized CT (sCT) images for the lung that achieved a high similarity to CT images, with an average SSIM index of 0.9747 and an average PSNR index of 38.5995 globally, and an average Pearman's coefficient of 0.8929 within the tumor region on multi-institutional datasets. The sCT images also achieved visually pleasing performance with effective artifacts suppression, noise reduction, and distinctive anatomical details preservation. Functional imaging tests further demonstrated the pulmonary texture correction performance of the sCT images, and the similarity of the functional imaging generated from sCT and CT images has reached an average DSC value of 0.9147, SCC value of 0.9615 and R value of 0.9661. Comparison experiments with pixel-to-pixel loss also showed that the proposed perceptual loss significantly enhances the performance of involved generative models. Our experiment results indicate that the proposed framework outperforms the state-of-the-art models for pulmonary CBCT enhancement. This framework holds great promise for generating high-quality pulmonary imaging from CBCT that is suitable for supporting further analysis of lung cancer treatment.

Artificial intelligence for treatment delivery: image-guided radiotherapy

Radiation therapy (RT) is a highly digitized field relying heavily on computational methods and, as such, has a high affinity for the automation potential afforded by modern artificial intelligence (AI). This is particularly relevant where imaging is concerned and is especially so during image-guided RT (IGRT). With the advent of online adaptive RT (ART) workflows at magnetic resonance (MR) linear accelerators (linacs) and at cone-beam computed tomography (CBCT) linacs, the need for automation is further increased. AI as applied to modern IGRT is thus one area of RT where we can expect important developments in the near future. In this review article, after outlining modern IGRT and online ART workflows, we cover the role of AI in CBCT and MRI correction for dose calculation, auto-segmentation on IGRT imaging, motion management, and response assessment based on in-room imaging.

Evaluation of cumulative dose distributions from external beam radiation therapy using CT-to-CBCT deformable image registration (DIR) for cervical cancer patients

PURPOSE

To investigate dose differences between the planning CT (pCT) and dose calculated on pre-treatment verification CBCTs using DIR and dose summation for cervical cancer patients.

METHODS

Cervical cancer patients treated at our institution with 45 Gy EBRT undergo a pCT and 5 CBCTs, once every five fractions of treatment. A free-form intensity-based DIR in MIM was performed between the pCT and each CBCT using the "Merged CBCT" feature to generate an extended FOV-CBCT (mCBCT). DIR-generated bladder and rectum contours were adjusted by a physician, and dice similarity coefficients (DSC) were calculated. After deformation, the investigated doses were (1) recalculated in Eclipse using original plan parameters (ecD), and (2) deformed from planning dose (pD) using the deformation matrix in MIM (mdD). Dose summation was performed to the first week's mCBCT. Dose distributions were compared for the bladder, rectum, and PTV in terms of percent dose difference, dose volume histograms (DVHs), and gamma analysis between the calculated doses.

RESULTS

For the 20 patients, the mean DSC was 0.68 ± 0.17 for bladder and 0.79 ± 0.09 for rectum. Most patients were within 5% of pD for D2cc (19/20), Dmax (17/20), and Dmean (16/20). All patients demonstrated a percent difference > 5% for bladder V45 due to variations in bladder volume from the pCT. D90 showed fewer differences with 19/20 patients within 2% of pD. Gamma rates between pD and ecD averaged 94% for bladder and 94% for rectum, while pD and mdD exhibited slightly better performance for bladder (93%) and lower for rectum (85%).

CONCLUSION

Using DIR with weekly CBCT images, the MIM deformed dose (mdD) was found to be in close agreement with the Eclipse calculated dose (ecD). The proposed workflow should be used on a case-by-case basis when the weekly CBCT shows marked difference in organs-at-risk from the planning CT.

Dose calculation accuracy of a new high-performance ring-gantry CBCT imaging system for prostate and lung cancer patients

BACKGROUND AND PURPOSE

The recently introduced high-performance CBCT imaging system called HyperSight offers improved Hounsfield units (HU) accuracy, a larger CBCT field-of-view and improved image quality compared to conventional ring gantry CBCT, possibly enabling treatment planning on CBCT imaging directly. In this study, we evaluated whether the dose calculation accuracy on HyperSight CBCT was sufficient for treatment planning in prostate and lung cancer patients.

MATERIALS AND METHODS

HyperSight CBCT was compared to planning CT (pCT) in terms of HU-to-mass density (MD) calibration curves. For twenty prostate patients and twenty lung patients, differences in DVH parameters, and 3D global gamma between dose distributions calculated on pCT and free breathing HyperSight CBCT were evaluated. For this purpose, HyperSight CBCT acquired at the first fraction was rigidly registered to the pCT, delineations from the CT were propagated and the dose was recalculated on the HyperSight CBCT.

RESULTS

For each insert of the HU-to-MD calibration phantom, the HU values of HyperSight CBCT and pCT agreed within 35 HU. For prostate maximum deviations in PTV Dmean, V95% and V107% were 1.8 %, -1.1 % and < 0.1 % respectively. For lung PTV V95% was generally lower (median -1.1 %) and PTV V107% was generally higher (median 1.1 %) on HyperSight CBCT due to breathing motion artifacts. The average (±SD) 2 %/2mm gamma pass rate was 98.7 %±1.2 % for prostate cancer patients and 96.2 %±2.1 % for lung cancer patients.

CONCLUSION

HyperSight CBCT enabled accurate dose calculation for prostate cancer patients, without implementation of a specific HyperSight CBCT-to-MD curve. For lung cancer patients, breathing motion hampered accurate dose calculations.

A novel comprehensive metric balancing imaging dose and setup accuracy in image-guided radiotherapy: concept proposal and clinical validation

Purpose

To propose and validate a comprehensive novel metric balancing the registration accuracy and imaging dose for image-guided-radiotherapy based on real patient data.

Materials and methods

With written informed consent and ethical approval, 56 patients were scanned using 6MV CBCT, 140 kV CBCT, and 100 kV CBCT on Halcyon system for three consecutive treatment fractions. Online registration was performed by various on-duty therapists under routine clinical pressure and time limitation. Offline registration was carried out by an experienced physicist without pressure. The consistency between the online and offline results was used as a surrogate of the missing ground-truth of registration accuracy, which was usually developed by introducing 'known' setup errors and rescan the phantoms, yet is ethnically not applicable to real patients. The registration differences (ΔD) between various imaging methods and observers were analyzed. The weighted CT dose index (CTDIw) for kV and MV CBCT was acquired using the PTW CTDI head phantom. The weighted-Dose-Accuracy-Product (DAPw) index was defined as DAPw =ΔD(mm) w1* CTDIw(mGy) w2, where w1 and w2 are the weighting factors of accuracy and dose respectively (w1+w2 = 1).

Results

The mean and interquartile range (IQR) of ΔD decreased monotonically for MV CBCT, 100 kV CBCT, and 140 kV CBCT, supporting the registration consistency as a surrogate metric of image quality. Significant differences of ΔD were observed between the online and offline registration across three imaging methods (P<0.05). The 140 kV CBCT provides superior positioning accuracy, less dependency on observer subjectivity and time pressure of clinical workflow. Using w1=w2 = 0.5 as an example, the smallest mean, standard deviation, and IQR of DAPw were observed on the 100 kV CBCT, indicating optimal balance between dose and accuracy than the other two methods. Analysis of variance (ANOVA) showed statistically significant differences in DAPw among the different imaging methods (P<0.01, F=50.57).

Conclusion

Using registration consistency as a surrogate indicator of image quality, this study proposed and validated a novel "DAPw" parameter based on real patient data, providing a purpose-specific tool for balancing setup accuracy and radiation dose in clinic.

Dual-encoder architecture for metal artifact reduction for kV-cone-beam CT images in head and neck cancer radiotherapy

During a radiotherapy (RT) course, geometrical variations of target volumes, organs at risk, weight changes (loss/gain), tumor regression and/or progression can significantly affect the treatment outcome. Adaptive RT has become the effective methods along with technical advancements in imaging modalities including cone-beam computed tomography (CBCT). Planning CT (pCT) can be modified via deformable image registration (DIR), which is applied to the pair of pCT and CBCT. However, the artifact existed in both pCT and CBCT is a vulnerable factor in DIR. The dose calculation on CBCT is also suggested. Missing information due to the artifacts hinders the accurate dose calculation on CBCT. In this study, we aim to develop a deep learning-based metal artifact reduction (MAR) model to reduce the metal artifacts in CBCT for head and neck cancer RT. To train the proposed MAR model, we synthesized the kV-CBCT images including metallic implants, with and without metal artifacts (simulated image data pairs) through sinogram image handling process. We propose the deep learning architecture which focuses on both artifact removal and reconstruction of anatomic structure using a dual-encoder architecture. We designed four single-encoder models and three dual-encoder models based on UNet (for an artifact removal) and FusionNet (for a tissue restoration). Each single-encoder model contains either UNet or FusionNet, while the dual-encoder models have both UNet and FusionNet architectures. In the dual-encoder models, we implemented different feature fusion methods, including simple addition, spatial attention, and spatial/channel wise attention. Among the models, a dual-encoder model with spatial/channel wise attention showed the highest scores in terms of peak signal-to-noise ratio, mean squared error, structural similarity index, and Pearson correlation coefficient. CBCT images from 34 head and neck cancer patients were used to test the developed models. The dual-encoder model with spatial/channel wise attention showed the best results in terms of artifact index. By using the proposed model to CBCT, one can achieve more accurate synthetic pCT for head and neck patients as well as better tissue recognition and structure delineation for CBCT image itself.

Artificial intelligence (AI) applications in improvement of IMRT and VMAT radiotherapy treatment planning processes: A systematic review

INTRODUCTION

Radiotherapy is a common option in the treatment of many types of cancer. Intensity-Modulated Radiation Therapy (IMRT) and Volumetric-Modulated Arc Therapy (VMAT) are the latest radiotherapy techniques. However, clinicians face problems due to these techniques' complexity and time-consuming planning. Various studies have pointed out the importance and role of artificial intelligence (AI) in radiotherapy and accelerating and improving its quality. This research explores different AI methods in different fields of IMRT and VMAT. This study evaluated both quantitative and qualitative methods used within the reviewed articles.

METHODS

Various articles were reviewed from Google Scholar, Science Direct, and PubMed databases between 2018 and 2024. According to PRISMA 2020 guidelines, study selection processes, screening, and inclusion and exclusion criteria were defined. The critical Appraisal Skill Program qualitative checklist tool was used for the qualitative evaluation of articles.

RESULTS

26 articles met the inclusion among the 33 articles obtained. The search procedure was displayed using the PRISMA flow diagram. The evaluation of the articles shows the automation of various treatment planning processes by AI methods and their better performance than traditional methods. The qualitative evaluation of studies has demonstrated the high quality of all studies. The lowest score obtained from the qualitative evaluation of the article is 7 out of 9.

CONCLUSION

AI methods used in radiotherapy reduce time and increase prediction accuracy. They also work better than other methods in different areas, such as dose prediction, treatment design, and dose delivery.

IMPLICATIONS FOR PRACTICE

Healthcare providers should consider integrating artificial intelligence technologies into their practice to optimize treatment planning and enhance patient care in radiation therapy. Additionally, fostering collaboration between radiotherapy experts and artificial intelligence specialists can significantly improve the development and application of AI technologies in this field.

Supervised deep learning-based synthetic computed tomography from kilovoltage cone-beam computed tomography images for adaptive radiation therapy in head and neck cancer

PURPOSE

To generate and investigate a supervised deep learning algorithm for creating synthetic computed tomography (sCT) images from kilovoltage cone-beam computed tomography (kV-CBCT) images for adaptive radiation therapy (ART) in head and neck cancer (HNC).

MATERIALS AND METHODS

This study generated the supervised U-Net deep learning model using 3,491 image pairs from planning computed tomography (pCT) and kV-CBCT datasets obtained from 40 HNC patients. The dataset was split into 80% for training and 20% for testing. The evaluation of the sCT images compared to pCT images focused on three aspects: Hounsfield units accuracy, assessed using mean absolute error (MAE) and root mean square error (RMSE); image quality, evaluated using the peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) between sCT and pCT images; and dosimetric accuracy, encompassing 3D gamma passing rates for dose distribution and percentage dose difference.

RESULTS

MAE, RMSE, PSNR, and SSIM showed improvements from their initial values of 53.15 ± 40.09, 153.99 ± 79.78, 47.91 ± 4.98 dB, and 0.97 ± 0.02 to 41.47 ± 30.59, 130.39 ± 78.06, 49.93 ± 6.00 dB, and 0.98 ± 0.02, respectively. Regarding dose evaluation, 3D gamma passing rates for dose distribution within sCT images under 2%/2 mm, 3%/2 mm, and 3%/3 mm criteria, yielded passing rates of 92.1% ± 3.8%, 93.8% ± 3.0%, and 96.9% ± 2.0%, respectively. The sCT images exhibited minor variations in the percentage dose distribution of the investigated target and structure volumes. However, it is worth noting that the sCT images exhibited anatomical variations when compared to the pCT images.

CONCLUSION

These findings highlight the potential of the supervised U-Net deep learningmodel in generating kV-CBCT-based sCT images for ART in patients with HNC.

Evaluation of dose delivery based on deformed CT using a commercial software for lung cancer

This study employed a commercial software velocity to perform deformable registration and dose calculation on deformed CT images, aiming to assess the accuracy of dose delivery during the radiotherapy for lung cancers. A total of 20 patients with lung cancer were enrolled in this study. Adaptive CT (ACT) was generated by deformed the planning CT (pCT) to the CBCT of initial radiotherapy fraction, followed by contour propagation and dose recalculation. There was not significant difference between volumes of GTV and CTV calculated from the ACT and pCT. However, significant differences in dice similarity coefficient (DSC) and coverage ratio (CR) between GTV and CTV were observed, with lower values for GTV volumes below 15 cc. The mean differences in dose corresponding to 95% of the GTV, GTV-P, CTV, and CTV-P between ACT and pCT were - 0.32%, 4.52%, 2.17%, and 4.71%, respectively. For the dose corresponding to 99%, the discrepancies were - 0.18%, 8.35%, 1.92%, and 24.96%, respectively. These differences in dose primarily appeared at the edges of the target areas. Notably, a significant enhancement of dose corresponding to 1 cc for spinal cord was observed in ACT, compared with pCT. There was no statistical difference in the mean dose of lungs and heart. In general, for lung cancer patients, anatomical motion may result in both CTV and GTV moving outside the original irradiation region. The dose difference within the original target area was small, but the difference in the planning target area was considerable.

2D antiscatter grid and scatter sampling based CBCT method for online dose calculations during CBCT guided radiation therapy of pelvis

BACKGROUND

Online dose calculations before the delivery of radiation treatments have applications in dose delivery verification, online adaptation of treatment plans, and simulation-free treatment planning. While dose calculations by directly utilizing CBCT images are desired, dosimetric accuracy can be compromised due to relatively lower HU accuracy in CBCT images.

PURPOSE

In this work, we propose a novel CBCT imaging pipeline to enhance the accuracy of CBCT-based dose calculations in the pelvis region. Our approach aims to improve the HU accuracy in CBCT images, thereby improving the overall accuracy of CBCT-based dose calculations prior to radiation treatment delivery.

METHODS

An in-house developed quantitative CBCT pipeline was implemented to address the CBCT raw data contamination problem. The pipeline combines algorithmic data correction strategies and 2D antiscatter grid-based scatter rejection to achieve high CT number accuracy. To evaluate the effect of the quantitative CBCT pipeline on CBCT-based dose calculations, phantoms mimicking pelvis anatomy were scanned using a linac-mounted CBCT system, and a gold standard multidetector CT used for treatment planning (pCT). A total of 20 intensity-modulated treatment plans were generated for five targets, using 6 and 10 MV flattening filter-free beams, and utilizing small and large pelvis phantom images. For each treatment plan, four different dose calculations were performed using pCT images and three CBCT imaging configurations: quantitative CBCT, clinical CBCT protocol, and a high-performance 1D antiscatter grid (1D ASG). Subsequently, dosimetric accuracy was evaluated for both targets and organs at risk as a function of patient size, target location, beam energy, and CBCT imaging configuration.

RESULTS

When compared to the gold-standard pCT, dosimetric errors in quantitative CBCT-based dose calculations were not significant across all phantom sizes, beam energies, and treatment sites. The largest error observed was 0.6% among all dose volume histogram metrics and evaluated dose calculations. In contrast, dosimetric errors reached up to 7% and 97% in clinical CBCT and high-performance ASG CBCT-based treatment plans, respectively. The largest dosimetric errors were observed in bony targets in the large phantom treated with 6 MV beams. The trends of dosimetric errors in organs at risk were similar to those observed in the targets.

CONCLUSIONS

The proposed quantitative CBCT pipeline has the potential to provide comparable dose calculation accuracy to the gold-standard planning CT in photon radiation therapy for the abdomen and pelvis. These robust dose calculations could eliminate the need for density overrides in CBCT images and enable direct utilization of CBCT images for dose delivery monitoring or online treatment plan adaptations before the delivery of radiation treatments.

Energy-guided diffusion model for CBCT-to-CT synthesis

Cone Beam Computed Tomography (CBCT) plays a crucial role in Image-Guided Radiation Therapy (IGRT), providing essential assurance of accuracy in radiation treatment by monitoring changes in anatomical structures during the treatment process. However, CBCT images often face interference from scatter noise and artifacts, posing a significant challenge when relying solely on CBCT for precise dose calculation and accurate tissue localization. There is an urgent need to enhance the quality of CBCT images, enabling a more practical application in IGRT. This study introduces EGDiff, a novel framework based on the diffusion model, designed to address the challenges posed by scatter noise and artifacts in CBCT images. In our approach, we employ a forward diffusion process by adding Gaussian noise to CT images, followed by a reverse denoising process using ResUNet with an attention mechanism to predict noise intensity, ultimately synthesizing CBCT-to-CT images. Additionally, we design an energy-guided function to retain domain-independent features and discard domain-specific features during the denoising process, enhancing the effectiveness of CBCT-CT generation. We conduct numerous experiments on the thorax dataset and pancreas dataset. The results demonstrate that EGDiff performs better on the thoracic tumor dataset with SSIM of 0.850, MAE of 26.87 HU, PSNR of 19.83 dB, and NCC of 0.874. EGDiff outperforms SoTA CBCT-to-CT synthesis methods on the pancreas dataset with SSIM of 0.754, MAE of 32.19 HU, PSNR of 19.35 dB, and NCC of 0.846. By improving the accuracy and reliability of CBCT images, EGDiff can enhance the precision of radiation therapy, minimize radiation exposure to healthy tissues, and ultimately contribute to more effective and personalized cancer treatment strategies.

A systematic literature review: deep learning techniques for synthetic medical image generation and their applications in radiotherapy

The aim of this systematic review is to determine whether Deep Learning (DL) algorithms can provide a clinically feasible alternative to classic algorithms for synthetic Computer Tomography (sCT). The following categories are presented in this study: ∙ MR-based treatment planning and synthetic CT generation techniques. ∙ Generation of synthetic CT images based on Cone Beam CT images. ∙ Low-dose CT to High-dose CT generation. ∙ Attenuation correction for PET images. To perform appropriate database searches, we reviewed journal articles published between January 2018 and June 2023. Current methodology, study strategies, and results with relevant clinical applications were analyzed as we outlined the state-of-the-art of deep learning based approaches to inter-modality and intra-modality image synthesis. This was accomplished by contrasting the provided methodologies with traditional research approaches. The key contributions of each category were highlighted, specific challenges were identified, and accomplishments were summarized. As a final step, the statistics of all the cited works from various aspects were analyzed, which revealed that DL-based sCTs have achieved considerable popularity, while also showing the potential of this technology. In order to assess the clinical readiness of the presented methods, we examined the current status of DL-based sCT generation.

Simulation and pre-planning omitted radiotherapy (SPORT): a feasibility study for prostate cancer

This study explored the feasibility of on-couch intensity modulated radiotherapy (IMRT) planning for prostate cancer (PCa) on a cone-beam CT (CBCT)-based online adaptive RT platform without an individualized pre-treatment plan and contours. Ten patients with PCa previously treated with image-guided IMRT (60 Gy/20 fractions) were selected. In contrast to the routine online adaptive RT workflow, a novel approach was employed in which the same preplan that was optimized on one reference patient was adapted to generate individual on-couch/initial plans for the other nine test patients using Ethos emulator. Simulation CTs of the test patients were used as simulated online CBCT (sCBCT) for emulation. Quality assessments were conducted on synthetic CTs (sCT). Dosimetric comparisons were performed between on-couch plans, on-couch plans recomputed on the sCBCT and individually optimized plans for test patients. The median value of mean absolute difference between sCT and sCBCT was 74.7 HU (range 69.5-91.5 HU). The average CTV/PTV coverage by prescription dose was 100.0%/94.7%, and normal tissue constraints were met for the nine test patients in on-couch plans on sCT. Recalculating on-couch plans on the sCBCT showed about 0.7% reduction of PTV coverage and a 0.6% increasing of hotspot, and the dose difference of the OARs was negligible (<0.5 Gy). Hence, initial IMRT plans for new patients can be generated by adapting a reference patient's preplan with online contours, which had similar qualities to the conventional approach of individually optimized plan on the simulation CT. Further study is needed to identify selection criteria for patient anatomy most amenable to this workflow.

Evaluation of a cone-beam computed tomography system calibrated for accurate radiotherapy dose calculation

Background and purpose

Dose calculation on cone-beam computed tomography (CBCT) images has been less accurate than on computed tomography (CT) images due to lower image quality and discrepancies in CT numbers for CBCT. As increasing interest arises in offline and online re-planning, dose calculation accuracy was evaluated for a novel CBCT imager integrated into a ring gantry treatment machine.

Materials and methods

The new CBCT system allowed fast image acquisition (5.9 s) by using new hardware, including a large-size flat panel detector, and incorporated image-processing algorithms with iterative reconstruction techniques, leading to accurate CT numbers allowing dose calculation. In this study, CBCT- and CT-based dose calculations were compared based on three anthropomorphic phantoms, after CBCT-to-mass-density calibration was performed. Six plans were created on the CT scans covering various target locations and complexities, followed by CBCT to CT registrations, copying of contours, and re-calculation of the plans on the CBCT scans. Dose-volume histogram metrics for target volumes and organs-at-risk (OARs) were evaluated, and global gamma analyses were performed.

Results

Target coverage differences were consistently below 1.2 %, demonstrating the agreement between CT and re-calculated CBCT dose distributions. Differences in Dmean for OARs were below 0.5 Gy for all plans, except for three OARs, which were below 0.8 Gy (<1.1 %). All plans had a 3 %/1mm gamma pass rate > 97 %.

Conclusions

This study demonstrated comparable results between dose calculations performed on CBCT and CT acquisitions. The new CBCT system with enhanced image quality and CT number accuracy opens possibilities for off-line and on-line re-planning.

Technical note: Evaluation of deep learning based synthetic CTs clinical readiness for dose and NTCP driven head and neck adaptive proton therapy

BACKGROUND

Adaptive proton therapy workflows rely on accurate imaging throughout the treatment course. Our centre currently utilizes weekly repeat CTs (rCTs) for treatment monitoring and plan adaptations. However, deep learning-based methods have recently shown to successfully correct CBCT images, which suffer from severe imaging artifacts, and generate high quality synthetic CT (sCT) images which enable CBCT-based proton dose calculations.

PURPOSE

To compare daily CBCT-based sCT images to planning CTs (pCT) and rCTs of head and neck (HN) cancer patients to investigate the dosimetric accuracy of CBCT-based sCTs in a scenario mimicking actual clinical practice.

METHODS

Data of 56 HN cancer patients, previously treated with proton therapy was used to generate 1.962 sCT images, using a previously developed and trained deep convolutional neural network. Clinical IMPT treatment plans were recalculated on the pCT, weekly rCTs and daily sCTs. The dosimetric accuracy of sCTs was compared to same day rCTs and the initial planning CT. As a reference, rCTs were also compared to pCTs. The dose difference between sCTs and rCTs/pCT was quantified by calculating the D98 difference for target volumes and Dmean difference for organs-at-risk. To investigate the clinical relevancy of possible dose differences, NTCP values were calculated for dysphagia and xerostomia.

RESULTS

For target volumes, only minor dose differences were found for sCT versus rCT and sCT versus pCT, with dose differences mostly within ±1.5%. Larger dose differences were observed in OARs, where a general shift towards positive differences was found, with the largest difference in the left parotid gland. Delta NTCP values for grade 2 dysphagia and xerostomia were within ±2.5% for 90% of the sCTs.

CONCLUSIONS

Target doses showed high similarity between rCTs and sCTs. Further investigations are required to identify the origin of the dose differences at OAR levels and its relevance in clinical decision making.

SEA-Net: Structure-Enhanced Attention Network for Limited-Angle CBCT Reconstruction of Clinical Projection Data

This work aims to improve limited-angle (LA) cone beam computed tomography (CBCT) by developing deep learning (DL) methods for real clinical CBCT projection data, which is the first feasibility study of clinical-projection-data-based LA-CBCT, to the best of our knowledge. In radiation therapy (RT), CBCT is routinely used as the on-board imaging modality for patient setup. Compared to diagnostic CT, CBCT has a long acquisition time, e.g., 60 seconds for a full 360° rotation, which is subject to the motion artifact. Therefore, the LA-CBCT, if achievable, is of the great interest for the purpose of RT, for its proportionally reduced scanning time in addition to the radiation dose. However, LA-CBCT suffers from severe wedge artifacts and image distortions. Targeting at real clinical projection data, we have explored various DL methods such as image/data/hybrid-domain methods and finally developed a so-called Structure-Enhanced Attention Network (SEA-Net) method that has the best image quality from clinical projection data among the DL methods we have implemented. Specifically, the proposed SEA-Net employs a specialized structure enhancement sub-network to promote texture preservation. Based on the observation that the distribution of wedge artifacts in reconstruction images is non-uniform, the spatial attention module is utilized to emphasize the relevant regions while ignores the irrelevant ones, which leads to more accurate texture restoration.

Generating synthetic images from cone beam computed tomography using self-attention residual UNet for head and neck radiotherapy

Background and purpose

Accurate CT numbers in Cone Beam CT (CBCT) are crucial for precise dose calculations in adaptive radiotherapy (ART). This study aimed to generate synthetic CT (sCT) from CBCT using deep learning (DL) models in head and neck (HN) radiotherapy.

Materials and methods

A novel DL model, the 'self-attention-residual-UNet' (ResUNet), was developed for accurate sCT generation. ResUNet incorporates a self-attention mechanism in its long skip connections to enhance information transfer between the encoder and decoder. Data from 93 HN patients, each with planning CT (pCT) and first-day CBCT images were used. Model performance was evaluated using two DL approaches (non-adversarial and adversarial training) and two model types (2D axial only vs. 2.5D axial, sagittal, and coronal). ResUNet was compared with the traditional UNet through image quality assessment (Mean Absolute Error (MAE), Peak-Signal-to-Noise Ratio (PSNR), Structural Similarity Index (SSIM)) and dose calculation accuracy evaluation (DVH deviation and gamma evaluation (1 %/1mm)).

Results

Image similarity evaluation results for the 2.5D-ResUNet and 2.5D-UNet models were: MAE: 46±7 HU vs. 51±9 HU, PSNR: 66.6±2.0 dB vs. 65.8±1.8 dB, and SSIM: 0.81±0.04 vs. 0.79±0.05. There were no significant differences in dose calculation accuracy between DL models. Both models demonstrated DVH deviation below 0.5 % and a gamma-pass-rate (1 %/1mm) exceeding 97 %.

Conclusions

ResUNet enhanced CT number accuracy and image quality of sCT and outperformed UNet in sCT generation from CBCT. This method holds promise for generating precise sCT for HN ART.

Contour-guided deep learning based deformable image registration for dose monitoring during CBCT-guided radiotherapy of prostate cancer

PURPOSE

To evaluate deep learning (DL)-based deformable image registration (DIR) for dose accumulation during radiotherapy of prostate cancer patients.

METHODS AND MATERIALS

Data including 341 CBCTs (209 daily, 132 weekly) and 23 planning CTs from 23 patients was retrospectively analyzed. Anatomical deformation during treatment was estimated using free-form deformation (FFD) method from Elastix and DL-based VoxelMorph approaches. The VoxelMorph method was investigated using anatomical scans (VMorph_Sc) or label images (VMorph_Msk), or the combination of both (VMorph_Sc_Msk). Accumulated doses were compared with the planning dose.

RESULTS

The DSC ranges, averaged for prostate, rectum and bladder, were 0.60-0.71, 0.67-0.79, 0.93-0.98, and 0.89-0.96 for the FFD, VMorph_Sc, VMorph_Msk, and VMorph_Sc_Msk methods, respectively. When including both anatomical and label images, VoxelMorph estimated more complex deformations resulting in heterogeneous determinant of Jacobian and higher percentage of deformation vector field (DVF) folding (up to a mean value of 1.90% in the prostate). Large differences were observed between DL-based methods regarding estimation of the accumulated dose, showing systematic overdosage and underdosage of the bladder and rectum, respectively. The difference between planned mean dose and accumulated mean dose with VMorph_Sc_Msk reached a median value of +6.3 Gy for the bladder and -5.1 Gy for the rectum.

CONCLUSION

The estimation of the deformations using DL-based approach is feasible for male pelvic anatomy but requires the inclusion of anatomical contours to improve organ correspondence. High variability in the estimation of the accumulated dose depending on the deformable strategy suggests further investigation of DL-based techniques before clinical deployment.

Assessment of dosimetric impact of interfractional 6D setup error in tongue cancer treated with IMRT and VMAT using daily kV-CBCT

Background

This study aimed to evaluate the dosimetric influence of 6-dimensional (6D) interfractional setup error in tongue cancer treated with intensity-modulated radiation therapy (IMRT) and volumetric modulated arc therapy (VMAT) using daily kilovoltage cone-beam computed tomography (kV-CBCT).

Materials and methods

This retrospective study included 20 tongue cancer patients treated with IMRT (10), VMAT (10), and daily kV-CBCT image guidance. Interfraction 6D setup errors along the lateral, longitudinal, vertical, pitch, roll, and yaw axes were evaluated for 600 CBCTs. Structures in the planning CT were deformed to the CBCT using deformable registration. For each fraction, a reference CBCT structure set with no rotation error was created. The treatment plan was recalculated on the CBCTs with the rotation error (R_Error), translation error (T_Error), and translation plus rotation error (T+R_Error). For targets and organs at risk (OARs), the dosimetric impacts of R_Error, T_Error, and T+R_Error were evaluated without and with moderate correction of setup errors.

Results

The maximum dose variation ΔD (%) for D_98% in clinical target volumes (CTV): CTV-60, CTV-54, planning target volumes (PTV): PTV-60, and PTV-54 was -1.2%, -1.9%, -12.0%, and -12.3%, respectively, in the T+R_Error without setup error correction. The maximum ΔD (%) for D_98% in CTV-60, CTV-54, PTV-60, and PTV-54 was -1.0%, -1.7%, -9.2%, and -9.5%, respectively, in the T+R_Error with moderate setup error correction. The dosimetric impact of interfractional 6D setup errors was statistically significant (p < 0.05) for D_98% in CTV-60, CTV-54, PTV-60, and PTV-54.

Conclusions

The uncorrected interfractional 6D setup errors could significantly impact the delivered dose to targets and OARs in tongue cancer. That emphasized the importance of daily 6D setup error correction in IMRT and VMAT.

Enhancing Radiotherapy Workflow for Head and Neck Cancer with Artificial Intelligence: A Systematic Review

BACKGROUND

Head and neck cancer (HNC) is characterized by complex-shaped tumors and numerous organs at risk (OARs), inducing challenging radiotherapy (RT) planning, optimization, and delivery. In this review, we provided a thorough description of the applications of artificial intelligence (AI) tools in the HNC RT process.

METHODS

The PubMed database was queried, and a total of 168 articles (2016-2022) were screened by a group of experts in radiation oncology. The group selected 62 articles, which were subdivided into three categories, representing the whole RT workflow: (i) target and OAR contouring, (ii) planning, and (iii) delivery.

RESULTS

The majority of the selected studies focused on the OARs segmentation process. Overall, the performance of AI models was evaluated using standard metrics, while limited research was found on how the introduction of AI could impact clinical outcomes. Additionally, papers usually lacked information about the confidence level associated with the predictions made by the AI models.

CONCLUSIONS

AI represents a promising tool to automate the RT workflow for the complex field of HNC treatment. To ensure that the development of AI technologies in RT is effectively aligned with clinical needs, we suggest conducting future studies within interdisciplinary groups, including clinicians and computer scientists.

Practical and technical key challenges in head and neck adaptive radiotherapy: The GORTEC point of view

Anatomical variations occur during head and neck (H&N) radiotherapy (RT) treatment. These variations may result in underdosage to the target volume or overdosage to the organ at risk. Replanning during the treatment course can be triggered to overcome this issue. Due to technological, methodological and clinical evolutions, tools for adaptive RT (ART) are becoming increasingly sophisticated. The aim of this paper is to give an overview of the key steps of an H&N ART workflow and tools from the point of view of a group of French-speaking medical physicists and physicians (from GORTEC). Focuses are made on image registration, segmentation, estimation of the delivered dose of the day, workflow and quality assurance for an implementation of H&N offline and online ART. Practical recommendations are given to assist physicians and medical physicists in a clinical workflow.

Combining physics-based models with deep learning image synthesis and uncertainty in intraoperative cone-beam CT of the brain

BACKGROUND

Image-guided neurosurgery requires high localization and registration accuracy to enable effective treatment and avoid complications. However, accurate neuronavigation based on preoperative magnetic resonance (MR) or computed tomography (CT) images is challenged by brain deformation occurring during the surgical intervention.

PURPOSE

To facilitate intraoperative visualization of brain tissues and deformable registration with preoperative images, a 3D deep learning (DL) reconstruction framework (termed DL-Recon) was proposed for improved intraoperative cone-beam CT (CBCT) image quality.

METHODS

The DL-Recon framework combines physics-based models with deep learning CT synthesis and leverages uncertainty information to promote robustness to unseen features. A 3D generative adversarial network (GAN) with a conditional loss function modulated by aleatoric uncertainty was developed for CBCT-to-CT synthesis. Epistemic uncertainty of the synthesis model was estimated via Monte Carlo (MC) dropout. Using spatially varying weights derived from epistemic uncertainty, the DL-Recon image combines the synthetic CT with an artifact-corrected filtered back-projection (FBP) reconstruction. In regions of high epistemic uncertainty, DL-Recon includes greater contribution from the FBP image. Twenty paired real CT and simulated CBCT images of the head were used for network training and validation, and experiments evaluated the performance of DL-Recon on CBCT images containing simulated and real brain lesions not present in the training data. Performance among learning- and physics-based methods was quantified in terms of structural similarity (SSIM) of the resulting image to diagnostic CT and Dice similarity metric (DSC) in lesion segmentation compared to ground truth. A pilot study was conducted involving seven subjects with CBCT images acquired during neurosurgery to assess the feasibility of DL-Recon in clinical data.

RESULTS

CBCT images reconstructed via FBP with physics-based corrections exhibited the usual challenges to soft-tissue contrast resolution due to image non-uniformity, noise, and residual artifacts. GAN synthesis improved image uniformity and soft-tissue visibility but was subject to error in the shape and contrast of simulated lesions that were unseen in training. Incorporation of aleatoric uncertainty in synthesis loss improved estimation of epistemic uncertainty, with variable brain structures and unseen lesions exhibiting higher epistemic uncertainty. The DL-Recon approach mitigated synthesis errors while maintaining improvement in image quality, yielding 15%-22% increase in SSIM (image appearance compared to diagnostic CT) and up to 25% increase in DSC in lesion segmentation compared to FBP. Clear gains in visual image quality were also observed in real brain lesions and in clinical CBCT images.

CONCLUSIONS

DL-Recon leveraged uncertainty estimation to combine the strengths of DL and physics-based reconstruction and demonstrated substantial improvements in the accuracy and quality of intraoperative CBCT. The improved soft-tissue contrast resolution could facilitate visualization of brain structures and support deformable registration with preoperative images, further extending the utility of intraoperative CBCT in image-guided neurosurgery.

Fan beam CT image synthesis from cone beam CT image using nested residual UNet based conditional generative adversarial network

A radiotherapy technique called Image-Guided Radiation Therapy adopts frequent imaging throughout a treatment session. Fan Beam Computed Tomography (FBCT) based planning followed by Cone Beam Computed Tomography (CBCT) based radiation delivery drastically improved the treatment accuracy. Furtherance in terms of radiation exposure and cost can be achieved if FBCT could be replaced with CBCT. This paper proposes a Conditional Generative Adversarial Network (CGAN) for CBCT-to-FBCT synthesis. Specifically, a new architecture called Nested Residual UNet (NR-UNet) is introduced as the generator of the CGAN. A composite loss function, which comprises adversarial loss, Mean Squared Error (MSE), and Gradient Difference Loss (GDL), is used with the generator. The CGAN utilises the inter-slice dependency in the input by taking three consecutive CBCT slices to generate an FBCT slice. The model is trained using Head-and-Neck (H&N) FBCT-CBCT images of 53 cancer patients. The synthetic images exhibited a Peak Signal-to-Noise Ratio of 34.04±0.93 dB, Structural Similarity Index Measure of 0.9751±0.001 and a Mean Absolute Error of 14.81±4.70 HU. On average, the proposed model guarantees an improvement in Contrast-to-Noise Ratio four times better than the input CBCT images. The model also minimised the MSE and alleviated blurriness. Compared to the CBCT-based plan, the synthetic image results in a treatment plan closer to the FBCT-based plan. The three-slice to single-slice translation captures the three-dimensional contextual information in the input. Besides, it withstands the computational complexity associated with a three-dimensional image synthesis model. Furthermore, the results demonstrate that the proposed model is superior to the state-of-the-art methods.

Dosimetric comparison of deformable image registration and synthetic CT generation based on CBCT images for organs at risk in cervical cancer radiotherapy

OBJECTIVE

Anatomical variations existing in cervical cancer radiotherapy treatment can be monitored by cone-beam computed tomography (CBCT) images. Deformable image registration (DIR) from planning CT (pCT) to CBCT images and synthetic CT (sCT) image generation based on CBCT are two methods for improving the quality of CBCT images. This study aims to compare the accuracy of these two approaches geometrically and dosimetrically in cervical cancer radiotherapy.

METHODS

In this study, 40 paired pCT-CBCT images were collected to evaluate the accuracy of DIR and sCT generation. The DIR method was based on a 3D multistage registration network that was trained with 150 paired pCT-CBCT images, and the sCT generation method was performed based on a 2D cycle-consistent adversarial network (CycleGAN) with 6000 paired pCT-CBCT slices for training. Then, the doses were recalculated with the CBCT, pCT, deformed pCT (dpCT) and sCT images by a GPU-based Monte Carlo dose code, ArcherQA, to obtain Dose_CBCT, Dose_pCT, Dose_dpCT and Dose_sCT. Organs at risk (OARs) included small intestine, rectum, bladder, spinal cord, femoral heads and bone marrow, CBCT and pCT contours were delineated manually, dpCT contours were propagated through deformation vector fields, sCT contours were auto-segmented and corrected manually.

RESULTS

The global gamma pass rate of Dose_sCT and Dose_dpCT was 99.66% ± 0.34%, while that of Dose_CBCT and Dose_dpCT was 85.92% ± 7.56% at the 1%/1 mm criterion and a low-dose threshold of 10%. Based on Dose_dpCT as uniform dose distribution, there were comparable errors in femoral heads and bone marrow for the dpCT and sCT contours compared with CBCT contours, while sCT contours had lower errors in small intestine, rectum, bladder and spinal cord, especially for those with large volume difference of pCT and CBCT.

CONCLUSIONS

For cervical cancer radiotherapy, the DIR method and sCT generation could produce similar precise dose distributions, but sCT contours had higher accuracy when the difference in planning CT and CBCT was large.

Daily dose evaluation based on corrected CBCTs for breast cancer patients: accuracy of dose and complication risk assessment

OBJECTIVES

The goal of this study is to validate different CBCT correction methods to select the superior method that can be used for dose evaluation in breast cancer patients with large anatomical changes treated with photon irradiation.

MATERIALS AND METHOD

Seventy-six breast cancer patients treated with a partial VMAT photon technique (70% conformal, 30% VMAT) were included in this study. All patients showed at least a 5 mm variation (swelling or shrinkage) of the breast on the CBCT compared to the planning-CT (pCT) and had a repeat-CT (rCT) for dose evaluation acquired within 3 days of this CBCT. The original CBCT was corrected using four methods: (1) HU-override correction (CBCT_HU), (2) analytical correction and conversion (CBCT_CC), (3) deep learning (DL) correction (CT_DL) and (4) virtual correction (CT_V). Image quality evaluation consisted of calculating the mean absolute error (MAE) and mean error (ME) within the whole breast clinical target volume (CTV) and the field of view of the CBCT minus 2 cm (CBCT-ROI) with respect to the rCT. The dose was calculated on all image sets using the clinical treatment plan for dose and gamma passing rate analysis.

RESULTS

The MAE of the CBCT-ROI was below 66 HU for all corrected CBCTs, except for the CBCT_HU with a MAE of 142 HU. No significant dose differences were observed in the CTV regions in the CBCT_CC, CT_DL and CT_v. Only the CBCT_HU deviated significantly (p < 0.01) resulting in 1.7% (± 1.1%) average dose deviation. Gamma passing rates were > 95% for 2%/2 mm for all corrected CBCTs.

CONCLUSION

The analytical correction and conversion, deep learning correction and virtual correction methods can be applied for an accurate CBCT correction that can be used for dose evaluation during the course of photon radiotherapy of breast cancer patients.

Evaluation of the dosimetric influence of interfractional 6D setup error in hypofractionated prostate cancer treated with IMRT and VMAT using daily kV-CBCT

INTRODUCTION

Prostate cancer is one of the most common malignant tumors in men and is usually treated with advanced intensity modulated radiation therapy (IMRT) and volumetric modulated arc therapy (VMAT). Significant uncorrected interfractional 6-Dimensional setup errors could impact the delivered dose. The aim of this study was to assess the dosimetric impact of 6D interfractional setup errors in hypofractionated prostate cancer using daily kilovoltage cone-beam computed tomography (kV-CBCT).

METHODS

This retrospective study comprised twenty prostate cancer patients treated with hypofractionated IMRT (8) and VMAT (12) with daily kV-CBCT image guidance. Interfraction 6D setup errors along lateral, longitudinal, vertical, pitch, roll, and yaw axes were evaluated for 400 CBCTs. For targets and organs at risk (OARs), the dosimetric impact of rotational error (R_Error), translational error (T_Error), and translational plus rotational error (T+R_Error) were evaluated on kV-CBCT images.

RESULTS

The single fraction maximum T_Error ranged from 12-20 mm, and the R_Error ranged from 2.8⁰-3.0⁰. The maximum mean absolute dose variation ΔD in D_98% (dose to 98% volume) of CTV-55 and PTV-55 was -0.66±0.82 and -5.94±3.8 Gy, respectively, in the T+R_Error. The maximum ΔD (%) for D_98% and D_0.035cc in CTV-55 was -4.29% and 2.49%, respectively, while in PTV-55 it was -24.9% and 2.36%. The mean dose reduction for D_98% in CTV-55 and D_98% and D_95% in PTV-55 was statistically significant (p<0.05) for T_Error and T+R_Error. The mean dose variation for D_mean and D_50% in the rectum was statistically significant (p<0.05) for T_Error and T+R_Error.

CONCLUSION

The uncorrected interfractional 6D setup error results in significant target underdosing and OAR overdosing in prostate cancer. This emphasizes the need to correct interfractional 6D setup errors daily in IMRT and VMAT.

Assessment of CBCT-based synthetic CT generation accuracy for adaptive radiotherapy planning

PURPOSE

Cone-beam CT (CBCT)-based synthetic CT (sCT) dose calculation has the potential to make the adaptive radiotherapy (ART) pathway more efficient while removing subjectivity. This study assessed four sCT generation methods using 15 head-and-neck rescanned ART patients. Each patient's planning CT (pCT), rescan CT (rCT), and CBCT post-rCT was acquired with the CBCT deformably registered to the rCT (dCBCT).

METHODS

The four methods investigated were as follows: method 1-deformably registering the pCT to the dCBCT. Method 2-assigning six mass density values to the dCBCT. Method 3-iteratively removing artifacts and correcting the dCBCT Hounsfield units (HU). Method 4-using a cycle general adversarial network machine learning model (trained with 45 paired pCT and CBCT). Treatment plans were created on the rCT and recalculated on each sCT. Planning target volume (PTV) and organ-at-risk (OAR) structures were contoured by clinicians on the rCT (high-dose PTV, low-dose PTV, spinal canal, larynx, brainstem, and parotids) to allow the assessment of dose-volume histogram statistics at clinically relevant points.

RESULTS

The HU mean absolute error (MAE) and minimum dose gamma index pass rate (2%/2 mm) were calculated, and the generation time was measured for 15 patients using the rCT as the comparator. For methods 1-4 the MAE, gamma index analysis, and generation time were as follows: 59.7 HU, 100.0%, and 143 s; 164.2 HU, 95.2%, and 232 s; 75.7 HU, 99.9%, and 153 s; and 79.4 HU, 99.8%, and 112 s, respectively. Dose differences for PTVs and OARs were all <0.3 Gy except for method 2 (<0.5 Gy).

CONCLUSION

All methods were considered clinically viable. The machine learning method was found to be most suitable for clinical implementation due to its high dosimetric accuracy and short generation time. Further investigation is required for larger anatomical changes between the CBCT and pCT and for other anatomical sites.

Evaluation of dose accumulation methods and workflows utilising cone beam computed tomography images

INTRODUCTION

Various adaptive radiation therapy (ART) methods have emerged, with little consensus amongst the literature as to which is most appropriate. This study aimed to compare dose mapping (DM) versus Monte Carlo recalculation (MCR), using cone beam computed tomography (CBCT) images when utilised in automated ART dose accumulation workflows in the MIM Maestro software package.

METHODS

The treatment plans for 38 cancer patients (19 prostate and 19 head and neck cases) were used to perform DM or MCR retrospectively upon CBCTs acquired during treatment, which were then deformably registered to the planning CT (DR-pCT) to facilitate dose accumulation. Dose-volume and region-of-interest data were extracted for the planning target volumes and organs at risk. Intraclass correlation (ICC) values and Bland-Altman plots were utilised to compare DM versus MCR doses on the CBCT images as well as CBCT versus DR-pCT doses.

RESULTS

When comparing DM and MCR on CBCTs, the differences across dose level mean dose differences were mostly within a ±5% level of agreement based on the Bland-Altman plots, with over 67% of ICC values over 0.9 and indicative of good correlation. When these distributions were deformed back to the planning CT, the agreement was reduced considerably, with larger differences (exceeding ±5%) resulting from workflow-related issues.

CONCLUSION

The results emphasise the need to consider and make adaptations to minimise the effect of workflows on algorithm performance. Manual user intervention, refined departmental protocols and further developments to the MIM Maestro software will enhance the use of this tool.

Deep learning methods for enhancing cone-beam CT image quality towards adaptive radiation therapy: A systematic review

The use of deep learning (DL) to improve cone-beam CT (CBCT) image quality has gained popularity as computational resources and algorithmic sophistication have advanced in tandem. CBCT imaging has the potential to facilitate online adaptive radiation therapy (ART) by utilizing up-to-date patient anatomy to modify treatment parameters before irradiation. Poor CBCT image quality has been an impediment to realizing ART due to the increased scatter conditions inherent to cone-beam acquisitions. Given the recent interest in DL applications in radiation oncology, and specifically DL for CBCT correction, we provide a systematic theoretical and literature review for future stakeholders. The review encompasses DL approaches for synthetic CT generation, as well as projection domain methods employed in the CBCT correction literature. We review trends pertaining to publications from January 2018 to April 2022 and condense their major findings - with emphasis on study design and deep learning techniques. Clinically relevant endpoints relating to image quality and dosimetric accuracy are summarised, highlighting gaps in the literature. Finally, we make recommendations for both clinicians and DL practitioners based on literature trends and the current DL state of the art methods utilized in radiation oncology. This article is protected by copyright. All rights reserved.

Application of informatics in cancer research and clinical practice: Opportunities and challenges

Cancer informatics has significantly progressed in the big data era. We summarize the application of informatics approaches to the cancer domain from both the informatics perspective (e.g., data management and data science) and the clinical perspective (e.g., cancer screening, risk assessment, diagnosis, treatment, and prognosis). We discuss various informatics methods and tools that are widely applied in cancer research and practices, such as cancer databases, data standards, terminologies, high-throughput omics data mining, machine-learning algorithms, artificial intelligence imaging, and intelligent radiation. We also address the informatics challenges within the cancer field that pursue better treatment decisions and patient outcomes, and focus on how informatics can provide opportunities for cancer research and practices. Finally, we conclude that the interdisciplinary nature of cancer informatics and collaborations are major drivers for future research and applications in clinical practices. It is hoped that this review is instrumental for cancer researchers and clinicians with its informatics-specific insights.

Research on new treatment mode of radiotherapy based on pseudo-medical images

BACKGROUND AND OBJECTIVE

Multi-modal medical images with multiple feature information are beneficial for radiotherapy. A new radiotherapy treatment mode based on triangle generative adversarial network (TGAN) model was proposed to synthesize pseudo-medical images between multi-modal datasets.

METHODS

CBCT, MRI and CT images of 80 patients with nasopharyngeal carcinoma were selected. The TGAN model based on multi-scale discriminant network was used for data training between different image domains. The generator of the TGAN model refers to cGAN and CycleGAN, and only one generation network can establish the non-linear mapping relationship between multiple image domains. The discriminator used multi-scale discrimination network to guide the generator to synthesize pseudo-medical images that are similar to real images from both shallow and deep aspects. The accuracy of pseudo-medical images was verified in anatomy and dosimetry.

RESULTS

In the three synthetic directions, namely, CBCT → CT, CBCT → MRI, and MRI → CT, significant differences (p < 0.05) in the three-fold-cross validation results on PSNR and SSIM metrics between the pseudo-medical images obtained based on TGAN and the real images. In the testing stage, for TGAN, the MAE metric results in the three synthesis directions (CBCT → CT, CBCT → MRI, and MRI → CT) were presented as mean (standard deviation), which were 68.67 (5.83), 83.14 (8.48), and 79.96 (7.59), and the NMI metric results were 0.8643 (0.0253), 0.8051 (0.0268), and 0.8146 (0.0267) respectively. In terms of dose verification, the differences in dose distribution between the pseudo-CT obtained by TGAN and the real CT were minimal. The H values of the measurement results of dose uncertainty in PGTV, PGTVnd, PTV1, and PTV2 were 42.510, 43.121, 17.054, and 7.795, respectively (P < 0.05). The differences were statistically significant. The gamma pass rate (2%/2 mm) of pseudo-CT obtained by the new model was 94.94% (0.73%), and the numerical results were better than those of the three other comparison models.

CONCLUSIONS

The pseudo-medical images acquired based on TGAN were close to the real images in anatomy and dosimetry. The pseudo-medical images synthesized by the TGAN model have good application prospects in clinical adaptive radiotherapy.

Improved accuracy of relative electron density and proton stopping power ratio through CycleGAN machine learning

Objective. Kilovoltage computed tomography (kVCT) is the cornerstone of radiotherapy treatment planning for delineating tissues and towards dose calculation. For the former, kVCT provides excellent contrast and signal-to-noise ratio. For the latter, kVCT may have greater uncertainty in determining relative electron density ( ρ e ) and proton stopping power ratio (SPR). Conversely, megavoltage CT (MVCT) may result in superior dose calculation accuracy. The purpose of this work was to convert kVCT HU to MVCT HU using deep learning to obtain higher accuracy ρ e and SPR. Approach. Tissue-mimicking phantoms were created to compare kVCT- and MVCT-determined ρ e and SPR to physical measurements. Using 100 head-and-neck datasets, an unpaired deep learning model was trained to learn the relationship between kVCTs and MVCTs, creating synthetic MVCTs (sMVCTs). Similarity metrics were calculated between kVCTs, sMVCTs, and MVCTs in 20 test datasets. An anthropomorphic head phantom containing bone-mimicking material with known composition was scanned to provide an independent determination of ρ e and SPR accuracy by sMVCT. Main results. In tissue-mimicking bone, ρ e errors were 2.20% versus 0.19% and SPR errors were 4.38% versus 0.22%, for kVCT versus MVCT, respectively. Compared to MVCT, in vivo mean difference (MD) values were 11 and 327 HU for kVCT and 2 and 3 HU for sMVCT in soft tissue and bone, respectively. ρ e MD decreased from 1.3% to 0.35% in soft tissue and 2.9% to 0.13% in bone, for kVCT and sMVCT, respectively. SPR MD decreased from 1.8% to 0.24% in soft tissue and 6.8% to 0.16% in bone, for kVCT and sMVCT, respectively. Relative to physical measurements, ρ e and SPR error in anthropomorphic bone decreased from 7.50% and 7.48% for kVCT to <1% for both MVCT and sMVCT. Significance. Deep learning can be used to map kVCT to sMVCT, suggesting higher accuracy ρ e and SPR is achievable with sMVCT versus kVCT.

Recent Applications of Artificial Intelligence in Radiotherapy: Where We Are and Beyond

In recent decades, artificial intelligence (AI) tools have been applied in many medical fields, opening the possibility of finding novel solutions for managing very complex and multifactorial problems, such as those commonly encountered in radiotherapy (RT). We conducted a PubMed and Scopus search to identify the AI application field in RT limited to the last four years. In total, 1824 original papers were identified, and 921 were analyzed by considering the phase of the RT workflow according to the applied AI approaches. AI permits the processing of large quantities of information, data, and images stored in RT oncology information systems, a process that is not manageable for individuals or groups. AI allows the iterative application of complex tasks in large datasets (e.g., delineating normal tissues or finding optimal planning solutions) and might support the entire community working in the various sectors of RT, as summarized in this overview. AI-based tools are now on the roadmap for RT and have been applied to the entire workflow, mainly for segmentation, the generation of synthetic images, and outcome prediction. Several concerns were raised, including the need for harmonization while overcoming ethical, legal, and skill barriers.

Evaluation of kV-CBCT based 3D dose calculation accuracy and its validation using delivery fluence derived dose metrics in Head and Neck Cancer

PURPOSE

The purpose of this study is to evaluate the dosimetric impact of Hounsfield unit (HU) variations in kilovoltage cone-beam computed tomography (kV-CBCT) based 3D dose calculation accuracy in the treatment planning system and its validation using measured treatment delivery dose (MTDD) derived dose metrics for Volumetric Modulated Arc Therapy (VMAT) and Intensity Modulated Radiotherapy (IMRT) plans in Head and Neck (HN) Cancer.

METHODS

CBCT dose calculation accuracy was evaluated for 8 VMAT plans on inhomogeneous phantom and 40 VMAT and IMRT plans of HN Cancer patients and validated using ArcCHECK diode array MTDD derived 3D dose metric on CT and CBCT.

RESULTS

The mean percentage dose difference between CBCT and CT in TPS (ΔD(CBCT-CT)_TPS) and 3DVH (ΔD(CBCT-CT)_3DVH) were compared for the corresponding evaluation dose metrics (D_98%, D_95%, D_50%, D_2%, D_max, D_1cc, D_0.03cc, D_mean) of all PTVs and OARs in phantom and patients. ΔD(CBCT-CT)_TPS and ΔD(CBCT-CT)_3DVH for all evaluation dose points of all PTVs and OARs were less than 2.55% in phantom and 2.4% in HN patients. The Pearson correlation coefficient (r) between ΔD(CBCT-CT)_TPS and ΔD(CBCT-CT)_3DVH for all dose points in all PTVs and OARs showed a strong to moderate correlation in phantom and patients with p < 0.001.

CONCLUSIONS

This study evaluated and validated the potential feasibility of kV-CBCT for treatment plan 3D dose reconstruction in clinical decision making for Adaptive radiotherapy on CT in Head and Neck cancer.

Automatic brain segmentation in preterm infants with post-hemorrhagic hydrocephalus using 3D Bayesian U-Net

Post‐hemorrhagic hydrocephalus (PHH) is a severe complication of intraventricular hemorrhage (IVH) in very preterm infants. PHH monitoring and treatment decisions rely heavily on manual and subjective two‐dimensional measurements of the ventricles. Automatic and reliable three‐dimensional (3D) measurements of the ventricles may provide a more accurate assessment of PHH, and lead to improved monitoring and treatment decisions. To accurately and efficiently obtain these 3D measurements, automatic segmentation of the ventricles can be explored. However, this segmentation is challenging due to the large ventricular anatomical shape variability in preterm infants diagnosed with PHH. This study aims to (a) propose a Bayesian U‐Net method using 3D spatial concrete dropout for automatic brain segmentation (with uncertainty assessment) of preterm infants with PHH; and (b) compare the Bayesian method to three reference methods: DenseNet, U‐Net, and ensemble learning using DenseNets and U‐Nets. A total of 41 T₂‐weighted MRIs from 27 preterm infants were manually segmented into lateral ventricles, external CSF, white and cortical gray matter, brainstem, and cerebellum. These segmentations were used as ground truth for model evaluation. All methods were trained and evaluated using 4‐fold cross‐validation and segmentation endpoints, with additional uncertainty endpoints for the Bayesian method. In the lateral ventricles, segmentation endpoint values for the DenseNet, U‐Net, ensemble learning, and Bayesian U‐Net methods were mean Dice score = 0.814 ± 0.213, 0.944 ± 0.041, 0.942 ± 0.042, and 0.948 ± 0.034 respectively. Uncertainty endpoint values for the Bayesian U‐Net were mean recall = 0.953 ± 0.037, mean  negative predictive value = 0.998 ± 0.005, mean accuracy = 0.906 ± 0.032, and mean AUC = 0.949 ± 0.031. To conclude, the Bayesian U‐Net showed the best segmentation results across all methods and provided accurate uncertainty maps. This method may be used in clinical practice for automatic brain segmentation of preterm infants with PHH, and lead to better PHH monitoring and more informed treatment decisions.

A deep-learning method for generating synthetic kV-CT and improving tumor segmentation for helical tomotherapy of nasopharyngeal carcinoma

Objective:Megavoltage computed tomography (MV-CT) is used for setup verification and adaptive radiotherapy in tomotherapy. However, its low contrast and high noise lead to poor image quality. This study aimed to develop a deep-learning-based method to generate synthetic kilovoltage CT (skV-CT) and then evaluate its ability to improve image quality and tumor segmentation.Approach:The planning kV-CT and MV-CT images of 270 patients with nasopharyngeal carcinoma (NPC) treated on an Accuray TomoHD system were used. An improved cycle-consistent adversarial network which used residual blocks as its generator was adopted to learn the mapping between MV-CT and kV-CT and then generate skV-CT from MV-CT. A Catphan 700 phantom and 30 patients with NPC were used to evaluate image quality. The quantitative indices included contrast-to-noise ratio (CNR), uniformity and signal-to-noise ratio (SNR) for the phantom and the structural similarity index measure (SSIM), mean absolute error (MAE), and peak signal-to-noise ratio (PSNR) for patients. Next, we trained three models for segmentation of the clinical target volume (CTV): MV-CT, skV-CT, and MV-CT combined with skV-CT. The segmentation accuracy was compared with indices of the dice similarity coefficient (DSC) and mean distance agreement (MDA).Mainresults:Compared with MV-CT, skV-CT showed significant improvement in CNR (184.0%), image uniformity (34.7%), and SNR (199.0%) in the phantom study and improved SSIM (1.7%), MAE (24.7%), and PSNR (7.5%) in the patient study. For CTV segmentation with only MV-CT, only skV-CT, and MV-CT combined with skV-CT, the DSCs were 0.75 ± 0.04, 0.78 ± 0.04, and 0.79 ± 0.03, respectively, and the MDAs (in mm) were 3.69 ± 0.81, 3.14 ± 0.80, and 2.90 ± 0.62, respectively.Significance:The proposed method improved the image quality of MV-CT and thus tumor segmentation in helical tomotherapy. The method potentially can benefit adaptive radiotherapy.

Generating synthetic CT from low-dose cone-beam CT by using generative adversarial networks for adaptive radiotherapy

OBJECTIVE

To develop high-quality synthetic CT (sCT) generation method from low-dose cone-beam CT (CBCT) images by using attention-guided generative adversarial networks (AGGAN) and apply these images to dose calculations in radiotherapy.

METHODS

The CBCT/planning CT images of 170 patients undergoing thoracic radiotherapy were used for training and testing. The CBCT images were scanned under a fast protocol with 50% less clinical projection frames compared with standard chest M20 protocol. Training with aligned paired images was performed using conditional adversarial networks (so-called pix2pix), and training with unpaired images was carried out with cycle-consistent adversarial networks (cycleGAN) and AGGAN, through which sCT images were generated. The image quality and Hounsfield unit (HU) value of the sCT images generated by the three neural networks were compared. The treatment plan was designed on CT and copied to sCT images to calculated dose distribution.

RESULTS

The image quality of sCT images by all the three methods are significantly improved compared with original CBCT images. The AGGAN achieves the best image quality in the testing patients with the smallest mean absolute error (MAE, 43.5 ± 6.69), largest structural similarity (SSIM, 93.7 ± 3.88) and peak signal-to-noise ratio (PSNR, 29.5 ± 2.36). The sCT images generated by all the three methods showed superior dose calculation accuracy with higher gamma passing rates compared with original CBCT image. The AGGAN offered the highest gamma passing rates (91.4 ± 3.26) under the strictest criteria of 1 mm/1% compared with other methods. In the phantom study, the sCT images generated by AGGAN demonstrated the best image quality and the highest dose calculation accuracy.

CONCLUSIONS

High-quality sCT images were generated from low-dose thoracic CBCT images by using the proposed AGGAN through unpaired CBCT and CT images. The dose distribution could be calculated accurately based on sCT images in radiotherapy.

Impact of Acquisition Protocols on Accuracy of Dose Calculation Based on XVI Cone Beam Computed Tomography

Purpose:

The objective of this work is to study the impact of acquisition protocols on the accuracy of cone beam computed tomography (CBCT)-based dose calculation and to determinate its limits from image characteristics such as image quality, Hounsfield numbers consistency, and restrictive sizes of volume acquisition, compared to the CT imaging for the different anatomy localizations: head and neck (H&N), thorax, and pelvis.

Materials and Methods:

In this work, we used a routine on-board imaging CBCT of the XVI system (Elekta, Stockholm, Sweden). Dosimetric calculations performed on CT images require the knowledge of the Hounsfield unit-relative electron density (HU-ReD) calibration curve, which is determined for each imaging technology and must be adapted to the imaging acquisition parameters (filter/field of view). The accuracy of the dose calculation from CBCT images strongly depends on the quality of these images and also on the appropriate correspondence to the electronic densities, which will be used by the treatment planning system to simulate the dose distribution. In this study, we evaluated the accuracy of the dose calculation for each protocol, as already pointed in many studies.

Results:

As a result, the protocols that give better results in terms of dose calculation are F0S20 for the H&N region and F1M20 for the thoracic and pelvic regions, with an error <2% compared to results obtained with CT images. In addition, the dose distributions obtained with CT and CBCT imaging modalities were compared by two different methods. The first comparison was done by gamma index in three planes (sagittal, coronal, and transverse) with 2%; 2 mm criteria. The results showed good correspondence, with more than 95% of points passed the criteria. We also compared the target volume, the organs at risk (OARs), and the maximum and minimum doses for the three localizations (H&N, thorax, and pelvis) in CT and CBCT imaging modalities using a Rando phantom.

Conclusions:

The choice of the adequate CBCT acquisition protocol and the appropriate phantom to determine the HU-ReD calibration curve provides a better precision in the calculation of dose on CBCT images. This allows improving the results obtained when using the HU-ReD calibration method for dose calculation in adaptive radiotherapy.

Deep learning based synthetic-CT generation in radiotherapy and PET: A review

Recently,deep learning (DL)-based methods for the generation of synthetic computed tomography (sCT) have received significant research attention as an alternative to classical ones. We present here a systematic review of these methods by grouping them into three categories, according to their clinical applications: (i) to replace computed tomography in magnetic resonance (MR) based treatment planning, (ii) facilitate cone-beam computed tomography based image-guided adaptive radiotherapy, and (iii) derive attenuation maps for the correction of positron emission tomography. Appropriate database searching was performed on journal articles published between January 2014 and December 2020. The DL methods' key characteristics were extracted from each eligible study, and a comprehensive comparison among network architectures and metrics was reported. A detailed review of each category was given, highlighting essential contributions, identifying specific challenges, and summarizing the achievements. Lastly, the statistics of all the cited works from various aspects were analyzed, revealing the popularity and future trends and the potential of DL-based sCT generation. The current status of DL-based sCT generation was evaluated, assessing the clinical readiness of the presented methods.

Dosimetric benefits of daily treatment plan adaptation for prostate cancer stereotactic body radiotherapy

BACKGROUND

Hypofractionation is increasingly being applied in radiotherapy for prostate cancer, requiring higher accuracy of daily treatment deliveries than in conventional image-guided radiotherapy (IGRT). Different adaptive radiotherapy (ART) strategies were evaluated with regard to dosimetric benefits.

METHODS

Treatments plans for 32 patients were retrospectively generated and analyzed according to the PACE-C trial treatment scheme (40 Gy in 5 fractions). Using a previously trained cycle-generative adversarial network algorithm, synthetic CT (sCT) were generated out of five daily cone-beam CT. Dose calculation on sCT was performed for four different adaptation approaches: IGRT without adaptation, adaptation via segment aperture morphing (SAM) and segment weight optimization (ART1) or additional shape optimization (ART2) as well as a full re-optimization (ART3). Dose distributions were evaluated regarding dose-volume parameters and a penalty score.

RESULTS

Compared to the IGRT approach, the ART1, ART2 and ART3 approaches substantially reduced the V37Gy(bladder) and V36Gy(rectum) from a mean of 7.4cm3 and 2.0cm3 to (5.9cm3, 6.1cm3, 5.2cm3) as well as to (1.4cm3, 1.4cm3, 1.0cm3), respectively. Plan adaptation required on average 2.6 min for the ART1 approach and yielded doses to the rectum being insignificantly different from the ART2 approach. Based on an accumulation over the total patient collective, a penalty score revealed dosimetric violations reduced by 79.2%, 75.7% and 93.2% through adaptation.

CONCLUSION

Treatment plan adaptation was demonstrated to adequately restore relevant dose criteria on a daily basis. While for SAM adaptation approaches dosimetric benefits were realized through ensuring sufficient target coverage, a full re-optimization mainly improved OAR sparing which helps to guide the decision of when to apply which adaptation strategy.

Alert system for monitoring changes in patient anatomy during radiation therapy of head and neck cancer

The purpose of this study is to validate a previously developed algorithm for alerting clinicians when to consider re-CT simulation due to changes in the patient's anatomy during radiation therapy of head and neck cancer. Cone beam computed tomography (CBCT) data were collected prospectively for 77 patients. Each CBCT was mathematically compared to a reference CBCT using the gamma index. We defined the match quality parameter (MQP) as an indicator of CBCT image similarity, where a negative MQP value indicates a poorer CBCT match than the match between the first two CBCT acquired during treatment. If three consecutive MQP values were below a chosen threshold, an "alert" is triggered to indicate action required, for example, possible re-CT simulation. The timing of image review requests made by the radiation therapists and any re-CT/re-plan decisions were documented for each patient's treatment course. The MQP for each patient (including any re-plans) was calculated in a manner that was blinded from the clinical process. The MQP as a function of fraction number was compared to actual clinical decisions in the treatment progress to evaluate alert system performance. There was a total of 93 plans (including re-plans) with 34 positives (action required) and 59 negatives (no action required). The sensitivity of the alert system was 0.76 and the false positive rate was 0.37. Only 1 case out of the 34 positive cases would have been missed by both the alert system and our clinical process. Despite the false negatives and false positives, analysis of the timing of alert triggers showed that the alert system could have resulted in seven fewer clinical misses. The alert system has the potential to be a valuable tool to complement human judgment and to provide a quality assurance safeguard to help improve the delivery of radiation treatment of head and neck cancer.

Evaluation of a cycle-generative adversarial network-based cone-beam CT to synthetic CT conversion algorithm for adaptive radiation therapy

PURPOSE

Image-guided radiation therapy could benefit from implementing adaptive radiation therapy (ART) techniques. A cycle-generative adversarial network (cycle-GAN)-based cone-beam computed tomography (CBCT)-to-synthetic CT (sCT) conversion algorithm was evaluated regarding image quality, image segmentation and dosimetric accuracy for head and neck (H&N), thoracic and pelvic body regions.

METHODS

Using a cycle-GAN, three body site-specific models were priorly trained with independent paired CT and CBCT datasets of a kV imaging system (XVI, Elekta). sCT were generated based on first-fraction CBCT for 15 patients of each body region. Mean errors (ME) and mean absolute errors (MAE) were analyzed for the sCT. On the sCT, manually delineated structures were compared to deformed structures from the planning CT (pCT) and evaluated with standard segmentation metrics. Treatment plans were recalculated on sCT. A comparison of clinically relevant dose-volume parameters (D₉₈, D₅₀ and D₂ of the target volume) and 3D-gamma (3%/3mm) analysis were performed.

RESULTS

The mean ME and MAE were 1.4, 29.6, 5.4 Hounsfield units (HU) and 77.2, 94.2, 41.8 HU for H&N, thoracic and pelvic region, respectively. Dice similarity coefficients varied between 66.7 ± 8.3% (seminal vesicles) and 94.9 ± 2.0% (lungs). Maximum mean surface distances were 6.3 mm (heart), followed by 3.5 mm (brainstem). The mean dosimetric differences of the target volumes did not exceed 1.7%. Mean 3D gamma pass rates greater than 97.8% were achieved in all cases.

CONCLUSIONS

The presented method generates sCT images with a quality close to pCT and yielded clinically acceptable dosimetric deviations. Thus, an important prerequisite towards clinical implementation of CBCT-based ART is fulfilled.