MV CBCT-Based Synthetic CT Generation Using a Deep Learning Method for Rectal Cancer Adaptive Radiotherapy

Synthetic CT generation from CBCT and MRI using StarGAN in the Pelvic Region

RATIONALE AND OBJECTIVES

This study evaluated StarGAN, a deep learning model designed to generate synthetic computed tomography (sCT) images from magnetic resonance imaging (MRI) and cone-beam computed tomography (CBCT) data using a single model. The goal was to provide accurate Hounsfield unit (HU) data for dose calculation to enable MRI simulation and adaptive radiation therapy (ART) using CBCT or MRI. We also compared the performance and benefits of StarGAN to the commonly used CycleGAN.

MATERIALS AND METHODS

StarGAN and CycleGAN were employed in this study. The dataset comprised 53 cases of pelvic cancer. Evaluation involved qualitative and quantitative analyses, focusing on synthetic image quality and dose distribution calculation.

RESULTS

For sCT generated from CBCT, StarGAN demonstrated superior anatomical preservation based on qualitative evaluation. Quantitatively, CycleGAN exhibited a lower mean absolute error (MAE) for the body (42.8 ± 4.3 HU) and bone (138.2 ± 20.3), whereas StarGAN produced a higher MAE for the body (50.8 ± 5.2 HU) and bone (153.4 ± 27.7 HU). Dosimetric evaluation showed a mean dose difference (DD) within 2% for the planning target volume (PTV) and body, with a gamma passing rate (GPR) > 90% under the 2%/2 mm criteria. For sCT generated from MRI, qualitative evaluation also favored the anatomical preservation provided by StarGAN. CycleGAN recorded a lower MAE (79.8 ± 14 HU for the body and 253.6 ± 30.9 HU for bone) compared with StarGAN (94.7 ± 7.4 HU for the body and 353.6 ± 34.9 HU for bone). Both models achieved a mean DD within 2% in the PTV and body, and GPR > 90%.

CONCLUSION

While CycleGAN exhibited superior quantitative metrics, StarGAN was better in anatomical preservation, highlighting its potential for sCT generation in radiotherapy.

Qualitative and quantitative evaluation of the role of CBCT in rectal cancer radiotherapy

Verifying patients' position and internal anatomical changes are important steps in the radiotherapy of rectal cancer. Cone Beam Computed Tomography (CBCT) is an advanced imaging method that allows for the quantification of these modifications, ensuring the delivery of radiation dose to the tumor volume, while protecting surrounding organs at risk. The aim of this review is to discuss and analyze the benefits offered by this method of imaging on board the linear accelerator. In view of this, a systematic search of the scientific literature in the Medline/PubMed database was performed for publications over the last decade, with 20 articles found to be relevant for this study. To highlight the benefits of this imaging technique in rectal cancer, the frequency of CBCT use, identification of tumor volume and organs at risk on CBCT images, quantification of the movement of these organs and tumor volume, analysis of positioning errors as well as evaluation of dosimetric parameters were analyzed.

Augmenting motion artifacts to enhance auto-contouring of complex structures in cone-beam computed tomography imaging

Objective. To develop an augmentation method that simulates cone-beam computed tomography (CBCT) related motion artifacts, which can be used to generate training-data to increase the performance of artificial intelligence models dedicated to auto-contouring tasks.Approach.The augmentation technique generates data that simulates artifacts typically present in CBCT imaging. The simulated pseudo-CBCT (pCBCT) is created using interleaved sequences of simulated breath-hold and free-breathing projections. Neural networks for auto-contouring of head and neck and bowel structures were trained with and without pCBCT data. Quantitative and qualitative assessment was done in two independent test sets containing CT and real CBCT data focus on four anatomical regions: head, neck, abdomen, and pelvis. Qualitative analyses were conducted by five clinical experts from three different healthcare institutions.Main results.The generated pCBCT images demonstrate realistic motion artifacts comparable to those observed in real CBCT data. Training a neural network with CT and pCBCT data improved Dice similarity coefficient (DSC) and average contour distance (ACD) results on CBCT test sets. The results were statistically significant (p-value ⩽.03) for bone-mandible (model without/with pCBCT: 0.91/0.92 DSC,p⩽ .01; 0.74/0.66 mm ACD,p⩽.01), brain (0.34/0.93 DSC,p⩽ 1 × 10-5; 17.5/2.79 mm ACD,p= 1 × 10-5), oral-cavity (0.81/0.83 DSC,p⩽.01; 5.11/4.61 mm ACD,p= .02), left-submandibular-gland (0.58/0.77 DSC,p⩽.001; 3.24/2.12 mm ACD,p⩽ .001), right-submandibular-gland (0.00/0.75 DSC,p⩽.1 × 10-5; 17.5/2.26 mm ACD,p⩽ 1 × 10-5), left-parotid (0.68/0.78 DSC,p⩽ .001; 3.34/2.58 mm ACD,p⩽.01), large-bowel (0.60/0.75 DSC,p⩽ .01; 6.14/4.56 mm ACD,p= .03) and small-bowel (3.08/2.65 mm ACD,p= .03). Visual evaluation showed fewer false positives, false negatives, and misclassifications in artifact-affected areas. Qualitative analyses demonstrated that, auto-generated contours are clinically acceptable in over 90% of cases for most structures, with only a few requiring adjustments.Significance.The inclusion of pCBCT improves the performance of trainable auto-contouring approaches, particularly in cases where the images are prone to severe artifacts.

Pseudo-CT synthesis in adaptive radiotherapy based on a stacked coarse-to-fine model: Combing diffusion process and spatial-frequency convolutions

BACKGROUND

Cone beam computed tomography (CBCT) provides critical anatomical information for adaptive radiotherapy (ART), especially for tumors in the pelvic region that undergo significant deformation. However, CBCT suffers from inaccurate Hounsfield Unit (HU) values and lower soft tissue contrast. These issues affect the accuracy of pelvic treatment plans and implementation of the treatment, hence requiring correction.

PURPOSE

A novel stacked coarse-to-fine model combining Denoising Diffusion Probabilistic Model (DDPM) and spatial-frequency domain convolution modules is proposed to enhance the imaging quality of CBCT images.

METHODS

The enhancement of low-quality CBCT images is divided into two stages. In the coarse stage, the improved DDPM with U-ConvNeXt architecture is used to complete the denoising task of CBCT images. In the fine stage, the deep convolutional network model jointly constructed by fast Fourier and dilated convolution modules is used to further enhance the image quality in local details and global imaging. Finally, the accurate pseudo-CT (pCT) images consistent with the size of the original data are obtained. Two hundred fifty paired CBCT-CT images from cervical and rectal cancer, combined with 200 public dataset cases, were used collectively for training, validation, and testing.

RESULTS

To evaluate the anatomical consistency between pCT and real CT, we have used the mean(std) of structure similarity index measure (SSIM), peak signal to noise ratio (PSNR), and normalized cross-correlation (NCC). The numerical results for the above three metrics comparing the pCT synthesized by the proposed model against real CT for cervical cancer cases were 87.14% (2.91%), 34.02 dB (1.35 dB), and 88.01% (1.82%), respectively. For rectal cancer cases, the corresponding results were 86.06% (2.70%), 33.50 dB (1.41 dB), and 87.44% (1.95%). The paired t-test analysis between the proposed model and the comparative models (ResUnet, CycleGAN, DDPM, and DDIM) for these metrics revealed statistically significant differences (p < 0.05). The visual results also showed that the anatomical structures between the real CT and the pCT synthesized by the proposed model were closer. For the dosimetric verification, mean absolute error of dosimetry (MAEdoes) values for the maximum dose (Dmax), the minimum dose (Dmin), and the mean dose (Dmean) in the planning target volume (PTV) were analyzed, with results presented as mean (lower quartile, upper quartile). The experimental results show that the values of the above three dosimetry indexes (Dmin, Dmax, and Dmean) for the pCT images synthesized by the proposed model were 0.90% (0.48%, 1.29%), 0.82% (0.47%, 1.17%), and 0.57% (0.44%, 0.67%). Compared with 10 cases of the original CBCT image by Mann-Whitney test (p < 0.05), it also proved that pCT can significantly improve the accuracy of HU values for the dose calculation.

CONCLUSION

The pCT synthesized by the proposed model outperforms the comparative models in numerical accuracy and visualization, promising for ART of pelvic cancers.

Feasibility of proton dosimetry overriding planning CT with daily CBCT elaborated through generative artificial intelligence tools

Radiotherapy commonly utilizes cone beam computed tomography (CBCT) for patient positioning and treatment monitoring. CBCT is deemed to be secure for patients, making it suitable for the delivery of fractional doses. However, limitations such as a narrow field of view, beam hardening, scattered radiation artifacts, and variability in pixel intensity hinder the direct use of raw CBCT for dose recalculation during treatment. To address this issue, reliable correction techniques are necessary to remove artifacts and remap pixel intensity into Hounsfield Units (HU) values. This study proposes a deep-learning framework for calibrating CBCT images acquired with narrow field of view (FOV) systems and demonstrates its potential use in proton treatment planning updates. Cycle-consistent generative adversarial networks (cGAN) processes raw CBCT to reduce scatter and remap HU. Monte Carlo simulation is used to generate CBCT scans, enabling the possibility to focus solely on the algorithm's ability to reduce artifacts and cupping effects without considering intra-patient longitudinal variability and producing a fair comparison between planning CT (pCT) and calibrated CBCT dosimetry. To showcase the viability of the approach using real-world data, experiments were also conducted using real CBCT. Tests were performed on a publicly available dataset of 40 patients who received ablative radiation therapy for pancreatic cancer. The simulated CBCT calibration led to a difference in proton dosimetry of less than 2%, compared to the planning CT. The potential toxicity effect on the organs at risk decreased from about 50% (uncalibrated) up the 2% (calibrated). The gamma pass rate at 3%/2 mm produced an improvement of about 37% in replicating the prescribed dose before and after calibration (53.78% vs 90.26%). Real data also confirmed this with slightly inferior performances for the same criteria (65.36% vs 87.20%). These results may confirm that generative artificial intelligence brings the use of narrow FOV CBCT scans incrementally closer to clinical translation in proton therapy planning updates.

Exploring dual energy CT synthesis in CBCT-based adaptive radiotherapy and proton therapy: application of denoising diffusion probabilistic models

Background.Adaptive radiotherapy (ART) requires precise tissue characterization to optimize treatment plans and enhance the efficacy of radiation delivery while minimizing exposure to organs at risk. Traditional imaging techniques such as cone beam computed tomography (CBCT) used in ART settings often lack the resolution and detail necessary for accurate dosimetry, especially in proton therapy.Purpose.This study aims to enhance ART by introducing an innovative approach that synthesizes dual-energy computed tomography (DECT) images from CBCT scans using a novel 3D conditional denoising diffusion probabilistic model (DDPM) multi-decoder. This method seeks to improve dose calculations in ART planning, enhancing tissue characterization.Methods.We utilized a paired CBCT-DECT dataset from 54 head and neck cancer patients to train and validate our DDPM model. The model employs a multi-decoder Swin-UNET architecture that synthesizes high-resolution DECT images by progressively reducing noise and artifacts in CBCT scans through a controlled diffusion process.Results.The proposed method demonstrated superior performance in synthesizing DECT images (High DECT MAE 39.582 ± 0.855 and Low DECT MAE 48.540± 1.833) with significantly enhanced signal-to-noise ratio and reduced artifacts compared to traditional GAN-based methods. It showed marked improvements in tissue characterization and anatomical structure similarity, critical for precise proton and radiation therapy planning.Conclusions.This research has opened a new avenue in CBCT-CT synthesis for ART/APT by generating DECT images using an enhanced DDPM approach. The demonstrated similarity between the synthesized DECT images and ground truth images suggests that these synthetic volumes can be used for accurate dose calculations, leading to better adaptation in treatment planning.

Machine Learning Methods for Precision Dosing in Anticancer Drug Therapy: A Scoping Review

INTRODUCTION

In the last decade, various Machine Learning techniques have been proposed aiming to individualise the dose of anticancer drugs mostly based on a presumed drug effect or measured effect biomarkers. The aim of this scoping review was to comprehensively summarise the research status on the use of Machine Learning for precision dosing in anticancer drug therapy.

METHODS

This scoping review was conducted in accordance with the interim guidance by Cochrane and the Joanna Briggs Institute. We systematically searched the databases Medline (via PubMed), Embase and the Cochrane Library for research articles and reviews including results published after 2016. Results were reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) checklist.

RESULTS

A total of 17 relevant studies was identified. In 12 of the included studies, Reinforcement Learning methods were used, including Classical, Deep, Double Deep and Conservative Q-Learning and Fuzzy Reinforcement Learning. Furthermore, classical Machine Learning methods were compared in terms of their performance and an artificial intelligence platform based on parabolic equations was used to guide dosing prospectively and retrospectively, albeit only in a limited number of patients. Due to the significantly different algorithm structures, a meaningful comparison between the various Machine Learning approaches was not possible.

CONCLUSION

Overall, this review emphasises the clinical relevance of Machine Learning methods for anticancer drug dose optimisation, as many algorithms have shown promising results enabling model-free predictions with the potential to maximise efficacy and minimise toxicity when compared to standard protocols.

Enhancing adaptive proton therapy through CBCT images: Synthetic head and neck CT generation based on 3D vision transformers

BACKGROUND

Proton therapy is a form of radiotherapy commonly used to treat various cancers. Due to its high conformality, minor variations in patient anatomy can lead to significant alterations in dose distribution, making adaptation crucial. While cone-beam computed tomography (CBCT) is a well-established technique for adaptive radiation therapy (ART), it cannot be directly used for adaptive proton therapy (APT) treatments because the stopping power ratio (SPR) cannot be estimated from CBCT images.

PURPOSE

To address this limitation, Deep Learning methods have been suggested for converting pseudo-CT (pCT) images from CBCT images. In spite of convolutional neural networks (CNNs) have shown consistent improvement in pCT literature, there is still a need for further enhancements to make them suitable for clinical applications.

METHODS

The authors introduce the 3D vision transformer (ViT) block, studying its performance at various stages of the proposed architectures. Additionally, they conduct a retrospective analysis of a dataset that includes 259 image pairs from 59 patients who underwent treatment for head and neck cancer. The dataset is partitioned into 80% for training, 10% for validation, and 10% for testing purposes.

RESULTS

The SPR maps obtained from the pCT using the proposed method present an absolute relative error of less than 5% from those computed from the planning CT, thus improving the results of CBCT.

CONCLUSIONS

We introduce an enhanced ViT3D architecture for pCT image generation from CBCT images, reducing SPR error within clinical margins for APT workflows. The new method minimizes bias compared to CT-based SPR estimation and dose calculation, signaling a promising direction for future research in this field. However, further research is needed to assess the robustness and generalizability across different medical imaging applications.

2D antiscatter grid and scatter sampling based CBCT method for online dose calculations during CBCT guided radiation therapy of pelvis

BACKGROUND

Online dose calculations before the delivery of radiation treatments have applications in dose delivery verification, online adaptation of treatment plans, and simulation-free treatment planning. While dose calculations by directly utilizing CBCT images are desired, dosimetric accuracy can be compromised due to relatively lower HU accuracy in CBCT images.

PURPOSE

In this work, we propose a novel CBCT imaging pipeline to enhance the accuracy of CBCT-based dose calculations in the pelvis region. Our approach aims to improve the HU accuracy in CBCT images, thereby improving the overall accuracy of CBCT-based dose calculations prior to radiation treatment delivery.

METHODS

An in-house developed quantitative CBCT pipeline was implemented to address the CBCT raw data contamination problem. The pipeline combines algorithmic data correction strategies and 2D antiscatter grid-based scatter rejection to achieve high CT number accuracy. To evaluate the effect of the quantitative CBCT pipeline on CBCT-based dose calculations, phantoms mimicking pelvis anatomy were scanned using a linac-mounted CBCT system, and a gold standard multidetector CT used for treatment planning (pCT). A total of 20 intensity-modulated treatment plans were generated for five targets, using 6 and 10 MV flattening filter-free beams, and utilizing small and large pelvis phantom images. For each treatment plan, four different dose calculations were performed using pCT images and three CBCT imaging configurations: quantitative CBCT, clinical CBCT protocol, and a high-performance 1D antiscatter grid (1D ASG). Subsequently, dosimetric accuracy was evaluated for both targets and organs at risk as a function of patient size, target location, beam energy, and CBCT imaging configuration.

RESULTS

When compared to the gold-standard pCT, dosimetric errors in quantitative CBCT-based dose calculations were not significant across all phantom sizes, beam energies, and treatment sites. The largest error observed was 0.6% among all dose volume histogram metrics and evaluated dose calculations. In contrast, dosimetric errors reached up to 7% and 97% in clinical CBCT and high-performance ASG CBCT-based treatment plans, respectively. The largest dosimetric errors were observed in bony targets in the large phantom treated with 6 MV beams. The trends of dosimetric errors in organs at risk were similar to those observed in the targets.

CONCLUSIONS

The proposed quantitative CBCT pipeline has the potential to provide comparable dose calculation accuracy to the gold-standard planning CT in photon radiation therapy for the abdomen and pelvis. These robust dose calculations could eliminate the need for density overrides in CBCT images and enable direct utilization of CBCT images for dose delivery monitoring or online treatment plan adaptations before the delivery of radiation treatments.

Application of deep learning in radiation therapy for cancer

In recent years, with the development of artificial intelligence, deep learning has been gradually applied to clinical treatment and research. It has also found its way into the applications in radiotherapy, a crucial method for cancer treatment. This study summarizes the commonly used and latest deep learning algorithms (including transformer, and diffusion models), introduces the workflow of different radiotherapy, and illustrates the application of different algorithms in different radiotherapy modules, as well as the defects and challenges of deep learning in the field of radiotherapy, so as to provide some help for the development of automatic radiotherapy for cancer.

A systematic literature review: deep learning techniques for synthetic medical image generation and their applications in radiotherapy

The aim of this systematic review is to determine whether Deep Learning (DL) algorithms can provide a clinically feasible alternative to classic algorithms for synthetic Computer Tomography (sCT). The following categories are presented in this study: ∙ MR-based treatment planning and synthetic CT generation techniques. ∙ Generation of synthetic CT images based on Cone Beam CT images. ∙ Low-dose CT to High-dose CT generation. ∙ Attenuation correction for PET images. To perform appropriate database searches, we reviewed journal articles published between January 2018 and June 2023. Current methodology, study strategies, and results with relevant clinical applications were analyzed as we outlined the state-of-the-art of deep learning based approaches to inter-modality and intra-modality image synthesis. This was accomplished by contrasting the provided methodologies with traditional research approaches. The key contributions of each category were highlighted, specific challenges were identified, and accomplishments were summarized. As a final step, the statistics of all the cited works from various aspects were analyzed, which revealed that DL-based sCTs have achieved considerable popularity, while also showing the potential of this technology. In order to assess the clinical readiness of the presented methods, we examined the current status of DL-based sCT generation.

CBCT-to-CT Synthesis for Cervical Cancer Adaptive Radiotherapy via U-Net-Based Model Hierarchically Trained with Hybrid Dataset

PURPOSE

To develop a deep learning framework based on a hybrid dataset to enhance the quality of CBCT images and obtain accurate HU values.

MATERIALS AND METHODS

A total of 228 cervical cancer patients treated in different LINACs were enrolled. We developed an encoder-decoder architecture with residual learning and skip connections. The model was hierarchically trained and validated on 5279 paired CBCT/planning CT images and tested on 1302 paired images. The mean absolute error (MAE), peak signal to noise ratio (PSNR), and structural similarity index (SSIM) were utilized to access the quality of the synthetic CT images generated by our model.

RESULTS

The MAE between synthetic CT images generated by our model and planning CT was 10.93 HU, compared to 50.02 HU for the CBCT images. The PSNR increased from 27.79 dB to 33.91 dB, and the SSIM increased from 0.76 to 0.90. Compared with synthetic CT images generated by the convolution neural networks with residual blocks, our model had superior performance both in qualitative and quantitative aspects.

CONCLUSIONS

Our model could synthesize CT images with enhanced image quality and accurate HU values. The synthetic CT images preserved the edges of tissues well, which is important for downstream tasks in adaptive radiotherapy.

Artificial general intelligence for radiation oncology

The emergence of artificial general intelligence (AGI) is transforming radiation oncology. As prominent vanguards of AGI, large language models (LLMs) such as GPT-4 and PaLM 2 can process extensive texts and large vision models (LVMs) such as the Segment Anything Model (SAM) can process extensive imaging data to enhance the efficiency and precision of radiation therapy. This paper explores full-spectrum applications of AGI across radiation oncology including initial consultation, simulation, treatment planning, treatment delivery, treatment verification, and patient follow-up. The fusion of vision data with LLMs also creates powerful multimodal models that elucidate nuanced clinical patterns. Together, AGI promises to catalyze a shift towards data-driven, personalized radiation therapy. However, these models should complement human expertise and care. This paper provides an overview of how AGI can transform radiation oncology to elevate the standard of patient care in radiation oncology, with the key insight being AGI's ability to exploit multimodal clinical data at scale.

Adaptive Radiation Therapy: A Review of CT-based Techniques

Adaptive radiation therapy is a feedback process by which imaging information acquired over the course of treatment, such as changes in patient anatomy, can be used to reoptimize the treatment plan, with the end goal of improving target coverage and reducing treatment toxicity. This review describes different types of adaptive radiation therapy and their clinical implementation with a focus on CT-guided online adaptive radiation therapy. Depending on local anatomic changes and clinical context, different anatomic sites and/or disease stages and presentations benefit from different adaptation strategies. Online adaptive radiation therapy, where images acquired in-room before each fraction are used to adjust the treatment plan while the patient remains on the treatment table, has emerged to address unpredictable anatomic changes between treatment fractions. Online treatment adaptation places unique pressures on the radiation therapy workflow, requiring high-quality daily imaging and rapid recontouring, replanning, plan review, and quality assurance. Generating a new plan with every fraction is resource intensive and time sensitive, emphasizing the need for workflow efficiency and clinical resource allocation. Cone-beam CT is widely used for image-guided radiation therapy, so implementing cone-beam CT-guided online adaptive radiation therapy can be easily integrated into the radiation therapy workflow and potentially allow for rapid imaging and replanning. The major challenge of this approach is the reduced image quality due to poor resolution, scatter, and artifacts. Keywords: Adaptive Radiation Therapy, Cone-Beam CT, Organs at Risk, Oncology © RSNA, 2023.

Improving synthetic CT accuracy by combining the benefits of multiple normalized preprocesses

PURPOSE

To investigate the effect of different normalization preprocesses in deep learning on the accuracy of different tissues in synthetic computed tomography (sCT) and to combine their advantages to improve the accuracy of all tissues.

METHODS

The cycle-consistent adversarial network (CycleGAN) model was used to generate sCT images from megavolt cone-beam CT (MVCBCT) images. In this study, 2639 head MVCBCT and CT image pairs from 203 patients were collected as a training set, and 249 image pairs from 29 patients were collected as a test set. We normalized the voxel values in images to 0 to 1 or -1 to 1, using two linear and five nonlinear normalization preprocessing methods to obtain seven data sets and compared the accuracy of different tissues in different sCT obtained from training these data. Finally, to combine the advantages of different normalization preprocessing methods, we obtained sCT_Blur by cropping, stitching, and smoothing (OpenCV's cv2.medianBlur, kernel size 5) each group of sCTs and evaluated its image quality and accuracy of OARs.

RESULTS

Different normalization preprocesses made sCT more accurate in different tissues. The proposed sCT_Blur took advantage of multiple normalization preprocessing methods, and all tissues are more accurate than the sCT obtained using a single conventional normalization method. Compared with other sCT images, the structural similarity of sCT_Blur versus CT was improved to 0.906 ± 0.019. The mean absolute errors of the CT numbers were reduced to 15.7 ± 4.1 HU, 23.2 ± 7.1 HU, 11.5 ± 4.1 HU, 212.8 ± 104.6 HU, 219.4 ± 35.1 HU, and 268.8 ± 88.8 HU for the oral cavity, parotid, spinal cord, cavity, mandible, and teeth, respectively.

CONCLUSION

The proposed approach combined the advantages of several normalization preprocessing methods to improve the accuracy of all tissues in sCT images, which is promising for improving the accuracy of dose calculations based on CBCT images in adaptive radiotherapy.

CBCT-based synthetic CT generated using CycleGAN with HU correction for adaptive radiotherapy of nasopharyngeal carcinoma

This study aims to utilize a hybrid approach of phantom correction and deep learning for synthesized CT (sCT) images generation based on cone-beam CT (CBCT) images for nasopharyngeal carcinoma (NPC). 52 CBCT/CT paired images of NPC patients were used for model training (41), validation (11). Hounsfield Units (HU) of the CBCT images was calibrated by a commercially available CIRS phantom. Then the original CBCT and the corrected CBCT (CBCT_cor) were trained separately with the same cycle generative adversarial network (CycleGAN) to generate SCT1 and SCT2. The mean error and mean absolute error (MAE) were used to quantify the image quality. For validations, the contours and treatment plans in CT images were transferred to original CBCT, CBCT_cor, SCT1 and SCT2 for dosimetric comparison. Dose distribution, dosimetric parameters and 3D gamma passing rate were analyzed. Compared with rigidly registered CT (RCT), the MAE of CBCT, CBCT_cor, SCT1 and SCT2 were 346.11 ± 13.58 HU, 145.95 ± 17.64 HU, 105.62 ± 16.08 HU and 83.51 ± 7.71 HU, respectively. Moreover, the average dosimetric parameter differences for the CBCT_cor, SCT1 and SCT2 were 2.7% ± 1.4%, 1.2% ± 1.0% and 0.6% ± 0.6%, respectively. Using the dose distribution of RCT images as reference, the 3D gamma passing rate of the hybrid method was significantly better than the other methods. The effectiveness of CBCT-based sCT generated using CycleGAN with HU correction for adaptive radiotherapy of nasopharyngeal carcinoma was confirmed. The image quality and dose accuracy of SCT2 were outperform the simple CycleGAN method. This finding has great significance for the clinical application of adaptive radiotherapy for NPC.

A clinically relevant online patient QA solution with daily CT scans and EPID-based in vivo dosimetry: a feasibility study on rectal cancer

Objective. Adaptive radiation therapy (ART) could protect organs at risk (OARs) while maintain high dose coverage to targets. However, there is still a lack of efficient online patient quality assurance (QA) methods, which is an obstacle to large-scale adoption of ART. We aim to develop a clinically relevant online patient QA solution for ART using daily CT scans and EPID-based in vivo dosimetry. Approach. Ten patients with rectal cancer at our center were included. Patients’ daily CT scans and portal images were collected to generate reconstructed 3D dose distributions. Contours of targets and OARs were recontoured on these daily CT scans by a clinician or an auto-segmentation algorithm, then dose-volume indices were calculated, and the percent deviation of these indices to their original plans were determined. This deviation was regarded as the metric for clinically relevant patient QA. The tolerance level was obtained using a 95% confidence interval of the QA metric distribution. These deviations could be further divided into anatomically relevant or delivery relevant indicators for error source analysis. Finally, our QA solution was validated on an additional six clinical patients. Main results. In rectal cancer, the 95% confidence intervals of the QA metric for PTV ΔD 95 (%) were [−3.11%, 2.35%], and for PTV ΔD 2 (%) were [−0.78%, 3.23%]. In validation, 68% for PTV ΔD 95 (%), and 79% for PTV ΔD 2 (%) of the 28 fractions are within tolerances of the QA metrics. one patient’s dosimetric impact of anatomical variations during treatment were observed through the source of error analysis. Significance. The online patient QA solution using daily CT scans and EPID-based in vivo dosimetry is clinically feasible. Source of error analysis has the potential for distinguishing sources of error and guiding ART for future treatments.

A novel approach for eliminating metal artifacts based on MVCBCT and CycleGAN

Purpose

To develop a metal artifact reduction (MAR) algorithm and eliminate the adverse effects of metal artifacts on imaging diagnosis and radiotherapy dose calculations.

Methods

Cycle-consistent adversarial network (CycleGAN) was used to generate synthetic CT (sCT) images from megavoltage cone beam CT (MVCBCT) images. In this study, there were 140 head cases with paired CT and MVCBCT images, from which 97 metal-free cases were used for training. Based on the trained model, metal-free sCT (sCT_MF) images and metal-containing sCT (sCT_M) images were generated from the MVCBCT images of 29 metal-free cases and 14 metal cases, respectively. Then, the sCT_MF and sCT_M images were quantitatively evaluated for imaging and dosimetry accuracy.

Results

The structural similarity (SSIM) index of the sCT_MF and metal-free CT (CT_MF) images were 0.9484, and the peak signal-to-noise ratio (PSNR) was 31.4 dB. Compared with the CT images, the sCT_MF images had similar relative electron density (RED) and dose distribution, and their gamma pass rate (1 mm/1%) reached 97.99% ± 1.14%. The sCT_M images had high tissue resolution with no metal artifacts, and the RED distribution accuracy in the range of 1.003 to 1.056 was improved significantly. The RED and dose corrections were most significant for the planning target volume (PTV), mandible and oral cavity. The maximum correction of Dmean and D50 for the oral cavity reached 90 cGy.

Conclusions

Accurate sCT_M images were generated from MVCBCT images based on CycleGAN, which eliminated the metal artifacts in clinical images completely and corrected the RED and dose distributions accurately for clinical application.

Deep learning-based low-dose CT for adaptive radiotherapy of abdominal and pelvic tumors

The shape and position of abdominal and pelvic organs change greatly during radiotherapy, so image-guided radiation therapy (IGRT) is urgently needed. The world’s first integrated CT-linac platform, equipped with fan beam CT (FBCT), can provide a diagnostic-quality FBCT for achieve adaptive radiotherapy (ART). However, CT scans will bring the risk of excessive scanning radiation dose. Reducing the tube current of the FBCT system can reduce the scanning dose, but it will lead to serious noise and artifacts in the reconstructed images. In this study, we proposed a deep learning method, Content-Noise Cycle-Consistent Generative Adversarial Network (CNCycle-GAN), to improve the image quality and CT value accuracy of low-dose FBCT images to meet the requirements of adaptive radiotherapy. We selected 76 patients with abdominal and pelvic tumors who received radiation therapy. The patients received one low-dose CT scan and one normal-dose CT scan in IGRT mode during different fractions of radiotherapy. The normal dose CT images (NDCT) and low dose CT images (LDCT) of 70 patients were used for network training, and the remaining 6 patients were used to validate the performance of the network. The quality of low-dose CT images after network restoration (RCT) were evaluated in three aspects: image quality, automatic delineation performance and dose calculation accuracy. Taking NDCT images as a reference, RCT images reduced MAE from 34.34 ± 5.91 to 20.25 ± 4.27, PSNR increased from 34.08 ± 1.49 to 37.23 ± 2.63, and SSIM increased from 0.92 ± 0.08 to 0.94 ± 0.07. The P value is less than 0.01 of the above performance indicators indicated that the difference were statistically significant. The Dice similarity coefficients (DCS) between the automatic delineation results of organs at risk such as bladder, femoral heads, and rectum on RCT and the results of manual delineation by doctors both reached 0.98. In terms of dose calculation accuracy, compared with the automatic planning based on LDCT, the difference in dose distribution between the automatic planning based on RCT and the automatic planning based on NDCT were smaller. Therefore, based on the integrated CT-linac platform, combined with deep learning technology, it provides clinical feasibility for the realization of low-dose FBCT adaptive radiotherapy for abdominal and pelvic tumors.

Multimodal image translation via deep learning inference model trained in video domain

Background

Current medical image translation is implemented in the image domain. Considering the medical image acquisition is essentially a temporally continuous process, we attempt to develop a novel image translation framework via deep learning trained in video domain for generating synthesized computed tomography (CT) images from cone-beam computed tomography (CBCT) images.

Methods

For a proof-of-concept demonstration, CBCT and CT images from 100 patients were collected to demonstrate the feasibility and reliability of the proposed framework. The CBCT and CT images were further registered as paired samples and used as the input data for the supervised model training. A vid2vid framework based on the conditional GAN network, with carefully-designed generators, discriminators and a new spatio-temporal learning objective, was applied to realize the CBCT–CT image translation in the video domain. Four evaluation metrics, including mean absolute error (MAE), peak signal-to-noise ratio (PSNR), normalized cross-correlation (NCC), and structural similarity (SSIM), were calculated on all the real and synthetic CT images from 10 new testing patients to illustrate the model performance.

Results

The average values for four evaluation metrics, including MAE, PSNR, NCC, and SSIM, are 23.27 ± 5.53, 32.67 ± 1.98, 0.99 ± 0.0059, and 0.97 ± 0.028, respectively. Most of the pixel-wise hounsfield units value differences between real and synthetic CT images are within 50. The synthetic CT images have great agreement with the real CT images and the image quality is improved with lower noise and artifacts compared with CBCT images.

Conclusions

We developed a deep-learning-based approach to perform the medical image translation problem in the video domain. Although the feasibility and reliability of the proposed framework were demonstrated by CBCT–CT image translation, it can be easily extended to other types of medical images. The current results illustrate that it is a very promising method that may pave a new path for medical image translation research.

Deep learning methods for enhancing cone-beam CT image quality towards adaptive radiation therapy: A systematic review

The use of deep learning (DL) to improve cone-beam CT (CBCT) image quality has gained popularity as computational resources and algorithmic sophistication have advanced in tandem. CBCT imaging has the potential to facilitate online adaptive radiation therapy (ART) by utilizing up-to-date patient anatomy to modify treatment parameters before irradiation. Poor CBCT image quality has been an impediment to realizing ART due to the increased scatter conditions inherent to cone-beam acquisitions. Given the recent interest in DL applications in radiation oncology, and specifically DL for CBCT correction, we provide a systematic theoretical and literature review for future stakeholders. The review encompasses DL approaches for synthetic CT generation, as well as projection domain methods employed in the CBCT correction literature. We review trends pertaining to publications from January 2018 to April 2022 and condense their major findings - with emphasis on study design and deep learning techniques. Clinically relevant endpoints relating to image quality and dosimetric accuracy are summarised, highlighting gaps in the literature. Finally, we make recommendations for both clinicians and DL practitioners based on literature trends and the current DL state of the art methods utilized in radiation oncology. This article is protected by copyright. All rights reserved.

A Comparison Study Between CNN-Based Deformed Planning CT and CycleGAN-Based Synthetic CT Methods for Improving iCBCT Image Quality

Purpose

The aim of this study is to compare two methods for improving the image quality of the Varian Halcyon cone-beam CT (iCBCT) system through the deformed planning CT (dpCT) based on the convolutional neural network (CNN) and the synthetic CT (sCT) generation based on the cycle-consistent generative adversarial network (CycleGAN).

Methods

A total of 190 paired pelvic CT and iCBCT image datasets were included in the study, out of which 150 were used for model training and the remaining 40 were used for model testing. For the registration network, we proposed a 3D multi-stage registration network (MSnet) to deform planning CT images to agree with iCBCT images, and the contours from CT images were propagated to the corresponding iCBCT images through a deformation matrix. The overlap between the deformed contours (dpCT) and the fixed contours (iCBCT) was calculated for purposes of evaluating the registration accuracy. For the sCT generation, we trained the 2D CycleGAN using the deformation-registered CT-iCBCT slicers and generated the sCT with corresponding iCBCT image data. Then, on sCT images, physicians re-delineated the contours that were compared with contours of manually delineated iCBCT images. The organs for contour comparison included the bladder, spinal cord, femoral head left, femoral head right, and bone marrow. The dice similarity coefficient (DSC) was used to evaluate the accuracy of registration and the accuracy of sCT generation.

Results

The DSC values of the registration and sCT generation were found to be 0.769 and 0.884 for the bladder (p < 0.05), 0.765 and 0.850 for the spinal cord (p < 0.05), 0.918 and 0.923 for the femoral head left (p > 0.05), 0.916 and 0.921 for the femoral head right (p > 0.05), and 0.878 and 0.916 for the bone marrow (p < 0.05), respectively. When the bladder volume difference in planning CT and iCBCT scans was more than double, the accuracy of sCT generation was significantly better than that of registration (DSC of bladder: 0.859 vs. 0.596, p < 0.05).

Conclusion

The registration and sCT generation could both improve the iCBCT image quality effectively, and the sCT generation could achieve higher accuracy when the difference in planning CT and iCBCT was large.