Synthetic Computed Tomography Generation from 0.35T Magnetic Resonance Images for Magnetic Resonance-Only Radiation Therapy Planning Using Perceptual Loss Models

A systematic literature review: deep learning techniques for synthetic medical image generation and their applications in radiotherapy

The aim of this systematic review is to determine whether Deep Learning (DL) algorithms can provide a clinically feasible alternative to classic algorithms for synthetic Computer Tomography (sCT). The following categories are presented in this study: ∙ MR-based treatment planning and synthetic CT generation techniques. ∙ Generation of synthetic CT images based on Cone Beam CT images. ∙ Low-dose CT to High-dose CT generation. ∙ Attenuation correction for PET images. To perform appropriate database searches, we reviewed journal articles published between January 2018 and June 2023. Current methodology, study strategies, and results with relevant clinical applications were analyzed as we outlined the state-of-the-art of deep learning based approaches to inter-modality and intra-modality image synthesis. This was accomplished by contrasting the provided methodologies with traditional research approaches. The key contributions of each category were highlighted, specific challenges were identified, and accomplishments were summarized. As a final step, the statistics of all the cited works from various aspects were analyzed, which revealed that DL-based sCTs have achieved considerable popularity, while also showing the potential of this technology. In order to assess the clinical readiness of the presented methods, we examined the current status of DL-based sCT generation.

The Future of MR-Guided Radiation Therapy

Magnetic resonance image guided radiation therapy (MRIgRT) is a relatively new technology that has already shown outcomes benefits but that has not yet reached its clinical potential. The improved soft-tissue contrast provided with MR, coupled with the immediacy of image acquisition with respect to the treatment, enables expansion of on-table adaptive protocols, currently at a cost of increased treatment complexity, use of human resources, and longer treatment slot times, which translate to decreased throughput. Many approaches are being investigated to meet these challenges, including the development of artificial intelligence (AI) algorithms to accelerate and automate much of the workflow and improved technology that parallelizes workflow tasks, as well as improvements in image acquisition speed and quality. This article summarizes limitations of current available integrated MRIgRT systems and gives an outlook about scientific developments to further expand the use of MRIgRT.

Research progress on deep learning in magnetic resonance imaging-based diagnosis and treatment of prostate cancer: a review on the current status and perspectives

Multiparametric magnetic resonance imaging (mpMRI) has emerged as a first-line screening and diagnostic tool for prostate cancer, aiding in treatment selection and noninvasive radiotherapy guidance. However, the manual interpretation of MRI data is challenging and time-consuming, which may impact sensitivity and specificity. With recent technological advances, artificial intelligence (AI) in the form of computer-aided diagnosis (CAD) based on MRI data has been applied to prostate cancer diagnosis and treatment. Among AI techniques, deep learning involving convolutional neural networks contributes to detection, segmentation, scoring, grading, and prognostic evaluation of prostate cancer. CAD systems have automatic operation, rapid processing, and accuracy, incorporating multiple sequences of multiparametric MRI data of the prostate gland into the deep learning model. Thus, they have become a research direction of great interest, especially in smart healthcare. This review highlights the current progress of deep learning technology in MRI-based diagnosis and treatment of prostate cancer. The key elements of deep learning-based MRI image processing in CAD systems and radiotherapy of prostate cancer are briefly described, making it understandable not only for radiologists but also for general physicians without specialized imaging interpretation training. Deep learning technology enables lesion identification, detection, and segmentation, grading and scoring of prostate cancer, and prediction of postoperative recurrence and prognostic outcomes. The diagnostic accuracy of deep learning can be improved by optimizing models and algorithms, expanding medical database resources, and combining multi-omics data and comprehensive analysis of various morphological data. Deep learning has the potential to become the key diagnostic method in prostate cancer diagnosis and treatment in the future.

Deep Learning in MRI-guided Radiation Therapy: A Systematic Review

MRI-guided radiation therapy (MRgRT) offers a precise and adaptive approach to treatment planning. Deep learning applications which augment the capabilities of MRgRT are systematically reviewed. MRI-guided radiation therapy offers a precise, adaptive approach to treatment planning. Deep learning applications which augment the capabilities of MRgRT are systematically reviewed with emphasis placed on underlying methods. Studies are further categorized into the areas of segmentation, synthesis, radiomics, and real time MRI. Finally, clinical implications, current challenges, and future directions are discussed.

Evaluation of MRI-only based online adaptive radiotherapy of abdominal region on MR-linac

PURPOSE

A hybrid magnetic resonance linear accelerator (MRL) can perform magnetic resonance imaging (MRI) with high soft-tissue contrast to be used for online adaptive radiotherapy (oART). To obtain electron densities needed for the oART dose calculation, a computed tomography (CT) is often deformably registered to MRI. Our aim was to evaluate an MRI-only based synthetic CT (sCT) generation as an alternative to the deformed CT (dCT)-based oART in the abdominal region.

METHODS

The study data consisted of 57 patients who were treated on a 0.35 T MRL system mainly for abdominal tumors. Simulation MRI-CT pairs of 43 patients were used for training and validation of a prototype convolutional neural network sCT-generation algorithm, based on HighRes3DNet, for the abdominal region. For remaining test patients, sCT images were produced from simulation MRIs and daily MRIs. The dCT-based plans were re-calculated on sCT with identical calculation parameters. The sCT and dCT were compared in terms of geometric agreement and calculated dose.

RESULTS

The mean and one standard deviation of the geometric agreement metrics over dCT-sCT-pairs were: mean error of 8 ± 10 HU, mean absolute error of 49 ± 10 HU, and Dice similarity coefficient of 55 ± 12%, 60 ± 5%, and 82 ± 15% for bone, fat, and lung tissues, respectively. The dose differences between the sCT and dCT-based dose for planning target volumes were 0.5 ± 0.9%, 0.6 ± 0.8%, and 0.5 ± 0.8% at D_2% , D_50% , and D_98% in physical dose and 0.8 ± 1.4%, 0.8 ± 1.2%, and 0.6 ± 1.1% in biologically effective dose (BED). For organs-at-risk, the dose differences of all evaluated dose-volume histogram points were within [-4.5%, 7.8%] and [-1.1 Gy, 3.5 Gy] in both physical dose and BED.

CONCLUSIONS

The geometric agreement metrics were within typically reported values and most average relative dose differences were within 1%. Thus, an MRI-only sCT-based approach is a promising alternative to the current clinical practice of the abdominal oART on MRL.

A body mass index-based method for "MR-only" abdominal MR-guided adaptive radiotherapy

PURPOSE

Dose calculation for MR-guided radiotherapy (MRgRT) at the 0.35 T MR-Linac is currently based on deformation of planning CTs (defCT) acquired for each patient. We present a simple and robust bulk density overwrite synthetic CT (sCT) method for abdominal treatments in order to streamline clinical workflows.

METHOD

Fifty-six abdominal patient treatment plans were retrospectively evaluated. All patients had been treated at the MR-Linac using MR datasets for treatment planning and plan adaption and defCT for dose calculation. Bulk density CTs (4M-sCT) were generated from MR images with four material compartments (bone, lung, air, soft tissue). The relative electron densities (RED) for bone and lung were extracted from contoured CT structure average REDs. For soft tissue, a correlation between BMI and RED was evaluated. Dose was recalculated on 4M-sCT and compared to dose distributions on defCTs assessing dose differences in the PTV and organs at risk (OAR).

RESULTS

Mean RED of bone was 1.17 ± 0.02, mean RED of lung 0.17 ± 0.05. The correlation between BMI and RED for soft tissue was statistically significant (p < 0.01). PTV dose differences between 4M-sCT and defCT were Dmean: -0.4 ± 1.0%, D1%: -0.3 ± 1.1% and D95%: -0.5 ± 1.0%. OARs showed D2%: -0.3 ± 1.9% and Dmean: -0.1 ± 1.4% differences. Local 3D gamma index pass rates (2%/2mm) between dose calculated using 4M-sCT and defCT were 96.8 ± 2.6% (range 89.9-99.6%).

CONCLUSION

The presented method for sCT generation enables precise dose calculation for MR-only abdominal MRgRT.

Emergence of MR-Linac in Radiation Oncology: Successes and Challenges of Riding on the MRgRT Bandwagon

The special issue of JCM on “Advances of MRI in Radiation Oncology” provides a unique forum for scientific literature related to MR imaging in radiation oncology. This issue covered many aspects, such as MR technology, motion management, economics, soft-tissue–air interface issues, and disease sites such as the pancreas, spine, sarcoma, prostate, head and neck, and rectum from both camps—the Unity and MRIdian systems. This paper provides additional information on the success and challenges of the two systems. A challenging aspect of this technology is low throughput and the monumental task of education and training that hinders its use for the majority of therapy centers. Additionally, the cost of this technology is too high for most institutions, and hence widespread use is still limited. This article highlights some of the difficulties and how to resolve them.

MRI-guided Radiotherapy (MRgRT) for treatment of Oligometastases: Review of clinical applications and challenges

PURPOSE

Early clinical results on the application of magnetic resonance imaging (MRI) coupled with a linear accelerator to deliver MR-guided radiation therapy (MRgRT) have demonstrated feasibility for safe delivery of stereotactic body radiotherapy (SBRT) in treatment of oligometastatic disease. Here we set out to review the clinical evidence and challenges associated with MRgRT in this setting.

METHODS AND MATERIALS

We performed a systematic review of the literature pertaining to clinical experiences and trials on the use of MRgRT primarily for the treatment of oligometastatic cancers. We reviewed the opportunities and challenges associated with the use of MRgRT.

RESULTS

Benefits of MRgRT pertaining to superior soft-tissue contrast, real-time imaging and gating, and online adaptive radiotherapy facilitate safe and effective dose escalation to oligometastatic tumors while simultaneously sparing surrounding healthy tissues. Challenges concerning further need for clinical evidence and technical considerations related to planning, delivery, quality assurance (QA) of hypofractionated doses, and safety in the MRI environment must be considered.

CONCLUSIONS

The promising early indications of safety and effectiveness of MRgRT for SBRT-based treatment of oligometastatic disease in multiple treatment locations should lead to further clinical evidence to demonstrate the benefit of this technology.

Research on new treatment mode of radiotherapy based on pseudo-medical images

BACKGROUND AND OBJECTIVE

Multi-modal medical images with multiple feature information are beneficial for radiotherapy. A new radiotherapy treatment mode based on triangle generative adversarial network (TGAN) model was proposed to synthesize pseudo-medical images between multi-modal datasets.

METHODS

CBCT, MRI and CT images of 80 patients with nasopharyngeal carcinoma were selected. The TGAN model based on multi-scale discriminant network was used for data training between different image domains. The generator of the TGAN model refers to cGAN and CycleGAN, and only one generation network can establish the non-linear mapping relationship between multiple image domains. The discriminator used multi-scale discrimination network to guide the generator to synthesize pseudo-medical images that are similar to real images from both shallow and deep aspects. The accuracy of pseudo-medical images was verified in anatomy and dosimetry.

RESULTS

In the three synthetic directions, namely, CBCT → CT, CBCT → MRI, and MRI → CT, significant differences (p < 0.05) in the three-fold-cross validation results on PSNR and SSIM metrics between the pseudo-medical images obtained based on TGAN and the real images. In the testing stage, for TGAN, the MAE metric results in the three synthesis directions (CBCT → CT, CBCT → MRI, and MRI → CT) were presented as mean (standard deviation), which were 68.67 (5.83), 83.14 (8.48), and 79.96 (7.59), and the NMI metric results were 0.8643 (0.0253), 0.8051 (0.0268), and 0.8146 (0.0267) respectively. In terms of dose verification, the differences in dose distribution between the pseudo-CT obtained by TGAN and the real CT were minimal. The H values of the measurement results of dose uncertainty in PGTV, PGTVnd, PTV1, and PTV2 were 42.510, 43.121, 17.054, and 7.795, respectively (P < 0.05). The differences were statistically significant. The gamma pass rate (2%/2 mm) of pseudo-CT obtained by the new model was 94.94% (0.73%), and the numerical results were better than those of the three other comparison models.

CONCLUSIONS

The pseudo-medical images acquired based on TGAN were close to the real images in anatomy and dosimetry. The pseudo-medical images synthesized by the TGAN model have good application prospects in clinical adaptive radiotherapy.