1
|
Rabe M, Kurz C, Thummerer A, Landry G. Artificial intelligence for treatment delivery: image-guided radiotherapy. Strahlenther Onkol 2025; 201:283-297. [PMID: 39138806 DOI: 10.1007/s00066-024-02277-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2024] [Accepted: 07/07/2024] [Indexed: 08/15/2024]
Abstract
Radiation therapy (RT) is a highly digitized field relying heavily on computational methods and, as such, has a high affinity for the automation potential afforded by modern artificial intelligence (AI). This is particularly relevant where imaging is concerned and is especially so during image-guided RT (IGRT). With the advent of online adaptive RT (ART) workflows at magnetic resonance (MR) linear accelerators (linacs) and at cone-beam computed tomography (CBCT) linacs, the need for automation is further increased. AI as applied to modern IGRT is thus one area of RT where we can expect important developments in the near future. In this review article, after outlining modern IGRT and online ART workflows, we cover the role of AI in CBCT and MRI correction for dose calculation, auto-segmentation on IGRT imaging, motion management, and response assessment based on in-room imaging.
Collapse
Affiliation(s)
- Moritz Rabe
- Department of Radiation Oncology, LMU University Hospital, LMU Munich, Marchioninistraße 15, 81377, Munich, Bavaria, Germany
| | - Christopher Kurz
- Department of Radiation Oncology, LMU University Hospital, LMU Munich, Marchioninistraße 15, 81377, Munich, Bavaria, Germany
| | - Adrian Thummerer
- Department of Radiation Oncology, LMU University Hospital, LMU Munich, Marchioninistraße 15, 81377, Munich, Bavaria, Germany
| | - Guillaume Landry
- Department of Radiation Oncology, LMU University Hospital, LMU Munich, Marchioninistraße 15, 81377, Munich, Bavaria, Germany.
- German Cancer Consortium (DKTK), partner site Munich, a partnership between the DKFZ and the LMU University Hospital Munich, Marchioninistraße 15, 81377, Munich, Bavaria, Germany.
- Bavarian Cancer Research Center (BZKF), Marchioninistraße 15, 81377, Munich, Bavaria, Germany.
| |
Collapse
|
2
|
Parchur AK, Zarenia M, Gage C, Paulson ES, Ahunbay E. Automated hallucination detection for synthetic CT images used in MR-only radiotherapy workflows. Phys Med Biol 2025; 70:05NT01. [PMID: 39946843 DOI: 10.1088/1361-6560/adb5eb] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2024] [Accepted: 02/13/2025] [Indexed: 02/26/2025]
Abstract
Objective. Artificial intelligence (AI)-generated synthetic CT (sCT) images have become commercially available to provide electron densities and reference anatomies in MR-only radiotherapy workflows. However, hallucinations (false regions of bone or air) introduced in AI-generated sCT images may affect the accuracy of dose calculation and patient setup verification. We developed a tool to detect bone hallucinations and/or inaccuracies in AI-generated pelvic sCT images used in MR-only workflows.Approach. A deep learning auto segmentation (DLAS) model was trained to auto-segment bone on MR images. The model was implemented with a 3D SegResNet network architecture using the MONAI framework with a training dataset of 86 Dixon MR image sets paired with their corresponding ground truth contours derived from planning CT images deformed to the MR images. The model performance was then assessed on an independent testing dataset (n= 10).Main results. The DLAS model-based hallucination screener identified hallucinations in bone structures using daily MR images and accurately flagged these regions on sCT images. The sensitivity of the screener is adjustable based on the distance of discrepancies between bone regions derived from sCT to bone contours generated by the DLAS. The average specificity of the DLAS model was 0.78, 0.93 and 0.98 for distance parameters of 0.8, 1.0 and 1.2 cm, respectively. The screener identified false high-density hallucination regions in the abdomen of AI-generated sCT images for all testing patients, highlighting potential issues with the training data used for the AI sCT model.Significance. A hallucination screener for AI-generated pelvic sCT images was developed and implemented for routine clinical use. The screener serves as an important quality assurance tool for MR-only radiotherapy workflows. By identifying potential AI-generated errors, the hallucination screener may improve the safety and accuracy of sCT images used for dose calculation and image guidance.
Collapse
Affiliation(s)
- Abdul K Parchur
- Department of Radiation Oncology, Medical College of Wisconsin, Milwaukee, WI 53226, United States of America
| | - Mohammad Zarenia
- Department of Radiation Oncology, Medical College of Wisconsin, Milwaukee, WI 53226, United States of America
| | - Colette Gage
- Department of Radiation Oncology, Medical College of Wisconsin, Milwaukee, WI 53226, United States of America
| | - Eric S Paulson
- Department of Radiation Oncology, Medical College of Wisconsin, Milwaukee, WI 53226, United States of America
| | - Ergun Ahunbay
- Department of Radiation Oncology, Medical College of Wisconsin, Milwaukee, WI 53226, United States of America
| |
Collapse
|
3
|
Levardon M, Autret D, Le Dorze T, Guillerminet C, Dufreneix S. Brain MR-only workflow in clinical practice: A comparison among generators for quality assurance and patient positioning. J Appl Clin Med Phys 2025; 26:e14583. [PMID: 39585187 PMCID: PMC11799901 DOI: 10.1002/acm2.14583] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2024] [Revised: 10/18/2024] [Accepted: 11/05/2024] [Indexed: 11/26/2024] Open
Abstract
BACKGROUND AND PURPOSE Routine quality control procedures are still required for sCT based on artificial intelligence (AI) to verify the performance of the generators. The aim of this study was to evaluate three generators based on AI or bulk density (BD) assignment for the patient-specific quality assurance (PSQA) of another AI-based generator in clinical routine. A patient positioning study based on 2D/2D kV-image comparing the performances of four sCT generators was also performed. MATERIALS AND METHODS On the four generators available commercially at our institution, one was chosen as the clinical one, and the three others were used for PSQA. Several dose metrics were calculated like the mean error, dose-volume histogram metrics, and 1%/1 mm gamma analysis. A comparison against CT was considered as a reference. Translations and rotations found during patient positioning based on sCT were compared to those based on CT. RESULTS Some of the metrics calculated against CT revealed patients outside the tolerances chosen (1% for point metrics; 90% for gamma pass rate). None of the generators was able to identify these outliers for all metrics studied. Performing a PSQA with other sCT generators introduced several false positives and false negatives. None of the generators was able to clearly identify, for all metrics studied, a true sCT failure caused by a metal implant. The smallest positioning deviations were found for the BD assignment sCT, the largest for the only AI generator not based on a T1 Dixon MR sequence. CONCLUSIONS PSQA of a sCT generator with another sCT generator should be performed with great care. Patient positioning is an important aspect to consider when evaluating a sCT generator. The results of this study should help medical physicists willing to set up a MR-only workflow for the brain based on a 2D/2D kV-image patient positioning.
Collapse
Affiliation(s)
- Mathilde Levardon
- Department of Nuclear MedicineCentre Hospitalier Universitaire d'AngersAngersFrance
| | - Damien Autret
- Department of Medical PhysicsInstitut de Cancérologie de l'OuestAngersFrance
| | - Thomas Le Dorze
- Department of Medical PhysicsInstitut de Cancérologie de l'OuestAngersFrance
| | | | - Stéphane Dufreneix
- Department of Medical PhysicsInstitut de Cancérologie de l'OuestAngersFrance
| |
Collapse
|
4
|
Fusella M, Alvarez Andres E, Villegas F, Milan L, Janssen TM, Dal Bello R, Garibaldi C, Placidi L, Cusumano D. Results of 2023 survey on the use of synthetic computed tomography for magnetic resonance Imaging-only radiotherapy: Current status and future steps. Phys Imaging Radiat Oncol 2024; 32:100652. [PMID: 39381612 PMCID: PMC11460247 DOI: 10.1016/j.phro.2024.100652] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2024] [Revised: 09/11/2024] [Accepted: 09/16/2024] [Indexed: 10/10/2024] Open
Abstract
Background and purpose The emergence of synthetic CT (sCT) in MR-guided radiotherapy (MRgRT) represents a significant advancement, supporting MR-only workflows and online treatment adaptation. However, the lack of consensus guidelines has led to varied practices. This study reports results from a 2023 ESTRO survey aimed at defining current practices in sCT development and use. Materials and methods An survey was distributed to ESTRO members, including 98 questions across four sections on sCT algorithm generation and usage. By June 2023, 100 centers participated. The survey revealed diverse clinical experiences and roles, with primary sCT use in the pelvis (60%), brain (15%), abdomen (11%), thorax (8%), and head-and-neck (6%). sCT was mostly used for conventional fractionation treatments (68%), photon SBRT (40%), and palliative cases (28%), with limited use in proton therapy (4%). Results Conditional GANs and GANs were the most used neural network architectures, operating mainly on 1.5 T and 3 T MRI images. Less than half used paired images for training, and only 20% performed image selection. Key MR image quality parameters included magnetic field homogeneity and spatial integrity. Half of the respondents lacked a dedicated sCT-QA program, and many did not apply sanitychecks before calculation. Selection strategies included age, weight, and metal artifacts. A strong consensus (95%) emerged for vendor neutral guidelines. Conclusion The survey highlights the need for expert-based, vendor-neutral guidelines to standardize sCT tools, metrics, and clinical protocols, ensuring effective sCT use in MR-guided radiotherapy.
Collapse
Affiliation(s)
- M. Fusella
- Abano Terme Hospital, Department of Radiation Oncology, Abano Terme (Padua), Italy
| | - E. Alvarez Andres
- OncoRay – National Center for Radiation Research in Oncology, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Helmholtz-Zentrum Dresden-Rossendorf, Dresden, Germany
- Faculty of Medicine Carl Gustav Carus, TUD Dresden University of Technology, Dresden, Germany
| | - F. Villegas
- Department of Oncology-Pathology, Karolinska Institutet, Solna, Sweden
- Radiotherapy Physics and Engineering, Medical Radiation Physics and Nuclear Medicine, Karolinska University Hospital, Solna, Sweden
| | - L. Milan
- Medical Physics Unit, Imaging Institute of Southern Switzerland (IIMSI), Ente Ospedaliero Cantonale, Bellinzona, Switzerland
| | - TM. Janssen
- Department of Radiation Oncology, the Netherlands Cancer Institute, Amsterdam, the Netherlands
| | - R. Dal Bello
- University Hospital Zurich and University of Zurich, Department of Radiation Oncology, Zurich, Switzerland
| | - C. Garibaldi
- Unit of Radiation Research, IEO, European Institute of Oncology IRCCS, Milan, Italy
| | - L. Placidi
- Fondazione Policlinico Universitario Agostino Gemelli, Medical Physics Unit, Roma, Italy
| | - D. Cusumano
- Mater Olbia Hospital, Department of Medical Physics, Olbia, (SS), Italy
| |
Collapse
|
5
|
Vellini L, Zucca S, Lenkowicz J, Menna S, Catucci F, Quaranta F, Pilloni E, D'Aviero A, Aquilano M, Di Dio C, Iezzi M, Re A, Preziosi F, Piras A, Boschetti A, Piccari D, Mattiucci GC, Cusumano D. A Deep Learning Approach for the Fast Generation of Synthetic Computed Tomography from Low-Dose Cone Beam Computed Tomography Images on a Linear Accelerator Equipped with Artificial Intelligence. APPLIED SCIENCES 2024; 14:4844. [DOI: 10.3390/app14114844] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2024]
Abstract
Artificial Intelligence (AI) is revolutionising many aspects of radiotherapy (RT), opening scenarios that were unimaginable just a few years ago. The aim of this study is to propose a Deep Leaning (DL) approach able to quickly generate synthetic Computed Tomography (CT) images from low-dose Cone Beam CT (CBCT) acquired on a modern linear accelerator integrating AI. Methods: A total of 53 patients treated in the pelvic region were enrolled and split into training (30), validation (9), and testing (14). A Generative Adversarial Network (GAN) was trained for 200 epochs. The image accuracy was evaluated by calculating the mean and mean absolute error (ME and ME) between sCT and CT. RT treatment plans were calculated on CT and sCT images, and dose accuracy was evaluated considering Dose Volume Histogram (DVH) and gamma analysis. Results: A total of 4507 images were selected for training. The MAE and ME values in the test set were 36 ± 6 HU and 7 ± 6 HU, respectively. Mean gamma passing rates for 1%/1 mm, 2%/2 mm, and 3%/3 mm tolerance criteria were respectively 93.5 ± 3.4%, 98.0 ± 1.3%, and 99.2 ± 0.7%, with no difference between curative and palliative cases. All the DVH parameters analysed were within 1 Gy of the difference between sCT and CT. Conclusion: This study demonstrated that sCT generation using the DL approach is feasible on low-dose CBCT images. The proposed approach can represent a valid tool to speed up the online adaptive procedure and remove CT simulation from the RT workflow.
Collapse
Affiliation(s)
| | - Sergio Zucca
- Azienda Ospedaliera Brotzu, 09047 Cagliari, Italy
| | - Jacopo Lenkowicz
- Fondazione Policlinico Universitario “Agostino Gemelli” IRCCS, 00168 Roma, Italy
| | | | | | | | | | | | | | | | | | - Alessia Re
- Mater Olbia Hospital, 07026 Olbia, Italy
| | | | - Antonio Piras
- UO Radioterapia Oncologica, Villa Santa Teresa, 90011 Palermo, Italy
| | | | | | - Gian Carlo Mattiucci
- Mater Olbia Hospital, 07026 Olbia, Italy
- Facoltà di Medicina e Chirurgia, Università Cattolica del Sacro Cuore, 00168 Roma, Italy
| | | |
Collapse
|
6
|
van Elmpt W, Trier Taasti V, Redalen KR. Current and future developments of synthetic computed tomography generation for radiotherapy. Phys Imaging Radiat Oncol 2023; 28:100521. [PMID: 38058591 PMCID: PMC10696097 DOI: 10.1016/j.phro.2023.100521] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/08/2023] Open
Affiliation(s)
- Wouter van Elmpt
- Department of Radiation Oncology (MAASTRO), GROW School for Oncology and Reproduction, Maastricht University Medical Center+, Maastricht, The Netherlands
| | - Vicki Trier Taasti
- Department of Radiation Oncology (MAASTRO), GROW School for Oncology and Reproduction, Maastricht University Medical Center+, Maastricht, The Netherlands
| | | |
Collapse
|