1
|
Rossi M, Belotti G, Mainardi L, Baroni G, Cerveri P. Feasibility of proton dosimetry overriding planning CT with daily CBCT elaborated through generative artificial intelligence tools. Comput Assist Surg (Abingdon) 2024; 29:2327981. [PMID: 38468391 DOI: 10.1080/24699322.2024.2327981] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/13/2024] Open
Abstract
Radiotherapy commonly utilizes cone beam computed tomography (CBCT) for patient positioning and treatment monitoring. CBCT is deemed to be secure for patients, making it suitable for the delivery of fractional doses. However, limitations such as a narrow field of view, beam hardening, scattered radiation artifacts, and variability in pixel intensity hinder the direct use of raw CBCT for dose recalculation during treatment. To address this issue, reliable correction techniques are necessary to remove artifacts and remap pixel intensity into Hounsfield Units (HU) values. This study proposes a deep-learning framework for calibrating CBCT images acquired with narrow field of view (FOV) systems and demonstrates its potential use in proton treatment planning updates. Cycle-consistent generative adversarial networks (cGAN) processes raw CBCT to reduce scatter and remap HU. Monte Carlo simulation is used to generate CBCT scans, enabling the possibility to focus solely on the algorithm's ability to reduce artifacts and cupping effects without considering intra-patient longitudinal variability and producing a fair comparison between planning CT (pCT) and calibrated CBCT dosimetry. To showcase the viability of the approach using real-world data, experiments were also conducted using real CBCT. Tests were performed on a publicly available dataset of 40 patients who received ablative radiation therapy for pancreatic cancer. The simulated CBCT calibration led to a difference in proton dosimetry of less than 2%, compared to the planning CT. The potential toxicity effect on the organs at risk decreased from about 50% (uncalibrated) up the 2% (calibrated). The gamma pass rate at 3%/2 mm produced an improvement of about 37% in replicating the prescribed dose before and after calibration (53.78% vs 90.26%). Real data also confirmed this with slightly inferior performances for the same criteria (65.36% vs 87.20%). These results may confirm that generative artificial intelligence brings the use of narrow FOV CBCT scans incrementally closer to clinical translation in proton therapy planning updates.
Collapse
Affiliation(s)
- Matteo Rossi
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy
- Laboratory of Innovation in Sleep Medicine, Istituto Auxologico Italiano, Milan, Italy
| | - Gabriele Belotti
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy
| | - Luca Mainardi
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy
| | - Guido Baroni
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy
- Bioengineering Unit, Clinical Department, National Center for Oncological Hadrontherapy (CNAO), Pavia, Italy
| | - Pietro Cerveri
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy
- Laboratory of Innovation in Sleep Medicine, Istituto Auxologico Italiano, Milan, Italy
| |
Collapse
|
2
|
Sherwani MK, Gopalakrishnan S. A systematic literature review: deep learning techniques for synthetic medical image generation and their applications in radiotherapy. FRONTIERS IN RADIOLOGY 2024; 4:1385742. [PMID: 38601888 PMCID: PMC11004271 DOI: 10.3389/fradi.2024.1385742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/13/2024] [Accepted: 03/11/2024] [Indexed: 04/12/2024]
Abstract
The aim of this systematic review is to determine whether Deep Learning (DL) algorithms can provide a clinically feasible alternative to classic algorithms for synthetic Computer Tomography (sCT). The following categories are presented in this study: ∙ MR-based treatment planning and synthetic CT generation techniques. ∙ Generation of synthetic CT images based on Cone Beam CT images. ∙ Low-dose CT to High-dose CT generation. ∙ Attenuation correction for PET images. To perform appropriate database searches, we reviewed journal articles published between January 2018 and June 2023. Current methodology, study strategies, and results with relevant clinical applications were analyzed as we outlined the state-of-the-art of deep learning based approaches to inter-modality and intra-modality image synthesis. This was accomplished by contrasting the provided methodologies with traditional research approaches. The key contributions of each category were highlighted, specific challenges were identified, and accomplishments were summarized. As a final step, the statistics of all the cited works from various aspects were analyzed, which revealed that DL-based sCTs have achieved considerable popularity, while also showing the potential of this technology. In order to assess the clinical readiness of the presented methods, we examined the current status of DL-based sCT generation.
Collapse
Affiliation(s)
- Moiz Khan Sherwani
- Section for Evolutionary Hologenomics, Globe Institute, University of Copenhagen, Copenhagen, Denmark
| | | |
Collapse
|
3
|
Kaushik S, Ödén J, Sharma DS, Fredriksson A, Toma-Dasu I. Generation and evaluation of anatomy-preserving virtual CT for online adaptive proton therapy. Med Phys 2024; 51:1536-1546. [PMID: 38230803 DOI: 10.1002/mp.16941] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2023] [Revised: 11/24/2023] [Accepted: 12/31/2023] [Indexed: 01/18/2024] Open
Abstract
BACKGROUND Daily CTs generated by CBCT correction are required for daily replanning in online-adaptive proton therapy (APT) to effectively deal with inter-fractional changes. Out of the currently available methods, the suitability of a daily CT generation method for proton dose calculation also depends on the anatomical site. PURPOSE We propose an anatomy-preserving virtual CT (APvCT) method as a hybrid method of CBCT correction, which is especially suitable for large anatomy deformations. The accuracy of the hybrid method was assessed by comparison with the corrected CBCT (cCBCT) and virtual CT (vCT) methods in the context of online APT. METHODS Seventy-one daily CBCTs of four prostate cancer patients treated with intensity modulated proton therapy (IMPT) were converted to daily CTs using cCBCT, vCT, and the newly proposed APvCT method. In APvCT, planning CT (pCT) were mapped to CBCT geometry using deformable image registration with boundary conditions on controlling regions of interest (ROIs) created with deep learning segmentation on cCBCT. The relative frequency distribution (RFD) of HU, mass density and stopping power ratio (SPR) values were assessed and compared with the pCT. The ROIs in the APvCT and vCT were compared with cCBCT in terms of Dice similarity coefficient (DSC) and mean distance-to-agreement (mDTA). For each patient, a robustly optimized IMPT plan was created on the pCT and subsequent daily adaptive plans on daily CTs. For dose distribution comparison on the same anatomy, the daily adaptive plans on cCBCT and vCT were recalculated on the corresponding APvCT. The dose distributions were compared in terms of isodose volumes and 3D global gamma-index passing rate (GPR) at γ(2%, 2 mm) criterion. RESULTS For all patients, no noticeable difference in RFDs was observed amongst APvCT, vCT, and pCT except in cCBCT, which showed a noticeable difference. The minimum DSC value was 0.96 and 0.39 for contours in APvCT and vCT respectively. The average value of mDTA for APvCT was 0.01 cm for clinical target volume and ≤0.01 cm for organs at risk, which increased to 0.18 cm and ≤0.52 cm for vCT. The mean GPR value was 90.9%, 64.5%, and 67.0% for APvCT versus cCBCT, vCT versus cCBCT, and APvCT versus vCT, respectively. When recalculated on APvCT, the adaptive cCBCT and vCT plans resulted in mean GPRs of 89.5 ± 5.1% and 65.9 ± 19.1%, respectively. The mean DSC values for 80.0%, 90.0%, 95.0%, 98.0%, and 100.0% isodose volumes were 0.97, 0.97, 0.97, 0.95, and 0.91 for recalculated cCBCT plans, and 0.89, 0.88, 0.87, 0.85, and 0.81 for recalculated vCT plans. Hausdorff distance for the 100.0% isodose volume in some cases of recalculated cCBCT plans on APvCT exceeded 1.00 cm. CONCLUSIONS APvCT contours showed good agreement with reference contours of cCBCT which indicates anatomy preservation in APvCT. A vCT with erroneous anatomy can result in an incorrect adaptive plan. Further, slightly lower values of GPR between the APvCT and cCBCT-based adaptive plans can be explained by the difference in the cCBCT's SPR RFD from the pCT.
Collapse
Affiliation(s)
- Suryakant Kaushik
- RaySearch Laboratories AB (Publ), Stockholm, Sweden
- Department of Physics, Medical Radiation Physics, Stockholm University, Stockholm, Sweden
- Department of Oncology and Pathology, Medical Radiation Physics, Karolinska Institutet, Stockholm, Sweden
| | - Jakob Ödén
- RaySearch Laboratories AB (Publ), Stockholm, Sweden
| | | | | | - Iuliana Toma-Dasu
- Department of Physics, Medical Radiation Physics, Stockholm University, Stockholm, Sweden
- Department of Oncology and Pathology, Medical Radiation Physics, Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|
4
|
Hoffmans-Holtzer N, Magallon-Baro A, de Pree I, Slagter C, Xu J, Thill D, Olofsen-van Acht M, Hoogeman M, Petit S. Evaluating AI-generated CBCT-based synthetic CT images for target delineation in palliative treatments of pelvic bone metastasis at conventional C-arm linacs. Radiother Oncol 2024; 192:110110. [PMID: 38272314 DOI: 10.1016/j.radonc.2024.110110] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Revised: 01/11/2024] [Accepted: 01/18/2024] [Indexed: 01/27/2024]
Abstract
PURPOSE One-table treatments with treatment imaging, preparation and delivery occurring at one treatment couch, could increase patients' comfort and throughput for palliative treatments. On regular C-arm linacs, however, cone-beam CT (CBCT) imaging quality is currently insufficient. Therefore, our goal was to assess the suitability of AI-generated CBCT based synthetic CT (sCT) images for target delineation and treatment planning for palliative radiotherapy. MATERIALS AND METHODS CBCTs and planning CT-scans of 22 female patients with pelvic bone metastasis were included. For each CBCT, a corresponding sCT image was generated by a deep learning model in ADMIRE 3.38.0. Radiation oncologists delineated 23 target volumes (TV) on the sCTs (TVsCT) and scored their delineation confidence. The delineations were transferred to planning CTs and manually adjusted if needed to yield gold standard target volumes (TVclin). TVsCT were geometrically compared to TVclin using Dice coefficient (DC) and Hausdorff Distance (HD). The dosimetric impact of TVsCT inaccuracies was evaluated for VMAT plans with different PTV margins. RESULTS Radiation oncologists scored the sCT quality as sufficient for 13/23 TVsCT (median: DC = 0.9, HD = 11 mm) and insufficient for 10/23 TVsCT (median: DC = 0.7, HD = 34 mm). For the sufficient category, remaining inaccuracies could be compensated by +1 to +4 mm additional margin to achieve coverage of V95% > 95% and V95% > 98%, respectively in 12/13 TVsCT. CONCLUSION The evaluated sCT quality allowed for accurate delineation for most targets. sCTs with insufficient quality could be identified accurately upfront. A moderate PTV margin expansion could address remaining delineation inaccuracies. Therefore, these findings support further exploration of CBCT based one-table treatments on C-arm linacs.
Collapse
Affiliation(s)
- Nienke Hoffmans-Holtzer
- Erasmus MC - Cancer Institute, University Medical Center Rotterdam, Department of Radiotherapy, P.O. Box 2040, 3000 CA Rotterdam, The Netherlands.
| | - Alba Magallon-Baro
- Erasmus MC - Cancer Institute, University Medical Center Rotterdam, Department of Radiotherapy, P.O. Box 2040, 3000 CA Rotterdam, The Netherlands.
| | - Ilse de Pree
- Erasmus MC - Cancer Institute, University Medical Center Rotterdam, Department of Radiotherapy, P.O. Box 2040, 3000 CA Rotterdam, The Netherlands
| | - Cleo Slagter
- Erasmus MC - Cancer Institute, University Medical Center Rotterdam, Department of Radiotherapy, P.O. Box 2040, 3000 CA Rotterdam, The Netherlands
| | - Jiaofeng Xu
- Elekta Inc, St. Charles office, 1450 Beale St, St. Charles, MO 63303, USA
| | - Daniel Thill
- Elekta Inc, St. Charles office, 1450 Beale St, St. Charles, MO 63303, USA
| | - Manouk Olofsen-van Acht
- Erasmus MC - Cancer Institute, University Medical Center Rotterdam, Department of Radiotherapy, P.O. Box 2040, 3000 CA Rotterdam, The Netherlands
| | - Mischa Hoogeman
- Erasmus MC - Cancer Institute, University Medical Center Rotterdam, Department of Radiotherapy, P.O. Box 2040, 3000 CA Rotterdam, The Netherlands
| | - Steven Petit
- Erasmus MC - Cancer Institute, University Medical Center Rotterdam, Department of Radiotherapy, P.O. Box 2040, 3000 CA Rotterdam, The Netherlands
| |
Collapse
|
5
|
Zhuang T, Parsons D, Desai N, Gibbard G, Keilty D, Lin MH, Cai B, Nguyen D, Chiu T, Godley A, Pompos A, Jiang S. Simulation and pre-planning omitted radiotherapy (SPORT): a feasibility study for prostate cancer. Biomed Phys Eng Express 2024; 10:025019. [PMID: 38241733 DOI: 10.1088/2057-1976/ad20aa] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2023] [Accepted: 01/19/2024] [Indexed: 01/21/2024]
Abstract
This study explored the feasibility of on-couch intensity modulated radiotherapy (IMRT) planning for prostate cancer (PCa) on a cone-beam CT (CBCT)-based online adaptive RT platform without an individualized pre-treatment plan and contours. Ten patients with PCa previously treated with image-guided IMRT (60 Gy/20 fractions) were selected. In contrast to the routine online adaptive RT workflow, a novel approach was employed in which the same preplan that was optimized on one reference patient was adapted to generate individual on-couch/initial plans for the other nine test patients using Ethos emulator. Simulation CTs of the test patients were used as simulated online CBCT (sCBCT) for emulation. Quality assessments were conducted on synthetic CTs (sCT). Dosimetric comparisons were performed between on-couch plans, on-couch plans recomputed on the sCBCT and individually optimized plans for test patients. The median value of mean absolute difference between sCT and sCBCT was 74.7 HU (range 69.5-91.5 HU). The average CTV/PTV coverage by prescription dose was 100.0%/94.7%, and normal tissue constraints were met for the nine test patients in on-couch plans on sCT. Recalculating on-couch plans on the sCBCT showed about 0.7% reduction of PTV coverage and a 0.6% increasing of hotspot, and the dose difference of the OARs was negligible (<0.5 Gy). Hence, initial IMRT plans for new patients can be generated by adapting a reference patient's preplan with online contours, which had similar qualities to the conventional approach of individually optimized plan on the simulation CT. Further study is needed to identify selection criteria for patient anatomy most amenable to this workflow.
Collapse
Affiliation(s)
- Tingliang Zhuang
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, United States of America
| | - David Parsons
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, United States of America
| | - Neil Desai
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, United States of America
| | - Grant Gibbard
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, United States of America
| | - Dana Keilty
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, United States of America
| | - Mu-Han Lin
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, United States of America
| | - Bin Cai
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, United States of America
| | - Dan Nguyen
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, United States of America
| | - Tsuicheng Chiu
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, United States of America
| | - Andrew Godley
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, United States of America
| | - Arnold Pompos
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, United States of America
| | - Steve Jiang
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, United States of America
| |
Collapse
|
6
|
Rusanov B, Hassan GM, Reynolds M, Sabet M, Rowshanfarzad P, Bucknell N, Gill S, Dass J, Ebert M. Transformer CycleGAN with uncertainty estimation for CBCT based synthetic CT in adaptive radiotherapy. Phys Med Biol 2024; 69:035014. [PMID: 38198726 DOI: 10.1088/1361-6560/ad1cfc] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Accepted: 01/10/2024] [Indexed: 01/12/2024]
Abstract
Objective. Clinical implementation of synthetic CT (sCT) from cone-beam CT (CBCT) for adaptive radiotherapy necessitates a high degree of anatomical integrity, Hounsfield unit (HU) accuracy, and image quality. To achieve these goals, a vision-transformer and anatomically sensitive loss functions are described. Better quantification of image quality is achieved using the alignment-invariant Fréchet inception distance (FID), and uncertainty estimation for sCT risk prediction is implemented in a scalable plug-and-play manner.Approach. Baseline U-Net, generative adversarial network (GAN), and CycleGAN models were trained to identify shortcomings in each approach. The proposed CycleGAN-Best model was empirically optimized based on a large ablation study and evaluated using classical image quality metrics, FID, gamma index, and a segmentation analysis. Two uncertainty estimation methods, Monte-Carlo Dropout (MCD) and test-time augmentation (TTA), were introduced to model epistemic and aleatoric uncertainty.Main results. FID was correlated to blind observer image quality scores with a Correlation Coefficient of -0.83, validating the metric as an accurate quantifier of perceived image quality. The FID and mean absolute error (MAE) of CycleGAN-Best was 42.11 ± 5.99 and 25.00 ± 1.97 HU, compared to 63.42 ± 15.45 and 31.80 HU for CycleGAN-Baseline, and 144.32 ± 20.91 and 68.00 ± 5.06 HU for the CBCT, respectively. Gamma 1%/1 mm pass rates were 98.66 ± 0.54% for CycleGAN-Best, compared to 86.72 ± 2.55% for the CBCT. TTA and MCD-based uncertainty maps were well spatially correlated with poor synthesis outputs.Significance. Anatomical accuracy was achieved by suppressing CycleGAN-related artefacts. FID better discriminated image quality, where alignment-based metrics such as MAE erroneously suggest poorer outputs perform better. Uncertainty estimation for sCT was shown to correlate with poor outputs and has clinical relevancy toward model risk assessment and quality assurance. The proposed model and accompanying evaluation and risk assessment tools are necessary additions to achieve clinically robust sCT generation models.
Collapse
Affiliation(s)
- Branimir Rusanov
- School of Physics, Mathematics and Computing, University of Western Australia, Perth, Western Australia, Australia
- Department of Radiation Oncology, Sir Charles Gairdner Hospital, Perth, Western Australia, Australia
- Center for Advanced Technologies in Cancer Research, Perth, Western Australia, Australia
| | - Ghulam Mubashar Hassan
- School of Physics, Mathematics and Computing, University of Western Australia, Perth, Western Australia, Australia
| | - Mark Reynolds
- School of Physics, Mathematics and Computing, University of Western Australia, Perth, Western Australia, Australia
| | - Mahsheed Sabet
- School of Physics, Mathematics and Computing, University of Western Australia, Perth, Western Australia, Australia
- Department of Radiation Oncology, Sir Charles Gairdner Hospital, Perth, Western Australia, Australia
- Center for Advanced Technologies in Cancer Research, Perth, Western Australia, Australia
| | - Pejman Rowshanfarzad
- School of Physics, Mathematics and Computing, University of Western Australia, Perth, Western Australia, Australia
- Center for Advanced Technologies in Cancer Research, Perth, Western Australia, Australia
| | - Nicholas Bucknell
- Department of Radiation Oncology, Sir Charles Gairdner Hospital, Perth, Western Australia, Australia
| | - Suki Gill
- Department of Radiation Oncology, Sir Charles Gairdner Hospital, Perth, Western Australia, Australia
| | - Joshua Dass
- Department of Radiation Oncology, Sir Charles Gairdner Hospital, Perth, Western Australia, Australia
| | - Martin Ebert
- School of Physics, Mathematics and Computing, University of Western Australia, Perth, Western Australia, Australia
- Department of Radiation Oncology, Sir Charles Gairdner Hospital, Perth, Western Australia, Australia
- Center for Advanced Technologies in Cancer Research, Perth, Western Australia, Australia
- Australian Centre for Quantitative Imaging, University of Western Australia, Perth, Western Australia, Australia
- School of Medicine and Public Health, University of Wisconsin, Madison WI, United States of America
| |
Collapse
|
7
|
de Koster RJC, Thummerer A, Scandurra D, Langendijk JA, Both S. Technical note: Evaluation of deep learning based synthetic CTs clinical readiness for dose and NTCP driven head and neck adaptive proton therapy. Med Phys 2023; 50:8023-8033. [PMID: 37831597 DOI: 10.1002/mp.16782] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Revised: 09/19/2023] [Accepted: 09/25/2023] [Indexed: 10/15/2023] Open
Abstract
BACKGROUND Adaptive proton therapy workflows rely on accurate imaging throughout the treatment course. Our centre currently utilizes weekly repeat CTs (rCTs) for treatment monitoring and plan adaptations. However, deep learning-based methods have recently shown to successfully correct CBCT images, which suffer from severe imaging artifacts, and generate high quality synthetic CT (sCT) images which enable CBCT-based proton dose calculations. PURPOSE To compare daily CBCT-based sCT images to planning CTs (pCT) and rCTs of head and neck (HN) cancer patients to investigate the dosimetric accuracy of CBCT-based sCTs in a scenario mimicking actual clinical practice. METHODS Data of 56 HN cancer patients, previously treated with proton therapy was used to generate 1.962 sCT images, using a previously developed and trained deep convolutional neural network. Clinical IMPT treatment plans were recalculated on the pCT, weekly rCTs and daily sCTs. The dosimetric accuracy of sCTs was compared to same day rCTs and the initial planning CT. As a reference, rCTs were also compared to pCTs. The dose difference between sCTs and rCTs/pCT was quantified by calculating the D98 difference for target volumes and Dmean difference for organs-at-risk. To investigate the clinical relevancy of possible dose differences, NTCP values were calculated for dysphagia and xerostomia. RESULTS For target volumes, only minor dose differences were found for sCT versus rCT and sCT versus pCT, with dose differences mostly within ±1.5%. Larger dose differences were observed in OARs, where a general shift towards positive differences was found, with the largest difference in the left parotid gland. Delta NTCP values for grade 2 dysphagia and xerostomia were within ±2.5% for 90% of the sCTs. CONCLUSIONS Target doses showed high similarity between rCTs and sCTs. Further investigations are required to identify the origin of the dose differences at OAR levels and its relevance in clinical decision making.
Collapse
Affiliation(s)
- Rutger J C de Koster
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Adrian Thummerer
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Daniel Scandurra
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Johannes A Langendijk
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Stefan Both
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| |
Collapse
|
8
|
de Hond YJM, van Haaren PMA, Verrijssen AE, Tijssen RHN, Hurkmans CW. Inter-observer variability in library plan selection on iterative CBCT and synthetic CT images of cervical cancer patients. J Appl Clin Med Phys 2023; 24:e14170. [PMID: 37788333 PMCID: PMC10647946 DOI: 10.1002/acm2.14170] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2023] [Revised: 09/11/2023] [Accepted: 09/15/2023] [Indexed: 10/05/2023] Open
Abstract
INTRODUCTION In the Library-of-Plans (LoP) approach, correct plan selection is essential for delivering radiotherapy treatment accurately. However, poor image quality of the cone-beam computed tomography (CBCT) may introduce inter-observer variability and thereby hamper accurate plan selection. In this study, we investigated whether new techniques to improve the CBCT image quality and improve consistency in plan selection, affects the accuracy of LoP selection in cervical cancer patients. MATERIALS AND METHODS CBCT images of 12 patients were used to investigate the inter-observer variability of plan selection based on different CBCT image types. Six observers were asked to individually select a plan based on clinical X-ray Volumetric Imaging (XVI) CBCT, iterative reconstructed CBCT (iCBCT) and synthetic CTs (sCT). Selections were performed before and after a consensus meeting with the entire group, in which guidelines were created. A scoring by all observers on the image quality and plan selection procedure was also included. For plan selection, Fleiss' kappa (κ) statistical test was used to determine the inter-observer variability within one image type. RESULTS The agreement between observers was significantly higher on sCT compared to CBCT. The consensus meeting improved the duration and inter-observer variability. In this manuscript, the guidelines attributed the overall results in the plan selection. Before the meeting, the gold standard was selected in 76% of the cases on XVI CBCT, 74% on iCBCT, and 76% on sCT. After the meeting, the gold standard was selected in 83% of the cases on XVI CBCT, 81% on iCBCT, and 90% on sCT. CONCLUSION The use of sCTs can increase the agreement of plan selection among observers and the gold standard was indicated to be selected more often. It is important that clear guidelines for plan selection are implemented in order to benefit from the increased image quality, accurate selection, and decrease inter-observer variability.
Collapse
Affiliation(s)
- Yvonne J. M. de Hond
- Department of Radiation OncologyCatharina Hospital EindhovenEindhovenThe Netherlands
| | | | | | - Rob H. N. Tijssen
- Department of Radiation OncologyCatharina Hospital EindhovenEindhovenThe Netherlands
| | - Coen W. Hurkmans
- Department of Radiation OncologyCatharina Hospital EindhovenEindhovenThe Netherlands
| |
Collapse
|
9
|
Gao L, Xie K, Sun J, Lin T, Sui J, Yang G, Ni X. A transformer-based dual-domain network for reconstructing FOV extended cone-beam CT images from truncated sinograms in radiation therapy. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 241:107767. [PMID: 37633083 DOI: 10.1016/j.cmpb.2023.107767] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 08/15/2023] [Accepted: 08/15/2023] [Indexed: 08/28/2023]
Abstract
BACKGROUND AND OBJECTIVE Cone-beam computed tomography (CBCT) is widely used in clinical radiotherapy, but its small field of view (sFOV) limits its application potential. In this study, a transformer-based dual-domain network (dual_swin), which combined image domain restoration and sinogram domain restoration, was proposed for the reconstruction of complete CBCT images with extended FOV from truncated sinograms. METHODS The planning CT images with large FOV (LFOV) of 330 patients who received radiation therapy were collected. The synthetic CBCT (sCBCT) images with LFOV were generated from CT images by the trained cycleGAN network, and CBCT images with sFOV were obtained through forward projection, projection truncation, and filtered back projection (FBP), comprising the training and test data. The proposed dual_swin includes sinogram domain restoration, image domain restoration, and FBP layer, and the swin transformer blocks were used as the basic feature extraction module in the network to improve the global feature extraction ability. The proposed dual_swin was compared with the image domain method, the sinogram domain method, the U-Net based dual domain network (dual_Unet), and the traditional iterative reconstruction method based on prior image and conjugate gradient least-squares (CGLS) in the test of sCBCT images and clinical CBCT images. The HU accuracy and body contour accuracy of the predicted images by each method were evaluated. RESULTS The images generated using the CGLS method were fuzzy and obtained the lowest structural similarity (SSIM) among all methods in the test of sCBCT and clinical CBCT images. The predicted images by the image domain methods are quite different from the ground truth and have low accuracy on HU value and body contour. In comparison with image domain methods, sinogram domain methods improved the accuracy of HU value and body contour but introduced secondary artifacts and distorted bone tissue. The proposed dual_swin achieved the highest HU and contour accuracy with mean absolute error (MAE) of 23.0 HU, SSIM of 95.7%, dice similarity coefficient (DSC) of 99.6%, and Hausdorff distance (HD) of 4.1 mm in the test of sCBCT images. In the test of clinical patients, images that were predicted by dual_swin yielded MAE, SSIM, DSC, and HD of 38.2 HU, 91.7%, 99.0%, and 5.4 mm, respectively. The predicted images by the proposed dual_swin has significantly higher accuracy than the other methods (P < 0.05). CONCLUSIONS The proposed dual_swin can accurately reconstruct FOV extended CBCT images from the truncated sinogram to improve the application potential of CBCT images in radiotherapy.
Collapse
Affiliation(s)
- Liugang Gao
- School of Computer Science and Engineering, Southeast University, Nanjing, China; The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China; Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| | - Kai Xie
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China; Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| | - Jiawei Sun
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China; Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| | - Tao Lin
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China; Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| | - Jianfeng Sui
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China; Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| | - Guanyu Yang
- School of Computer Science and Engineering, Southeast University, Nanjing, China.
| | - Xinye Ni
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China; Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China.
| |
Collapse
|
10
|
Yang S, Kim KD, Ariji E, Takata N, Kise Y. Evaluating the performance of generative adversarial network-synthesized periapical images in classifying C-shaped root canals. Sci Rep 2023; 13:18038. [PMID: 37865655 PMCID: PMC10590373 DOI: 10.1038/s41598-023-45290-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Accepted: 10/18/2023] [Indexed: 10/23/2023] Open
Abstract
This study evaluated the performance of generative adversarial network (GAN)-synthesized periapical images for classifying C-shaped root canals, which are challenging to diagnose because of their complex morphology. GANs have emerged as a promising technique for generating realistic images, offering a potential solution for data augmentation in scenarios with limited training datasets. Periapical images were synthesized using the StyleGAN2-ADA framework, and their quality was evaluated based on the average Frechet inception distance (FID) and the visual Turing test. The average FID was found to be 35.353 (± 4.386) for synthesized C-shaped canal images and 25.471 (± 2.779) for non C-shaped canal images. The visual Turing test conducted by two radiologists on 100 randomly selected images revealed that distinguishing between real and synthetic images was difficult. These results indicate that GAN-synthesized images exhibit satisfactory visual quality. The classification performance of the neural network, when augmented with GAN data, showed improvements compared with using real data alone, and could be advantageous in addressing data conditions with class imbalance. GAN-generated images have proven to be an effective data augmentation method, addressing the limitations of limited training data and computational resources in diagnosing dental anomalies.
Collapse
Affiliation(s)
- Sujin Yang
- Department of Advanced General Dentistry, College of Dentistry, Yonsei University, Seoul, Korea
| | - Kee-Deog Kim
- Department of Advanced General Dentistry, College of Dentistry, Yonsei University, Seoul, Korea
| | - Eiichiro Ariji
- Department of Oral and Maxillofacial Radiology, Aichi Gakuin University, 2-11 Seuemori-Dori, Chikusa-Ku, Nagoya, 464-8651, Japan
| | - Natsuho Takata
- Department of Oral and Maxillofacial Radiology, Aichi Gakuin University, 2-11 Seuemori-Dori, Chikusa-Ku, Nagoya, 464-8651, Japan
| | - Yoshitaka Kise
- Department of Oral and Maxillofacial Radiology, Aichi Gakuin University, 2-11 Seuemori-Dori, Chikusa-Ku, Nagoya, 464-8651, Japan.
| |
Collapse
|
11
|
Szmul A, Taylor S, Lim P, Cantwell J, Moreira I, Zhang Y, D’Souza D, Moinuddin S, Gaze MN, Gains J, Veiga C. Deep learning based synthetic CT from cone beam CT generation for abdominal paediatric radiotherapy. Phys Med Biol 2023; 68:105006. [PMID: 36996837 PMCID: PMC10160738 DOI: 10.1088/1361-6560/acc921] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2022] [Revised: 03/13/2023] [Accepted: 03/30/2023] [Indexed: 04/01/2023]
Abstract
Objective. Adaptive radiotherapy workflows require images with the quality of computed tomography (CT) for re-calculation and re-optimisation of radiation doses. In this work we aim to improve the quality of on-board cone beam CT (CBCT) images for dose calculation using deep learning.Approach. We propose a novel framework for CBCT-to-CT synthesis using cycle-consistent Generative Adversarial Networks (cycleGANs). The framework was tailored for paediatric abdominal patients, a challenging application due to the inter-fractional variability in bowel filling and small patient numbers. We introduced to the networks the concept of global residuals only learning and modified the cycleGAN loss function to explicitly promote structural consistency between source and synthetic images. Finally, to compensate for the anatomical variability and address the difficulties in collecting large datasets in the paediatric population, we applied a smart 2D slice selection based on the common field-of-view (abdomen) to our imaging dataset. This acted as a weakly paired data approach that allowed us to take advantage of scans from patients treated for a variety of malignancies (thoracic-abdominal-pelvic) for training purposes. We first optimised the proposed framework and benchmarked its performance on a development dataset. Later, a comprehensive quantitative evaluation was performed on an unseen dataset, which included calculating global image similarity metrics, segmentation-based measures and proton therapy-specific metrics.Main results. We found improved performance for our proposed method, compared to a baseline cycleGAN implementation, on image-similarity metrics such as Mean Absolute Error calculated for a matched virtual CT (55.0 ± 16.6 HU proposed versus 58.9 ± 16.8 HU baseline). There was also a higher level of structural agreement for gastrointestinal gas between source and synthetic images measured using the dice similarity coefficient (0.872 ± 0.053 proposed versus 0.846 ± 0.052 baseline). Differences found in water-equivalent thickness metrics were also smaller for our method (3.3 ± 2.4% proposed versus 3.7 ± 2.8% baseline).Significance. Our findings indicate that our innovations to the cycleGAN framework improved the quality and structure consistency of the synthetic CTs generated.
Collapse
Affiliation(s)
- Adam Szmul
- Centre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, United Kingdom
| | - Sabrina Taylor
- Centre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| | - Pei Lim
- Department of Oncology, University College London Hospitals NHS Foundation Trust, London, United Kingdom
| | - Jessica Cantwell
- Radiotherapy, University College London Hospitals NHS Foundation Trust, London, United Kingdom
| | - Isabel Moreira
- Centre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| | - Ying Zhang
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| | - Derek D’Souza
- Radiotherapy Physics Services, University College London Hospitals NHS Foundation Trust, London, United Kingdom
| | - Syed Moinuddin
- Radiotherapy, University College London Hospitals NHS Foundation Trust, London, United Kingdom
| | - Mark N. Gaze
- Department of Oncology, University College London Hospitals NHS Foundation Trust, London, United Kingdom
| | - Jennifer Gains
- Department of Oncology, University College London Hospitals NHS Foundation Trust, London, United Kingdom
| | - Catarina Veiga
- Centre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| |
Collapse
|
12
|
Suwanraksa C, Bridhikitti J, Liamsuwan T, Chaichulee S. CBCT-to-CT Translation Using Registration-Based Generative Adversarial Networks in Patients with Head and Neck Cancer. Cancers (Basel) 2023; 15:cancers15072017. [PMID: 37046678 PMCID: PMC10093508 DOI: 10.3390/cancers15072017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2022] [Accepted: 03/27/2023] [Indexed: 03/31/2023] Open
Abstract
Recently, deep learning with generative adversarial networks (GANs) has been applied in multi-domain image-to-image translation. This study aims to improve the image quality of cone-beam computed tomography (CBCT) by generating synthetic CT (sCT) that maintains the patient’s anatomy as in CBCT, while having the image quality of CT. As CBCT and CT are acquired at different time points, it is challenging to obtain paired images with aligned anatomy for supervised training. To address this limitation, the study incorporated a registration network (RegNet) into GAN during training. RegNet can dynamically estimate the correct labels, allowing supervised learning with noisy labels. The study developed and evaluated the approach using imaging data from 146 patients with head and neck cancer. The results showed that GAN trained with RegNet performed better than those trained without RegNet. Specifically, in the UNIT model trained with RegNet, the mean absolute error (MAE) was reduced from 40.46 to 37.21, the root mean-square error (RMSE) was reduced from 119.45 to 108.86, the peak signal-to-noise ratio (PSNR) was increased from 28.67 to 29.55, and the structural similarity index (SSIM) was increased from 0.8630 to 0.8791. The sCT generated from the model had fewer artifacts and retained the anatomical information as in CBCT.
Collapse
|
13
|
Hoppen L, Sarria GR, Kwok CS, Boda-Heggemann J, Buergy D, Ehmann M, Giordano FA, Fleckenstein J. Dosimetric benefits of adaptive radiation therapy for patients with stage III non-small cell lung cancer. Radiat Oncol 2023; 18:34. [PMID: 36814271 PMCID: PMC9945670 DOI: 10.1186/s13014-023-02222-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Accepted: 02/06/2023] [Indexed: 02/24/2023] Open
Abstract
BACKGROUND Daily adaptive radiation therapy (ART) of patients with non-small cell lung cancer (NSCLC) lowers organs at risk exposure while maintaining the planning target volume (PTV) coverage. Thus, ART allows an isotoxic approach with increased doses to the PTV that could improve local tumor control. Herein we evaluate daily online ART strategies regarding their impact on relevant dose-volume metrics. METHODS Daily cone-beam CTs (1 × n = 28, 1 × n = 29, 11 × n = 30) of 13 stage III NSCLC patients were converted into synthetic CTs (sCTs). Treatment plans (TPs) were created retrospectively on the first-fraction sCTs (sCT1) and subsequently transferred unaltered to the sCTs of the remaining fractions of each patient (sCT2-n) (IGRT scenario). Two additional TPs were generated on sCT2-n: one minimizing the lung-dose while preserving the D95%(PTV) (isoeffective scenario), the other escalating the D95%(PTV) with a constant V20Gy(lungipsilateral) (isotoxic scenario). RESULTS Compared to the original TPs predicted dose, the median D95%(PTV) in the IGRT scenario decreased by 1.6 Gy ± 4.2 Gy while the V20Gy(lungipsilateral) increased in median by 1.1% ± 4.4%. The isoeffective scenario preserved the PTV coverage and reduced the median V20Gy(lungipsilateral) by 3.1% ± 3.6%. Furthermore, the median V5%(heart) decreased by 2.9% ± 6.4%. With an isotoxic prescription, a median dose-escalation to the gross target volume of 10.0 Gy ± 8.1 Gy without increasing the V20Gy(lungipsilateral) and V5%(heart) was feasible. CONCLUSIONS We demonstrated that even without reducing safety margins, ART can reduce lung-doses, while still reaching adequate target coverage or escalate target doses without increasing ipsilateral lung exposure. Clinical benefits by means of toxicity and local control of both strategies should be evaluated in prospective clinical trials.
Collapse
Affiliation(s)
- Lea Hoppen
- Department of Radiation Oncology, University Medical Center Mannheim, University of Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany.
| | - Gustavo R. Sarria
- grid.10388.320000 0001 2240 3300Department of Radiation Oncology, University Hospital Bonn, University of Bonn, Bonn, Germany
| | - Chung S. Kwok
- grid.7700.00000 0001 2190 4373Department of Radiation Oncology, University Medical Center Mannheim, University of Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167 Mannheim, Germany
| | - Judit Boda-Heggemann
- grid.7700.00000 0001 2190 4373Department of Radiation Oncology, University Medical Center Mannheim, University of Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167 Mannheim, Germany
| | - Daniel Buergy
- grid.7700.00000 0001 2190 4373Department of Radiation Oncology, University Medical Center Mannheim, University of Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167 Mannheim, Germany
| | - Michael Ehmann
- grid.7700.00000 0001 2190 4373Department of Radiation Oncology, University Medical Center Mannheim, University of Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167 Mannheim, Germany
| | - Frank A. Giordano
- grid.7700.00000 0001 2190 4373Department of Radiation Oncology, University Medical Center Mannheim, University of Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167 Mannheim, Germany
| | - Jens Fleckenstein
- grid.7700.00000 0001 2190 4373Department of Radiation Oncology, University Medical Center Mannheim, University of Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167 Mannheim, Germany
| |
Collapse
|
14
|
Gao L, Xie K, Sun J, Lin T, Sui J, Yang G, Ni X. Streaking artifact reduction for CBCT-based synthetic CT generation in adaptive radiotherapy. Med Phys 2023; 50:879-893. [PMID: 36183234 DOI: 10.1002/mp.16017] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Revised: 09/02/2022] [Accepted: 09/25/2022] [Indexed: 11/07/2022] Open
Abstract
BACKGROUND Cone-beam computed tomography (CBCT) is widely used for daily image guidance in radiation therapy, enhancing the reproducibility of patient setup. However, its application in adaptive radiotherapy (ART) is limited by many imaging artifacts and inaccurate Hounsfield units (HUs). The correction of CBCT image is necessary and of great value for CBCT-based ART. PURPOSE To explore the synthetic CT (sCT) generation from CBCT images of thorax and abdomen patients, which usually surfer from serious artifacts duo to organ state changes. In this study, a streaking artifact reduction network (SARN) is proposed to reduce artifacts and combine with cycleGAN to generate high-quality sCT images from CBCT and achieve an accurate dose calculation. METHODS The proposed SARN was trained in a self-supervised manner. Artifact-CT images were generated from planning CT by random deformation and projection replacement, and SARN was trained based on paired artifact-CT and CT images. The planning CT and CBCT images of 260 patients with cancer, including 120 thoracic and 140 abdominal CT scans, were used to train and evaluate neural networks. The CBCT images of another 12 patients in late treatment fractions, which contained large anatomy changes, were also tested by trained models. The trained models include commonly used U-Net, cycleGAN, attention-gated cycleGAN (cycAT), and cascade models combined SARN with cycleGAN or cycAT. The generated sCT images were compared in terms of image quality and dose calculation accuracy. RESULTS The sCT images generated by SARN combined with cycleGAN and cycAT showed the best image quality, removed the most artifacts, and retained the normal anatomical structure. The SARN+cycleGAN performed best in streaking artifacts removal with the maximum percent integrity uniformity (PIUm ) of 91.0% and minimum standard deviation (SD) of 35.4 HU for delineated artifact regions among all models. The mean absolute error (MAE) of CBCT images in the thorax and abdomen were 71.6 and 55.2 HU, respectively, using planning CT images after deformable registration as ground truth. Compared with CBCT, the thoracic and abdominal sCT images generated by each model had significantly improved image quality with smaller MAE (p < 0.05). The SARN+cycAT obtained the minimum MAEs of 42.5 HU in the thorax while SARN+cycleGAN got the minimum MAEs of 32.0 HU in the abdomen. The sCT generated by U-Net had a remarkably lower anatomical structure accuracy compared with the other models. The thoracic and abdominal sCT images generated by SARN+cycleGAN showed optimal dose calculation accuracy with gamma passing rates (2 mm/2%) of 98.2% and 96.9%, respectively. CONCLUSIONS The proposed SARN can reduce serious streaking artifacts in CBCT images. The SARN combined with cycleGAN can generate high-quality sCT images with fewer artifacts, high-accuracy HU values, and accurate anatomical structures, thus providing reliable dose calculation in ART.
Collapse
Affiliation(s)
- Liugang Gao
- School of Computer Science and Engineering, Southeast University, Nanjing, China
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| | - Kai Xie
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| | - Jiawei Sun
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| | - Tao Lin
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| | - Jianfeng Sui
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| | - Guanyu Yang
- School of Computer Science and Engineering, Southeast University, Nanjing, China
| | - Xinye Ni
- The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
| |
Collapse
|
15
|
Pai S, Hadzic I, Rao C, Zhovannik I, Dekker A, Traverso A, Asteriadis S, Hortal E. Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation. SENSORS (BASEL, SWITZERLAND) 2023; 23:1089. [PMID: 36772129 PMCID: PMC9920313 DOI: 10.3390/s23031089] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Revised: 12/28/2022] [Accepted: 01/05/2023] [Indexed: 06/18/2023]
Abstract
Research exploring CycleGAN-based synthetic image generation has recently accelerated in the medical community due to its ability to leverage unpaired images effectively. However, a commonly established drawback of the CycleGAN, the introduction of artifacts in generated images, makes it unreliable for medical imaging use cases. In an attempt to address this, we explore the effect of structure losses on the CycleGAN and propose a generalized frequency-based loss that aims at preserving the content in the frequency domain. We apply this loss to the use-case of cone-beam computed tomography (CBCT) translation to computed tomography (CT)-like quality. Synthetic CT (sCT) images generated from our methods are compared against baseline CycleGAN along with other existing structure losses proposed in the literature. Our methods (MAE: 85.5, MSE: 20433, NMSE: 0.026, PSNR: 30.02, SSIM: 0.935) quantitatively and qualitatively improve over the baseline CycleGAN (MAE: 88.8, MSE: 24244, NMSE: 0.03, PSNR: 29.37, SSIM: 0.935) across all investigated metrics and are more robust than existing methods. Furthermore, no observable artifacts or loss in image quality were observed. Finally, we demonstrated that sCTs generated using our methods have superior performance compared to the original CBCT images on selected downstream tasks.
Collapse
Affiliation(s)
- Suraj Pai
- GROW School for Oncology and Reproduction, Maastricht University Medical Centre+, 6229 HX Maastricht, The Netherlands
| | - Ibrahim Hadzic
- GROW School for Oncology and Reproduction, Maastricht University Medical Centre+, 6229 HX Maastricht, The Netherlands
| | - Chinmay Rao
- Division of Image Processing, Leiden University Medical Center, 2333 ZA Leiden, The Netherlands
| | - Ivan Zhovannik
- GROW School for Oncology and Reproduction, Maastricht University Medical Centre+, 6229 HX Maastricht, The Netherlands
| | - Andre Dekker
- GROW School for Oncology and Reproduction, Maastricht University Medical Centre+, 6229 HX Maastricht, The Netherlands
| | - Alberto Traverso
- GROW School for Oncology and Reproduction, Maastricht University Medical Centre+, 6229 HX Maastricht, The Netherlands
| | - Stylianos Asteriadis
- Department of Advanced Computing Sciences, Maastricht University, 6229 EN Maastricht, The Netherlands
| | - Enrique Hortal
- Department of Advanced Computing Sciences, Maastricht University, 6229 EN Maastricht, The Netherlands
| |
Collapse
|
16
|
Hyuk Choi J, Asadi B, Simpson J, Dowling JA, Chalup S, Welsh J, Greer P. Investigation of a water equivalent depth method for dosimetric accuracy evaluation of synthetic CT. Phys Med 2023; 105:102507. [PMID: 36535236 DOI: 10.1016/j.ejmp.2022.11.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/18/2022] [Revised: 11/24/2022] [Accepted: 11/26/2022] [Indexed: 12/23/2022] Open
Abstract
PURPOSE To provide a metric that reflects the dosimetric utility of the synthetic CT (sCT) and can be rapidly determined. METHODS Retrospective CT and atlas-based sCT of 62 (53 IMRT and 9 VMAT) prostate cancer patients were used. For image similarity measurements, the sCT and reference CT (rCT) were aligned using clinical registration parameters. Conventional image similarity metrics including the mean absolute error (MAE) and mean error (ME) were calculated. The water equivalent depth (WED) was automatically determined for each patient on the rCT and sCT as the distance from the skin surface to the treatment plan isocentre at 36 equidistant gantry angles, and the mean WED difference (ΔWED¯) between the two scans was calculated. Doses were calculated on each scan pair for the clinical plan in the treatment planning system. The image similarity measurements and ΔWED¯ were then compared to the isocentre dose difference (ΔDiso) between the two scans. RESULTS While no particular relationship to dose was observed for the other image similarity metrics, the ME results showed a linear trend against ΔDiso with R2 = 0.6, and the 95 % prediction interval for ΔDiso between -1.2 and 1 %. The ΔWED¯ results showed an improved linear trend (R2 = 0.8) with a narrower 95 % prediction interval from -0.8 % to 0.8 %. CONCLUSION ΔWED¯ highly correlates with ΔDiso for the reference and synthetic CT scans. This is easy to calculate automatically and does not require time-consuming dose calculations. Therefore, it can facilitate the process of developing and evaluating new sCT generation algorithms.
Collapse
Affiliation(s)
- Jae Hyuk Choi
- School of Information and Physical Sciences, University of Newcastle, Newcastle, New South Wales, Australia.
| | - Behzad Asadi
- Department of Radiation Oncology, Calvary Mater Hospital, Newcastle, New South Wales, Australia
| | - John Simpson
- Department of Radiation Oncology, Calvary Mater Hospital, Newcastle, New South Wales, Australia
| | - Jason A Dowling
- School of Information and Physical Sciences, University of Newcastle, Newcastle, New South Wales, Australia; Commonwealth Scientific and Industrial Research Organisation, Australian E-Health Research Centre, Herston, Queensland, Australia
| | - Stephan Chalup
- School of Information and Physical Sciences, University of Newcastle, Newcastle, New South Wales, Australia
| | - James Welsh
- School of Engineering, University of Newcastle, Newcastle, New South Wales, Australia
| | - Peter Greer
- School of Information and Physical Sciences, University of Newcastle, Newcastle, New South Wales, Australia; Department of Radiation Oncology, Calvary Mater Hospital, Newcastle, New South Wales, Australia
| |
Collapse
|
17
|
Anatomical evaluation of deep-learning synthetic computed tomography images generated from male pelvis cone-beam computed tomography. Phys Imaging Radiat Oncol 2023; 25:100416. [PMID: 36969503 PMCID: PMC10037090 DOI: 10.1016/j.phro.2023.100416] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Revised: 01/17/2023] [Accepted: 01/18/2023] [Indexed: 01/25/2023] Open
Abstract
Background and purpose To improve cone-beam computed tomography (CBCT), deep-learning (DL)-models are being explored to generate synthetic CTs (sCT). The sCT evaluation is mainly focused on image quality and CT number accuracy. However, correct representation of daily anatomy of the CBCT is also important for sCTs in adaptive radiotherapy. The aim of this study was to emphasize the importance of anatomical correctness by quantitatively assessing sCT scans generated from CBCT scans using different paired and unpaired dl-models. Materials and methods Planning CTs (pCT) and CBCTs of 56 prostate cancer patients were included to generate sCTs. Three different dl-models, Dual-UNet, Single-UNet and Cycle-consistent Generative Adversarial Network (CycleGAN), were evaluated on image quality and anatomical correctness. The image quality was assessed using image metrics, such as Mean Absolute Error (MAE). The anatomical correctness between sCT and CBCT was quantified using organs-at-risk volumes and average surface distances (ASD). Results MAE was 24 Hounsfield Unit (HU) [range:19-30 HU] for Dual-UNet, 40 HU [range:34-56 HU] for Single-UNet and 41HU [range:37-46 HU] for CycleGAN. Bladder ASD was 4.5 mm [range:1.6-12.3 mm] for Dual-UNet, 0.7 mm [range:0.4-1.2 mm] for Single-UNet and 0.9 mm [range:0.4-1.1 mm] CycleGAN. Conclusions Although Dual-UNet performed best in standard image quality measures, such as MAE, the contour based anatomical feature comparison with the CBCT showed that Dual-UNet performed worst on anatomical comparison. This emphasizes the importance of adding anatomy based evaluation of sCTs generated by dl-models. For applications in the pelvic area, direct anatomical comparison with the CBCT may provide a useful method to assess the clinical applicability of dl-based sCT generation methods.
Collapse
|
18
|
Zhao R, Wang X, Wei H. Accuracy and Feasibility of Synthetic CT for Lung Adaptive Radiotherapy: A Phantom Study. Technol Cancer Res Treat 2023; 22:15330338231218161. [PMID: 38037343 PMCID: PMC10693223 DOI: 10.1177/15330338231218161] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Revised: 10/22/2023] [Accepted: 11/14/2023] [Indexed: 12/02/2023] Open
Abstract
OBJECTIVES The respiratory variations will lead to inconsistency between the actual delivery dose and the planning dose. How the minor interfractional amplitude changes affect the geometry and dose delivery accuracy remains to be investigated in the context of lung adaptive radiotherapy. METHODS Planning 4-dimensional-computed tomography and kV-cone beam computed tomography were scanned based on the Computerized Imaging Reference Systems phantom, which was employed to simulate the minor interfractional amplitude variations. The corresponding synthetic computed tomography for a particular motion pattern can be generated from Velocity program. Then a clinically meaningful synthetic computed tomography was analyzed through the geometrical and dosimetric assessment. RESULTS The image quality of synthetic computed tomography was improved obviously compared with cone beam computed tomography. Mean absolute error was minimized when no significant interfractional motion occurs and Velocity can be qualified for dealing with the regular breathing motion patterns. The mean percent hounsfield unit difference of the synthetic hounsfield unit values per organ relative to the planning 4-dimensional-computed tomography image was 22.3%. Under the same conditions, the mean percent hounsfield unit difference of the cone beam computed tomography hounsfield unit values per organ, relative to the planning 4-dimensional-computed tomography image was 83.9%. Overall, the accuracy of hounsfield unit in synthetic computed tomography was improved obviously and the variability of the synthetic image correlates with the planning 4-dimensional-computed tomography image variability. Meanwhile, the dose-volume histograms between planning 4-dimensional-computed tomography and synthetic computed tomography almost coincided each other, which indicates that Velocity program can qualify lung adaptive radiotherapy well when there were no interfractional respiratory variations. However, for cases with obvious interfractional amplitude change, the volume covered at least by 100% of the prescription dose was only 59.6% for that synthetic image. CONCLUSION The synthetic computed tomography images generated from Velocity were close to the real images in anatomy and dosimetry, which can make clinical lung adaptive radiotherapy possible based on the actual patient anatomy during treatment.
Collapse
Affiliation(s)
- Ruifeng Zhao
- Department of Radiation Oncology, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, China
| | - Xingliu Wang
- Application, Varian Medical System, Beijing, China
| | - Huanhai Wei
- Department of Radiation Oncology, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, China
| |
Collapse
|
19
|
Hamming VC, Andersson S, Maduro JH, Langendijk JA, Both S, Sijtsema NM. Daily dose evaluation based on corrected CBCTs for breast cancer patients: accuracy of dose and complication risk assessment. Radiat Oncol 2022; 17:205. [PMID: 36510254 PMCID: PMC9746176 DOI: 10.1186/s13014-022-02174-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2022] [Accepted: 11/30/2022] [Indexed: 12/14/2022] Open
Abstract
OBJECTIVES The goal of this study is to validate different CBCT correction methods to select the superior method that can be used for dose evaluation in breast cancer patients with large anatomical changes treated with photon irradiation. MATERIALS AND METHOD Seventy-six breast cancer patients treated with a partial VMAT photon technique (70% conformal, 30% VMAT) were included in this study. All patients showed at least a 5 mm variation (swelling or shrinkage) of the breast on the CBCT compared to the planning-CT (pCT) and had a repeat-CT (rCT) for dose evaluation acquired within 3 days of this CBCT. The original CBCT was corrected using four methods: (1) HU-override correction (CBCTHU), (2) analytical correction and conversion (CBCTCC), (3) deep learning (DL) correction (CTDL) and (4) virtual correction (CTV). Image quality evaluation consisted of calculating the mean absolute error (MAE) and mean error (ME) within the whole breast clinical target volume (CTV) and the field of view of the CBCT minus 2 cm (CBCT-ROI) with respect to the rCT. The dose was calculated on all image sets using the clinical treatment plan for dose and gamma passing rate analysis. RESULTS The MAE of the CBCT-ROI was below 66 HU for all corrected CBCTs, except for the CBCTHU with a MAE of 142 HU. No significant dose differences were observed in the CTV regions in the CBCTCC, CTDL and CTv. Only the CBCTHU deviated significantly (p < 0.01) resulting in 1.7% (± 1.1%) average dose deviation. Gamma passing rates were > 95% for 2%/2 mm for all corrected CBCTs. CONCLUSION The analytical correction and conversion, deep learning correction and virtual correction methods can be applied for an accurate CBCT correction that can be used for dose evaluation during the course of photon radiotherapy of breast cancer patients.
Collapse
Affiliation(s)
- Vincent C. Hamming
- grid.4830.f0000 0004 0407 1981Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | | | - John H. Maduro
- grid.4830.f0000 0004 0407 1981Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Johannes A. Langendijk
- grid.4830.f0000 0004 0407 1981Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Stefan Both
- grid.4830.f0000 0004 0407 1981Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Nanna M. Sijtsema
- grid.4830.f0000 0004 0407 1981Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| |
Collapse
|
20
|
Abbani N, Baudier T, Rit S, Franco FD, Okoli F, Jaouen V, Tilquin F, Barateau A, Simon A, de Crevoisier R, Bert J, Sarrut D. Deep learning-based segmentation in prostate radiation therapy using Monte Carlo simulated cone-beam computed tomography. Med Phys 2022; 49:6930-6944. [PMID: 36000762 DOI: 10.1002/mp.15946] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Revised: 07/28/2022] [Accepted: 08/05/2022] [Indexed: 12/13/2022] Open
Abstract
PURPOSE Segmenting organs in cone-beam CT (CBCT) images would allow to adapt the radiotherapy based on the organ deformations that may occur between treatment fractions. However, this is a difficult task because of the relative lack of contrast in CBCT images, leading to high inter-observer variability. Deformable image registration (DIR) and deep-learning based automatic segmentation approaches have shown interesting results for this task in the past years. However, they are either sensitive to large organ deformations, or require to train a convolutional neural network (CNN) from a database of delineated CBCT images, which is difficult to do without improvement of image quality. In this work, we propose an alternative approach: to train a CNN (using a deep learning-based segmentation tool called nnU-Net) from a database of artificial CBCT images simulated from planning CT, for which it is easier to obtain the organ contours. METHODS Pseudo-CBCT (pCBCT) images were simulated from readily available segmented planning CT images, using the GATE Monte Carlo simulation. CT reference delineations were copied onto the pCBCT, resulting in a database of segmented images used to train the neural network. The studied segmentation contours were: bladder, rectum, and prostate contours. We trained multiple nnU-Net models using different training: (1) segmented real CBCT, (2) pCBCT, (3) segmented real CT and tested on pseudo-CT (pCT) generated from CBCT with cycleGAN, and (4) a combination of (2) and (3). The evaluation was performed on different datasets of segmented CBCT or pCT by comparing predicted segmentations with reference ones thanks to Dice similarity score and Hausdorff distance. A qualitative evaluation was also performed to compare DIR-based and nnU-Net-based segmentations. RESULTS Training with pCBCT was found to lead to comparable results to using real CBCT images. When evaluated on CBCT obtained from the same hospital as the CT images used in the simulation of the pCBCT, the model trained with pCBCT scored mean DSCs of 0.92 ± 0.05, 0.87 ± 0.02, and 0.85 ± 0.04 and mean Hausdorff distance 4.67 ± 3.01, 3.91 ± 0.98, and 5.00 ± 1.32 for the bladder, rectum, and prostate contours respectively, while the model trained with real CBCT scored mean DSCs of 0.91 ± 0.06, 0.83 ± 0.07, and 0.81 ± 0.05 and mean Hausdorff distance 5.62 ± 3.24, 6.43 ± 5.11, and 6.19 ± 1.14 for the bladder, rectum, and prostate contours, respectively. It was also found to outperform models using pCT or a combination of both, except for the prostate contour when tested on a dataset from a different hospital. Moreover, the resulting segmentations demonstrated a clinical acceptability, where 78% of bladder segmentations, 98% of rectum segmentations, and 93% of prostate segmentations required minor or no corrections, and for 76% of the patients, all structures of the patient required minor or no corrections. CONCLUSION We proposed to use simulated CBCT images to train a nnU-Net segmentation model, avoiding the need to gather complex and time-consuming reference delineations on CBCT images.
Collapse
Affiliation(s)
- Nelly Abbani
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, CNRS, Inserm, Lyon, France
| | - Thomas Baudier
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, CNRS, Inserm, Lyon, France
| | - Simon Rit
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, CNRS, Inserm, Lyon, France
| | - Francesca di Franco
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, CNRS, Inserm, Lyon, France
| | - Franklin Okoli
- LaTIM, Université de Bretagne Occidentale, Inserm, Brest, France
| | - Vincent Jaouen
- LaTIM, Université de Bretagne Occidentale, Inserm, Brest, France
| | | | - Anaïs Barateau
- Univ Rennes, CLCC Eugène Marquis, Inserm, Rennes, France
| | - Antoine Simon
- Univ Rennes, CLCC Eugène Marquis, Inserm, Rennes, France
| | | | - Julien Bert
- LaTIM, Université de Bretagne Occidentale, Inserm, Brest, France
| | - David Sarrut
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, CNRS, Inserm, Lyon, France
| |
Collapse
|
21
|
Evaluation of CBCT based dose calculation in the thorax and pelvis using two generic algorithms. Phys Med 2022; 103:157-165. [DOI: 10.1016/j.ejmp.2022.10.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/02/2022] [Revised: 09/26/2022] [Accepted: 10/22/2022] [Indexed: 11/24/2022] Open
|
22
|
O'Hara CJ, Bird D, Al-Qaisieh B, Speight R. Assessment of CBCT-based synthetic CT generation accuracy for adaptive radiotherapy planning. J Appl Clin Med Phys 2022; 23:e13737. [PMID: 36200179 DOI: 10.1002/acm2.13737] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Revised: 05/26/2022] [Accepted: 07/04/2022] [Indexed: 11/09/2022] Open
Abstract
PURPOSE Cone-beam CT (CBCT)-based synthetic CT (sCT) dose calculation has the potential to make the adaptive radiotherapy (ART) pathway more efficient while removing subjectivity. This study assessed four sCT generation methods using 15 head-and-neck rescanned ART patients. Each patient's planning CT (pCT), rescan CT (rCT), and CBCT post-rCT was acquired with the CBCT deformably registered to the rCT (dCBCT). METHODS The four methods investigated were as follows: method 1-deformably registering the pCT to the dCBCT. Method 2-assigning six mass density values to the dCBCT. Method 3-iteratively removing artifacts and correcting the dCBCT Hounsfield units (HU). Method 4-using a cycle general adversarial network machine learning model (trained with 45 paired pCT and CBCT). Treatment plans were created on the rCT and recalculated on each sCT. Planning target volume (PTV) and organ-at-risk (OAR) structures were contoured by clinicians on the rCT (high-dose PTV, low-dose PTV, spinal canal, larynx, brainstem, and parotids) to allow the assessment of dose-volume histogram statistics at clinically relevant points. RESULTS The HU mean absolute error (MAE) and minimum dose gamma index pass rate (2%/2 mm) were calculated, and the generation time was measured for 15 patients using the rCT as the comparator. For methods 1-4 the MAE, gamma index analysis, and generation time were as follows: 59.7 HU, 100.0%, and 143 s; 164.2 HU, 95.2%, and 232 s; 75.7 HU, 99.9%, and 153 s; and 79.4 HU, 99.8%, and 112 s, respectively. Dose differences for PTVs and OARs were all <0.3 Gy except for method 2 (<0.5 Gy). CONCLUSION All methods were considered clinically viable. The machine learning method was found to be most suitable for clinical implementation due to its high dosimetric accuracy and short generation time. Further investigation is required for larger anatomical changes between the CBCT and pCT and for other anatomical sites.
Collapse
Affiliation(s)
| | - David Bird
- Leeds Cancer Centre, Leeds Teaching Hospitals NHS Trust, Leeds, UK
| | | | - Richard Speight
- Leeds Cancer Centre, Leeds Teaching Hospitals NHS Trust, Leeds, UK
| |
Collapse
|
23
|
Teuwen J, Gouw ZA, Sonke JJ. Artificial Intelligence for Image Registration in Radiation Oncology. Semin Radiat Oncol 2022; 32:330-342. [DOI: 10.1016/j.semradonc.2022.06.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
24
|
Rusanov B, Hassan GM, Reynolds M, Sabet M, Kendrick J, Farzad PR, Ebert M. Deep learning methods for enhancing cone-beam CT image quality towards adaptive radiation therapy: A systematic review. Med Phys 2022; 49:6019-6054. [PMID: 35789489 PMCID: PMC9543319 DOI: 10.1002/mp.15840] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Revised: 05/21/2022] [Accepted: 06/16/2022] [Indexed: 11/11/2022] Open
Abstract
The use of deep learning (DL) to improve cone-beam CT (CBCT) image quality has gained popularity as computational resources and algorithmic sophistication have advanced in tandem. CBCT imaging has the potential to facilitate online adaptive radiation therapy (ART) by utilizing up-to-date patient anatomy to modify treatment parameters before irradiation. Poor CBCT image quality has been an impediment to realizing ART due to the increased scatter conditions inherent to cone-beam acquisitions. Given the recent interest in DL applications in radiation oncology, and specifically DL for CBCT correction, we provide a systematic theoretical and literature review for future stakeholders. The review encompasses DL approaches for synthetic CT generation, as well as projection domain methods employed in the CBCT correction literature. We review trends pertaining to publications from January 2018 to April 2022 and condense their major findings - with emphasis on study design and deep learning techniques. Clinically relevant endpoints relating to image quality and dosimetric accuracy are summarised, highlighting gaps in the literature. Finally, we make recommendations for both clinicians and DL practitioners based on literature trends and the current DL state of the art methods utilized in radiation oncology. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Branimir Rusanov
- School of Physics, Mathematics and Computing, The University of Western Australia, Perth, Western Australia, 6009, Australia.,Department of Radiation Oncology, Sir Chairles Gairdner Hospital, Perth, Western Australia, 6009, Australia
| | - Ghulam Mubashar Hassan
- School of Physics, Mathematics and Computing, The University of Western Australia, Perth, Western Australia, 6009, Australia
| | - Mark Reynolds
- School of Physics, Mathematics and Computing, The University of Western Australia, Perth, Western Australia, 6009, Australia
| | - Mahsheed Sabet
- School of Physics, Mathematics and Computing, The University of Western Australia, Perth, Western Australia, 6009, Australia.,Department of Radiation Oncology, Sir Chairles Gairdner Hospital, Perth, Western Australia, 6009, Australia
| | - Jake Kendrick
- School of Physics, Mathematics and Computing, The University of Western Australia, Perth, Western Australia, 6009, Australia.,Department of Radiation Oncology, Sir Chairles Gairdner Hospital, Perth, Western Australia, 6009, Australia
| | - Pejman Rowshan Farzad
- School of Physics, Mathematics and Computing, The University of Western Australia, Perth, Western Australia, 6009, Australia.,Department of Radiation Oncology, Sir Chairles Gairdner Hospital, Perth, Western Australia, 6009, Australia
| | - Martin Ebert
- School of Physics, Mathematics and Computing, The University of Western Australia, Perth, Western Australia, 6009, Australia.,Department of Radiation Oncology, Sir Chairles Gairdner Hospital, Perth, Western Australia, 6009, Australia
| |
Collapse
|
25
|
Head CT Image Segmentation and Three-Dimensional Reconstruction Technology Based on Human Anatomy. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:7091476. [PMID: 35755748 PMCID: PMC9225843 DOI: 10.1155/2022/7091476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Revised: 04/29/2022] [Accepted: 05/18/2022] [Indexed: 11/17/2022]
Abstract
With the continuous development of computer science and technology, the level of medical image processing and analysis technology has been significantly improved. In order to further optimize the medical imaging technology and provide assistance for medical diagnosis and treatment, this study will explore the head CT image segmentation technology and three-dimensional reconstruction technology based on human anatomy, using two morphological operation methods of image expansion and image corrosion, as well as the triangulation method based on surface contour, Optimize CT image segmentation technology and three-dimensional reconstruction technology. The results show that the CT image segmentation technology based on human anatomy can obtain the more essential morphology and features of the target image, and significantly improve the image quality. The size of the threshold can have a certain impact on the 3D reconstruction effect and reconstruction time to a certain extent. The larger the threshold, the shorter the reconstruction time, but the worse the 3D reconstruction effect. This shows that the target image after fitting has a good reconstruction effect, but the threshold level should be kept at a low level. The head CT image segmentation technology and three-dimensional reconstruction technology based on human anatomy have good application effects and can be popularized and applied in clinical diagnosis and treatment.
Collapse
|
26
|
Usui K, Ogawa K, Goto M, Sakano Y, Kyougoku S, Daida H. A cycle generative adversarial network for improving the quality of four-dimensional cone-beam computed tomography images. Radiat Oncol 2022; 17:69. [PMID: 35392947 PMCID: PMC8991563 DOI: 10.1186/s13014-022-02042-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Accepted: 03/23/2022] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Four-dimensional cone-beam computed tomography (4D-CBCT) can visualize moving tumors, thus adaptive radiation therapy (ART) could be improved if 4D-CBCT were used. However, 4D-CBCT images suffer from severe imaging artifacts. The aim of this study is to investigate the use of synthetic 4D-CBCT (sCT) images created by a cycle generative adversarial network (CycleGAN) for ART for lung cancer. METHODS Unpaired thoracic 4D-CBCT images and four-dimensional multislice computed tomography (4D-MSCT) images of 20 lung-cancer patients were used for training. High-quality sCT lung images generated by the CycleGAN model were tested on another 10 cases. The mean and mean absolute errors were calculated to assess changes in the computed tomography number. The structural similarity index measure (SSIM) and peak signal-to-noise ratio (PSNR) were used to compare the sCT and original 4D-CBCT images. Moreover, a volumetric modulation arc therapy plan with a dose of 48 Gy in four fractions was recalculated using the sCT images and compared with ideal dose distributions observed in 4D-MSCT images. RESULTS The generated sCT images had fewer artifacts, and lung tumor regions were clearly observed in the sCT images. The mean and mean absolute errors were near 0 Hounsfield units in all organ regions. The SSIM and PSNR results were significantly improved in the sCT images by approximately 51% and 18%, respectively. Moreover, the results of gamma analysis were significantly improved; the pass rate reached over 90% in the doses recalculated using the sCT images. Moreover, each organ dose index of the sCT images agreed well with those of the 4D-MSCT images and were within approximately 5%. CONCLUSIONS The proposed CycleGAN enhances the quality of 4D-CBCT images, making them comparable to 4D-MSCT images. Thus, clinical implementation of sCT-based ART for lung cancer is feasible.
Collapse
Affiliation(s)
- Keisuke Usui
- Department of Radiological Technology, Faculty of Health Science, Juntendo University, 2-1-1, Hongo, Bunkyo-ku, Tokyo, 113-8421, Japan.
| | - Koichi Ogawa
- Department of Applied Informatics, Faculty of Science and Engineering, Hosei University, 3-7-3, Kajino, Koganei, Tokyo, 184-8584, Japan
| | - Masami Goto
- Department of Radiological Technology, Faculty of Health Science, Juntendo University, 2-1-1, Hongo, Bunkyo-ku, Tokyo, 113-8421, Japan
| | - Yasuaki Sakano
- Department of Radiological Technology, Faculty of Health Science, Juntendo University, 2-1-1, Hongo, Bunkyo-ku, Tokyo, 113-8421, Japan
| | - Shinsuke Kyougoku
- Department of Radiological Technology, Faculty of Health Science, Juntendo University, 2-1-1, Hongo, Bunkyo-ku, Tokyo, 113-8421, Japan
| | - Hiroyuki Daida
- Department of Radiological Technology, Faculty of Health Science, Juntendo University, 2-1-1, Hongo, Bunkyo-ku, Tokyo, 113-8421, Japan
| |
Collapse
|
27
|
Dai Z, Zhang Y, Zhu L, Tan J, Yang G, Zhang B, Cai C, Jin H, Meng H, Tan X, Jian W, Yang W, Wang X. Geometric and Dosimetric Evaluation of Deep Learning-Based Automatic Delineation on CBCT-Synthesized CT and Planning CT for Breast Cancer Adaptive Radiotherapy: A Multi-Institutional Study. Front Oncol 2021; 11:725507. [PMID: 34858813 PMCID: PMC8630628 DOI: 10.3389/fonc.2021.725507] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2021] [Accepted: 10/12/2021] [Indexed: 12/29/2022] Open
Abstract
Purpose We developed a deep learning model to achieve automatic multitarget delineation on planning CT (pCT) and synthetic CT (sCT) images generated from cone-beam CT (CBCT) images. The geometric and dosimetric impact of the model was evaluated for breast cancer adaptive radiation therapy. Methods We retrospectively analyzed 1,127 patients treated with radiotherapy after breast-conserving surgery from two medical institutions. The CBCT images for patient setup acquired utilizing breath-hold guided by optical surface monitoring system were used to generate sCT with a generative adversarial network. Organs at risk (OARs), clinical target volume (CTV), and tumor bed (TB) were delineated automatically with a 3D U-Net model on pCT and sCT images. The geometric accuracy of the model was evaluated with metrics, including Dice similarity coefficient (DSC) and 95% Hausdorff distance (HD95). Dosimetric evaluation was performed by quick dose recalculation on sCT images relying on gamma analysis and dose-volume histogram (DVH) parameters. The relationship between ΔD95, ΔV95 and DSC-CTV was assessed to quantify the clinical impact of the geometric changes of CTV. Results The ranges of DSC and HD95 were 0.73–0.97 and 2.22–9.36 mm for pCT, 0.63–0.95 and 2.30–19.57 mm for sCT from institution A, 0.70–0.97 and 2.10–11.43 mm for pCT from institution B, respectively. The quality of sCT was excellent with an average mean absolute error (MAE) of 71.58 ± 8.78 HU. The mean gamma pass rate (3%/3 mm criterion) was 91.46 ± 4.63%. DSC-CTV down to 0.65 accounted for a variation of more than 6% of V95 and 3 Gy of D95. DSC-CTV up to 0.80 accounted for a variation of less than 4% of V95 and 2 Gy of D95. The mean ΔD90/ΔD95 of CTV and TB were less than 2Gy/4Gy, 4Gy/5Gy for all the patients. The cardiac dose difference in left breast cancer cases was larger than that in right breast cancer cases. Conclusions The accurate multitarget delineation is achievable on pCT and sCT via deep learning. The results show that dose distribution needs to be considered to evaluate the clinical impact of geometric variations during breast cancer radiotherapy.
Collapse
Affiliation(s)
- Zhenhui Dai
- Department of Radiation Therapy, The Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Yiwen Zhang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China
| | - Lin Zhu
- Department of Radiation Therapy, The Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Junwen Tan
- Department of Oncology, The Fourth Affiliated Hospital, Guangxi Medical University, Liuzhou, China
| | - Geng Yang
- Department of Radiation Therapy, The Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Bailin Zhang
- Department of Radiation Therapy, The Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Chunya Cai
- Department of Radiation Therapy, The Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Huaizhi Jin
- Department of Radiation Therapy, The Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Haoyu Meng
- Department of Radiation Therapy, The Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Xiang Tan
- Department of Radiation Therapy, The Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Wanwei Jian
- Department of Radiation Therapy, The Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Wei Yang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China
| | - Xuetao Wang
- Department of Radiation Therapy, The Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou, China
| |
Collapse
|
28
|
Thummerer A, Seller Oria C, Zaffino P, Meijers A, Guterres Marmitt G, Wijsman R, Seco J, Langendijk JA, Knopf AC, Spadea MF, Both S. Clinical suitability of deep learning based synthetic CTs for adaptive proton therapy of lung cancer. Med Phys 2021; 48:7673-7684. [PMID: 34725829 PMCID: PMC9299115 DOI: 10.1002/mp.15333] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Revised: 09/22/2021] [Accepted: 10/27/2021] [Indexed: 01/14/2023] Open
Abstract
Purpose Adaptive proton therapy (APT) of lung cancer patients requires frequent volumetric imaging of diagnostic quality. Cone‐beam CT (CBCT) can provide these daily images, but x‐ray scattering limits CBCT‐image quality and hampers dose calculation accuracy. The purpose of this study was to generate CBCT‐based synthetic CTs using a deep convolutional neural network (DCNN) and investigate image quality and clinical suitability for proton dose calculations in lung cancer patients. Methods A dataset of 33 thoracic cancer patients, containing CBCTs, same‐day repeat CTs (rCT), planning‐CTs (pCTs), and clinical proton treatment plans, was used to train and evaluate a DCNN with and without a pCT‐based correction method. Mean absolute error (MAE), mean error (ME), peak signal‐to‐noise ratio, and structural similarity were used to quantify image quality. The evaluation of clinical suitability was based on recalculation of clinical proton treatment plans. Gamma pass ratios, mean dose to target volumes and organs at risk, and normal tissue complication probabilities (NTCP) were calculated. Furthermore, proton radiography simulations were performed to assess the HU‐accuracy of sCTs in terms of range errors. Results On average, sCTs without correction resulted in a MAE of 34 ± 6 HU and ME of 4 ± 8 HU. The correction reduced the MAE to 31 ± 4HU (ME to 2 ± 4HU). Average 3%/3 mm gamma pass ratios increased from 93.7% to 96.8%, when the correction was applied. The patient specific correction reduced mean proton range errors from 1.5 to 1.1 mm. Relative mean target dose differences between sCTs and rCT were below ± 0.5% for all patients and both synthetic CTs (with/without correction). NTCP values showed high agreement between sCTs and rCT (<2%). Conclusion CBCT‐based sCTs can enable accurate proton dose calculations for APT of lung cancer patients. The patient specific correction method increased the image quality and dosimetric accuracy but had only a limited influence on clinically relevant parameters.
Collapse
Affiliation(s)
- Adrian Thummerer
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Carmen Seller Oria
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Paolo Zaffino
- Department of Experimental and Clinical Medicine, Magna Graecia University, Catanzaro, Italy
| | - Arturs Meijers
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Gabriel Guterres Marmitt
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Robin Wijsman
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Joao Seco
- Department of Biomedical Physics in Radiation Oncology, Deutsches Krebsfoschungszentrum (DKFZ), Heidelberg, Germany.,Department of Physics and Astronomy, Heidelberg University, Heidelberg, Germany
| | - Johannes Albertus Langendijk
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Antje-Christin Knopf
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands.,Department I of Internal Medicine, Center for Integrated Oncology Cologne, University Hospital of Cologne, Cologne, Germany
| | - Maria Francesca Spadea
- Department of Experimental and Clinical Medicine, Magna Graecia University, Catanzaro, Italy
| | - Stefan Both
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| |
Collapse
|
29
|
Spadea MF, Maspero M, Zaffino P, Seco J. Deep learning based synthetic-CT generation in radiotherapy and PET: A review. Med Phys 2021; 48:6537-6566. [PMID: 34407209 DOI: 10.1002/mp.15150] [Citation(s) in RCA: 80] [Impact Index Per Article: 26.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2021] [Revised: 06/06/2021] [Accepted: 07/13/2021] [Indexed: 01/22/2023] Open
Abstract
Recently,deep learning (DL)-based methods for the generation of synthetic computed tomography (sCT) have received significant research attention as an alternative to classical ones. We present here a systematic review of these methods by grouping them into three categories, according to their clinical applications: (i) to replace computed tomography in magnetic resonance (MR) based treatment planning, (ii) facilitate cone-beam computed tomography based image-guided adaptive radiotherapy, and (iii) derive attenuation maps for the correction of positron emission tomography. Appropriate database searching was performed on journal articles published between January 2014 and December 2020. The DL methods' key characteristics were extracted from each eligible study, and a comprehensive comparison among network architectures and metrics was reported. A detailed review of each category was given, highlighting essential contributions, identifying specific challenges, and summarizing the achievements. Lastly, the statistics of all the cited works from various aspects were analyzed, revealing the popularity and future trends and the potential of DL-based sCT generation. The current status of DL-based sCT generation was evaluated, assessing the clinical readiness of the presented methods.
Collapse
Affiliation(s)
- Maria Francesca Spadea
- Department Experimental and Clinical Medicine, University "Magna Graecia" of Catanzaro, Catanzaro, 88100, Italy
| | - Matteo Maspero
- Division of Imaging & Oncology, Department of Radiotherapy, University Medical Center Utrecht, Heidelberglaan, Utrecht, The Netherlands.,Computational Imaging Group for MR Diagnostics & Therapy, Center for Image Sciences, University Medical Center Utrecht, Heidelberglaan, Utrecht, The Netherlands
| | - Paolo Zaffino
- Department Experimental and Clinical Medicine, University "Magna Graecia" of Catanzaro, Catanzaro, 88100, Italy
| | - Joao Seco
- Division of Biomedical Physics in Radiation Oncology, DKFZ German Cancer Research Center, Heidelberg, Germany.,Department of Physics and Astronomy, Heidelberg University, Heidelberg, Germany
| |
Collapse
|
30
|
Eckl M, Sarria GR, Springer S, Willam M, Ruder AM, Steil V, Ehmann M, Wenz F, Fleckenstein J. Dosimetric benefits of daily treatment plan adaptation for prostate cancer stereotactic body radiotherapy. Radiat Oncol 2021; 16:145. [PMID: 34348765 PMCID: PMC8335467 DOI: 10.1186/s13014-021-01872-9] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2021] [Accepted: 07/27/2021] [Indexed: 01/02/2023] Open
Abstract
BACKGROUND Hypofractionation is increasingly being applied in radiotherapy for prostate cancer, requiring higher accuracy of daily treatment deliveries than in conventional image-guided radiotherapy (IGRT). Different adaptive radiotherapy (ART) strategies were evaluated with regard to dosimetric benefits. METHODS Treatments plans for 32 patients were retrospectively generated and analyzed according to the PACE-C trial treatment scheme (40 Gy in 5 fractions). Using a previously trained cycle-generative adversarial network algorithm, synthetic CT (sCT) were generated out of five daily cone-beam CT. Dose calculation on sCT was performed for four different adaptation approaches: IGRT without adaptation, adaptation via segment aperture morphing (SAM) and segment weight optimization (ART1) or additional shape optimization (ART2) as well as a full re-optimization (ART3). Dose distributions were evaluated regarding dose-volume parameters and a penalty score. RESULTS Compared to the IGRT approach, the ART1, ART2 and ART3 approaches substantially reduced the V37Gy(bladder) and V36Gy(rectum) from a mean of 7.4cm3 and 2.0cm3 to (5.9cm3, 6.1cm3, 5.2cm3) as well as to (1.4cm3, 1.4cm3, 1.0cm3), respectively. Plan adaptation required on average 2.6 min for the ART1 approach and yielded doses to the rectum being insignificantly different from the ART2 approach. Based on an accumulation over the total patient collective, a penalty score revealed dosimetric violations reduced by 79.2%, 75.7% and 93.2% through adaptation. CONCLUSION Treatment plan adaptation was demonstrated to adequately restore relevant dose criteria on a daily basis. While for SAM adaptation approaches dosimetric benefits were realized through ensuring sufficient target coverage, a full re-optimization mainly improved OAR sparing which helps to guide the decision of when to apply which adaptation strategy.
Collapse
Affiliation(s)
- Miriam Eckl
- Department of Radiation Oncology, University Medical Centre Mannheim, University of Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany.
| | - Gustavo R Sarria
- Department of Radiation Oncology, University Hospital Bonn, University of Bonn, Bonn, Germany
| | - Sandra Springer
- Department of Radiation Oncology, University Medical Centre Mannheim, University of Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| | - Marvin Willam
- Department of Radiation Oncology, University Medical Centre Mannheim, University of Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| | - Arne M Ruder
- Department of Radiation Oncology, University Medical Centre Mannheim, University of Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| | - Volker Steil
- Department of Radiation Oncology, University Medical Centre Mannheim, University of Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| | - Michael Ehmann
- Department of Radiation Oncology, University Medical Centre Mannheim, University of Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| | - Frederik Wenz
- University Medical Center Freiburg, University of Freiburg, Freiburg im Breisgau, Germany
| | - Jens Fleckenstein
- Department of Radiation Oncology, University Medical Centre Mannheim, University of Heidelberg, Theodor-Kutzer-Ufer 1-3, 68167, Mannheim, Germany
| |
Collapse
|
31
|
Training a deep neural network coping with diversities in abdominal and pelvic images of children and young adults for CBCT-based adaptive proton therapy. Radiother Oncol 2021; 160:250-258. [PMID: 33992626 DOI: 10.1016/j.radonc.2021.05.006] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 05/04/2021] [Accepted: 05/05/2021] [Indexed: 11/24/2022]
Abstract
PURPOSE To train a deep neural network for correcting abdominal and pelvic cone-beam computed tomography (CBCT) of children and young adults in the presence of diverse patient size, anatomic extent, and scan parameters. MATERIALS AND METHODS Pretreatment CBCT and planning/repeat CT image pairs from 64 children and young adults treated with proton therapy (aged 1-23 years) were analyzed. To evaluate the impact of anatomic extent in CBCT and data size in the training data, we compared the performance of three cycle-consistent generative adversarial network models that were separately trained by three datasets comprising abdominal (n = 21), pelvic (n = 29), and combined abdominal-pelvic image pairs (n = 50), respectively. The maximum body width of each patient was normalized to a fixed width before training and model application to reduce the impact of variations in body size. The corrected CBCT images by the three models were comparatively evaluated against the repeat CT closest in time to the CBCT (median gap, 0 days; range, 0-6 days) in HU accuracy, estimated dose distribution, and proton range. RESULTS The network model trained by the combined dataset significantly outperformed the abdomen and pelvis models in mean absolute HU error of the corrected CBCT from 14 testing patients (47 ± 7 HU versus 51 ± 8 HU; paired Wilcoxon signed-rank test, P < 0.01). The larger error (60 ± 7 HU) without the body-size normalization confirmed the efficacy of the preprocessing. The model trained with the combined dataset resulted in gamma passing rates of 98.5 ± 1.9% (2%/2 mm criterion) and the range (80% distal fall-off) differences from the reference within ±3 mm for 91.2 ± 11.5% beamlets. CONCLUSION Combining data from adjacent anatomic sites and normalizing age-dependent body sizes in children and young adults were beneficial in training a neural network to accurately estimate proton dose from CBCT despite limited training data size and anatomic diversities.
Collapse
|