Segmentation by test-time optimization for CBCT-based adaptive radiation therapy

A systematic review of the role of artificial intelligence in automating computed tomography-based adaptive radiotherapy for head and neck cancer

Purpose

Adaptive radiotherapy (ART) may improve treatment quality by monitoring variations in patient anatomy and incorporating them into the treatment plan. This systematic review investigated the role of artificial intelligence (AI) in computed tomography (CT)-based ART for head and neck (H&N) cancer.

Methods

A comprehensive search of main electronic databases was conducted until April 2024. Titles and abstracts were reviewed to evaluate the compliance with inclusion criteria: CT-based imaging for photon ART of H&N patients and AI applications. 17 original retrospective studies with samples sizes ranging from 37 to 239 patients were included. The quality of the studies was evaluated with the Quality Assessment of Diagnostic Accuracy Studies-2 and the Checklist for Artificial Intelligence in Medical Imaging (CLAIM) tools. Key metrics were examined to evaluate the performances of the proposed AI-methods.

Results

Overall, the risk of bias was low. The average CLAIM score was 70%. A major finding was that generated synthetic CTs improved similarity metrics with planning CT compared to original cone-beam CTs, with average mean absolute error up to 39 HU and maximum improvement of 80%. Auto-segmentation provided an efficient and accurate option for organ-at-risk delineation, with average Dice similarity coefficient ranging from 80 to 87%. Finally, AI models could be trained using clinical and radiomic features to predict the effectiveness of ART with accuracy above 80%.

Conclusions

Automation of processes in ART for H&N cancer is very promising throughout the entire chain, from the generation of synthetic CTs and auto-segmentation to predict the effectiveness of ART.

Custom-Trained Deep Learning-Based Auto-Segmentation for Male Pelvic Iterative CBCT on C-Arm Linear Accelerators

PURPOSE

The purpose of this investigation was to evaluate the clinical applicability of a commercial artificial intelligence-driven deep learning auto-segmentation (DLAS) tool on enhanced iterative cone beam computed tomography (iCBCT) acquisitions for intact prostate and prostate bed treatments.

METHODS AND MATERIALS

DLAS models were trained using 116 iCBCT data sets with manually delineated organs at risk (bladder, femoral heads, and rectum) and target volumes (intact prostate and prostate bed) adhering to institution-specific contouring guidelines. An additional 25 intact prostate and prostate bed iCBCT data sets were used for model testing. Segmentation accuracy relative to a reference structure set was quantified using various geometric comparison metrics and qualitatively evaluated by trained physicists and physicians. These results were compared with those obtained for an additional DLAS-based model trained on planning computed tomography (pCT) data sets and for a deformable image registration (DIR)-based automatic contour propagation method.

RESULTS

In most instances, statistically significant differences in the Dice similarity coefficient (DSC), 95% directed Hausdorff distance, and mean surface distance metrics were observed between the models, as the iCBCT-trained DLAS model outperformed the pCT-trained DLAS model and DIR-based method for all organs at risk and the intact prostate target volume. Mean DSC values for the proposed method were ≥0.90 for these volumes of interest. The iCBCT-trained DLAS model demonstrated a relatively suboptimal performance for the prostate bed segmentation, as the mean DSC value was <0.75 for this target contour. Overall, 90% of bladder, 93% of femoral head, 67% of rectum, and 92% of intact prostate contours generated by the proposed method were deemed clinically acceptable based on qualitative scoring, and approximately 63% of prostate bed contours required moderate or major manual editing to adhere to institutional contouring guidelines.

CONCLUSIONS

The proposed method presents the potential for improved segmentation accuracy and efficiency compared with the DIR-based automatic contour propagation method as commonly applied in CBCT-based dose evaluation and calculation studies.

Progressive auto-segmentation for cone-beam computed tomography-based online adaptive radiotherapy

Background and purpose

Accurate and automated segmentation of targets and organs-at-risk (OARs) is crucial for the successful clinical application of online adaptive radiotherapy (ART). Current methods for cone-beam computed tomography (CBCT) auto-segmentation face challenges, resulting in segmentations often failing to reach clinical acceptability. Current approaches for CBCT auto-segmentation overlook the wealth of information available from initial planning and prior adaptive fractions that could enhance segmentation precision.

Materials and methods

We introduce a novel framework that incorporates data from a patient's initial plan and previous adaptive fractions, harnessing this additional temporal context to significantly refine the segmentation accuracy for the current fraction's CBCT images. We present LSTM-UNet, an innovative architecture that integrates Long Short-Term Memory (LSTM) units into the skip connections of the traditional U-Net framework to retain information from previous fractions. The models underwent initial pre-training with simulated data followed by fine-tuning on a clinical dataset.

Results

Our proposed model's segmentation predictions yield an average Dice similarity coefficient of 79% from 8 Head & Neck organs and targets, compared to 52% from a baseline model without prior knowledge and 78% from a baseline model with prior knowledge but no memory.

Conclusions

Our proposed model excels beyond baseline segmentation frameworks by effectively utilizing information from prior fractions, thus reducing the effort of clinicians to revise the auto-segmentation results. Moreover, it works together with registration-based methods that offer better prior knowledge. Our model holds promise for integration into the online ART workflow, offering precise segmentation capabilities on synthetic CT images.

Enhancing Radiotherapy Workflow for Head and Neck Cancer with Artificial Intelligence: A Systematic Review

BACKGROUND

Head and neck cancer (HNC) is characterized by complex-shaped tumors and numerous organs at risk (OARs), inducing challenging radiotherapy (RT) planning, optimization, and delivery. In this review, we provided a thorough description of the applications of artificial intelligence (AI) tools in the HNC RT process.

METHODS

The PubMed database was queried, and a total of 168 articles (2016-2022) were screened by a group of experts in radiation oncology. The group selected 62 articles, which were subdivided into three categories, representing the whole RT workflow: (i) target and OAR contouring, (ii) planning, and (iii) delivery.

RESULTS

The majority of the selected studies focused on the OARs segmentation process. Overall, the performance of AI models was evaluated using standard metrics, while limited research was found on how the introduction of AI could impact clinical outcomes. Additionally, papers usually lacked information about the confidence level associated with the predictions made by the AI models.

CONCLUSIONS

AI represents a promising tool to automate the RT workflow for the complex field of HNC treatment. To ensure that the development of AI technologies in RT is effectively aligned with clinical needs, we suggest conducting future studies within interdisciplinary groups, including clinicians and computer scientists.

An Unsupervised Learning-Based Regional Deformable Model for Automated Multi-Organ Contour Propagation

The aim of this study is to evaluate a regional deformable model based on a deep unsupervised learning model for automatic contour propagation in breast cone-beam computed tomography-guided adaptive radiation therapy. A deep unsupervised learning model was introduced to map breast's tumor bed, clinical target volume, heart, left lung, right lung, and spinal cord from planning computed tomography to cone-beam CT. To improve the traditional image registration method's performance, we used a regional deformable framework based on the narrow-band mapping, which can mitigate the effect of the image artifacts on the cone-beam CT. We retrospectively selected 373 anonymized cone-beam CT volumes from 111 patients with breast cancer. The cone-beam CTs are divided into three sets. 311 / 20 / 42 cone-beam CT images were used for training, validating, and testing. The manual contour was used as reference for the testing set. We compared the results between the reference and the model prediction for evaluating the performance. The mean Dice between manual reference segmentations and the model predicted segmentations for breast tumor bed, clinical target volume, heart, left lung, right lung, and spinal cord were 0.78 ± 0.09, 0.90 ± 0.03, 0.88 ± 0.04, 0.94 ± 0.03, 0.95 ± 0.02, and 0.77 ± 0.07, respectively. The results demonstrated a good agreement between the reference and the proposed contours. The proposed deep learning-based regional deformable model technique can automatically propagate contours for breast cancer adaptive radiotherapy. Deep learning in contour propagation was promising, but further investigation was warranted.

Deep learning based direct segmentation assisted by deformable image registration for cone-beam CT based auto-segmentation for adaptive radiotherapy

Cone-beam CT (CBCT)-based online adaptive radiotherapy calls for accurate auto-segmentation to reduce the time cost for physicians. However, deep learning (DL)-based direct segmentation of CBCT images is a challenging task, mainly due to the poor image quality and lack of well-labelled large training datasets. Deformable image registration (DIR) is often used to propagate the manual contours on the planning CT (pCT) of the same patient to CBCT. In this work, we undertake solving the problems mentioned above with the assistance of DIR. Our method consists of three main components. First, we use deformed pCT contours derived from multiple DIR methods between pCT and CBCT as pseudo labels for initial training of the DL-based direct segmentation model. Second, we use deformed pCT contours from another DIR algorithm as influencer volumes to define the region of interest for DL-based direct segmentation. Third, the initially trained DL model is further fine-tuned using a smaller set of true labels. Nine patients are used for model evaluation. We found that DL-based direct segmentation on CBCT without influencer volumes has much poorer performance compared to DIR-based segmentation. However, adding deformed pCT contours as influencer volumes in the direct segmentation network dramatically improves segmentation performance, reaching the accuracy level of DIR-based segmentation. The DL model with influencer volumes can be further improved through fine-tuning using a smaller set of true labels, achieving mean Dice similarity coefficient of 0.86, Hausdorff distance at the 95th percentile of 2.34 mm, and average surface distance of 0.56 mm. A DL-based direct CBCT segmentation model can be improved to outperform DIR-based segmentation models by using deformed pCT contours as pseudo labels and influencer volumes for initial training, and by using a smaller set of true labels for model fine tuning.