Deep Learning for Radiotherapy Outcome Prediction Using Dose Data - A Review

Artificial intelligence, and in particular deep learning using convolutional neural networks, has been used extensively for image classification and segmentation, including on medical images for diagnosis and prognosis prediction. Use in radiotherapy prognostic modelling is still limited, however, especially as applied to toxicity and tumour response prediction from radiation dose distributions. We review and summarise studies that applied deep learning to radiotherapy dose data, in particular studies that utilised full three-dimensional dose distributions. Ten papers have reported on deep learning models for outcome prediction utilising spatial dose information, whereas four studies used reduced dimensionality (dose volume histogram) information for prediction. Many of these studies suffer from the same issues that plagued early normal tissue complication probability modelling, including small, single-institutional patient cohorts, lack of external validation, poor data and model reporting, use of late toxicity data without taking time-to-event into account, and nearly exclusive focus on clinician-reported complications. They demonstrate, however, how radiation dose, imaging and clinical data may be technically integrated in convolutional neural networks-based models; and some studies explore how deep learning may help better understand spatial variation in radiosensitivity. In general, there are a number of issues specific to the intersection of radiotherapy outcome modelling and deep learning, for example translation of model developments into treatment plan optimisation, which will require further combined effort from the radiation oncology and artificial intelligence communities.

Prediction of outcome in anal squamous cell carcinoma using radiomic feature analysis of pre-treatment FDG PET-CT

PURPOSE

Incidence of anal squamous cell carcinoma (ASCC) is increasing, with curative chemoradiotherapy (CRT) as the primary treatment of non-metastatic disease. A significant proportion of patients have locoregional treatment failure (LRF), but distant relapse is uncommon. Accurate prognostication of progression-free survival (PFS) would help personalisation of CRT regimens. The study aim was to evaluate novel imaging pre-treatment features, to prognosticate for PFS in ASCC.

METHODS

Consecutive patients with ASCC treated with curative intent at a large tertiary referral centre who underwent pre-treatment FDG-PET/CT were included. Radiomic feature extraction was performed using LIFEx software on baseline FDG-PET/CT. Outcome data (PFS) was collated from electronic patient records. Elastic net regularisation and feature selection were used for logistic regression model generation on a randomly selected training cohort and applied to a validation cohort using TRIPOD guidelines. ROC-AUC analysis was used to compare performance of a regression model encompassing standard clinical prognostic factors (age, sex, tumour and nodal stage-model A), a radiomic feature model (model B) and a combined radiomic/clinical model (model C).

RESULTS

A total of 189 patients were included in the study, with 145 in the training cohort and 44 in the validation cohort. Median follow-up was 35.1 and 37. 9 months, respectively for each cohort, with 70.3% and 68.2% reaching this time-point with PFS. GLCM entropy (a measure of randomness of distribution of co-occurring pixel grey-levels), NGLDM busyness (a measure of spatial frequency of changes in intensity between nearby voxels of different grey-level), minimum CT value (lowest HU within the lesion) and SMTV (a standardized version of MTV) were selected for inclusion in the prognostic model, alongside tumour and nodal stage. AUCs for performance of model A (clinical), B (radiomic) and C (radiomic/clinical) were 0.6355, 0.7403, 0.7412 in the training cohort and 0.6024, 0.6595, 0.7381 in the validation cohort.

CONCLUSION

Radiomic features extracted from pre-treatment FDG-PET/CT in patients with ASCC may provide better PFS prognosis than conventional staging parameters. With external validation, this might be useful to help personalise CRT regimens in the future.