Deep learning radiomics under multimodality explore association between muscle/fat and metastasis and survival in breast cancer patients

Body composition radiomic features as a predictor of survival in patients with non-small cellular lung carcinoma: A multicenter retrospective study

OBJECTIVES

This study combined two novel approaches in oncology patient outcome predictions-body composition and radiomic features analysis. The aim of this study was to validate whether automatically extracted muscle and adipose tissue radiomic features could be used as a predictor of survival in patients with non-small cell lung cancer.

METHODS

The study included 178 patients with non-small cell lung cancer receiving concurrent platinum-based chemoradiotherapy. Abdominal imaging was conducted as a part of whole-body positron emission tomography/computed tomography performed before therapy. Methods used included automated assessment of the volume of interest using densely connected convolutional network classification model - DenseNet121, automated muscle and adipose tissue segmentation using U-net architecture implemented in nnUnet framework, and radiomic features extraction. Acquired body composition radiomic features and clinical data were used for overall and 1-y survival prediction using machine learning classification algorithms.

RESULTS

The volume of interest detection model achieved the following metric scores: 0.98 accuracy, 0.89 precision, 0.96 recall, and 0.92 F1 score. Automated segmentation achieved a median dice coefficient >0.99 in all segmented regions. We extracted 330 body composition radiomic features for every patient. For overall survival prediction using clinical and radiomic data, the best-performing feature selection and prediction method achieved areas under the curve-receiver operating characteristic (AUC-ROC) of 0.73 (P < 0.05); for 1-y survival prediction AUC-ROC was 0.74 (P < 0.05).

CONCLUSION

Automatically extracted muscle and adipose tissue radiomic features could be used as a predictor of survival in patients with non-small cell lung cancer.

Exploring non-invasive precision treatment in non-small cell lung cancer patients through deep learning radiomics across imaging features and molecular phenotypes

BACKGROUND

Accurate prediction of tumor molecular alterations is vital for optimizing cancer treatment. Traditional tissue-based approaches encounter limitations due to invasiveness, heterogeneity, and molecular dynamic changes. We aim to develop and validate a deep learning radiomics framework to obtain imaging features that reflect various molecular changes, aiding first-line treatment decisions for cancer patients.

METHODS

We conducted a retrospective study involving 508 NSCLC patients from three institutions, incorporating CT images and clinicopathologic data. Two radiomic scores and a deep network feature were constructed on three data sources in the 3D tumor region. Using these features, we developed and validated the 'Deep-RadScore,' a deep learning radiomics model to predict prognostic factors, gene mutations, and immune molecule expression levels.

FINDINGS

The Deep-RadScore exhibits strong discrimination for tumor molecular features. In the independent test cohort, it achieved impressive AUCs: 0.889 for lymphovascular invasion, 0.903 for pleural invasion, 0.894 for T staging; 0.884 for EGFR and ALK, 0.896 for KRAS and PIK3CA, 0.889 for TP53, 0.895 for ROS1; and 0.893 for PD-1/PD-L1. Fusing features yielded optimal predictive power, surpassing any single imaging feature. Correlation and interpretability analyses confirmed the effectiveness of customized deep network features in capturing additional imaging phenotypes beyond known radiomic features.

INTERPRETATION

This proof-of-concept framework demonstrates that new biomarkers across imaging features and molecular phenotypes can be provided by fusing radiomic features and deep network features from multiple data sources. This holds the potential to offer valuable insights for radiological phenotyping in characterizing diverse tumor molecular alterations, thereby advancing the pursuit of non-invasive personalized treatment for NSCLC patients.