Non-small cell lung carcinoma histopathological subtype phenotyping using high-dimensional multinomial multiclass CT radiomics signature

Information fusion for fully automated segmentation of head and neck tumors from PET and CT images

BACKGROUND

PET/CT images combining anatomic and metabolic data provide complementary information that can improve clinical task performance. PET image segmentation algorithms exploiting the multi-modal information available are still lacking.

PURPOSE

Our study aimed to assess the performance of PET and CT image fusion for gross tumor volume (GTV) segmentations of head and neck cancers (HNCs) utilizing conventional, deep learning (DL), and output-level voting-based fusions.

METHODS

The current study is based on a total of 328 histologically confirmed HNCs from six different centers. The images were automatically cropped to a 200 × 200 head and neck region box, and CT and PET images were normalized for further processing. Eighteen conventional image-level fusions were implemented. In addition, a modified U2-Net architecture as DL fusion model baseline was used. Three different input, layer, and decision-level information fusions were used. Simultaneous truth and performance level estimation (STAPLE) and majority voting to merge different segmentation outputs (from PET and image-level and network-level fusions), that is, output-level information fusion (voting-based fusions) were employed. Different networks were trained in a 2D manner with a batch size of 64. Twenty percent of the dataset with stratification concerning the centers (20% in each center) were used for final result reporting. Different standard segmentation metrics and conventional PET metrics, such as SUV, were calculated.

RESULTS

In single modalities, PET had a reasonable performance with a Dice score of 0.77 ± 0.09, while CT did not perform acceptably and reached a Dice score of only 0.38 ± 0.22. Conventional fusion algorithms obtained a Dice score range of [0.76-0.81] with guided-filter-based context enhancement (GFCE) at the low-end, and anisotropic diffusion and Karhunen-Loeve transform fusion (ADF), multi-resolution singular value decomposition (MSVD), and multi-level image decomposition based on latent low-rank representation (MDLatLRR) at the high-end. All DL fusion models achieved Dice scores of 0.80. Output-level voting-based models outperformed all other models, achieving superior results with a Dice score of 0.84 for Majority_ImgFus, Majority_All, and Majority_Fast. A mean error of almost zero was achieved for all fusions using SUVpeak , SUVmean and SUVmedian .

CONCLUSION

PET/CT information fusion adds significant value to segmentation tasks, considerably outperforming PET-only and CT-only methods. In addition, both conventional image-level and DL fusions achieve competitive results. Meanwhile, output-level voting-based fusion using majority voting of several algorithms results in statistically significant improvements in the segmentation of HNC.

Radiotranscriptomics of non-small cell lung carcinoma for assessing high-level clinical outcomes using a machine learning-derived multi-modal signature

BACKGROUND

Multi-omics research has the potential to holistically capture intra-tumor variability, thereby improving therapeutic decisions by incorporating the key principles of precision medicine. The purpose of this study is to identify a robust method of integrating features from different sources, such as imaging, transcriptomics, and clinical data, to predict the survival and therapy response of non-small cell lung cancer patients.

METHODS

2996 radiomics, 5268 transcriptomics, and 8 clinical features were extracted from the NSCLC Radiogenomics dataset. Radiomics and deep features were calculated based on the volume of interest in pre-treatment, routine CT examinations, and then combined with RNA-seq and clinical data. Several machine learning classifiers were used to perform survival analysis and assess the patient's response to adjuvant chemotherapy. The proposed analysis was evaluated on an unseen testing set in a k-fold cross-validation scheme. Score- and concatenation-based multi-omics were used as feature integration techniques.

RESULTS

Six radiomics (elongation, cluster shade, entropy, variance, gray-level non-uniformity, and maximal correlation coefficient), six deep features (NasNet-based activations), and three transcriptomics (OTUD3, SUCGL2, and RQCD1) were found to be significant for therapy response. The examined score-based multi-omic improved the AUC up to 0.10 on the unseen testing set (0.74 ± 0.06) and the balance between sensitivity and specificity for predicting therapy response for 106 patients, resulting in less biased models and improving upon the either highly sensitive or highly specific single-source models. Six radiomics (kurtosis, GLRLM- and GLSZM-based non-uniformity from images with no filtering, biorthogonal, and daubechies wavelets), seven deep features (ResNet-based activations), and seven transcriptomics (ELP3, ZZZ3, PGRMC2, TRAK1, ATIC, USP7, and PNPLA2) were found to be significant for the survival analysis. Accordingly, the survival analysis for 115 patients was also enhanced up to 0.20 by the proposed score-based multi-omics in terms of the C-index (0.79 ± 0.03).

CONCLUSIONS

Compared to single-source models, multi-omics integration has the potential to improve prediction performance, increase model stability, and reduce bias for both treatment response and survival analysis.

Cytokine Profile in Lung Cancer Patients: Anti-Tumor and Oncogenic Cytokines

Lung cancer is currently the second leading cause of cancer death worldwide. In recent years, checkpoint inhibitor immunotherapy (ICI) has emerged as a new treatment. A better understanding of the tumor microenvironment (TMJ) or the immune system surrounding the tumor is needed. Cytokines are small proteins that carry messages between cells and are known to play an important role in the body's response to inflammation and infection. Cytokines are important for immunity in lung cancer. They promote tumor growth (oncogenic cytokines) or inhibit tumor growth (anti-tumour cytokines) by controlling signaling pathways for growth, proliferation, metastasis, and apoptosis. The immune system relies heavily on cytokines. They can also be produced in the laboratory for therapeutic use. Cytokine therapy helps the immune system to stop the growth or kill cancer cells. Interleukins and interferons are the two types of cytokines used to treat cancer. This article begins by addressing the role of the TMJ and its components in lung cancer. This review also highlights the functions of various cytokines such as interleukins (IL), transforming growth factor (TGF), and tumor necrosis factor (TNF).

Dual-Centre Harmonised Multimodal Positron Emission Tomography/Computed Tomography Image Radiomic Features and Machine Learning Algorithms for Non-small Cell Lung Cancer Histopathological Subtype Phenotype Decoding

AIMS

We aimed to build radiomic models for classifying non-small cell lung cancer (NSCLC) histopathological subtypes through a dual-centre dataset and comprehensively evaluate the effect of ComBat harmonisation on the performance of single- and multimodality radiomic models.

MATERIALS AND METHODS

A public dataset of NSCLC patients from two independent centres was used. Two image fusion methods, namely guided filtering-based fusion and image fusion based on visual saliency map and weighted least square optimisation, were used. Radiomic features were extracted from each scan, including first-order, texture and moment-invariant features. Subsequently, ComBat harmonisation was applied to the extracted features from computed tomography (CT), positron emission tomography (PET) and fused images to correct the centre effect. For feature selection, least absolute shrinkage and selection operator (Lasso) and recursive feature elimination (RFE) were investigated. For machine learning, logistic regression (LR), support vector machine (SVM) and AdaBoost were evaluated for classifying NSCLC subtypes. Training and evaluation of the models were carried out in a robust framework to offset plausible errors and performance was reported using area under the curve, balanced accuracy, sensitivity and specificity before and after harmonisation. N-way ANOVA was used to assess the effect of different factors on the performance of the models.

RESULTS

Support vector machine fed with selected features by recursive feature elimination from a harmonised PET feature set achieved the highest performance (area under the curve = 0.82) in classifying NSCLC histopathological subtypes. Although the performance of the models did not significantly improve for CT images after harmonisation, the performance of PET and guided filtering-based fusion feature signatures significantly improved for almost all models. Although the selection of the image modality and feature selection methods was effective on the performance of the model (ANOVA P-values <0.001), machine learning and harmonisation did not change the performance significantly (ANOVA P-values = 0.839 and 0.292, respectively).

CONCLUSION

This study confirmed the potential of radiomic analysis on PET, CT and hybrid images for histopathological classification of NSCLC subtypes.

Imaging Analytics using Artificial Intelligence in Oncology: A Comprehensive Review

The present era has seen a surge in artificial intelligence-related research in oncology, mainly using deep learning, because of powerful computer hardware, improved algorithms and the availability of large amounts of data from open-source domains and the use of transfer learning. Here we discuss the multifaceted role of deep learning in cancer care, ranging from risk stratification, the screening and diagnosis of cancer, to the prediction of genomic mutations, treatment response and survival outcome prediction, through the use of convolutional neural networks. Another role of artificial intelligence is in the generation of automated radiology reports, which is a boon in high-volume centres to minimise report turnaround time. Although a validated and deployable deep-learning model for clinical use is still in its infancy, there is ongoing research to overcome the barriers for its universal implementation and we also delve into this aspect. We also briefly describe the role of radiomics in oncoimaging. Artificial intelligence can provide answers pertaining to cancer management at baseline imaging, saving cost and time. Imaging biobanks, which are repositories of anonymised images, are also briefly described. We also discuss the commercialisation and ethical issues pertaining to artificial intelligence. The latest generation generalist artificial intelligence model is also briefly described at the end of the article. We believe this article will not only enrich knowledge, but also promote research acumen in the minds of readers to take oncoimaging to another level using artificial intelligence and also work towards clinical translation of such research.

Radiomics and deep learning models to differentiate lung adenosquamous carcinoma: A multicenter trial

Adenosquamous carcinoma (ASC) is frequently misdiagnosed or overlooked in clinical practice due to its dual histological components and potential transformation from either adenocarcinoma (ADC) or squamous cell carcinoma (SCC). Our study aimed to differentiate ASC from ADC and SCC by incorporating features of enhanced CTs and clinical characteristics to build radiomics and deep learning models. The classification models were trained in Xiangya Hospital and validated in two other independent hospitals. The areas under the receiver operating characteristic curves (AUC), accuracy, sensitivity, specificity, positive predictive value, and negative predictive value were used to estimate the performance. The optimal three-class classification model achieved a maximum AUC of 0.89 and accuracy of 0.81 in external validation sets, AUC of 0.99 and accuracy of 0.99 in the internal test set. These findings highlight the efficacy of our models in differentiating ASC, providing a non-invasive, timely, and accurate diagnostic approach before and during the treatment.

Radiomics under 2D regions, 3D regions, and peritumoral regions reveal tumor heterogeneity in non-small cell lung cancer: a multicenter study

PURPOSE

Lung cancer has significant genetic and phenotypic heterogeneity, leading to poor prognosis. Radiomic features have emerged as promising predictors of the tumor phenotype. However, the role of underlying information surrounding the cancer remains unclear.

MATERIALS AND METHODS

We conducted a retrospective study of 508 patients with NSCLC from three institutions. Radiomics models were built using features from six tumor regions and seven classifiers to predict three prognostically significant tumor phenotypes. The models were evaluated and interpreted by the mean area under the receiver operating characteristic curve (AUC) under nested cross-validation and Shapley values. The best-performing predictive models corresponding to six tumor regions and three tumor phenotypes were identified for further comparative analysis. In addition, we designed five experiments with different voxel spacing to assess the sensitivity of the experimental results to the spatial resolution of the voxels.

RESULTS

Our results demonstrated that models based on 2D, 3D, and peritumoral region features yielded mean AUCs and 95% confidence intervals of 0.759 and [0.747-0.771] for lymphovascular invasion, 0.889 and [0.882-0.896] for pleural invasion, and 0.839 and [0.829-0.849] for T-staging in the testing cohort, which was significantly higher than all other models. Similar results were obtained for the model combining the three regional features at five voxel spacings.

CONCLUSION

Our study revealed the predictive role of the developed methods with multi-regional features for the preoperative assessment of prognostic factors in NSCLC. The analysis of different voxel spacing and model interpretability strengthens the experimental findings and contributes to understanding the biological significance of the radiological phenotype.

Post-revascularization Ejection Fraction Prediction for Patients Undergoing Percutaneous Coronary Intervention Based on Myocardial Perfusion SPECT Imaging Radiomics: a Preliminary Machine Learning Study

In this study, the ability of radiomics features extracted from myocardial perfusion imaging with SPECT (MPI-SPECT) was investigated for the prediction of ejection fraction (EF) post-percutaneous coronary intervention (PCI) treatment. A total of 52 patients who had undergone pre-PCI MPI-SPECT were enrolled in this study. After normalization of the images, features were extracted from the left ventricle, initially automatically segmented by k-means and active contour methods, and finally edited and approved by an expert radiologist. More than 1700 2D and 3D radiomics features were extracted from each patient's scan. A cross-combination of three feature selections and seven classifier methods was implemented. Three classes of no or dis-improvement (class 1), improved EF from 0 to 5% (class 2), and improved EF over 5% (class 3) were predicted by using tenfold cross-validation. Lastly, the models were evaluated based on accuracy, AUC, sensitivity, specificity, precision, and F-score. Neighborhood component analysis (NCA) selected the most predictive feature signatures, including Gabor, first-order, and NGTDM features. Among the classifiers, the best performance was achieved by the fine KNN classifier, which yielded mean accuracy, AUC, sensitivity, specificity, precision, and F-score of 0.84, 0.83, 0.75, 0.87, 0.78, and 0.76, respectively, in 100 iterations of classification, within the 52 patients with 10-fold cross-validation. The MPI-SPECT-based radiomic features are well suited for predicting post-revascularization EF and therefore provide a helpful approach for deciding on the most appropriate treatment.

Deep learning-enhanced radiomics for histologic classification and grade stratification of stage IA lung adenocarcinoma: a multicenter study

Background

Preoperative prediction models for histologic subtype and grade of stage IA lung adenocarcinoma (LUAD) according to the update of the WHO Classification of Tumors of the Lung in 2021 and the 2020 new grade system are yet to be explored. We aim to develop the noninvasive pathology and grade evaluation approach for patients with stage IA LUAD via CT-based radiomics approach and evaluate their performance in clinical practice.

Methods

Chest CT scans were retrospectively collected from patients who were diagnosed with stage IA LUAD and underwent complete resection at two hospitals. A deep learning segmentation algorithm was first applied to assist lesion delineation. Expansion strategies such as bounding-box annotations were further applied. Radiomics features were then extracted and selected followed by radiomics modeling based on four classic machine learning algorithms for histologic subtype classification and grade stratification. The area under the receiver operating characteristic curve (AUC) was used to evaluate model performance.

Results

The study included 294 and 145 patients with stage IA LUAD from two hospitals for radiomics analysis, respectively. For classification of four histological subtypes, multilayer perceptron (MLP) algorithm presented no annotation strategy preference and achieved the average AUC of 0.855, 0.922, and 0.720 on internal, independent, and external test sets with 1-pixel expansion annotation. Bounding-box annotation strategy also enabled MLP an acceptable and stable accuracy among test sets. Meanwhile, logistic regression was selected for grade stratification and achieved the average AUC of 0.928, 0.837, and 0.748 on internal, independent, and external test sets with optimal annotation strategies.

Conclusions

DL-enhanced radiomics models had great potential to predict the fine histological subtypes and grades of early-stage LUADs based on CT images, which might serve as a promising noninvasive approach for the diagnosis and management of early LUADs.

Lung cancer treatment potential and limits associated with the STAT family of transcription factors

Lung cancer is one of the mortal cancers and the leading cause of cancer-related mortality, with a cancer survival rate of fewer than 5% in developing nations. This low survival rate can be linked to things like late-stage detection, quick postoperative recurrences in patients receiving therapy, and chemoresistance developing against various lung cancer treatments. Signal transducer and activator of transcription (STAT) family of transcription factors are involved in lung cancer cell proliferation, metastasis, immunological control, and treatment resistance. By interacting with specific DNA sequences, STAT proteins trigger the production of particular genes, which in turn result in adaptive and incredibly specific biological responses. In the human genome, seven STAT proteins have been discovered (STAT1 to STAT6, including STAT5a and STAT5b). Many external signaling proteins can activate unphosphorylated STATs (uSTATs), which are found inactively in the cytoplasm. When STAT proteins are activated, they can increase the transcription of several target genes, which leads to unchecked cellular proliferation, anti-apoptotic reactions, and angiogenesis. The effects of STAT transcription factors on lung cancer are variable; some are either pro- or anti-tumorigenic, while others maintain dual, context-dependent activities. Here, we give a succinct summary of the various functions that each member of the STAT family plays in lung cancer and go into more detail about the advantages and disadvantages of pharmacologically targeting STAT proteins and their upstream activators in the context of lung cancer treatment.

LaCOme: Learning the latent convolutional patterns among transcriptomic features to improve classifications

OMIC is a novel approach that analyses entire genetic or molecular profiles in humans and other organisms. It involves identifying and quantifying biological molecules that contribute to a species' structure, function, and dynamics. Finding the secrets of OMIC is like deciphering the biochemical code, but building data-driven models to mine the hidden phenotypic trait information has been a research hotspot. Transcriptome analysis is a popular biological technology for characterizing living systems' overall health, including cells and tissues. Individual transcript expression levels are known to be correlated with those of other transcripts. Nevertheless, most computational studies do not fully exploit these inter-feature correlations. Differential expression analyses, for example, assume that the expression levels of the transcripts are independent. Thus, we propose extracting these inter-feature correlations using the convolutional neural network (CNN) and transforming the transcriptomic features into a new space of convolutional transcriptomic (LaCOme) features. On most transcriptomic datasets in use, a series of comprehensive experiments have demonstrated that engineered LaCOme features outperform the original transcriptomic features in classification performances. Based on experimental results, OMIC data from biological samples could be further enriched using CNN to enhance computational analysis results. Also, feature rough screening can be used to extract valuable information from OMIC, regardless of the algorithm used to select features. It may always be better to create a novel feature than to keep the original. Furthermore, we investigated the feasibility of the feature construction method through cross-validation and independent verification, hoping to develop a more efficient and effective method.

Myocardial Perfusion SPECT Imaging Radiomic Features and Machine Learning Algorithms for Cardiac Contractile Pattern Recognition

A U-shaped contraction pattern was shown to be associated with a better Cardiac resynchronization therapy (CRT) response. The main goal of this study is to automatically recognize left ventricular contractile patterns using machine learning algorithms trained on conventional quantitative features (ConQuaFea) and radiomic features extracted from Gated single-photon emission computed tomography myocardial perfusion imaging (GSPECT MPI). Among 98 patients with standard resting GSPECT MPI included in this study, 29 received CRT therapy and 69 did not (also had CRT inclusion criteria but did not receive treatment yet at the time of data collection, or refused treatment). A total of 69 non-CRT patients were employed for training, and the 29 were employed for testing. The models were built utilizing features from three distinct feature sets (ConQuaFea, radiomics, and ConQuaFea + radiomics (combined)), which were chosen using Recursive feature elimination (RFE) feature selection (FS), and then trained using seven different machine learning (ML) classifiers. In addition, CRT outcome prediction was assessed by different treatment inclusion criteria as the study's final phase. The MLP classifier had the highest performance among ConQuaFea models (AUC, SEN, SPE = 0.80, 0.85, 0.76). RF achieved the best performance in terms of AUC, SEN, and SPE with values of 0.65, 0.62, and 0.68, respectively, among radiomic models. GB and RF approaches achieved the best AUC, SEN, and SPE values of 0.78, 0.92, and 0.63 and 0.74, 0.93, and 0.56, respectively, among the combined models. A promising outcome was obtained when using radiomic and ConQuaFea from GSPECT MPI to detect left ventricular contractile patterns by machine learning.

Phenotyping the Histopathological Subtypes of Non-Small-Cell Lung Carcinoma: How Beneficial Is Radiomics?

The aim of this study was to investigate the usefulness of radiomics in the absence of well-defined standard guidelines. Specifically, we extracted radiomics features from multicenter computed tomography (CT) images to differentiate between the four histopathological subtypes of non-small-cell lung carcinoma (NSCLC). In addition, the results that varied with the radiomics model were compared. We investigated the presence of the batch effects and the impact of feature harmonization on the models' performance. Moreover, the question on how the training dataset composition influenced the selected feature subsets and, consequently, the model's performance was also investigated. Therefore, through combining data from the two publicly available datasets, this study involves a total of 152 squamous cell carcinoma (SCC), 106 large cell carcinoma (LCC), 150 adenocarcinoma (ADC), and 58 no other specified (NOS). Through the matRadiomics tool, which is an example of Image Biomarker Standardization Initiative (IBSI) compliant software, 1781 radiomics features were extracted from each of the malignant lesions that were identified in CT images. After batch analysis and feature harmonization, which were based on the ComBat tool and were integrated in matRadiomics, the datasets (the harmonized and the non-harmonized) were given as an input to a machine learning modeling pipeline. The following steps were articulated: (i) training-set/test-set splitting (80/20); (ii) a Kruskal-Wallis analysis and LASSO linear regression for the feature selection; (iii) model training; (iv) a model validation and hyperparameter optimization; and (v) model testing. Model optimization consisted of a 5-fold cross-validated Bayesian optimization, repeated ten times (inner loop). The whole pipeline was repeated 10 times (outer loop) with six different machine learning classification algorithms. Moreover, the stability of the feature selection was evaluated. Results showed that the batch effects were present even if the voxels were resampled to an isotropic form and whether feature harmonization correctly removed them, even though the models' performances decreased. Moreover, the results showed that a low accuracy (61.41%) was reached when differentiating between the four subtypes, even though a high average area under curve (AUC) was reached (0.831). Further, a NOS subtype was classified as almost completely correct (true positive rate ~90%). The accuracy increased (77.25%) when only the SCC and ADC subtypes were considered, as well as when a high AUC (0.821) was obtained-although harmonization decreased the accuracy to 58%. Moreover, the features that contributed the most to models' performance were those extracted from wavelet decomposed and Laplacian of Gaussian (LoG) filtered images and they belonged to the texture feature class.. In conclusion, we showed that our multicenter data were affected by batch effects, that they could significantly alter the models' performance, and that feature harmonization correctly removed them. Although wavelet features seemed to be the most informative features, an absolute subset could not be identified since it changed depending on the training/testing splitting. Moreover, performance was influenced by the chosen dataset and by the machine learning methods, which could reach a high accuracy in binary classification tasks, but could underperform in multiclass problems. It is, therefore, essential that the scientific community propose a more systematic radiomics approach, focusing on multicenter studies, with clear and solid guidelines to facilitate the translation of radiomics to clinical practice.

Introduction to radiomics for a clinical audience

Radiomics is a rapidly developing field of research focused on the extraction of quantitative features from medical images, thus converting these digital images into minable, high-dimensional data, which offer unique biological information that can enhance our understanding of disease processes and provide clinical decision support. To date, most radiomics research has been focused on oncological applications; however, it is increasingly being used in a raft of other diseases. This review gives an overview of radiomics for a clinical audience, including the radiomics pipeline and the common pitfalls associated with each stage. Key studies in oncology are presented with a focus on both those that use radiomics analysis alone and those that integrate its use with other multimodal data streams. Importantly, clinical applications outside oncology are also presented. Finally, we conclude by offering a vision for radiomics research in the future, including how it might impact our practice as radiologists.

Tumor-infiltrating lymphocyte enrichment predicted by CT radiomics analysis is associated with clinical outcomes of non-small cell lung cancer patients receiving immune checkpoint inhibitors

Background

Enrichment of tumor-infiltrating lymphocytes (TIL) in the tumor microenvironment (TME) is a reliable biomarker of immune checkpoint inhibitors (ICI) in non-small cell lung cancer (NSCLC). Phenotyping through computed tomography (CT) radiomics has the overcome the limitations of tissue-based assessment, including for TIL analysis. Here, we assess TIL enrichment objectively using an artificial intelligence-powered TIL analysis in hematoxylin and eosin (H&E) image and analyze its association with quantitative radiomic features (RFs). Clinical significance of the selected RFs is then validated in the independent NSCLC patients who received ICI.

Methods

In the training cohort containing both tumor tissue samples and corresponding CT images obtained within 1 month, we extracted 86 RFs from the CT images. The TIL enrichment score (TILes) was defined as the fraction of tissue area with high intra-tumoral or stromal TIL density divided by the whole TME area, as measured on an H&E slide. From the corresponding CT images, the least absolute shrinkage and selection operator model was then developed using features that were significantly associated with TIL enrichment. The CT model was applied to CT images from the validation cohort, which included NSCLC patients who received ICI monotherapy.

Results

A total of 220 NSCLC samples were included in the training cohort. After filtering the RFs, two features, gray level variance (coefficient 1.71 x 10^-3) and large area low gray level emphasis (coefficient -2.48 x 10^-5), were included in the model. The two features were both computed from the size-zone matrix, which has strength in reflecting intralesional texture heterogeneity. In the validation cohort, the patients with high predicted TILes (≥ median) had significantly prolonged progression-free survival compared to those with low predicted TILes (median 4.0 months [95% CI 2.2-5.7] versus 2.1 months [95% CI 1.6-3.1], p = 0.002). Patients who experienced a response to ICI or stable disease with ICI had higher predicted TILes compared with the patients who experienced progressive disease as the best response (p = 0.001, p = 0.036, respectively). Predicted TILes was significantly associated with progression-free survival independent of PD-L1 status.

Conclusions

In this CT radiomics model, predicted TILes was significantly associated with ICI outcomes in NSCLC patients. Analyzing TME through radiomics may overcome the limitations of tissue-based analysis and assist clinical decisions regarding ICI.

Incremental benefits of size-zone matrix-based radiomics features for the prognosis of lung adenocarcinoma: advantage of spatial partitioning on tumor evaluation

OBJECTIVES

Prognostic models of lung adenocarcinoma (ADC) can be built using radiomics features from various categories. The size-zone matrix (SZM) features have a strong biological basis related to tumor partitioning, but their incremental benefits have not been fully explored. In our study, we aimed to evaluate the incremental benefits of SZM features for the prognosis of lung ADC.

METHODS

A total of 298 patients were included and their pretreatment computed tomography images were analyzed in fivefold cross-validation. We built a risk model of overall survival using SZM features and compared it with a conventional radiomics risk model and a clinical variable-based risk model. We also compared it with other models incorporating various combinations of SZM features, other radiomics features, and clinical variables. A total of seven risk models were compared and evaluated using the hazard ratio (HR) on the left-out test fold.

RESULTS

As a baseline, the clinical variable risk model showed an HR of 2.739. Combining the radiomics signature with SZM feature was better (HR 4.034) than using radiomics signature alone (HR 3.439). Combining radiomics signature, SZM feature, and clinical variable (HR 6.524) fared better than just combining radiomics signature and clinical variables (HR 4.202). These results confirmed the added benefits of SZM features for prognosis in lung ADC.

CONCLUSION

Combining SZM feature with the radiomics signature was better than using the radiomics signature alone and the benefits of SZM features were maintained when clinical variables were added confirming the incremental benefits of SZM features for lung ADC prognosis.

KEY POINTS

• Size-zone matrix (SZM) features provide incremental benefits for the prognosis of lung adenocarcinoma. • Combining the radiomics signature with SZM features performed better than using a radiomics signature alone.

High-dimensional multinomial multiclass severity scoring of COVID-19 pneumonia using CT radiomics features and machine learning algorithms

We aimed to construct a prediction model based on computed tomography (CT) radiomics features to classify COVID-19 patients into severe-, moderate-, mild-, and non-pneumonic. A total of 1110 patients were studied from a publicly available dataset with 4-class severity scoring performed by a radiologist (based on CT images and clinical features). The entire lungs were segmented and followed by resizing, bin discretization and radiomic features extraction. We utilized two feature selection algorithms, namely bagging random forest (BRF) and multivariate adaptive regression splines (MARS), each coupled to a classifier, namely multinomial logistic regression (MLR), to construct multiclass classification models. The dataset was divided into 50% (555 samples), 20% (223 samples), and 30% (332 samples) for training, validation, and untouched test datasets, respectively. Subsequently, nested cross-validation was performed on train/validation to select the features and tune the models. All predictive power indices were reported based on the testing set. The performance of multi-class models was assessed using precision, recall, F1-score, and accuracy based on the 4 × 4 confusion matrices. In addition, the areas under the receiver operating characteristic curves (AUCs) for multi-class classifications were calculated and compared for both models. Using BRF, 23 radiomic features were selected, 11 from first-order, 9 from GLCM, 1 GLRLM, 1 from GLDM, and 1 from shape. Ten features were selected using the MARS algorithm, namely 3 from first-order, 1 from GLDM, 1 from GLRLM, 1 from GLSZM, 1 from shape, and 3 from GLCM features. The mean absolute deviation, skewness, and variance from first-order and flatness from shape, and cluster prominence from GLCM features and Gray Level Non Uniformity Normalize from GLRLM were selected by both BRF and MARS algorithms. All selected features by BRF or MARS were significantly associated with four-class outcomes as assessed within MLR (All p values < 0.05). BRF + MLR and MARS + MLR resulted in pseudo-R² prediction performances of 0.305 and 0.253, respectively. Meanwhile, there was a significant difference between the feature selection models when using a likelihood ratio test (p value = 0.046). Based on confusion matrices for BRF + MLR and MARS + MLR algorithms, the precision was 0.856 and 0.728, the recall was 0.852 and 0.722, whereas the accuracy was 0.921 and 0.861, respectively. AUCs (95% CI) for multi-class classification were 0.846 (0.805-0.887) and 0.807 (0.752-0.861) for BRF + MLR and MARS + MLR algorithms, respectively. Our models based on the utilization of radiomic features, coupled with machine learning were able to accurately classify patients according to the severity of pneumonia, thus highlighting the potential of this emerging paradigm in the prognostication and management of COVID-19 patients.

CT-based morphologic and radiomics features for the classification of MYCN gene amplification status in pediatric neuroblastoma

PURPOSE

MYCN onco-gene amplification in neuroblastoma confers patients to the high-risk disease category for which prognosis is poor and more aggressive multimodal treatment is indicated. This retrospective study leverages machine learning techniques to develop a computed tomography (CT)-based model incorporating semantic and non-semantic features for non-invasive prediction of MYCN amplification status in pediatric neuroblastoma.

METHODS

From 2009 to 2020, 54 pediatric patients treated for neuroblastoma at a specialized children's hospital with pre-treatment contrast-enhanced CT and MYCN status were identified (training cohort, n = 44; testing cohort, n = 10). Six morphologic features and 107 quantitative gray-level texture radiomics features extracted from manually drawn volume-of-interest were analyzed. Following feature selection and class balancing, the final predictive model was developed with eXtreme Gradient Boosting (XGBoost) algorithm. Accumulated local effects (ALE) plots were used to explore main effects of the predictive features. Tumor texture maps were also generated for visualization of radiomics features.

RESULTS

One morphologic and 2 radiomics features were selected for model building. The XGBoost model from the training cohort yielded an area under the receiver operating characteristics curve (AUC-ROC) of 0.930 (95% CI, 0.85-1.00), optimized F1-score of 0.878, and Matthews correlation coefficient (MCC) of 0.773. Evaluation on the testing cohort returned AUC-ROC of 0.880 (95% CI, 0.64-1.00), optimized F1-score of 0.933, and MCC of 0.764. ALE plots and texture maps showed higher "GreyLevelNonUniformity" values, lower "Strength" values, and higher number of image-defined risk factors contribute to higher predicted probability of MYCN amplification.

CONCLUSION

The machine learning model reliably classified MYCN amplification in pediatric neuroblastoma and shows potential as a surrogate imaging biomarker.

DETECT-LC: A 3D Deep Learning and Textural Radiomics Computational Model for Lung Cancer Staging and Tumor Phenotyping Based on Computed Tomography Volumes

Lung Cancer is one of the primary causes of cancer-related deaths worldwide. Timely diagnosis and precise staging are pivotal for treatment planning, and thus can lead to increased survival rates. The application of advanced machine learning techniques helps in effective diagnosis and staging. In this study, a multistage neurobased computational model is proposed, DETECT-LC learning. DETECT-LC handles the challenge of choosing discriminative CT slices for constructing 3D volumes, using Haralick, histogram-based radiomics, and unsupervised clustering. ALT-CNN-DENSE Net architecture is introduced as part of DETECT-LC for voxel-based classification. DETECT-LC offers an automatic threshold-based segmentation approach instead of the manual procedure, to help mitigate this burden for radiologists and clinicians. Also, DETECT-LC presents a slice selection approach and a newly proposed relatively light weight 3D CNN architecture to improve existing studies performance. The proposed pipeline is employed for tumor phenotyping and staging. DETECT-LC performance is assessed through a range of experiments, in which DETECT-LC attains outstanding performance surpassing its counterparts in terms of accuracy, sensitivity, F1-score and Area under Curve (AuC). For histopathology classification, DETECT-LC average performance achieved an improvement of 20% in overall accuracy, 0.19 in sensitivity, 0.16 in F1-Score and 0.16 in AuC over the state of the art. A similar enhancement is reached for staging, where higher overall accuracy, sensitivity and F1-score are attained with differences of 8%, 0.08 and 0.14.

[18F]FDG-PET/CT radiomics and artificial intelligence in lung cancer: Technical aspects and potential clinical applications

Lung cancer is the second most common cancer and the leading cause of cancer-related death worldwide. Molecular imaging using [¹⁸F]fluorodeoxyglucose Positron Emission Tomography and/or Computed Tomography ([¹⁸F]FDG-PET/CT) plays an essential role in the diagnosis, evaluation of response to treatment, and prediction of outcomes. The images are evaluated using qualitative and conventional quantitative indices. However, there is far more information embedded in the images, which can be extracted by sophisticated algorithms. Recently, the concept of uncovering and analyzing the invisible data extracted from medical images, called radiomics, is gaining more attention. Currently, [¹⁸F]FDG-PET/CT radiomics is growingly evaluated in lung cancer to discover if it enhances the diagnostic performance or implication of [¹⁸F]FDG-PET/CT in the management of lung cancer. In this review, we provide a short overview of the technical aspects, as they are discussed in different articles of this special issue. We mainly focus on the diagnostic performance of the [¹⁸F]FDG-PET/CT-based radiomics and the role of artificial intelligence in non-small cell lung cancer, impacting the early detection, staging, prediction of tumor subtypes, biomarkers, and patient's outcomes.

COVID-19 prognostic modeling using CT radiomic features and machine learning algorithms: Analysis of a multi-institutional dataset of 14,339 patients

BACKGROUND

We aimed to analyze the prognostic power of CT-based radiomics models using data of 14,339 COVID-19 patients.

METHODS

Whole lung segmentations were performed automatically using a deep learning-based model to extract 107 intensity and texture radiomics features. We used four feature selection algorithms and seven classifiers. We evaluated the models using ten different splitting and cross-validation strategies, including non-harmonized and ComBat-harmonized datasets. The sensitivity, specificity, and area under the receiver operating characteristic curve (AUC) were reported.

RESULTS

In the test dataset (4,301) consisting of CT and/or RT-PCR positive cases, AUC, sensitivity, and specificity of 0.83 ± 0.01 (CI95%: 0.81-0.85), 0.81, and 0.72, respectively, were obtained by ANOVA feature selector + Random Forest (RF) classifier. Similar results were achieved in RT-PCR-only positive test sets (3,644). In ComBat harmonized dataset, Relief feature selector + RF classifier resulted in the highest performance of AUC, reaching 0.83 ± 0.01 (CI95%: 0.81-0.85), with a sensitivity and specificity of 0.77 and 0.74, respectively. ComBat harmonization did not depict statistically significant improvement compared to a non-harmonized dataset. In leave-one-center-out, the combination of ANOVA feature selector and RF classifier resulted in the highest performance.

CONCLUSION

Lung CT radiomics features can be used for robust prognostic modeling of COVID-19. The predictive power of the proposed CT radiomics model is more reliable when using a large multicentric heterogeneous dataset, and may be used prospectively in clinical setting to manage COVID-19 patients.

Radiomics in Early Lung Cancer Diagnosis: From Diagnosis to Clinical Decision Support and Education

Lung cancer is the most frequent cause of cancer-related death around the world. With the recent introduction of low-dose lung computed tomography for lung cancer screening, there has been an increasing number of smoking- and non-smoking-related lung cancer cases worldwide that are manifesting with subsolid nodules, especially in Asian populations. However, the pros and cons of lung cancer screening also follow the implementation of lung cancer screening programs. Here, we review the literature related to radiomics for early lung cancer diagnosis. There are four main radiomics applications: the classification of lung nodules as being malignant/benign; determining the degree of invasiveness of the lung adenocarcinoma; histopathologic subtyping; and prognostication in lung cancer prediction models. In conclusion, radiomics offers great potential to improve diagnosis and personalized risk stratification in early lung cancer diagnosis through patient–doctor cooperation and shared decision making.

Non-contrast Cine Cardiac Magnetic Resonance image radiomics features and machine learning algorithms for myocardial infarction detection

OBJECTIVE

Robust differentiation between infarcted and normal tissue is important for clinical diagnosis and precision medicine. The aim of this work is to investigate the radiomic features and to develop a machine learning algorithm for the differentiation of myocardial infarction (MI) and viable tissues/normal cases in the left ventricular myocardium on non-contrast Cine Cardiac Magnetic Resonance (Cine-CMR) images.

METHODS

Seventy-two patients (52 with MI and 20 healthy control patients) were enrolled in this study. MR imaging was performed on a 1.5 T MRI using the following parameters: TR = 43.35 ms, TE = 1.22 ms, flip angle = 65°, temporal resolution of 30-40 ms. N4 bias field correction algorithm was applied to correct the inhomogeneity of images. All images were segmented and verified simultaneously by two cardiac imaging experts in consensus. Subsequently, features extraction was performed within the whole left ventricular myocardium (3D volume) in end-diastolic volume phase. Re-sampling to 1 × 1 × 1 mm³ voxels was performed for MR images. All intensities within the VOI of MR images were discretized to 64 bins. Radiomic features were normalized to obtain Z-scores, followed by Student's t-test statistical analysis for comparison. A p-value < 0.05 was used as a threshold for statistically significant differences and false discovery rate (FDR) correction performed to report q-value (FDR adjusted p-value). The extracted features were ranked using the MSVM-RFE algorithm, then Spearman correlation between features was performed to eliminate highly correlated features (R2 > 0.80). Ten different machine learning algorithms were used for classification and different metrics used for evaluation and various parameters used for models' evaluation.

RESULTS

In univariate analysis, the highest area under the curve (AUC) of receiver operating characteristic (ROC) value was achieved for the Maximum 2D diameter slice (M2DS) shape feature (AUC = 0.88, q-value = 1.02E-7), while the average of univariate AUCs was 0.62 ± 0.08. In multivariate analysis, Logistic Regression (AUC = 0.93 ± 0.03, Accuracy = 0.86 ± 0.05, Recall = 0.87 ± 0.1, Precision = 0.93 ± 0.03 and F1 Score = 0.90 ± 0.04) and SVM (AUC = 0.92 ± 0.05, Accuracy = 0.85 ± 0.04, Recall = 0.92 ± 0.01, Precision = 0.88 ± 0.04 and F1 Score = 0.90 ± 0.02) yielded optimal performance as the best machine learning algorithm for this radiomics analysis.

CONCLUSION

This study demonstrated that using radiomics analysis on non-contrast Cine-CMR images enables to accurately detect MI, which could potentially be used as an alternative diagnostic method for Late Gadolinium Enhancement Cardiac Magnetic Resonance (LGE-CMR).

MRI-based radiomics distinguish different pathological types of hepatocellular carcinoma

OBJECT

To distinguish combined hepatocellular cholangiocarcinoma (cHCC-CC), hepatocellular carcinoma (HCC) and cholangiocarcinoma (CC) before operation using MRI radiomics.

METHOD

This study retrospectively analyzed 196 liver cancers: 33 cHCC-CC, 88 HCC and 75 CC. They had confirmed by pathological analysis in the Affiliated Hospital of Hebei University. MRI lesions were manually segmented by a radiologist.1316 features were extracted from MRI lesions by Pyradiomics. Useful features were retained through two-level feature selection to establish a classification model. Receiver operating characteristic (ROC), area under curve (AUC) and F1-score were used to evaluate the performance of the model.

RESULTS

Compared with low-order image features, the performance of the model based on high-order features was improved by about 10%. The model showed better performance in identifying HCC tumors during the delay phase (AUC = 0.91, sensitivity = 0.88, specificity = 0.89, accuracy = 0.89, F1-Score = 0.88).

CONCLUSION

The classification ability of cHCC-CC, HCC and CC can be further improved by extracting MRI high-order features and using a two-level feature selection method.