Reproducibility of radiomic features in CT images of NSCLC patients: an integrative analysis on the impact of acquisition and reconstruction parameters

AutoFRS: an externally validated, annotation-free approach to computational preoperative complication risk stratification in pancreatic surgery - an experimental study

BACKGROUND

The risk of postoperative pancreatic fistula (POPF), one of the most dreaded complications after pancreatic surgery, can be predicted from preoperative imaging and tabular clinical routine data. However, existing studies suffer from limited clinical applicability due to a need for manual data annotation and a lack of external validation. We propose AutoFRS (automated fistula risk score software), an externally validated end-to-end prediction tool for POPF risk stratification based on multimodal preoperative data.

MATERIALS AND METHODS

We trained AutoFRS on preoperative contrast-enhanced computed tomography imaging and clinical data from 108 patients undergoing pancreatic head resection and validated it on an external cohort of 61 patients. Prediction performance was assessed using the area under the receiver operating characteristic curve (AUC) and balanced accuracy. In addition, model performance was compared to the updated alternative fistula risk score (ua-FRS), the current clinical gold standard method for intraoperative POPF risk stratification.

RESULTS

AutoFRS achieved an AUC of 0.81 and a balanced accuracy of 0.72 in internal validation and an AUC of 0.79 and a balanced accuracy of 0.70 in external validation. In a patient subset with documented intraoperative POPF risk factors, AutoFRS (AUC: 0.84 ± 0.05) performed on par with the uaFRS (AUC: 0.85 ± 0.06). The AutoFRS web application facilitates annotation-free prediction of POPF from preoperative imaging and clinical data based on the AutoFRS prediction model.

CONCLUSION

POPF can be predicted from multimodal clinical routine data without human data annotation, automating the risk prediction process. We provide additional evidence of the clinical feasibility of preoperative POPF risk stratification and introduce a software pipeline for future prospective evaluation.

GRAPHICAL ABSTRACT

PADS-Net: GAN-based radiomics using multi-task network of denoising and segmentation for ultrasonic diagnosis of Parkinson disease

Parkinson disease (PD) is a prevalent neurodegenerative disorder, and its accurate diagnosis is crucial for timely intervention. We propose the PArkinson disease Denoising and Segmentation Network (PADS-Net), to simultaneously denoise and segment transcranial ultrasound images of midbrain for accurate PD diagnosis. The PADS-Net is built upon generative adversarial networks and incorporates a multi-task deep learning framework aimed at optimizing the tasks of denoising and segmentation for ultrasound images. A composite loss function including the mean absolute error, the mean squared error and the Dice loss, is adopted in the PADS-Net to effectively capture image details. The PADS-Net also integrates radiomics techniques for PD diagnosis by exploiting high-throughput features from ultrasound images. A four-branch ensemble diagnostic model is designed by utilizing two "wings" of the butterfly-shaped midbrain regions on both ipsilateral and contralateral images to enhance the accuracy of PD diagnosis. Experimental results demonstrate that the PADS-Net not only reduced speckle noise, achieving the edge-to-noise ratio of 16.90, but also attained a Dice coefficient of 0.91 for midbrain segmentation. The PADS-Net finally achieved an area under the receiver operating characteristic curve as high as 0.87 for diagnosis of PD. Our PADS-Net excels in transcranial ultrasound image denoising and segmentation and offers a potential clinical solution to accurate PD assessment.

Methodological issues in radiomics: impact on accuracy of MRI for predicting response to neoadjuvant chemotherapy in breast cancer

AIM

To investigate whether methodological aspects may influence the performance of MRI-radiomic models to predict response to neoadjuvant treatment (NAT) in breast cancer (BC) patients.

MATERIALS AND METHODS

We conducted a systematic review until March 2023. A random-effects meta-analysis was performed to combine the area under the receiver operating characteristic curve (AUC) values. Publication bias was assessed using Egger's test and heterogeneity was estimated by I2. A meta-regression was conducted to investigate the impact of various factors, including scanner, features' number/transformation/type, pixel/voxel scaling, etc. RESULTS: Forty-two studies were included. The summary AUC was 0.77 (95% CI: 0.74-0.81). Substantial heterogeneity was observed (I2 = 81%) with no publication bias (p = 0.35). Radiomic model accuracy was influenced by the scanner vendor, with lower AUCs in studies using mixed scanner vendors (AUC; 95% CI: 0.70; 0.61-0.78) compared to studies including images obtained from the same scanner (AUC (95% CI): 0.83 (0.77-0.88), 0.74 (0.67-0.82), 0.83 (0.78-0.89) for three different vendors; vendors 1, 2, and 3, respectively; p-value = 0.03 for comparison with vendor 1). Feature type also seemed to have an impact on the AUC, with higher prediction accuracy observed for studies using 3D than 2D/2.5D images (AUC; 95% CI: 0.81; 0.78-0.85 and 0.73; 0.65-0.81, respectively, p-value = 0.03). Non-significant between-study heterogeneity was observed in the studies including 3D images (I2 = 33%) and Vendor 1 scanners (I2 = 40%).

CONCLUSION

MRI-radiomics has emerged as a potential method for predicting the response to NAT in BC patients, showing promising outcomes. Nevertheless, it is important to acknowledge the diversity among the methodological choices applied. Further investigations should prioritize achieving standardized protocols, and enhancing methodological rigor in MRI-radiomics.

KEY POINTS

Question Do methodological aspects influence the performance of MRI-radiomic models in predicting response to NAT in BC patients? Findings Radiomic model accuracy was influenced by the scanner vendor and feature type. Clinical relevance Methodological discrepancies affect the performance of MRI-radiomic models. Developing standardized protocols and enhancing methodological rigor in these studies should be prioritized.

Radiomics and Clinical Features for Distinguishing Kidney Stone-Associated Urinary Tract Infection: A Comprehensive Analysis of Machine Learning Classification

Background

This study investigated the abilities of radiomics and clinical feature models to distinguish kidney stone-associated urinary tract infections (KS-UTIs) using computed tomography.

Methods

A retrospective analysis was conducted on a single-center dataset comprising computed tomography (CT) scans and corresponding clinical information from 461 patients with kidney stones. Radiomics features were extracted from CT images and underwent dimensionality reduction and selection. Multiple machine learning (Three types of shallow learning and four types of deep learning) algorithms were employed to construct radiomics and clinical models in this study. Performance evaluation and optimal model selection were done using receiver operating characteristic (ROC) curve analysis and Delong test. Univariate and multivariate logistic regression analyzed clinical and radiomics features to identify significant variables and develop a clinical model. A combined model integrating radiomics and clinical features was established. Model performance was assessed by ROC curve analysis, clinical utility was evaluated through decision curve analysis, and the accuracy of the model was analyzed via calibration curve.

Results

Multilayer perceptron (MLP) showed higher classification accuracy than other classifiers (area under the curve (AUC) for radiomics model: train 0.96, test 0.94; AUC for clinical model: train 0.95, test 0.91. The combined radiomics-clinical model performed best (AUC for combined model: train 0.98, test 0.95). Decision curve and calibration curve analyses confirmed the model's clinical efficacy and calibration.

Conclusions

This study showed the effectiveness of combining radiomics and clinical features from CT scans to identify KS-UTIs. A combined model using MLP exhibited strong classification abilities.

The reproducibility and predictivity of radiomic features extracted from dynamic contrast-enhanced computed tomography of hepatocellular carcinoma

PURPOSE

To assess the reproducibility of radiomic features (RFs) extracted from dynamic contrast-enhanced computed tomography (DCE-CT) scans of patients diagnosed with hepatocellular carcinoma (HCC) with regards to inter-observer variability and acquisition timing after contrast injection. The predictive ability of reproducible RFs for differentiating between the degrees of HCC differentiation is also investigated.

METHODS

We analyzed a set of DCE-CT scans of 39 patients diagnosed with HCC. Two radiologists independently segmented the scans, and RFs were extracted from each sequence of the DCE-CT scans. The same lesion was segmented across the DCE-CT sequences of each patient's scan. From each lesion, 127 commonly used RFs were extracted. The reproducibility of RFs was assessed with regard to (i) inter-observer variability, by evaluating the reproducibility of RFs between the two radiologists; and (ii) timing of acquisition following contrast injection (inter- and intra-imaging phase). The reproducibility of RFs was assessed using the concordance correlation coefficient (CCC), with a cut-off value of 0.90. Reproducible RFs were used for building XGBoost classification models for the differentiation of HCC differentiation.

RESULTS

Inter-observer analyses across the different contrast-enhancement phases showed that the number of reproducible RFs was 29 (22.8%), 52 (40.9%), and 36 (28.3%) for the non-contrast enhanced, late arterial, and portal venous phases, respectively. Intra- and inter-sequence analyses revealed that the number of reproducible RFs ranged between 1 (0.8%) and 47 (37%), inversely related with time interval between the sequences. XGBoost algorithms built using reproducible RFs in each phase were found to be high predictive ability of the degree of HCC tumor differentiation.

CONCLUSIONS

The reproducibility of many RFs was significantly impacted by inter-observer variability, and a larger number of RFs were impacted by the difference in the time of acquisition after contrast injection. Our findings highlight the need for quality assessment to ensure that scans are analyzed in the same physiologic imaging phase in quantitative imaging studies, or that phase-wide reproducible RFs are selected. Overall, the study emphasizes the importance of reproducibility and quality control when using RFs as biomarkers for clinical applications.

Enhancing the Clinical Utility of Radiomics: Addressing the Challenges of Repeatability and Reproducibility in CT and MRI

Radiomics, which integrates the comprehensive characterization of imaging phenotypes with machine learning algorithms, is increasingly recognized for its potential in the diagnosis and prognosis of oncological conditions. However, the repeatability and reproducibility of radiomic features are critical challenges that hinder their widespread clinical adoption. This review aims to address the paucity of discussion regarding the factors that influence the reproducibility and repeatability of radiomic features and their subsequent impact on the application of radiomic models. We provide a synthesis of the literature on the repeatability and reproducibility of CT/MR-based radiomic features, examining sources of variation, the number of reproducible features, and the availability of individual feature repeatability indices. We differentiate sources of variation into random effects, which are challenging to control but can be quantified through simulation methods such as perturbation, and biases, which arise from scanner variability and inter-reader differences and can significantly affect the generalizability of radiomic model performance in diverse settings. Four suggestions for repeatability and reproducibility studies are suggested: (1) detailed reporting of variation sources, (2) transparent disclosure of calculation parameters, (3) careful selection of suitable reliability indices, and (4) comprehensive reporting of reliability metrics. This review underscores the importance of random effects in feature selection and harmonizing biases between development and clinical application settings to facilitate the successful translation of radiomic models from research to clinical practice.

CT and MRI radiomic features of lung cancer (NSCLC): comparison and software consistency

BACKGROUND

Radiomics is a quantitative approach that allows the extraction of mineable data from medical images. Despite the growing clinical interest, radiomics studies are affected by variability stemming from analysis choices. We aimed to investigate the agreement between two open-source radiomics software for both contrast-enhanced computed tomography (CT) and contrast-enhanced magnetic resonance imaging (MRI) of lung cancers and to preliminarily evaluate the existence of radiomic features stable for both techniques.

METHODS

Contrast-enhanced CT and MRI images of 35 patients affected with non-small cell lung cancer (NSCLC) were manually segmented and preprocessed using three different methods. Sixty-six Image Biomarker Standardisation Initiative-compliant features common to the considered platforms, PyRadiomics and LIFEx, were extracted. The correlation among features with the same mathematical definition was analyzed by comparing PyRadiomics and LIFEx (at fixed imaging technique), and MRI with CT results (for the same software).

RESULTS

When assessing the agreement between LIFEx and PyRadiomics across the considered resampling, the maximum statistically significant correlations were observed to be 94% for CT features and 95% for MRI ones. When examining the correlation between features extracted from contrast-enhanced CT and MRI using the same software, higher significant correspondences were identified in 11% of features for both software.

CONCLUSIONS

Considering NSCLC, (i) for both imaging techniques, LIFEx and PyRadiomics agreed on average for 90% of features, with MRI being more affected by resampling and (ii) CT and MRI contained mostly non-redundant information, but there are shape features and, more importantly, texture features that can be singled out by both techniques.

RELEVANCE STATEMENT

Identifying and selecting features that are stable cross-modalities may be one of the strategies to pave the way for radiomics clinical translation.

KEY POINTS

• More than 90% of LIFEx and PyRadiomics features contain the same information. • Ten percent of features (shape, texture) are stable among contrast-enhanced CT and MRI. • Software compliance and cross-modalities stability features are impacted by the resampling method.

Radiomics-based discriminant analysis of principal components to stratify the treatment response of lung metastases following stereotactic body radiation therapy

PURPOSE

Discriminant analysis of principal components (DAPC) was introduced to describe the clusters of genetically related individuals focusing on the variation between the groups of individuals. Borrowing this approach, we evaluated the potential of DAPC for the evaluation of clusters in terms of treatment response to SBRT of lung lesions using radiomics analysis on pre-treatment CT images.

MATERIALS AND METHODS

80 pulmonary metastases from 56 patients treated with SBRT were analyzed. Treatment response was stratified as complete, incomplete and null responses. For each lesion, 107 radiomics features were extracted using the PyRadiomics software. The concordance correlation coefficients (CCC) between the radiomics features obtained by two segmentations were calculated. DAPC analysis was performed to infer the structure of "radiomically" related lesions for treatment response assessment. The DAPC was performed using the "adegenet" package for the R software.

RESULTS

The overall mean CCC was 0.97 ± 0.14. The analysis yields 14 dimensions in order to explain 95 % of the variance. DAPC was able to group the 80 lesions into the 3 different clusters based on treatment response depending on the radiomics features characteristics. The first Linear Discriminant achieved the best discrimination of individuals into the three pre-defined groups. The greater radiomics loadings who contributed the most to the treatment response differentiation were associated with the "sphericity", "correlation" and "maximal correlation coefficient" features.

CONCLUSION

This study demonstrates that a DAPC analysis based on radiomics features obtained from pretreatment CT is able to provide a reliable stratification of complete, incomplete or null response of lung metastases following SBRT.

Protocol selection formalism for minimizing detectable differences in morphological radiomics features of lung lesions in repeated CT acquisitions

Background

The accuracy of morphological radiomic features (MRFs) can be affected by various acquisition settings and imaging conditions. To ensure that clinically irrelevant changes do not reduce sensitivity to capture the radiomics changes between successive acquisitions, it is essential to determine the optimal imaging systems and protocols to use.

Purpose

The main goal of our study was to optimize CT protocols and minimize the minimum detectable difference (MDD) in successive acquisitions of MRFs.

Method

MDDs were derived based on the previous research involving 15 realizations of nodule models at two different sizes. Our study involved simulations of two consecutive acquisitions using 297 different imaging conditions, representing variations in scanners' reconstruction kernels, dose levels, and slice thicknesses. Parametric polynomial models were developed to establish correlations between imaging system characteristics, lesion size, and MDDs. Additionally, polynomial models were used to model the correlation of the imaging system parameters. Optimization problems were formulated for each MRF to minimize the approximated function. Feature importance was determined for each MRF through permutation feature analysis. The proposed method was compared to the recommended guidelines by the quantitative imaging biomarkers alliance (QIBA).

Results

The feature importance analysis showed that lesion size is the most influential parameter to estimate the MDDs in most of the MRFs. Our study revealed that thinner slices and higher doses had a measurable impact on reducing the MDDs. Higher spatial resolution and lower noise magnitude were identified as the most suitable or noninferior acquisition settings. Compared to QIBA, the proposed protocol selection guideline demonstrated a reduced coefficient of variation, with values decreasing from 1.49 to 1.11 for large lesions and from 1.68 to 1.12 for small lesions.

Conclusion

The protocol optimization framework provides means to assess and optimize protocols to minimize the MDD to increase the sensitivity of the measurements in lung cancer screening.

Fusion-based tensor radiomics using reproducible features: Application to survival prediction in head and neck cancer

BACKGROUND

Numerous features are commonly generated in radiomics applications as applied to medical imaging, and identification of robust radiomics features (RFs) can be an important step to derivation of reliable, reproducible solutions. In this work, we utilize a tensor radiomics (TR) framework, where numerous fusions are explored, to generate different flavours of RFs, and we aimed to identify RFs that are robust to fusion techniques in head and neck cancer. Overall, we aimed to predict progression-free survival (PFS) using Hybrid Machine Learning Systems (HMLS) and reproducible RFs.

METHODS

The study was performed on 408 patients with head and neck cancer from The Cancer Imaging Archive. After image preprocessing, 15 fusion techniques were employed to combine Positron Emission Tomography (PET) and Computed Tomography (CT) images. Subsequently, 215 RFs were extracted through a standardized radiomics software, with 17 'flavours' generated using PET-only, CT-only, and 15 fused PET&CT images. The variability of RFs across flavours was studied using the Intraclass Correlation Coefficient (ICC). Furthermore, the features were categorized into seven reliability groups, 106 reproducible RFs with ICC>0.75 were selected, highly correlated flavours were removed, Principal Component Analysis was used to convert 17 flavours to 1 attribute, the polynomial function was utilized to increase RFs, and Analysis of variance (ANOVA) was used to select the relevant attributes. Finally, 3 classifiers including Random Forest (RFC), Logistic regression (LR), and Multi-layer perceptron were applied to the preselected relevant attributes to predict binary PFS. In 5-fold cross-validation, 80% of 4 divisions were utilized to train the model, and the remaining 20% was utilized to evaluate the model. Further, the remaining fold was used for external nested testing.

RESULTS

Reliability analysis indicated that most morphological features belong to the high-reliability category. By contrast, local intensity and statistical features extracted from images belong to the low-reliability category. In the tensor framework, the highest 5-fold cross-validation accuracy of 76.7%±3.3% with an external nested testing of 70.6%±6.7% resulted from the reproducible TR+polynomial function+ANOVA+LR algorithm while the accuracy of 70.0%±4.2% with the external nested testing of 67.7%±4.9% was achieved through the PCA fusion+RFC (non-tensor paradigm).

CONCLUSIONS

This study demonstrated that using reproducible RFs as utilized within a tensor fusion radiomics framework, linked with ANOVA and LR, added value to prediction of progression-free survival outcome in head and neck cancer patients.

Association between Contrast-Enhanced Computed Tomography Radiomic Features, Genomic Alterations and Prognosis in Advanced Lung Adenocarcinoma Patients

Non-invasive methods to assess mutational status, as well as novel prognostic biomarkers, are warranted to foster therapy personalization of patients with advanced non-small cell lung cancer (NSCLC). This study investigated the association of contrast-enhanced Computed Tomography (CT) radiomic features of lung adenocarcinoma lesions, alone or integrated with clinical parameters, with tumor mutational status (EGFR, KRAS, ALK alterations) and Overall Survival (OS). In total, 261 retrospective and 48 prospective patients were enrolled. A Radiomic Score (RS) was created with LASSO-Logistic regression models to predict mutational status. Radiomic, clinical and clinical-radiomic models were trained on retrospective data and tested (Area Under the Curve, AUC) on prospective data. OS prediction models were trained and tested on retrospective data with internal cross-validation (C-index). RS significantly predicted each alteration at training (radiomic and clinical-radiomic AUC 0.95-0.98); validation performance was good for EGFR (AUC 0.86), moderate for KRAS and ALK (AUC 0.61-0.65). RS was also associated with OS at univariate and multivariable analysis, in the latter with stage and type of treatment. The validation C-index was 0.63, 0.79, and 0.80 for clinical, radiomic, and clinical-radiomic models. The study supports the potential role of CT radiomics for non-invasive identification of gene alterations and prognosis prediction in patients with advanced lung adenocarcinoma, to be confirmed with independent studies.

The role of parametric feature maps to correct different volume of interest sizes: an in vivo liver MRI study

BACKGROUND

Different volume of interest (VOI) sizes influence radiomic features. This study examined if translating images into feature maps before feature sampling could compensate for these effects in liver magnetic resonance imaging (MRI).

METHODS

T1- and T2-weighted sequences from three different scanners (two 3-T scanners, one 1.5-T scanner) of 66 patients with normal abdominal MRI were included retrospectively. Three differently sized VOIs (10, 20, and 30 mm in diameter) were drawn in the liver parenchyma (right lobe), excluding adjacent structures. Ninety-three features were extracted conventionally using PyRadiomics. All images were also converted to 93 parametric feature maps using a pretested software. Agreement between the three VOI sizes was assessed with overall concordance correlation coefficients (OCCCs), while OCCCs > 0.85 were rated reproducible. OCCCs were calculated twice: for the VOI sizes of 10, 20, and 30 mm and for those of 20 and 30 mm.

RESULTS

When extracted from original images, only 4 out of the 93 features were reproducible across all VOI sizes in T1- and T2-weighted images. When the smallest VOI was excluded, 5 features (T1-weighted) and 7 features (T2-weighted) were reproducible. Extraction from parametric maps increased the number of reproducible features to 9 (T1- and T2-weighted) across all VOIs. Excluding the 10-mm VOI, reproducibility improved to 16 (T1-weighted) and 55 features (T2-weighted). The stability of all other features also increased in feature maps.

CONCLUSIONS

Translating images into parametric maps before feature extraction improves reproducibility across different VOI sizes in normal liver MRI.

RELEVANCE STATEMENT

The size of the segmented VOI influences the feature quantity of radiomics, while software-based conversion of images into parametric feature maps before feature sampling improves reproducibility across different VOI sizes in MRI of normal liver tissue.

KEY POINTS

• Parametric feature maps can compensate for different VOI sizes. • The effect seems dependent on the VOI sizes and the MRI sequence. • Feature maps can visualize features throughout the entire image stack.

Radiomics and artificial intelligence for precision medicine in lung cancer treatment

Lung cancer is the leading cause of cancer-related deaths worldwide. It exhibits, at the mesoscopic scale, phenotypic characteristics that are generally indiscernible to the human eye but can be captured non-invasively on medical imaging as radiomic features, which can form a high dimensional data space amenable to machine learning. Radiomic features can be harnessed and used in an artificial intelligence paradigm to risk stratify patients, and predict for histological and molecular findings, and clinical outcome measures, thereby facilitating precision medicine for improving patient care. Compared to tissue sampling-driven approaches, radiomics-based methods are superior for being non-invasive, reproducible, cheaper, and less susceptible to intra-tumoral heterogeneity. This review focuses on the application of radiomics, combined with artificial intelligence, for delivering precision medicine in lung cancer treatment, with discussion centered on pioneering and groundbreaking works, and future research directions in the area.

Reproducibility of CT radiomic features in lung neuroendocrine tumours (NETs) patients: analysis in a heterogeneous population

BACKGROUND

The aim is to find a correlation between texture features extracted from neuroendocrine (NET) lung cancer subtypes, both Ki-67 index and the presence of lymph-nodal mediastinal metastases detected while using different computer tomography (CT) scanners.

METHODS

Sixty patients with a confirmed pulmonary NET histological diagnosis, a known Ki-67 status and metastases, were included. After subdivision of primary lesions in baseline acquisition and venous phase, 107 radiomic features of first and higher orders were extracted. Spearman's correlation matrix with Ward's hierarchical clustering was applied to confirm the absence of bias due to the database heterogeneity. Nonparametric tests were conducted to identify statistically significant features in the distinction between patient groups (Ki-67 < 3-Group 1; 3 ≤ Ki-67 ≤ 20-Group 2; and Ki-67 > 20-Group 3, and presence of metastases).

RESULTS

No bias arising from sample heterogeneity was found. Regarding Ki-67 groups statistical tests, seven statistically significant features (p value < 0.05) were found in post-contrast enhanced CT; three in baseline acquisitions. In metastasis classes distinction, three features (first-order class) were statistically significant in post-contrast acquisitions and 15 features (second-order class) in baseline acquisitions, including the three features distinguishing between Ki-67 groups in baseline images (MCC, ClusterProminence and Strength).

CONCLUSIONS

Some radiomic features can be used as a valid and reproducible tool for predicting Ki-67 class and hence the subtype of lung NET in baseline and post-contrast enhanced CT images. In particular, in baseline examination three features can establish both tumour class and aggressiveness.

Brain metastases from NSCLC treated with stereotactic radiotherapy: prediction mismatch between two different radiomic platforms

BACKGROUND AND PURPOSE

Radiomics enables the mining of quantitative features from medical images. The influence of the radiomic feature extraction software on the final performance of models is still a poorly understood topic. This study aimed to investigate the ability of radiomic features extracted by two different radiomic platforms to predict clinical outcomes in patients treated with radiosurgery for brain metastases from non-small cell lung cancer. We developed models integrating pre-treatment magnetic resonance imaging (MRI)-derived radiomic features and clinical data.

MATERIALS AND METHODS

Pre-radiotherapy gadolinium enhanced axial T1-weighted MRI scans were used. MRI images were re-sampled, intensity-shifted, and histogram-matched before radiomic extraction by means of two different platforms (PyRadiomics and SOPHiA Radiomics). We adopted LASSO Cox regression models for multivariable analyses by creating radiomic, clinical, and combined models using three survival clinical endpoints (local control, distant progression, and overall survival). The statistical analysis was repeated 50 times with different random seeds and the median concordance index was used as performance metric of the models.

RESULTS

We analysed 276 metastases from 148 patients. The use of the two platforms resulted in differences in both the quality and the number of extractable features. That led to mismatches in terms of end-to-end performance, statistical significance of radiomic scores, and clinical covariates found significant in combined models.

CONCLUSION

This study shed new light on how extracting radiomic features from the same images using two different platforms could yield several discrepancies. That may lead to acute consequences on drawing conclusions, comparing results across the literature, and translating radiomics into clinical practice.

Harmonization of robust radiomic features in the submandibular gland using multi-ultrasound systems: a preliminary study

OBJECTIVE

This study aimed to identify robust radiomic features in multiultrasonography of the submandibular gland and normalize the interdevice discrepancies by applying a machine-learning-based harmonization method.

METHODS

Ultrasonographic images of normal submandibular gland of young healthy adults, aged between 20 and 40 years, were selected from two different devices. In a total of 30 images, the region of interest was determined along the border of gland parenchyma, and 103 radiomic features were extracted using A-VIEW. The coefficient of variation (CV) was obtained for individual features, and the features showing CV less than 10% were selected. For the selected features, the interdevice discrepancy was normalized using machine-learning method, called the ComBat harmonization. Median differences of the features between the two scanners, before and after harmonization, were compared using Mann-Whitney U-test; confidence interval of 95%.

RESULTS

Among total 103 radiomic features, 17 features were selected as robust, showing CV less than 10% in both scanners. All values of selected features, except two, showed a statistical difference between the two devices. After applying the ComBat harmonization method, the median and distribution of the 16 features were harmonized to show no significant difference between the two scanners (p > 0.05). One feature remained different (p ≤ 0.05).

CONCLUSION

On ultrasonographic examination, robust radiomic features for normal submandibular gland were obtained and interdevice normalization was efficiently conducted using ComBat harmonization. Our findings would be useful for multidevices or multicenter studies based on clinical ultrasonographic imaging data to improve the accuracy of the overall diagnostic model.

Robustness of Radiomics in Pre-Surgical Computer Tomography of Non-Small-Cell Lung Cancer

Background: Radiomic features are increasingly used in CT of NSCLC. However, their robustness with respect to segmentation variability has not yet been demonstrated. The aim of this study was to assess radiomic features agreement across three kinds of segmentation. Methods: We retrospectively included 48 patients suffering from NSCLC who underwent pre-surgery CT. Two expert radiologists in consensus manually delineated three 3D-ROIs on each patient. To assess robustness for each feature, the intra-class correlation coefficient (ICC) across segmentations was evaluated. The ‘sensitivity’ of ICC upon some parameters affecting features computation (such as bin-width for first-order features and pixel-distances for second-order features) was also evaluated. Moreover, an assessment with respect to interpolator and isotropic resolution was also performed. Results: Our results indicate that ‘shape’ features tend to have excellent agreement (ICC > 0.9) across segmentations; moreover, they have approximately zero sensitivity to other parameters. ‘First-order’ features are in general sensitive to parameters variation; however, a few of them showed excellent agreement and low sensitivity (below 0.1) with respect to bin-width and pixel-distance. Similarly, a few second-order features showed excellent agreement and low sensitivity. Conclusions: Our results suggest that a limited number of radiomic features can achieve a high level of reproducibility in CT of NSCLC.

Impact of image filtering and assessment of volume-confounding effects on CT radiomic features and derived survival models in non-small cell lung cancer

Background

No evidence supports the choice of specific imaging filtering methodologies in radiomics. As the volume of the primary tumor is a well-recognized prognosticator, our purpose is to assess how filtering may impact the feature/volume dependency in computed tomography (CT) images of non-small cell lung cancer (NSCLC), and if such impact translates into differences in the performance of survival modeling. The role of lesion volume in model performances was also considered and discussed.

Methods

Four-hundred seventeen CT images NSCLC patients were retrieved from the NSCLC-Radiomics public repository. Pre-processing and features extraction were implemented using Pyradiomics v3.0.1. Features showing high correlation with volume across original and filtered images were excluded. Cox proportional hazards (PH) with least absolute shrinkage and selection operator (LASSO) regularization and CatBoost models were built with and without volume, and their concordance (C-) indices were compared using Wilcoxon signed-ranked test. The Mann Whitney U test was used to assess model performances after stratification into two groups based on low- and high-volume lesions.

Results

Radiomic models significantly outperformed models built on only clinical variables and volume. However, the exclusion/inclusion of volume did not generally alter the performances of radiomic models. Overall, performances were not substantially affected by the choice of either imaging filter (overall C-index 0.539-0.590 for Cox PH and 0.589-0.612 for CatBoost). The separation of patients with high-volume lesions resulted in significantly better performances in 2/10 and 7/10 cases for Cox PH and CatBoost models, respectively. Both low- and high-volume models performed significantly better with the inclusion of radiomic features (P<0.0001), but the improvement was largest in the high-volume group (+10.2% against +8.7% improvement for CatBoost models and +10.0% against +5.4% in Cox PH models).

Conclusions

Radiomic features complement well-known prognostic factors such as volume, but their volume-dependency is high and should be managed with vigilance. The informative content of radiomic features may be diminished in small lesion volumes, which could limit the applicability of radiomics in early-stage NSCLC, where tumors tend to be small. Our results also suggest an advantage of CatBoost models over the Cox PH models.

The effect of preprocessing filters on predictive performance in radiomics

Background

Radiomics is a noninvasive method using machine learning to support personalised medicine. Preprocessing filters such as wavelet and Laplacian-of-Gaussian filters are commonly used being thought to increase predictive performance. However, the use of preprocessing filters increases the number of features by up to an order of magnitude and can produce many correlated features. Both substantially increase the dataset complexity, which in turn makes modeling with machine learning techniques more challenging, possibly leading to poorer performance. We investigated the impact of these filters on predictive performance.

Methods

Using seven publicly available radiomic datasets, we measured the impact of adding features preprocessed with eight different preprocessing filters to the unprocessed features on the predictive performance of radiomic models. Modeling was performed using five feature selection methods and five classifiers, while predictive performance was measured using area-under-the-curve at receiver operating characteristics analysis (AUC-ROC) with nested, stratified 10-fold cross-validation.

Results

Significant improvements of up to 0.08 in AUC-ROC were observed when all image preprocessing filters were applied compared to using only the original features (up to p = 0.024). Decreases of -0.04 and -0.10 were observed on some data sets, but these were not statistically significant (p > 0.179). Tuning of the image preprocessing filters did not result in decreases in AUC-ROC but further improved results by up to 0.1; however, these improvements were not statistically significant (p > 0.086) except for one data set (p = 0.023).

Conclusions

Preprocessing filters can have a significant impact on the predictive performance and should be used in radiomic studies.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41747-022-00294-w.

Enhancing the stability of CT radiomics across different volume of interest sizes using parametric feature maps: a phantom study

BACKGROUND

In radiomics studies, differences in the volume of interest (VOI) are often inevitable and may confound the extracted features. We aimed to correct this confounding effect of VOI variability by applying parametric maps with a fixed voxel size.

METHODS

Ten scans of a cup filled with sodium chloride solution were scanned using a multislice computed tomography (CT) unit. Sphere-shaped VOIs with different diameters (4, 8, or 16 mm) were drawn centrally into the phantom. A total of 93 features were extracted conventionally from the original images using PyRadiomics. Using a self-designed and pretested software tool, parametric maps for the same 93 features with a fixed voxel size of 4 mm3 were created. To retrieve the feature values from the maps, VOIs were copied from the original images to preserve the position. Differences in feature quantities between the VOI sizes were tested with the Mann-Whitney U-test and agreement with overall concordance correlation coefficients (OCCC).

RESULTS

Fifty-five conventionally extracted features were significantly different between the VOI sizes, and none of the features showed excellent agreement in terms of OCCCs. When read from the parametric maps, only 8 features showed significant differences, and 3 features showed an excellent OCCC (≥ 0.85). The OCCCs for 89 features substantially increased using the parametric maps.

CONCLUSIONS

This phantom study shows that converting CT images into parametric maps resolves the confounding effect of VOI variability and increases feature reproducibility across VOI sizes.

HeLLePhant: A phantom mimicking non-small cell lung cancer for texture analysis in CT images

PURPOSE

Phantoms mimicking human tissue heterogeneity and intensity are required to establish radiomic features robustness in Computed Tomography (CT) images. We developed inserts with two different techniques for the radiomic study of Non-Small Cell Lung Cancer (NSCLC) lesions.

METHODS

We developed two insert prototypes: two 3D-printed made of glycol-modified polyethylene terephthalate (PET-G), and nine with sodium polyacrylate plus iodinated contrast medium. The inserts were put in a handcraft phantom (HeLLePhant). We also analysed four materials of a commercial homogeneous phantom (Catphan® 424) and collected 29 NSCLC patients for comparison. All the CT acquisitions were performed with the same clinical protocol and scanner at 120kVp. The HeLLePhant phantom was scanned ten times in fixed condition at 120kVp and 100kVp for repeatability investigation. We extracted 153 radiomic features using Pyradiomics. To compare the features between phantoms and patients, we computed how many phantom features fell in the range between 10th and 90th percentile of the corresponding patient values. We deemed repeatable the features with a coefficient of variation (CV) less than or equal to 0.10.

RESULTS

The best similarity with the patients was obtained with the polyacrylate inserts (55.6-90.2%), the worst with Catphan (15.7-19.0%). For the PET-G inserts 35.3% and 36.6% of the features match the patient range. We found high repeatability for all the inserts of the HeLLePhant phantom (74.3-100% at 120kVp, 75.7-97.9% at 100kVp), and observed a texture dependency in repeatability.

CONCLUSIONS

Our study shows a promising way to construct heterogeneous inserts mimicking a target tissue for radiomic studies.