Impact of inter-reader contouring variability on textural radiomics of colorectal liver metastases

Development and benchmarking of a Deep Learning-based MRI-guided gross tumor segmentation algorithm for Radiomics analyses in extremity soft tissue sarcomas

BACKGROUND

Volume of interest (VOI) segmentation is a crucial step for Radiomics analyses and radiotherapy (RT) treatment planning. Because it can be time-consuming and subject to inter-observer variability, we developed and tested a Deep Learning-based automatic segmentation (DLBAS) algorithm to reproducibly predict the primary gross tumor as VOI for Radiomics analyses in extremity soft tissue sarcomas (STS).

METHODS

A DLBAS algorithm was trained on a cohort of 157 patients and externally tested on an independent cohort of 87 patients using contrast-enhanced MRI. Manual tumor delineations by a radiation oncologist served as ground truths (GTs). A benchmark study with 20 cases from the test cohort compared the DLBAS predictions against manual VOI segmentations of two residents (ERs) and clinical delineations of two radiation oncologists (ROs). The ROs rated DLBAS predictions regarding their direct applicability.

RESULTS

The DLBAS achieved a median dice similarity coefficient (DSC) of 0.88 against the GTs in the entire test cohort (interquartile range (IQR): 0.11) and a median DSC of 0.89 (IQR 0.07) and 0.82 (IQR 0.10) in comparison to ERs and ROs, respectively. Radiomics feature stability was high with a median intraclass correlation coefficient of 0.97, 0.95 and 0.94 for GTs, ERs, and ROs, respectively. DLBAS predictions were deemed clinically suitable by the two ROs in 35% and 20% of cases, respectively.

CONCLUSION

The results demonstrate that the DLBAS algorithm provides reproducible VOI predictions for radiomics feature extraction. Variability remains regarding direct clinical applicability of predictions for RT treatment planning.

Multi-sequence MRI radiomics of colorectal liver metastases: Which features are reproducible across readers?

PURPOSE

To assess the inter-reader reproducibility of radiomics features on multiple MRI sequences after segmentations of colorectal liver metastases (CRLM).

METHOD

30 CRLM (in 23 patients) were manually delineated by three readers on MRI before the start of chemotherapy on the contrast enhanced T1-weighted images (CE-T1W) in the portal venous phase, T2-weighted images (T2W) and b800 diffusion weighted images (DWI). DWI delineations were copied to the ADC-maps. 107 radiomics features were extracted per sequence. The intraclass correlation coefficient (ICC) was calculated per feature. Features were considered reproducible if ICC > 0.9.

RESULTS

90% of CE-T1W features were reproducible with a median ICC of 0.98 (range 0.76-1.00). 81% of DWI features were robust with median ICC = 0.97 (range 0.38-1.00). The T2W features had a median ICC of 0.96 (range 0.55-0.99) and were reproducible in 80%. ADC showed the lowest number of reproducible features with 58% and median ICC = 0.91 (range 0.38-0.99) When considering the lower bound of the ICC 95% confidence intervals, 58%, 66%, 54% and 29% reached 0.9 for the CE-T1W, DWI, T2W and ADC features, respectively. The feature class with the best reproducibility differed per sequence.

CONCLUSIONS

The majority of MRI radiomics features from CE-T1W, T2W, DWI and ADC in colorectal liver metastases were robust for segmentation variability between readers. The CE-T1W yielded slightly better reproducibility results compared to DWI and T2W. The ADC features seem more susceptible to reader differences compared to the other three sequences.

Radiomics and liver: Where we are and where we are headed?

Hepatic diffuse conditions and focal liver lesions represent two of the most common scenarios to face in everyday radiological clinical practice. Thanks to the advances in technology, radiology has gained a central role in the management of patients with liver disease, especially due to its high sensitivity and specificity. Since the introduction of computed tomography (CT) and magnetic resonance imaging (MRI), radiology has been considered the non-invasive reference modality to assess and characterize liver pathologies. In recent years, clinical practice has moved forward to a quantitative approach to better evaluate and manage each patient with a more fitted approach. In this setting, radiomics has gained an important role in helping radiologists and clinicians characterize hepatic pathological entities, in managing patients, and in determining prognosis. Radiomics can extract a large amount of data from radiological images, which can be associated with different liver scenarios. Thanks to its wide applications in ultrasonography (US), CT, and MRI, different studies were focused on specific aspects related to liver diseases. Even if broadly applied, radiomics has some advantages and different pitfalls. This review aims to summarize the most important and robust studies published in the field of liver radiomics, underlying their main limitations and issues, and what they can add to the current and future clinical practice and literature.

Radiomics and machine learning analysis by computed tomography and magnetic resonance imaging in colorectal liver metastases prognostic assessment

OBJECTIVE

The aim of this study was the evaluation radiomics analysis efficacy performed using computed tomography (CT) and magnetic resonance imaging in the prediction of colorectal liver metastases patterns linked to patient prognosis: tumor growth front; grade; tumor budding; mucinous type. Moreover, the prediction of liver recurrence was also evaluated.

METHODS

The retrospective study included an internal and validation dataset; the first was composed by 119 liver metastases from 49 patients while the second consisted to 28 patients with single lesion. Radiomic features were extracted using PyRadiomics. Univariate and multivariate approaches including machine learning algorithms were employed.

RESULTS

The best predictor to identify tumor growth was the Wavelet_HLH_glcm_MaximumProbability with an accuracy of 84% and to detect recurrence the best predictor was wavelet_HLH_ngtdm_Complexity with an accuracy of 90%, both extracted by T1-weigthed arterial phase sequence. The best predictor to detect tumor budding was the wavelet_LLH_glcm_Imc1 with an accuracy of 88% and to identify mucinous type was wavelet_LLH_glcm_JointEntropy with an accuracy of 92%, both calculated on T2-weigthed sequence. An increase statistically significant of accuracy (90%) was obtained using a linear weighted combination of 15 predictors extracted by T2-weigthed images to detect tumor front growth. An increase statistically significant of accuracy at 93% was obtained using a linear weighted combination of 11 predictors by the T1-weigthed arterial phase sequence to classify tumor budding. An increase statistically significant of accuracy at 97% was obtained using a linear weighted combination of 16 predictors extracted on CT to detect recurrence. An increase statistically significant of accuracy was obtained in the tumor budding identification considering a K-nearest neighbors and the 11 significant features extracted T1-weigthed arterial phase sequence.

CONCLUSIONS

The results confirmed the Radiomics capacity to recognize clinical and histopathological prognostic features that should influence the choice of treatments in colorectal liver metastases patients to obtain a more personalized therapy.

Radiomic features from multiparametric magnetic resonance imaging predict molecular subgroups of pediatric low-grade gliomas

BACKGROUND

We aimed to develop machine learning models for prediction of molecular subgroups (low-risk group and intermediate/high-risk group) and molecular marker (KIAA1549-BRAF fusion) of pediatric low-grade gliomas (PLGGs) based on radiomic features extracted from multiparametric MRI.

METHODS

61 patients with PLGGs were included in this retrospective study, which were divided into a training set and an internal validation set at a ratio of 2:1 based on the molecular subgroups or the molecular marker. The patients were classified into low-risk and intermediate/high-risk groups, BRAF fusion positive and negative groups, respectively. We extracted 5929 radiomic features from multiparametric MRI. Thereafter, we removed redundant features, trained random forest models on the training set for predicting the molecular subgroups or the molecular marker, and validated their performance on the internal validation set. The performance of the prediction model was verified by 3-fold cross-validation.

RESULTS

We constructed the classification model differentiating low-risk PLGGs from intermediate/high-risk PLGGs using 4 relevant features, with an AUC of 0.833 and an accuracy of 76.2% in the internal validation set. In the prediction model for predicting KIAA1549-BRAF fusion using 4 relevant features, an AUC of 0.818 and an accuracy of 81.0% were achieved in the internal validation set.

CONCLUSIONS

The current study demonstrates that MRI radiomics is able to predict molecular subgroups of PLGGs and KIAA1549-BRAF fusion with satisfying sensitivity.

TRIAL REGISTRATION

This study was retrospectively registered at clinicaltrials.gov (NCT04217018).

Tumor-to-bone distance and radiomic features on MRI distinguish intramuscular lipomas from well-differentiated liposarcomas

Background

To develop a machine learning model based on tumor-to-bone distance and radiomic features derived from preoperative MRI images to distinguish intramuscular (IM) lipomas and atypical lipomatous tumors/well-differentiated liposarcomas (ALTs/WDLSs) and compared with radiologists.

Methods

The study included patients with IM lipomas and ALTs/WDLSs diagnosed between 2010 and 2022, and with MRI scans (sequence/field strength: T1-weighted (T1W) imaging at 1.5 or 3.0 Tesla MRI). Manual segmentation of tumors based on the three-dimensional T1W images was performed by two observers to appraise the intra- and interobserver variability. After radiomic features and tumor-to-bone distance were extracted, it was used to train a machine learning model to distinguish IM lipomas and ALTs/WDLSs. Both feature selection and classification steps were performed using Least Absolute Shrinkage and Selection Operator logistic regression. The performance of the classification model was assessed using a tenfold cross-validation strategy and subsequently evaluated using the receiver operating characteristic curve (ROC) analysis. The classification agreement of two experienced musculoskeletal (MSK) radiologists was assessed using the kappa statistics. The diagnosis accuracy of each radiologist was evaluated using the final pathological results as the gold standard. Additionally, we compared the performance of the model and two radiologists in terms of the area under the receiver operator characteristic curves (AUCs) using the Delong’s test.

Results

There were 68 tumors (38 IM lipomas and 30 ALTs/WDLSs). The AUC of the machine learning model was 0.88 [95% CI 0.72–1] (sensitivity, 91.6%; specificity, 85.7%; and accuracy, 89.0%). For Radiologist 1, the AUC was 0.94 [95% CI 0.87–1] (sensitivity, 97.4%; specificity, 90.9%; and accuracy, 95.0%), and as to Radiologist 2, the AUC was 0.91 [95% CI 0.83–0.99] (sensitivity, 100%; specificity, 81.8%; and accuracy, 93.3%). The classification agreement of the radiologists was 0.89 of kappa value (95% CI 0.76–1). Although the AUC of the model was lower than of two experienced MSK radiologists, there was no statistically significant difference between the model and two radiologists (all P > 0.05).

Conclusions

The novel machine learning model based on tumor-to-bone distance and radiomic features is a noninvasive procedure that has the potential for distinguishing IM lipomas from ALTs/WDLSs. The predictive features that suggested malignancy were size, shape, depth, texture, histogram, and tumor-to-bone distance.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13018-023-03718-4.

Colorectal liver metastases patients prognostic assessment: prospects and limits of radiomics and radiogenomics

In this narrative review, we reported un up-to-date on the role of radiomics to assess prognostic features, which can impact on the liver metastases patient treatment choice. In the liver metastases patients, the possibility to assess mutational status (RAS or MSI), the tumor growth pattern and the histological subtype (NOS or mucinous) allows a better treatment selection to avoid unnecessary therapies. However, today, the detection of these features require an invasive approach. Recently, radiomics analysis application has improved rapidly, with a consequent growing interest in the oncological field. Radiomics analysis allows the textural characteristics assessment, which are correlated to biological data. This approach is captivating since it should allow to extract biological data from the radiological images, without invasive approach, so that to reduce costs and time, avoiding any risk for the patients. Several studies showed the ability of Radiomics to identify mutational status, tumor growth pattern and histological type in colorectal liver metastases. Although, radiomics analysis in a non-invasive and repeatable way, however features as the poor standardization and generalization of clinical studies results limit the translation of this analysis into clinical practice. Clear limits are data-quality control, reproducibility, repeatability, generalizability of results, and issues related to model overfitting.

The Additive Value of Radiomics Features Extracted from Baseline MR Images to the Barcelona Clinic Liver Cancer (BCLC) Staging System in Predicting Transplant-Free Survival in Patients with Hepatocellular Carcinoma: A Single-Center Retrospective Analysis

BACKGROUND

To study the additive value of radiomics features to the BCLC staging system in clustering HCC patients.

METHODS

A total of 266 patients with HCC were included in this retrospective study. All patients had undergone baseline MR imaging, and 95 radiomics features were extracted from 3D segmentations representative of lesions on the venous phase and apparent diffusion coefficient maps. A random forest algorithm was utilized to extract the most relevant features to transplant-free survival. The selected features were used alongside BCLC staging to construct Kaplan-Meier curves.

RESULTS

Out of 95 extracted features, the three most relevant features were incorporated into random forest classifiers. The Integrated Brier score of the prediction error curve was 0.135, 0.072, and 0.048 for the BCLC, radiomics, and combined models, respectively. The mean area under the receiver operating curve (ROC curve) over time for the three models was 81.1%, 77.3%, and 56.2% for the combined radiomics and BCLC models, respectively.

CONCLUSIONS

Radiomics features outperformed the BCLC staging system in determining prognosis in HCC patients. The addition of a radiomics classifier increased the classification capability of the BCLC model. Texture analysis features could be considered as possible biomarkers in predicting transplant-free survival in HCC patients.

Robustness of Radiomic Features: Two-Dimensional versus Three-Dimensional MRI-Based Feature Reproducibility in Lipomatous Soft-Tissue Tumors

This retrospective study aimed to compare the intra- and inter-observer manual-segmentation variability in the feature reproducibility between two-dimensional (2D) and three-dimensional (3D) magnetic-resonance imaging (MRI)-based radiomic features. The study included patients with lipomatous soft-tissue tumors that were diagnosed with histopathology and underwent MRI scans. Tumor segmentation based on the 2D and 3D MRI images was performed by two observers to assess the intra- and inter-observer variability. In both the 2D and the 3D segmentations, the radiomic features were extracted from the normalized images. Regarding the stability of the features, the intraclass correlation coefficient (ICC) was used to evaluate the intra- and inter-observer segmentation variability. Features with ICC > 0.75 were considered reproducible. The degree of feature robustness was classified as low, moderate, or high. Additionally, we compared the efficacy of 2D and 3D contour-focused segmentation in terms of the effects of the stable feature rate, sensitivity, specificity, and diagnostic accuracy of machine learning on the reproducible features. In total, 93 and 107 features were extracted from the 2D and 3D images, respectively. Only 35 features from the 2D images and 63 features from the 3D images were reproducible. The stable feature rate for the 3D segmentation was more significant than for the 2D segmentation (58.9% vs. 37.6%, p = 0.002). The majority of the features for the 3D segmentation had moderate-to-high robustness, while 40.9% of the features for the 2D segmentation had low robustness. The diagnostic accuracy of the machine-learning model for the 2D segmentation was close to that for the 3D segmentation (88% vs. 90%). In both the 2D and the 3D segmentation, the specificity values were equal to 100%. However, the sensitivity for the 2D segmentation was lower than for the 3D segmentation (75% vs. 83%). For the 2D + 3D radiomic features, the model achieved a diagnostic accuracy of 87% (sensitivity, 100%, and specificity, 80%). Both 2D and 3D MRI-based radiomic features of lipomatous soft-tissue tumors are reproducible. With a higher stable feature rate, 3D contour-focused segmentation should be selected for the feature-extraction process.

Comprehensive prognostic modeling of locoregional recurrence after radiotherapy for patients with locoregionally advanced hypopharyngeal squamous cell carcinoma

Purpose

To propose and evaluate a comprehensive modeling approach combing radiomics, dosiomics and clinical components, for more accurate prediction of locoregional recurrence risk after radiotherapy for patients with locoregionally advanced HPSCC.

Materials and methods

Clinical data of 77 HPSCC patients were retrospectively investigated, whose median follow-up duration was 23.27 (4.83-81.40) months. From the planning CT and dose distribution, 1321 radiomics and dosiomics features were extracted respectively from planning gross tumor volume (PGTV) region each patient. After stability test, feature dimension was further reduced by Principal Component Analysis (PCA), yielding Radiomic and Dosiomic Principal Components (RPCs and DPCs) respectively. Multiple Cox regression models were constructed using various combinations of RPC, DPC and clinical variables as the predictors. Akaike information criterion (AIC) and C-index were used to evaluate the performance of Cox regression models.

Results

PCA was performed on 338 radiomic and 873 dosiomic features that were tested as stable (ICC₁ > 0.7 and ICC₂ > 0.95), yielding 5 RPCs and DPCs respectively. Three comprehensive features (RPC0, P<0.01, DPC0, P<0.01 and DPC3, P<0.05) were found to be significant in the individual Radiomic or Dosiomic Cox regression models. The model combining the above features and clinical variable (total stage IVB) provided best risk stratification of locoregional recurrence (C-index, 0.815; 95%CI, 0.770-0.859) and prevailing balance between predictive accuracy and complexity (AIC, 143.65) than any other investigated models using either single factors or two combined components.

Conclusion

This study provided quantitative tools and additional evidence for the personalized treatment selection and protocol optimization for HPSCC, a relatively rare cancer. By combining complementary information from radiomics, dosiomics, and clinical variables, the proposed comprehensive model provided more accurate prediction of locoregional recurrence risk after radiotherapy.

Use of radiomics containing an effective peritumoral area to predict early recurrence of solitary hepatocellular carcinoma ≤5 cm in diameter

Background

Hepatocellular carcinoma (HCC) is the sixth leading type of cancer worldwide. We aimed to develop a preoperative predictive model of the risk of early tumor recurrence after HCC treatment based on radiomic features of the peritumoral region and evaluate the performance of this model against postoperative pathology.

Method

Our model was developed using a retrospective analysis of imaging and clinicopathological data of 175 patients with an isolated HCC ≤5 cm in diameter; 117 patients were used for model training and 58 for model validation. The peritumoral area was delineated layer-by-layer for the arterial and portal vein phase on preoperative dynamic enhanced computed tomography images. The volume area of interest was expanded by 5 and 10 mm and the radiomic features of these areas extracted. Lasso was used to select the most stable features.

Results

The radiomic features of the 5-mm area were sufficient for prediction of early tumor recurrence, with an area under the curve (AUC) value of 0.706 for the validation set and 0.837 for the training set using combined images. The AUC of the model using clinicopathological information alone was 0.753 compared with 0.786 for the preoperative radiomics model (P >0.05).

Conclusions

Radiomic features of a 5-mm peritumoral region may provide a non-invasive biomarker for the preoperative prediction of the risk of early tumor recurrence for patients with a solitary HCC ≤5 cm in diameter. A fusion model that combines the radiomic features of the peritumoral region and postoperative pathology could contribute to individualized treatment of HCC.

A Review of Radiomics in Predicting Therapeutic Response in Colorectal Liver Metastases: From Traditional to Artificial Intelligence Techniques

An early evaluation of colorectal cancer liver metastasis (CRCLM) is crucial in determining treatment options that ultimately affect patient survival rates and outcomes. Radiomics (quantitative imaging features) have recently gained popularity in diagnostic and therapeutic strategies. Despite this, radiomics faces many challenges and limitations. This study sheds light on these limitations by reviewing the studies that used radiomics to predict therapeutic response in CRCLM. Despite radiomics’ potential to enhance clinical decision-making, it lacks standardization. According to the results of this study, the instability of radiomics quantification is caused by changes in CT scan parameters used to obtain CT scans, lesion segmentation methods used for contouring liver metastases, feature extraction methods, and dataset size used for experimentation and validation. Accordingly, the study recommends combining radiomics with deep learning to improve prediction accuracy.

Enhancing the stability of CT radiomics across different volume of interest sizes using parametric feature maps: a phantom study

BACKGROUND

In radiomics studies, differences in the volume of interest (VOI) are often inevitable and may confound the extracted features. We aimed to correct this confounding effect of VOI variability by applying parametric maps with a fixed voxel size.

METHODS

Ten scans of a cup filled with sodium chloride solution were scanned using a multislice computed tomography (CT) unit. Sphere-shaped VOIs with different diameters (4, 8, or 16 mm) were drawn centrally into the phantom. A total of 93 features were extracted conventionally from the original images using PyRadiomics. Using a self-designed and pretested software tool, parametric maps for the same 93 features with a fixed voxel size of 4 mm3 were created. To retrieve the feature values from the maps, VOIs were copied from the original images to preserve the position. Differences in feature quantities between the VOI sizes were tested with the Mann-Whitney U-test and agreement with overall concordance correlation coefficients (OCCC).

RESULTS

Fifty-five conventionally extracted features were significantly different between the VOI sizes, and none of the features showed excellent agreement in terms of OCCCs. When read from the parametric maps, only 8 features showed significant differences, and 3 features showed an excellent OCCC (≥ 0.85). The OCCCs for 89 features substantially increased using the parametric maps.

CONCLUSIONS

This phantom study shows that converting CT images into parametric maps resolves the confounding effect of VOI variability and increases feature reproducibility across VOI sizes.

Atlas-Based Lung Segmentation Combined With Automatic Densitometry Characterization In COVID-19 Patients: Training, Validation And First Application In A Longitudinal Study

Purpose

To develop and validate an automated segmentation tool for COVID-19 lung CTs. To combine it with densitometry information in identifying Aerated, Intermediate and Consolidated Volumes in admission (CT1) and follow up CT (CT3).

Materials and Methods

An Atlas was trained on manually segmented CT1 of 250 patients and validated on 10 CT1 of the training group, 10 new CT1 and 10 CT3, by comparing DICE index between automatic (AUTO), automatic-corrected (AUTOMAN) and manual (MAN) contours. A previously developed automatic method was applied on HU lung density histograms to quantify Aerated, Intermediate and Consolidated Volumes. Volumes of subregions in validation CT1 and CT3 were quantified for each method.

Results

In validation CT1/CT3, manual correction of automatic contours was not necessary in 40% of cases. Mean DICE values for both lungs were 0.94 for AUTOVsMAN and 0.96 for AUTOMANVsMAN. Differences between Aerated and Intermediate Volumes quantified with AUTOVsMAN contours were always < 6%. Consolidated Volumes showed larger differences (mean: −95 ± 72 cc). If considering AUTOMANVsMAN volumes, differences got further smaller for Aerated and Intermediate, and were drastically reduced for consolidated Volumes (mean: −36 ± 25 cc). The average time for manual correction of automatic lungs contours on CT1 was 5 ± 2 min.

Conclusions

An Atlas for automatic segmentation of lungs in COVID-19 patients was developed and validated. Combined with a previously developed method for lung densitometry characterization, it provides a fast, operator-independent way to extract relevant quantitative parameters with minimal manual intervention.

Association of CT-Based Delta Radiomics Biomarker With Progression-Free Survival in Patients With Colorectal Liver Metastases Undergo Chemotherapy

Predicting the prognosis of patients in advance is conducive to providing personalized treatment for patients. Our aim was to predict the therapeutic efficacy and progression free survival (PFS) of patients with liver metastasis of colorectal cancer according to the changes of computed tomography (CT) radiomics before and after chemotherapy.

Methods

This retrospective study included 139 patients (397 lesions) with colorectal liver metastases who underwent neoadjuvant chemotherapy from April 2015 to April 2020. We divided the lesions into training cohort and testing cohort with a ratio of 7:3. Two - dimensional region of interest (ROI) was obtained by manually delineating the largest layers of each metastasis lesion. The expanded ROI (3 mm and 5 mm) were also included in the study to characterize microenvironment around tumor. For each of the ROI, 1,316 radiomics features were extracted from delineated plain scan, arterial, and venous phase CT images before and after neoadjuvant chemotherapy. Delta radiomics features were constructed by subtracting the radiomics features after treatment from the radiomics features before treatment. Univariate Cox regression and the Least Absolute Shrinkage and Selection Operator (LASSO) Cox regression were applied in the training cohort to select the valuable features. Based on clinical characteristics and radiomics features, 7 Cox proportional-hazards model were constructed to predict the PFS of patients. C-index value and Kaplan Meier (KM) analysis were used to evaluate the efficacy of predicting PFS of these models. Moreover, the prediction performance of one-year PFS was also evaluated by area under the curve (AUC).

Results

Compared with the PreRad (Radiomics form pre-treatment CT images; C-index [95% confidence interval (CI)] in testing cohort: 0.614(0.552-0.675) and PostRad models (Radiomics form post-treatment CT images; 0.642(0.578-0.707), the delta model has better PFS prediction performance (Delta radiomics; 0.688(0.627-0.749). By incorporating clinical characteristics, CombDeltaRad obtains the best performance in both training cohort [C-index (95% CI): 0.802(0.772-0.832)] and the testing cohort (0.744(0.686-0.803). For 1-year PFS prediction, CombDeltaRad model obtained the best performance with AUC (95% CI) of 0.871(0.828-0.914) and 0.745 (0.651-0.838) in training cohort and testing cohort, respectively.

Conclusion

CT radiomics features have the potential to predict PFS in patients with colorectal cancer and liver metastasis who undergo neoadjuvant chemotherapy. By combining pre-treatment radiomics features, post-treatment radiomics features, and clinical characteristics better prediction results can be achieved.

Radiomics textural features by MR imaging to assess clinical outcomes following liver resection in colorectal liver metastases

PURPOSE

To assess the efficacy of radiomics features obtained by T2-weighted sequences to predict clinical outcomes following liver resection in colorectal liver metastases patients.

METHODS

This retrospective analysis was approved by the local Ethical Committee board and radiological databases were interrogated, from January 2018 to May 2021, to select patients with liver metastases with pathological proof and MRI study in pre-surgical setting. The cohort of patients included a training set and an external validation set. The internal training set included 51 patients with 61 years of median age and 121 liver metastases. The validation cohort consisted a total of 30 patients with single lesion with 60 years of median age. For each volume of interest, 851 radiomics features were extracted as median values using PyRadiomics. Nonparametric test, intraclass correlation, receiver operating characteristic (ROC) analysis, linear regression modelling and pattern recognition methods (support vector machine (SVM), k-nearest neighbours (KNN), artificial neural network (NNET) and decision tree (DT)) were considered.

RESULTS

The best predictor to discriminate expansive versus infiltrative front of tumour growth was obtained by wavelet_LHL_gldm_DependenceNonUniformityNormalized with an accuracy of 82%; to discriminate high grade versus low grade or absent was the wavelet_LLH_glcm_Imc1 with accuracy of 88%; to differentiate the mucinous type of tumour was the wavelet_LLH_glcm_JointEntropy with accuracy of 92% while to identify tumour recurrence was the wavelet_LLL_glcm_Correlation with accuracy of 85%. Linear regression model increased the performance obtained with respect to the univariate analysis exclusively in the discrimination of expansive versus infiltrative front of tumour growth reaching an accuracy of 90%, a sensitivity of 95% and a specificity of 80%. Considering significant texture metrics tested with pattern recognition approaches, the best performance was reached by the KNN in the discrimination of the tumour budding considering the four textural predictors obtaining an accuracy of 93%, a sensitivity of 81% and a specificity of 97%.

CONCLUSIONS

Ours results confirmed the capacity of radiomics to identify as biomarkers, several prognostic features that could affect the treatment choice in patients with liver metastases, in order to obtain a more personalized approach.

CT-Based Radiomics Analysis to Predict Histopathological Outcomes Following Liver Resection in Colorectal Liver Metastases

Simple Summary

The objective of the study was to assess the radiomic features obtained by computed tomography (CT) examination as prognostic biomarkers in patients with colorectal liver metastases, in order to predict histopathological outcomes following liver resection. We obtained good performance considering the single significant textural metric in the identification of the front of tumor growth (expansive versus infiltrative) and tumor budding (high grade versus low grade or absent), in the recognition of mucinous type, and in the detection of recurrences.

Abstract

Purpose: We aimed to assess the efficacy of radiomic features extracted by computed tomography (CT) in predicting histopathological outcomes following liver resection in colorectal liver metastases patients, evaluating recurrence, mutational status, histopathological characteristics (mucinous), and surgical resection margin. Methods: This retrospectively approved study included a training set and an external validation set. The internal training set included 49 patients with a median age of 60 years and 119 liver colorectal metastases. The validation cohort consisted of 28 patients with single liver colorectal metastasis and a median age of 61 years. Radiomic features were extracted using PyRadiomics on CT portal phase. Nonparametric Kruskal–Wallis tests, intraclass correlation, receiver operating characteristic (ROC) analyses, linear regression modeling, and pattern recognition methods (support vector machine (SVM), k-nearest neighbors (KNN), artificial neural network (NNET), and decision tree (DT)) were considered. Results: The median value of intraclass correlation coefficients for the features was 0.92 (range 0.87–0.96). The best performance in discriminating expansive versus infiltrative front of tumor growth was wavelet_HHL_glcm_Imc2, with an accuracy of 79%, a sensitivity of 84%, and a specificity of 67%. The best performance in discriminating expansive versus tumor budding was wavelet_LLL_firstorder_Mean, with an accuracy of 86%, a sensitivity of 91%, and a specificity of 65%. The best performance in differentiating the mucinous type of tumor was original_firstorder_RobustMeanAbsoluteDeviation, with an accuracy of 88%, a sensitivity of 42%, and a specificity of 100%. The best performance in identifying tumor recurrence was the wavelet_HLH_glcm_Idmn, with an accuracy of 85%, a sensitivity of 81%, and a specificity of 88%. The best linear regression model was obtained with the identification of recurrence considering the linear combination of the 16 significant textural metrics (accuracy of 97%, sensitivity of 94%, and specificity of 98%). The best performance for each outcome was reached using KNN as a classifier with an accuracy greater than 86% in the training and validation sets for each classification problem; the best results were obtained with the identification of tumor front growth considering the seven significant textural features (accuracy of 97%, sensitivity of 90%, and specificity of 100%). Conclusions: This study confirmed the capacity of radiomics data to identify several prognostic features that may affect the treatment choice in patients with liver metastases, in order to obtain a more personalized approach.

EOB-MR Based Radiomics Analysis to Assess Clinical Outcomes following Liver Resection in Colorectal Liver Metastases

Simple Summary

The aim of this study was to assess the efficacy of radiomics features obtained by EOB-MRI phase in order to predict clinical outcomes following liver resection in Colorectal Liver Metastases Patients, and evaluate recurrence, mutational status, pathological characteristic (mucinous) and surgical resection margin. Ours results confirmed the capacity of radiomics to identify, as biomarkers, several prognostic features that could affect the treatment choice in patients with liver metastases, in order to obtain a more personalized approach. These results were confirmed by external validation dataset. We obtained a good performance considering the single textural significant metric in the identification of front of tumor growth (expansive versus infiltrative) and tumor budding (high grade versus low grade or absent), in the recognition of mucinous type and in the detection of recurrences.

Abstract

The aim of this study was to assess the efficacy of radiomics features obtained by EOB-MRI phase in order to predict clinical outcomes following liver resection in Colorectal Liver Metastases Patients, and evaluate recurrence, mutational status, pathological characteristic (mucinous) and surgical resection margin. This retrospective analysis was approved by the local Ethical Committee board of National Cancer of Naples, IRCCS “Fondazione Pascale”. Radiological databases were interrogated from January 2018 to May 2021 in order to select patients with liver metastases with pathological proof and EOB-MRI study in pre-surgical setting. The cohort of patients included a training set (51 patients with 61 years of median age and 121 liver metastases) and an external validation set (30 patients with single lesion with 60 years of median age). For each segmented volume of interest by 2 expert radiologists, 851 radiomics features were extracted as median values using PyRadiomics. non-parametric test, intraclass correlation, receiver operating characteristic (ROC) analysis, linear regression modelling and pattern recognition methods (support vector machine (SVM), k-nearest neighbors (KNN), artificial neural network (NNET), and decision tree (DT)) were considered. The best predictor to discriminate expansive versus infiltrative front of tumor growth was HLH_glcm_MaximumProbability extraxted on VIBE_FA30 with an accuracy of 84%, a sensitivity of 83%, and a specificity of 82%. The best predictor to discriminate tumor budding was Inverse Variance obtained by the original GLCM matrix extraxted on VIBE_FA30 with an accuracy of 89%, a sensitivity of 96% and a specificity of 65%. The best predictor to differentiate the mucinous type of tumor was the HHL_glszm_ZoneVariance extraxted on VIBE_FA30 with an accuracy of 85%, a sensitivity of 46% and a specificity of 95%. The best predictor to identify tumor recurrence was the LHL_glcm_Correlation extraxted on VIBE_FA30 with an accuracy of 86%, a sensitivity of 52% and a specificity of 97%. The best linear regression model was obtained in the identification of the tumor growth front considering the height textural significant metrics by VIBE_FA10 (an accuracy of 89%; sensitivity of 93% and a specificity of 82%). Considering significant texture metrics tested with pattern recognition approaches, the best performance for each outcome was reached by a KNN in the identification of recurrence with the 3 textural significant features extracted by VIBE_FA10 (AUC of 91%, an accuracy of 93%; sensitivity of 99% and a specificity of 77%). Ours results confirmed the capacity of radiomics to identify as biomarkers, several prognostic features that could affect the treatment choice in patients with liver metastases, in order to obtain a more personalized approach.

Contrast MR-Based Radiomics and Machine Learning Analysis to Assess Clinical Outcomes following Liver Resection in Colorectal Liver Metastases: A Preliminary Study

Simple Summary

The objective of the study was to evaluate the radiomics features obtained by contrast MRI studies as prognostic biomarkers in colorectal liver metastases patients to predict clinical outcomes following liver resection. We demonstrated a good performance considering the single textural significant metric in the identification of front of tumor growth (expansive versus infiltrative) and tumor budding (high grade versus low grade or absent), in the recognition of mucinous type and in the detection of recurrences. Moreover, considering linear regression models or neural network classifiers in a multivariate approach was possible to increase the performance in terms of accuracy, sensitivity, and specificity.

Abstract

Purpose: To assess radiomics features efficacy obtained by arterial and portal MRI phase in the prediction of clinical outcomes in the colorectal liver metastases patients, evaluating recurrence, mutational status, pathological characteristic (mucinous and tumor budding) and surgical resection margin. Methods: This retrospective analysis was approved by the local Ethical Committee board, and radiological databases were used to select patients with colorectal liver metastases with pathological proof and MRI study in a pre-surgical setting after neoadjuvant chemotherapy. The cohort of patients included a training set (51 patients with 61 years of median age and 121 liver metastases) and an external validation set (30 patients with single lesion with 60 years of median age). For each segmented volume of interest on MRI by two expert radiologists, 851 radiomics features were extracted as median values using the PyRadiomics tool. Non-parametric Kruskal-Wallis test, intraclass correlation, receiver operating characteristic (ROC) analysis, linear regression modelling and pattern recognition methods (support vector machine (SVM), k-nearest neighbors (KNN), artificial neural network (NNET), and decision tree (DT)) were considered. Results: The best predictor to discriminate expansive versus infiltrative tumor growth front was wavelet_LHH_glrlm_ShortRunLowGrayLevelEmphasis extracted on portal phase with accuracy of 82%, sensitivity of 84%, and specificity of 77%. The best predictor to discriminate tumor budding was wavelet_LLH_firstorder_10Percentile extracted on portal phase with accuracy of 92%, a sensitivity of 96%, and a specificity of 81%. The best predictor to differentiate the mucinous type of tumor was the wavelet_LLL_glcm_ClusterTendency extracted on portal phase with accuracy of 88%, a sensitivity of 38%, and a specificity of 100%. The best predictor to identify the recurrence was the wavelet_HLH_ngtdm_Complexity extracted on arterial phase with accuracy of 90%, a sensitivity of 71%, and a specificity of 95%. The best linear regression model was obtained in the identification of mucinous type considering the 13 textural significant metrics extracted by arterial phase (accuracy of 94%, sensitivity of 77% and a specificity of 99%). The best results were obtained in the identification of tumor budding with the eleven textural significant features extracted by arterial phase using a KNN (accuracy of 95%, sensitivity of 84%, and a specificity of 99%). Conclusions: Our results confirmed the capacity of radiomics to identify as biomarkers and several prognostic features that could affect the treatment choice in patients with liver metastases in order to obtain a more personalized approach.

Delta-Radiomics Predicts Response to First-Line Oxaliplatin-Based Chemotherapy in Colorectal Cancer Patients with Liver Metastases

Simple Summary

Oxaliplatin-based chemotherapy remains the mainstay of first-line therapy in patients with metastatic colorectal cancer (mCRC). Unfortunately, only approximately 60% of treated patients achieve response, and half of responders will experience an early onset of disease progression. Furthermore, some individuals will develop a mixed response due to the emergence of resistant tumor subclones. The ability to predicting which patients will acquire resistance could help them avoid the unnecessary toxicity of oxaliplatin therapies. Furthermore, sorting out lesions that do not respond, in the context of an overall good response, could trigger further investigation into their mutational landscape, providing mechanistic insight towards the planning of a more comprehensive treatment. In this study, we validated a delta-radiomics signature capable of predicting response to oxaliplatin-based first-line treatment of individual liver colorectal cancer metastases. Findings could pave the way to a more personalized treatment of patients with mCRC.

Abstract

The purpose of this paper is to develop and validate a delta-radiomics score to predict the response of individual colorectal cancer liver metastases (lmCRC) to first-line FOLFOX chemotherapy. Three hundred one lmCRC were manually segmented on both CT performed at baseline and after the first cycle of first-line FOLFOX, and 107 radiomics features were computed by subtracting textural features of CT at baseline from those at timepoint 1 (TP1). LmCRC were classified as nonresponders (R−) if they showed progression of disease (PD), according to RECIST1.1, before 8 months, and as responders (R+), otherwise. After feature selection, we developed a decision tree statistical model trained using all lmCRC coming from one hospital. The final output was a delta-radiomics signature subsequently validated on an external dataset. Sensitivity, specificity, positive (PPV), and negative (NPV) predictive values in correctly classifying individual lesions were assessed on both datasets. Per-lesion sensitivity, specificity, PPV, and NPV were 99%, 94%, 95%, 99%, 85%, 92%, 90%, and 87%, respectively, in the training and validation datasets. The delta-radiomics signature was able to reliably predict R− lmCRC, which were wrongly classified by lesion RECIST as R+ at TP1, (93%, averaging training and validation set, versus 67% of RECIST). The delta-radiomics signature developed in this study can reliably predict the response of individual lmCRC to oxaliplatin-based chemotherapy. Lesions forecasted as poor or nonresponders by the signature could be further investigated, potentially paving the way to lesion-specific therapies.

Advances in liver US, CT, and MRI: moving toward the future

Over the past two decades, the epidemiology of chronic liver disease has changed with an increase in the prevalence of nonalcoholic fatty liver disease in parallel to the advent of curative treatments for hepatitis C. Recent developments provided new tools for diagnosis and monitoring of liver diseases based on ultrasound (US), computed tomography (CT), and magnetic resonance imaging (MRI), as applied for assessing steatosis, fibrosis, and focal lesions. This narrative review aims to discuss the emerging approaches for qualitative and quantitative liver imaging, focusing on those expected to become adopted in clinical practice in the next 5 to 10 years. While radiomics is an emerging tool for many of these applications, dedicated techniques have been investigated for US (controlled attenuation parameter, backscatter coefficient, elastography methods such as point shear wave elastography [pSWE] and transient elastography [TE], novel Doppler techniques, and three-dimensional contrast-enhanced ultrasound [3D-CEUS]), CT (dual-energy, spectral photon counting, extracellular volume fraction, perfusion, and surface nodularity), and MRI (proton density fat fraction [PDFF], elastography [MRE], contrast enhancement index, relative enhancement, T1 mapping on the hepatobiliary phase, perfusion). Concurrently, the advent of abbreviated MRI protocols will help fulfill an increasing number of examination requests in an era of healthcare resource constraints.

Assessment of CT to CBCT contour mapping for radiomic feature analysis in prostate cancer

This study provides a quantitative assessment of the accuracy of a commercially available deformable image registration (DIR) algorithm to automatically generate prostate contours and additionally investigates the robustness of radiomic features to differing contours. Twenty-eight prostate cancer patients enrolled on an institutional review board (IRB) approved protocol were selected. Planning CTs (pCTs) were deformably registered to daily cone-beam CTs (CBCTs) to generate prostate contours (auto contours). The prostate contours were also manually drawn by a physician. Quantitative assessment of deformed versus manually drawn prostate contours on daily CBCT images was performed using Dice similarity coefficient (DSC), mean distance-to-agreement (MDA), difference in center-of-mass position (ΔCM) and difference in volume (ΔVol). Radiomic features from 6 classes were extracted from each contour. Lin’s concordance correlation coefficient (CCC) and mean absolute percent difference in radiomic feature-derived data (mean |%Δ|RF) between auto and manual contours were calculated. The mean (± SD) DSC, MDA, ΔCM and ΔVol between the auto and manual prostate contours were 0.90 ± 0.04, 1.81 ± 0.47 mm, 2.17 ± 1.26 mm and 5.1 ± 4.1% respectively. Of the 1,010 fractions under consideration, 94.8% of DIRs were within TG-132 recommended tolerance. 30 radiomic features had a CCC > 0.90 and 21 had a mean |%∆|RF < 5%. Auto-propagation of prostate contours resulted in nearly 95% of DIRs within tolerance recommendations of TG-132, leading to the majority of features being regarded as acceptably robust. The use of auto contours for radiomic feature analysis is promising but must be done with caution.

Radiogenomics: Hunting Down Liver Metastasis in Colorectal Cancer Patients

Simple Summary

Colorectal cancer (CRC) is the third leading cause of cancer and the second most deadly tumor type in the world. The liver is the most common site of metastasis in CRC patients. The conversion of new imaging biomarkers into diagnostic, prognostic and predictive signatures, by the development of radiomics and radiogenomics, is an important potential new tool for the clinical management of cancer patients. In this review, we assess the knowledge gained from radiomics and radiogenomics studies in liver metastatic colorectal cancer patients and their possible use for early diagnosis, response assessment and treatment decisions.

Abstract

Radiomics is a developing new discipline that analyzes conventional medical images to extract quantifiable data that can be mined for new biomarkers that show the biology of pathological processes at microscopic levels. These data can be converted into image-based signatures to improve diagnostic, prognostic and predictive accuracy in cancer patients. The combination of radiomics and molecular data, called radiogenomics, has clear implications for cancer patients’ management. Though some studies have focused on radiogenomics signatures in hepatocellular carcinoma patients, only a few have examined colorectal cancer metastatic lesions in the liver. Moreover, the need to differentiate between liver lesions is fundamental for accurate diagnosis and treatment. In this review, we summarize the knowledge gained from radiomics and radiogenomics studies in hepatic metastatic colorectal cancer patients and their use in early diagnosis, response assessment and treatment decisions. We also investigate their value as possible prognostic biomarkers. In addition, the great potential of image mining to provide a comprehensive view of liver niche formation is examined thoroughly. Finally, new challenges and current limitations for the early detection of the liver premetastatic niche, based on radiomics and radiogenomics, are also discussed.

Robustness and performance of radiomic features in diagnosing cystic renal masses

PURPOSE

We study the inter-reader variability in manual delineation of cystic renal masses (CRMs) presented in computerized tomography (CT) images and its effect on the classification performance of a machine learning algorithm in distinguishing benign from potentially malignant CRMs. In addition, we assessed whether the inclusion of higher-order robust radiomic features improves the classification performance over the use of first-order features.

METHODS

230 CRMs were independently delineated by two radiologists. Through a combination of random fluctuations, dilation, and erosion operations over the original region of interests (ROIs), we generated four additional sets of synthetic ROIs to capture the inter-reader variability realistically, as confirmed by dice coefficient measurements and visual assessment. We then identified the robust features based on the intra-class coefficient (ICC > 0.85) across these datasets. We applied a tenfold stratified cross-validation (CV) to train and test the performance of the random forest model for the classification of CRMs into benign and potentially malignant.

RESULTS

The mean area under the curve (AUC), sensitivity, specificity, positive predictive value, and negative predictive value were 0.87, 0.82, 0.90, 0.85, and 0.93, respectively. With the usage of first-order features alone, the corresponding values were nearly identical.

CONCLUSION

AUC ranged for the robust and uncorrelated features from 0.83 ± 0.09 to 0.93 ± 0.04 and for the first-order features from 0.84 ± 0.09 to 0.91 ± 0.04. Our study indicates that the first-order features alone are sufficient for the classification of CRMs, and that inclusion of higher-order features does not necessarily improve performance.

Integrated prognostication of intrahepatic cholangiocarcinoma by contrast-enhanced computed tomography: the adjunct yield of radiomics

Purpose

To test radiomics for prognostication of intrahepatic mass-forming cholangiocarcinoma (IMCC) and to develop a comprehensive risk model.

Methods

Histologically proven IMCC (representing the full range of stages) were retrospectively analyzed by volume segmentation on baseline hepatic venous phase computed tomography (CT), by two readers with different experience (R1 and R2). Morphological CT features included: tumor size, hepatic satellite lesions, lymph node and distant metastases. Radiomic features (RF) were compared across CT protocols and readers. Univariate analysis against overall survival (OS) warranted ranking and selection of RF into radiomic signature (RSign), which was dichotomized into high and low-risk strata (RSign*). Models without and with RSign* (Model 1 and 2, respectively) were compared.

Results

Among 78 patients (median follow-up 262 days, IQR 73–957), 62/78 (79%) died during the study period, 46/78 (59%) died within 1 year. Up to 10% RF showed variability across CT protocols; 37/108 (34%) RF showed variability due to manual segmentation. RSign stratified OS (univariate: HR 1.37 for R1, HR 1.28 for R2), RSign* was different between readers (R1 0.39; R2 0.57). Model 1 showed AUC 0.71, which increased in Model 2: AUC 0.81 (p < 0.001) and AIC 89 for R1, AUC 0.81 (p = 0.001) and AIC 90.2 for R2.

Conclusion

The use of RF into a unified RSign score stratified OS in patients with IMCC. Dichotomized RSign* classified survival strata, its inclusion in risk models showed adjunct yield. The cut-off value of RSign* was different between readers, suggesting that the use of reference values is hampered by interobserver variability.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00261-021-03183-9.

Automatic lung segmentation in COVID-19 patients: Impact on quantitative computed tomography analysis

Purpose

To assess the impact of lung segmentation accuracy in an automatic pipeline for quantitative analysis of CT images.

Methods

Four different platforms for automatic lung segmentation based on convolutional neural network (CNN), region-growing technique and atlas-based algorithm were considered. The platforms were tested using CT images of 55 COVID-19 patients with severe lung impairment. Four radiologists assessed the segmentations using a 5-point qualitative score (QS). For each CT series, a manually revised reference segmentation (RS) was obtained. Histogram-based quantitative metrics (QM) were calculated from CT histogram using lung segmentationsfrom all platforms and RS. Dice index (DI) and differences of QMs (ΔQMs) were calculated between RS and other segmentations.

Results

Highest QS and lower ΔQMs values were associated to the CNN algorithm. However, only 45% CNN segmentations were judged to need no or only minimal corrections, and in only 17 cases (31%), automatic segmentations provided RS without manual corrections. Median values of the DI for the four algorithms ranged from 0.993 to 0.904. Significant differences for all QMs calculated between automatic segmentations and RS were found both when data were pooled together and stratified according to QS, indicating a relationship between qualitative and quantitative measurements. The most unstable QM was the histogram 90th percentile, with median ΔQMs values ranging from 10HU and 158HU between different algorithms.

Conclusions

None of tested algorithms provided fully reliable segmentation. Segmentation accuracy impacts differently on different quantitative metrics, and each of them should be individually evaluated according to the purpose of subsequent analyses.

Radiomics in Oncology, Part 1: Technical Principles and Gastrointestinal Application in CT and MRI

Simple Summary

Part I is an overview aimed to investigate some technical principles and the main fields of radiomic application in gastrointestinal oncologic imaging (CT and MRI) with a focus on diagnosis, prediction prognosis, and assessment of response to therapy in gastrointestinal cancers, describing mostly the results for each pre-eminent tumor. In particular, this paper provides a general description of the main radiomic drawbacks and future challenges, which limit radiomic application in clinical setting as routine. Further investigations need to standardize and validate the Radiomics as a helpful tool in management of oncologic patients. In that context, Radiomics has been playing a relevant role and could be considered as a future imaging landscape.

Abstract

Radiomics has been playing a pivotal role in oncological translational imaging, particularly in cancer diagnosis, prediction prognosis, and therapy response assessment. Recently, promising results were achieved in management of cancer patients by extracting mineable high-dimensional data from medical images, supporting clinicians in decision-making process in the new era of target therapy and personalized medicine. Radiomics could provide quantitative data, extracted from medical images, that could reflect microenvironmental tumor heterogeneity, which might be a useful information for treatment tailoring. Thus, it could be helpful to overcome the main limitations of traditional tumor biopsy, often affected by bias in tumor sampling, lack of repeatability and possible procedure complications. This quantitative approach has been widely investigated as a non-invasive and an objective imaging biomarker in cancer patients; however, it is not applied as a clinical routine due to several limitations related to lack of standardization and validation of images acquisition protocols, features segmentation, extraction, processing, and data analysis. This field is in continuous evolution in each type of cancer, and results support the idea that in the future Radiomics might be a reliable application in oncologic imaging. The first part of this review aimed to describe some radiomic technical principles and clinical applications to gastrointestinal oncologic imaging (CT and MRI) with a focus on diagnosis, prediction prognosis, and assessment of response to therapy.

Radiomics and Magnetic Resonance Imaging of Rectal Cancer: From Engineering to Clinical Practice

While cross-sectional imaging has seen continuous progress and plays an undiscussed pivotal role in the diagnostic management and treatment planning of patients with rectal cancer, a largely unmet need remains for improved staging accuracy, assessment of treatment response and prediction of individual patient outcome. Moreover, the increasing availability of target therapies has called for developing reliable diagnostic tools for identifying potential responders and optimizing overall treatment strategy on a personalized basis. Radiomics has emerged as a promising, still fully evolving research topic, which could harness the power of modern computer technology to generate quantitative information from imaging datasets based on advanced data-driven biomathematical models, potentially providing an added value to conventional imaging for improved patient management. The present study aimed to illustrate the contribution that current radiomics methods applied to magnetic resonance imaging can offer to managing patients with rectal cancer.

On the usage of average Hausdorff distance for segmentation performance assessment: hidden error when used for ranking

Average Hausdorff distance is a widely used performance measure to calculate the distance between two point sets. In medical image segmentation, it is used to compare ground truth images with segmentations allowing their ranking. We identified, however, ranking errors of average Hausdorff distance making it less suitable for applications in segmentation performance assessment. To mitigate this error, we present a modified calculation of this performance measure that we have coined “balanced average Hausdorff distance”. To simulate segmentations for ranking, we manually created non-overlapping segmentation errors common in magnetic resonance angiography cerebral vessel segmentation as our use-case. Adding the created errors consecutively and randomly to the ground truth, we created sets of simulated segmentations with increasing number of errors. Each set of simulated segmentations was ranked using both performance measures. We calculated the Kendall rank correlation coefficient between the segmentation ranking and the number of errors in each simulated segmentation. The rankings produced by balanced average Hausdorff distance had a significantly higher median correlation (1.00) than those by average Hausdorff distance (0.89). In 200 total rankings, the former misranked 52 whilst the latter misranked 179 segmentations. Balanced average Hausdorff distance is more suitable for rankings and quality assessment of segmentations than average Hausdorff distance.