Quantitative radiomics studies for tissue characterization: a review of technology and methodological procedures

MRI-Based Deep Learning Segmentation and Radiomics of Sarcoma in Mice

Small-animal imaging is an essential tool that provides noninvasive, longitudinal insight into novel cancer therapies. However, considerable variability in image analysis techniques can lead to inconsistent results. We have developed quantitative imaging for application in the preclinical arm of a coclinical trial by using a genetically engineered mouse model of soft tissue sarcoma. Magnetic resonance imaging (MRI) images were acquired 1 day before and 1 week after radiation therapy. After the second MRI, the primary tumor was surgically removed by amputating the tumor-bearing hind limb, and mice were followed for up to 6 months. An automatic analysis pipeline was used for multicontrast MRI data using a convolutional neural network for tumor segmentation followed by radiomics analysis. We then calculated radiomics features for the tumor, the peritumoral area, and the 2 combined. The first radiomics analysis focused on features most indicative of radiation therapy effects; the second radiomics analysis looked for features that might predict primary tumor recurrence. The segmentation results indicated that Dice scores were similar when using multicontrast versus single T2-weighted data (0.863 vs 0.861). One week post RT, larger tumor volumes were measured, and radiomics analysis showed greater heterogeneity. In the tumor and peritumoral area, radiomics features were predictive of primary tumor recurrence (AUC: 0.79). We have created an image processing pipeline for high-throughput, reduced-bias segmentation of multiparametric tumor MRI data and radiomics analysis, to better our understanding of preclinical imaging and the insights it provides when studying new cancer therapies.

PETER PHAN: An MRI phantom for the optimisation of radiomic studies of the female pelvis

PURPOSE

To develop a phantom for methodological radiomic investigation on Magnetic Resonance (MR) images of female patients affected by pelvic cancer.

METHODS

A pelvis-shaped container was filled with a MnCl₂ solution reproducing the relaxation times (T₁, T₂) of muscle surrounding pelvic malignancies. Inserts simulating multi-textured lesions were embedded in the phantom. The relaxation times of muscle and tumour were measured on an MR scanner on healthy volunteers and patients; T₁ and T₂ of MnCl₂ solutions were evaluated with a relaxometer to find the concentrations providing a match to in vivo relaxation times. Radiomic features were extracted from the phantom inserts and the patients' lesions. Their repeatability was assessed by multiple measurements.

RESULTS

Muscle T₁ and T₂ were 1128 (806-1378) and 51 (40-65) ms, respectively. The phantom reproduced in vivo values within 13% (T₁) and 12% (T₂). T₁ and T₂ of tumour tissue were 1637 (1396-2121) and 94 (79-101) ms, respectively. The phantom insert best mimicking the tumour agreed within 7% (T₁) and 24% (T₂) with in vivo values. Out of 1034 features, 75% (95%) had interclass correlation coefficient greater than 0.9 on T₁ (T₂)-weighted images, reducing to 33% (25%) if the phantom was repositioned. The most repeatable features on phantom showed values in agreement with the features extracted from patients' lesions.

CONCLUSIONS

We developed an MR phantom with inserts mimicking both relaxation times and texture of pelvic tumours. As exemplified with repeatability assessment, such phantom is useful to investigate features robustness and optimise the radiomic workflow on pelvic MR images.

MRI radiomics for early prediction of response to vaccine therapy in a transgenic mouse model of pancreatic ductal adenocarcinoma

BACKGROUND

There is a lack of well-established clinical tools for predicting dendritic cell (DC) vaccination response of pancreatic ductal adenocarcinoma (PDAC). DC vaccine treatment efficiency was demonstrated using histological analysis in pre-clinical studies; however, its usage was limited due to invasiveness. In this study, we aimed to investigate the potential of MRI texture features for detection of early immunotherapeutic response as well as overall survival (OS) of PDAC subjects following dendritic cell (DC) vaccine treatment in LSL-KrasG12D;LSL-Trp53R172H;Pdx-1-Cre (KPC) transgenic mouse model of pancreatic ductal adenocarcinoma (PDAC).

MATERIALS AND METHODS

KPC mice were treated with DC vaccines, and tumor growth was dynamically monitored. A total of a hundred and fifty-two image features of T2-weighted MRI images were analyzed using a kernel-based support vector machine model to detect treatment effects following the first and third weeks of the treatment. Moreover, univariate analysis was performed to describe the association between MRI texture and survival of KPC mice as well as histological tumor biomarkers.

RESULTS

OS for mice in the treatment group was 54.8 ± 22.54 days while the control group had 35.39 ± 17.17 days. A subset of three MRI features distinguished treatment effects starting from the first week with increasing accuracy throughout the treatment (75% to 94%). Besides, we observed that short-run emphasis of approximate wavelet coefficients had a positive correlation with the survival of the KPC mice (r = 0.78, p < 0.001). Additionally, tissue-specific MRI texture features showed positive association with fibrosis percentage (r = 0.84, p < 0.002), CK19 positive percentage (r = - 0.97, p < 0.001), and Ki67 positive cells (r = 0.81, p < 0.02) as histological disease biomarkers.

CONCLUSION

Our results demonstrate that MRI texture features can be used as imaging biomarkers for early detection of therapeutic response following DC vaccination in the KPC mouse model of PDAC. Besides, MRI texture can be utilized to characterize tumor microenvironment reflected with histology analysis.

Eleven grand challenges in single-cell data science

The recent boom in microfluidics and combinatorial indexing strategies, combined with low sequencing costs, has empowered single-cell sequencing technology. Thousands-or even millions-of cells analyzed in a single experiment amount to a data revolution in single-cell biology and pose unique data science problems. Here, we outline eleven challenges that will be central to bringing this emerging field of single-cell data science forward. For each challenge, we highlight motivating research questions, review prior work, and formulate open problems. This compendium is for established researchers, newcomers, and students alike, highlighting interesting and rewarding problems for the coming years.

State-of-the-art in radiomics of hepatocellular carcinoma: a review of basic principles, applications, and limitations

Radiomics is a new field in medical imaging with the potential of changing medical practice. Radiomics is characterized by the extraction of several quantitative imaging features which are not visible to the naked eye from conventional imaging modalities, and its correlation with specific relevant clinical endpoints, such as pathology, therapeutic response, and survival. Several studies have evaluated the use of radiomics in patients with hepatocellular carcinoma (HCC) with encouraging results, particularly in the pretreatment prediction of tumor biological characteristics, risk of recurrence, and survival. In spite of this, there are limitations and challenges to be overcome before the implementation of radiomics into clinical routine. In this article, we will review the concepts of radiomics and their current potential applications in patients with HCC. It is important that the multidisciplinary team involved in the treatment of patients with HCC be aware of the basic principles, benefits, and limitations of radiomics in order to achieve a balanced interpretation of the results toward a personalized medicine.

Differentiation of supratentorial single brain metastasis and glioblastoma by using peri-enhancing oedema region-derived radiomic features and multiple classifiers

OBJECTIVE

To differentiate supratentorial single brain metastasis (MET) from glioblastoma (GBM) by using radiomic features derived from the peri-enhancing oedema region and multiple classifiers.

METHODS

One hundred and twenty single brain METs and GBMs were retrospectively reviewed and then randomly divided into a training data set (70%) and validation data set (30%). Quantitative radiomic features of each case were extracted from the peri-enhancing oedema region of conventional MR images. After feature selection, five classifiers were built. Additionally, the combined use of the classifiers was studied. Accuracy, sensitivity, and specificity were used to evaluate the classification performance.

RESULTS

A total of 321 features were extracted, and 3 features were selected for each case. The 5 classifiers showed an accuracy of 0.70 to 0.76, sensitivity of 0.57 to 0.98, and specificity of 0.43 to 0.93 for the training data set, with an accuracy of 0.56 to 0.64, sensitivity of 0.39 to 0.78, and specificity of 0.50 to 0.89 for the validation data set. When combining the classifiers, the classification performance differed according to the combined mode and the agreement pattern of classifiers, and the greatest benefit was obtained when all the classifiers reached agreement using the same weight and simple majority vote method.

CONCLUSIONS

Three features derived from the peri-enhancing oedema region had moderate value in differentiating supratentorial single brain MET from GBM with five single classifiers. Combined use of classifiers, like multi-disciplinary team (MDT) consultation, could confer extra benefits, especially for those cases when all classifiers reach agreement.

KEY POINTS

• Radiomics provides a way to differentiate single brain MET between GBM by using conventional MR images. • The results of classifiers or algorithms themselves are also data, the transformation of the primary data. • Like MDT consultation, the combined use of multiple classifiers may confer extra benefits.

Overlooked pitfalls in multi-class machine learning classification in radiation oncology and how to avoid them

In radiation oncology, Machine Learning classification publications are typically related to two outcome classes, e.g. the presence or absence of distant metastasis. However, multi-class classification problems also have great clinical relevance, e.g., predicting the grade of a treatment complication following lung irradiation. This work comprised two studies aimed at making work in this domain less prone to statistical blindsides. In multi-class classification, AUC is not defined, whereas correlation coefficients are. It may seem like solely quoting the correlation coefficient value (in lieu of the AUC value) is a suitable choice. In the first study, we illustrated using Monte Carlo (MC) models why this choice is misleading. We also considered the special case where the multiple classes are not ordinal, but nominal, and explained why Pearson or Spearman correlation coefficients are not only providing incomplete information but are actually meaningless. The second study concerned surrogate biomarkers for a clinical endpoint, which have purported benefits including potential for early assessment, being inexpensive, and being non-invasive. Using a MC experiment, we showed how conclusions derived from surrogate markers can be misleading. The simulated endpoint was radiation toxicity (scale of 0-5). The surrogate marker was the true toxicity grade plus a noise term. Five patient cohorts were simulated, including one control. Two of the cohorts were designed to have a statistically significant difference in toxicity. Under 1000 repeated experiments using the biomarker, these two cohorts were often found to be statistically indistinguishable, with the fraction of such occurrences rising with the level of noise.

Comparison of radiomic features in diagnostic CT images with and without contrast enhancement in the delayed phase for NSCLC patients

PURPOSE

To compare radiomic features extracted from diagnostic computed tomography (CT) images with and without contrast enhancement in delayed phase for non-small cell lung cancer (NSCLC) patients.

METHODS

Diagnostic CT images from 269 tumors [non-contrast CT, 188 (dataset NE); contrast-enhanced CT, 81 (dataset CE)] were enrolled in this study. Eighteen first-order and seventy-five texture features were extracted by setting five bin width levels for CT values. Reproducible features were selected by the intraclass correlation coefficient (ICC). Radiomic features were compared between datasets NE and CE. Subgroup analyses were performed based on the CT acquisition period, exposure value, and patient characteristics.

RESULTS

Eighty features were considered reproducible (0.5 ≤ ICC). Twelve of the sixteen first-order features, independent of the bin width levels, were statistically different between datasets NE and CE (p < 0.05), and the p-values of two first-order features depending on the bin width levels were reduced with narrower bin widths. Sixteen out of sixty-two features showed a significant difference, regardless of the bin width (p < 0.05). There were significant differences between datasets NE and CE with older age, lighter body weight, better performance status, being a smoker, larger gross tumor volume, and tumor location at central region.

CONCLUSIONS

Contrast enhancement in the delayed phase of CT images for NSCLC patients affected some of the radiomic features and the variability of radiomic features due to contrast uptake may depend largely on the patient characteristics.

Quantitative MRI Biomarkers of Stereotactic Radiotherapy Outcome in Brain Metastasis

About 20-40% of cancer patients develop brain metastases, causing significant morbidity and mortality. Stereotactic radiation treatment is an established option that delivers high dose radiation to the target while sparing the surrounding normal tissue. However, up to 20% of metastatic brain tumours progress despite stereotactic treatment, and it can take months before it is evident on follow-up imaging. An early predictor of radiation therapy outcome in terms of tumour local failure (LF) is crucial, and can facilitate treatment adjustments or allow for early salvage treatment. In this study, an MR-based radiomics framework was proposed to derive and investigate quantitative MRI (qMRI) biomarkers for the outcome of LF in brain metastasis patients treated with hypo-fractionated stereotactic radiation therapy (SRT). The qMRI biomarkers were constructed through a multi-step feature extraction/reduction/selection framework using the conventional MR imaging data acquired from 100 patients (133 lesions), and were applied in conjunction with machine learning techniques for outcome prediction and risk assessment. The results indicated that the majority of the features in the optimal qMRI biomarkers characterize the heterogeneity in the surrounding regions of tumour including edema and tumour/lesion margins. The optimal qMRI biomarker consisted of five features that predict the outcome of LF with an area under the curve (AUC) of 0.79, and a cross-validated sensitivity and specificity of 81% and 79%, respectively. The Kaplan-Meier analyses showed a statistically significant difference in local control (p-value < 0.0001) and overall survival (p = 0.01). Findings from this study are a step towards using qMRI for early prediction of local failure in brain metastasis patients treated with SRT. This may facilitate early adjustments in treatment, such as surgical resection or salvage radiation, that can potentially improve treatment outcomes. Investigations on larger cohorts of patients are, however, required for further validation of the technique.

Artificial intelligence, machine learning, computer-aided diagnosis, and radiomics: advances in imaging towards to precision medicine

The discipline of radiology and diagnostic imaging has evolved greatly in recent years. We have observed an exponential increase in the number of exams performed, subspecialization of medical fields, and increases in accuracy of the various imaging methods, making it a challenge for the radiologist to "know everything about all exams and regions". In addition, imaging exams are no longer only qualitative and diagnostic, providing now quantitative information on disease severity, as well as identifying biomarkers of prognosis and treatment response. In view of this, computer-aided diagnosis systems have been developed with the objective of complementing diagnostic imaging and helping the therapeutic decision-making process. With the advent of artificial intelligence, "big data", and machine learning, we are moving toward the rapid expansion of the use of these tools in daily life of physicians, making each patient unique, as well as leading radiology toward the concept of multidisciplinary approach and precision medicine. In this article, we will present the main aspects of the computational tools currently available for analysis of images and the principles of such analysis, together with the main terms and concepts involved, as well as examining the impact that the development of artificial intelligence has had on radiology and diagnostic imaging.

Prediction of outcome in anal squamous cell carcinoma using radiomic feature analysis of pre-treatment FDG PET-CT

PURPOSE

Incidence of anal squamous cell carcinoma (ASCC) is increasing, with curative chemoradiotherapy (CRT) as the primary treatment of non-metastatic disease. A significant proportion of patients have locoregional treatment failure (LRF), but distant relapse is uncommon. Accurate prognostication of progression-free survival (PFS) would help personalisation of CRT regimens. The study aim was to evaluate novel imaging pre-treatment features, to prognosticate for PFS in ASCC.

METHODS

Consecutive patients with ASCC treated with curative intent at a large tertiary referral centre who underwent pre-treatment FDG-PET/CT were included. Radiomic feature extraction was performed using LIFEx software on baseline FDG-PET/CT. Outcome data (PFS) was collated from electronic patient records. Elastic net regularisation and feature selection were used for logistic regression model generation on a randomly selected training cohort and applied to a validation cohort using TRIPOD guidelines. ROC-AUC analysis was used to compare performance of a regression model encompassing standard clinical prognostic factors (age, sex, tumour and nodal stage-model A), a radiomic feature model (model B) and a combined radiomic/clinical model (model C).

RESULTS

A total of 189 patients were included in the study, with 145 in the training cohort and 44 in the validation cohort. Median follow-up was 35.1 and 37. 9 months, respectively for each cohort, with 70.3% and 68.2% reaching this time-point with PFS. GLCM entropy (a measure of randomness of distribution of co-occurring pixel grey-levels), NGLDM busyness (a measure of spatial frequency of changes in intensity between nearby voxels of different grey-level), minimum CT value (lowest HU within the lesion) and SMTV (a standardized version of MTV) were selected for inclusion in the prognostic model, alongside tumour and nodal stage. AUCs for performance of model A (clinical), B (radiomic) and C (radiomic/clinical) were 0.6355, 0.7403, 0.7412 in the training cohort and 0.6024, 0.6595, 0.7381 in the validation cohort.

CONCLUSION

Radiomic features extracted from pre-treatment FDG-PET/CT in patients with ASCC may provide better PFS prognosis than conventional staging parameters. With external validation, this might be useful to help personalise CRT regimens in the future.

Study Progress of Radiomics With Machine Learning for Precision Medicine in Bladder Cancer Management

Bladder cancer is a fatal cancer that happens in the genitourinary tract with quite high morbidity and mortality annually. The high level of recurrence rate ranging from 50 to 80% makes bladder cancer one of the most challenging and costly diseases to manage. Faced with various problems in existing methods, a recently emerging concept for the measurement of imaging biomarkers and extraction of quantitative features called "radiomics" shows great potential in the application of detection, grading, and follow-up management of bladder cancer. Furthermore, machine-learning (ML) algorithms on the basis of "big data" are fueling the powers of radiomics for bladder cancer monitoring in the era of precision medicine. Currently, the usefulness of the novel combination of radiomics and ML has been demonstrated by a large number of successful cases. It possesses outstanding strengths including non-invasiveness, low cost, and high efficiency, which may serve as a revolution to tumor assessment and emancipate workforce. However, for the extensive clinical application in the future, more efforts should be made to break down the limitations caused by technology deficiencies, inherent problems during the process of radiomic analysis, as well as the quality of present studies.

Preoperative CT texture features predict prognosis after curative resection in pancreatic cancer

Pancreatic cancer is a lethal disease, and resistance to chemotherapy is a critical factor influencing the postoperative prognosis. Tumour heterogeneity is an important indicator of chemoresistance. Therefore, we analysed tumour heterogeneity in preoperative computed tomography scans by performing texture analysis using the grey-level run-length matrix and analysed the correlation of survival with the value obtained in these analyses. We analysed 116 consecutive patients who underwent curative resection and had preoperative contrast-enhanced computed tomography data available for analysis. A region of interest was drawn on all slices with a visible tumour and normal pancreas on the arterial phase computed tomography scans; the correlation of pathological characteristics with grey-level run-length matrix features was analysed. We then performed Kaplan–Meier survival curve analysis among pancreatic cancer patients. The grey-level non-uniformity values in grey-level run-length matrix features for tumours were higher than those for normal pancreas. High grey-level non-uniformity values represent a non-uniform texture, i.e., heterogeneity. Grey-level run-length matrix features showed that recurrence-free survival was shorter in the group with high grey-level non-uniformity 135 values (p = 0.025). Our analyses of the correlation between pathological outcomes and grey-level run-length matrix features in pancreatic cancer patients showed that grey-level non-uniformity values were powerful prognostic indicators.

Radiomics Analysis on Contrast-Enhanced Spectral Mammography Images for Breast Cancer Diagnosis: A Pilot Study

Contrast-enhanced spectral mammography is one of the latest diagnostic tool for breast care; therefore, the literature is poor in radiomics image analysis useful to drive the development of automatic diagnostic support systems. In this work, we propose a preliminary exploratory analysis to evaluate the impact of different sets of textural features in the discrimination of benign and malignant breast lesions. The analysis is performed on 55 ROIs extracted from 51 patients referred to Istituto Tumori “Giovanni Paolo II” of Bari (Italy) from the breast cancer screening phase between March 2017 and June 2018. We extracted feature sets by calculating statistical measures on original ROIs, gradiented images, Haar decompositions of the same original ROIs, and on gray-level co-occurrence matrices of the each sub-ROI obtained by Haar transform. First, we evaluated the overall impact of each feature set on the diagnosis through a principal component analysis by training a support vector machine classifier. Then, in order to identify a sub-set for each set of features with higher diagnostic power, we developed a feature importance analysis by means of wrapper and embedded methods. Finally, we trained an SVM classifier on each sub-set of previously selected features to compare their classification performances with respect to those of the overall set. We found a sub-set of significant features extracted from the original ROIs with a diagnostic accuracy greater than 80 % . The features extracted from each sub-ROI decomposed by two levels of Haar transform were predictive only when they were all used without any selection, reaching the best mean accuracy of about 80 % . Moreover, most of the significant features calculated by HAAR decompositions and their GLCMs were extracted from recombined CESM images. Our pilot study suggested that textural features could provide complementary information about the characterization of breast lesions. In particular, we found a sub-set of significant features extracted from the original ROIs, gradiented ROI images, and GLCMs calculated from each sub-ROI previously decomposed by the Haar transform.

CT-based radiomics for prediction of histologic subtype and metastatic disease in primary malignant lung neoplasms

PURPOSE

As some of the most important factors for treatment decision of lung cancer (which is the deadliest neoplasm) are staging and histology, this work aimed to associate quantitative contrast-enhanced computed tomography (CT) features from malignant lung tumors with distant and nodal metastases (according to clinical TNM staging) and histopathology (according to biopsy and surgical resection) using radiomics assessment.

METHODS

A local cohort of 85 patients were retrospectively (2010-2017) analyzed after approval by the institutional research review board. CT images acquired with the same protocol were semiautomatically segmented by a volumetric segmentation method. Tumors were characterized by quantitative CT features of shape, first-order, second-order, and higher-order textures. Statistical and machine learning analyses assessed the features individually and combined with clinical data.

RESULTS

Univariate and multivariate analyses identified 40, 2003, and 45 quantitative features associated with distant metastasis, nodal metastasis, and histopathology (adenocarcinoma and squamous cell carcinoma), respectively. A machine learning model yielded the highest areas under the receiver operating characteristic curves of 0.92, 0.84, and 0.88 to predict the same previous patterns.

CONCLUSION

Several radiomic features (including wavelet energies, information measures of correlation and maximum probability from co-occurrence matrix, busyness from neighborhood intensity-difference matrix, directionalities from Tamura's texture, and fractal dimension estimation) significantly associated with distant metastasis, nodal metastasis, and histology were discovered in this work, presenting great potential as imaging biomarkers for pathological diagnosis and target therapy decision.

Novel imaging techniques of rectal cancer: what do radiomics and radiogenomics have to offer? A literature review

INTRODUCTION

As computational capabilities have advanced, radiologists and their collaborators have looked for novel ways to analyze diagnostic images. This has resulted in the development of radiomics and radiogenomics as new fields in medical imaging. Radiomics and radiogenomics may change the practice of medicine, particularly for patients with colorectal cancer. Radiomics corresponds to the extraction and analysis of numerous quantitative imaging features from conventional imaging modalities in correlation with several endpoints, including the prediction of pathology, genomics, therapeutic response, and clinical outcome. In radiogenomics, qualitative and/or quantitative imaging features are extracted and correlated with genetic profiles of the imaged tissue. Thus far, several studies have evaluated the use of radiomics and radiogenomics in patients with colorectal cancer; however, there are challenges to be overcome before its routine implementation including challenges related to sample size, model design and interpretability, and the lack of robust multicenter validation set.

MATERIAL AND METHODS

In this article, we will review the concepts of radiomics and radiogenomics and their potential applications in rectal cancer.

CONCLUSION

Radiologists should be aware of the basic concepts, benefits, pitfalls, and limitations of new radiomic and radiogenomics techniques to achieve a balanced interpretation of the results.

MRI-derived radiomics: methodology and clinical applications in the field of pelvic oncology

Personalized medicine aims at offering optimized treatment options and improved survival for cancer patients based on individual variability. The success of precision medicine depends on robust biomarkers. Recently, the requirement for improved non-biologic biomarkers that reflect tumor biology has emerged and there has been a growing interest in the automatic extraction of quantitative features from medical images, denoted as radiomics. Radiomics as a methodological approach can be applied to any image and most studies have focused on PET, CT, ultrasound, and MRI. Here, we aim to present an overview of the radiomics workflow as well as the major challenges with special emphasis on the use of multiparametric MRI datasets. We then reviewed recent studies on radiomics in the field of pelvic oncology including prostate, cervical, and colorectal cancer.

A machine learning based delta-radiomics process for early prediction of treatment response of pancreatic cancer

Changes of radiomic features over time in longitudinal images, delta radiomics, can potentially be used as a biomarker to predict treatment response. This study aims to develop a delta-radiomic process based on machine learning by (1) acquiring and registering longitudinal images, (2) segmenting and populating regions of interest (ROIs), (3) extracting radiomic features and calculating their changes (delta-radiomic features, DRFs), (4) reducing feature space and determining candidate DRFs showing treatment-induced changes, and (5) creating outcome prediction models using machine learning. This process was demonstrated by retrospectively analyzing daily non-contrast CTs acquired during routine CT-guided-chemoradiation therapy for 90 pancreatic cancer patients. A total of 2520 CT sets (28-daily-fractions-per-patient) along with their pathological response were analyzed. Over 1300 radiomic features were extracted from the segmented ROIs. Highly correlated DRFs were ruled out using Spearman correlations. Correlation between the selected DRFs and pathological response was established using linear-regression-models. T test and linear-mixed-effects-models were used to determine which DRFs changed significantly compared with first fraction. A Bayesian-regularization-neural-network was used to build a response prediction model. The model was trained using 50 patients and leave-one-out-cross-validation. Performance was judged using the area-under-ROC-curve. External independent validation was done using data from the remaining 40 patients. The results show that 13 DRFs passed the tests and demonstrated significant changes following 2-4 weeks of treatment. The best performing combination differentiating good versus bad responders (CV-AUC = 0.94) was obtained using normalized-entropy-to-standard-deviation-difference-(NESTD), kurtosis, and coarseness. With further studies using larger data sets, delta radiomics may develop into a biomarker for early prediction of treatment response.

Real-time control of respiratory motion: Beyond radiation therapy

Motion management in radiation oncology is an important aspect of modern treatment planning and delivery. Special attention has been paid to control respiratory motion in recent years. However, other medical procedures related to both diagnosis and treatment are likely to benefit from the explicit control of breathing motion. Quantitative imaging - including increasingly important tools in radiology and nuclear medicine - is among the fields where a rapid development of motion control is most likely, due to the need for quantification accuracy. Emerging treatment modalities like focussed-ultrasound tumor ablation are also likely to benefit from a significant evolution of motion control in the near future. In the present article an overview of available respiratory motion systems along with ongoing research in this area is provided. Furthermore, an attempt is made to envision some of the most expected developments in this field in the near future.

3-D Multi-parametric Contrast-Enhanced Ultrasound for the Prediction of Prostate Cancer

Trans-rectal ultrasound-guided 12-core systematic biopsy (SBx) is the standard diagnostic pathway for prostate cancer (PCa) because of a lack of sufficiently accurate imaging. Quantification of 3-D dynamic contrast-enhanced ultrasound (US) might open the way for a targeted procedure in which biopsies are directed at lesions suspicious on imaging. This work describes the expansion of contrast US dispersion imaging algorithms to 3-D and compares its performance against malignant and benign disease. Furthermore, we examined the feasibility of a multi-parametric approach to predict SBx-core outcomes using machine learning. An area under the receiver operating characteristic (ROC) curve of 0.76 and 0.81 was obtained for all PCa and significant PCa, respectively, an improvement over previous US methods. We found that prostatitis, in particular, was a source of false-positive readings.

Using CT texture analysis to differentiate cystic and cystic-appearing odontogenic lesions

PURPOSE

Cystic and cystic-appearing odontogenic lesions of the jaw may appear similar on CT imaging. Accurate diagnosis is often difficult although the relationship of the lesion to the tooth root or crown may offer a clue to the etiology. The purpose of this study was to evaluate CT texture analysis as an aid in differentiating cystic and cystic-appearing odontogenic lesions of the jaw.

METHODS

This was an IRB-approved retrospective study including 42 pathology-proven dentigerous cysts, 37 odontogenic keratocysts, and 19 ameloblastomas. Each lesion was manually segmented on axial CT images, and textural features were analyzed using an in-house-developed Matlab-based texture analysis program that extracted 47 texture features from each segmented volume. Statistical analysis was performed comparing all pairs of the three types of lesions.

RESULTS

Pairwise analysis revealed that nine histogram features, one GLCM feature, three GLRL features, two Laws features, four GLGM features and two Chi-square features showed significant differences between dentigerous cysts and odontogenic keratocysts. Four histogram features and one Chi-square feature showed significant differences between odontogenic keratocysts and ameloblastomas. Two histogram features showed significant differences between dentigerous cysts and ameloblastomas.

CONCLUSIONS

CT texture analysis may be useful as a noninvasive method to obtain additional quantitative information to differentiate cystic and cystic-appearing odontogenic lesions of the jaw.

Radiomics in hepatocellular carcinoma: a quantitative review

Radiomics is an emerging field which extracts quantitative radiology data from medical images and explores their correlation with clinical outcomes in a non-invasive manner. This review aims to assess whether radiomics is a useful and reproducible method for clinical management of hepatocellular carcinoma (HCC) by reviewing the strengths and weaknesses of current radiomics literature pertaining specifically to HCC. From an initial set of 48 articles recovered through database searches, 23 articles were retained to be included in this review after full screening. Among these 23 studies, 7 used a radiomics approach in magnetic resonance imaging (MRI). Only two studies applied radiomics to positron emission tomography-computed tomography (PET-CT). In the remaining 14 articles, a radiomics analysis was performed on computed tomography (CT). Eight studies dealt with the relationship between biological signatures and imaging findings, and can be classified as radiogenomic studies. For each study included in our review, we computed a Radiomics Quality Score (RQS) as proposed by Lambin et al. We found that the RQS (mean ± standard deviation) was 8.35 ± 5.38 (out of a possible maximum value of 36). Although these scores are fairly low, and radiomics has not yet reached clinical utility in HCC, it is important to underscore the fact that these early studies pave the way for the radiomics field with a focus on HCC. Radiomics is still a very young field, and is far from being mature, but it remains a very promising technology for the future for developing adequate personalized treatment as a non-invasive approach, for complementing or replacing tumor biopsies, as well as for developing novel prognostic biomarkers in HCC patients.

Multi-parametric and multi-regional histogram analysis of MRI: modality integration reveals imaging phenotypes of glioblastoma

OBJECTIVES

Integrating multiple imaging modalities is crucial for MRI data interpretation. The purpose of this study is to determine whether a previously proposed multi-view approach can effectively integrate the histogram features from multi-parametric MRI and whether the selected features can offer incremental prognostic values over clinical variables.

METHODS

Eighty newly-diagnosed glioblastoma patients underwent surgery and chemoradiotherapy. Histogram features of diffusion and perfusion imaging were extracted from contrast-enhancing (CE) and non-enhancing (NE) regions independently. An unsupervised patient clustering was performed by the multi-view approach. Kaplan-Meier and Cox proportional hazards regression analyses were performed to evaluate the relevance of patient clustering to survival. The metabolic signatures of patient clusters were compared using multi-voxel spectroscopy analysis. The prognostic values of histogram features were evaluated by survival and ROC curve analyses.

RESULTS

Two patient clusters were generated, consisting of 53 and 27 patients respectively. Cluster 2 demonstrated better overall survival (OS) (p = 0.007) and progression-free survival (PFS) (p < 0.001) than Cluster 1. Cluster 2 displayed lower N-acetylaspartate/creatine ratio in NE region (p = 0.040). A higher mean value of anisotropic diffusion in NE region was associated with worse OS (hazard ratio [HR] = 1.40, p = 0.020) and PFS (HR = 1.36, p = 0.031). The seven features selected by this approach showed significantly incremental value in predicting 12-month OS (p = 0.020) and PFS (p = 0.022).

CONCLUSIONS

The multi-view clustering method can provide an effective integration of multi-parametric MRI. The histogram features selected may be used as potential prognostic markers.

KEY POINTS

• Multi-parametric magnetic resonance imaging captures multi-faceted tumor physiology. • Contrast-enhancing and non-enhancing tumor regions represent different tumor components with distinct clinical relevance. • Multi-view data analysis offers a method which can effectively select and integrate multi-parametric and multi-regional imaging features.

Identification of suspicious invasive placentation based on clinical MRI data using textural features and automated machine learning

OBJECTIVE

The aim of this study was to investigate whether intraplacental texture features from routine placental MRI can objectively and accurately predict invasive placentation.

MATERIAL AND METHODS

This retrospective study includes 99 pregnant women with pathologically confirmed placental invasion and 56 pregnant women with simple placenta previa. All participants underwent magnetic resonance imaging after 24 gestational weeks. The placenta was segmented in sagittal images from both turbo spin echo (TSE) and balanced turbo field echo (bTFE) sequences. Textural features were extracted from the both original and Laplacian of Gaussian (LoG)-filtered MRI images. An automated machine learning algorithm was applied to the extracted feature sets to obtain the optimal preprocessing steps, classification algorithm, and corresponding hyper-parameters.

RESULTS

A gradient boosting classifier using all textual features from original and LoG-filtered TSE images and bTFE images identified by the automated machine learning algorithm achieved the optimal performance with sensitivity, specificity, accuracy, and area under ROC curve (AUC) of 100%, 88.5%, 95.2%, and 0.98 in the prediction of placental invasion. In addition, textural features that contributed to the prediction of placental invasion differ from the features significantly affected by normal placenta maturation.

CONCLUSIONS

Quantifying intraplacental heterogeneity using LoG filtration and texture analysis highlights the different heterogeneous appearance caused by abnormal placentation relative to normal maturation. The predictive model derived from automated machine learning yielded good performance, indicating the proposed radiomic analysis pipeline can accurately predict placental invasion and facilitate clinical decision-making for pregnant women with suspicious placental invasion.

KEY POINTS

• The intraplacental texture features have high efficiency in prediction of invasive placentation after 24 gestational weeks. • The features with dominated predictive power did not overlap with the features significantly affected by gestational age.

Prognostic Value of Functional Parameters of 18F-FDG-PET Images in Patients with Primary Renal/Adrenal Lymphoma

Objectives

The aim of this study is to explore the textural features that may identify the morphological changes in the lymphoma region and predict the prognosis of patients with primary renal lymphoma (PRL) and primary adrenal lymphoma (PAL).

Methods

This retrospective study comprised nineteen non-Hodgkin's lymphoma (NHL) patients undergoing ¹⁸F-FDG-PET/CT at West China Hospital from December 2013 to May 2017. ¹⁸F-FDG-PET images were reviewed independently by two board certificated radiologists of nuclear medicine, and the texture features were extracted from LifeX packages. The prognostic value of PET FDG-uptake parameters, patients' baseline characteristics, and textural parameters were analyzed using Kaplan–Meier analysis. Cox regression analysis was used to identify the independent prognostic factors among the imaging and clinical features.

Results

The overall survival of included patients was 18.84 ± 13.40 (mean ± SD) months. Univariate Cox analyses found that the tumor stage, GLCM (gray-level co-occurrence matrix) entropy, GLZLM_GLNU (gray-level nonuniformity), and GLZLM_ZLNU (zone length nonuniformity), values were significant predictors for OS. Among them, GLRLM_RLNU ≥216.6 demonstrated association with worse OS at multivariate analysis (HR 9.016, 95% CI 1.041–78.112, p=0.046).

Conclusions

The texture analysis of ¹⁸F-FDG-PET images could potentially serve as a noninvasive strategy to predict the overall survival of patients with PRL and PAL.

Radiomics and Artificial Intelligence for Biomarker and Prediction Model Development in Oncology

Unlabelled Image.

Leveraging RSF and PET images for prognosis of multiple myeloma at diagnosis

PURPOSE

Multiple myeloma (MM) is a bone marrow cancer that accounts for 10% of all hematological malignancies. It has been reported that FDG PET imaging provides prognostic information for both baseline and therapeutic follow-up of MM patients using visual analysis. In this study, we aim to develop a computer-assisted method based on PET quantitative image features to assist diagnoses and treatment decisions for MM patients.

METHODS

Our proposed model relies on a two-stage method with Random Survival Forest (RFS) and variable importance (VIMP) for both feature selection and prediction. The targeted variable for prediction is the progression-free survival (PFS). We consider texture-based (radiomics), conventional (e.g., SUVmax) and clinical biomarkers. We evaluate PFS predictions in terms of C-index and final prognosis separation in two risk groups, from a database of 66 patients who were part of the prospective multi-centric french IMAJEM study.

RESULTS

Our method (VIMP + RSF) provides better results (1-C-index of 0.36) than conventional methods such as Lasso-Cox and gradient-boosting Cox (0.48 and 0.56, respectively). We experimentally proved the interest of using selection (0.61 for RSF without selection) and showed that VIMP selection is more stable and gives better results than minimal depth and variable hunting (0.47 and 0.43). The approach gives better prognosis group separation (a p value of 0.05 against 0.11 to 0.4 for others).

CONCLUSION

Our results confirm the predictive value of radiomics for MM patients, in particular, they demonstrate that quantitative/heterogeneity image-based features reduce the error of the predicted progression. To our knowledge, this is the first work using RFS on PET images for the progression prediction of MM patients. Moreover, we provide an analysis of the feature selection process, which points toward the identification of clinically relevant biomarkers.

MRI-based radiomic signature as predictive marker for patients with head and neck squamous cell carcinoma

PURPOSE

To develop magnetic resonance imaging (MRI)-based radiomic signature and nomogram for preoperatively predicting prognosis in head and neck squamous cell carcinoma (HNSCC) patients.

METHOD

This retrospective study consisted of a training cohort (n = 85) and a validation cohort (n = 85) of patients with HNSCC. LASSO Cox regression model was used to select the most useful prognostic features with their coefficients, upon which a radiomic signature was generated. The receiver operator characteristics (ROC) analysis and association of the radiomic signature with overall survival (OS) of patients was assessed in both cohorts. A nomogram incorporating the radiomic signature and independent clinical predictors was then constructed. The incremental prognostic value of the radiomic signature was evaluated.

RESULTS

The radiomic signature, consisted of 7 selected features from MR images, was significantly associated with OS of patients with HNSCC (P < 0.0001 for training cohort, P = 0.0013 for validation cohort). The radiomic signature and TNM stage were proved to be independently associated with OS of HNSCC patients, which therefore were incorporated to generate the radiomic nomogram. In the training cohort, the nomogram showed a better prognostic capability than TNM stage only (P =  0.005), which was confirmed in the validation cohort (P =  0.01). Furthermore, the calibration curves of the nomogram demonstrated good agreement with actual observation.

CONCLUSIONS

MRI-based radiomic signature is an independent prognostic factor for HNSCC patients. Nomogram based on radiomic signature and TNM stage shows promising in non-invasively and preoperatively predicting prognosis of HNSCC patient in clinical practice.

Pancreatic cancer detection and characterization-state of the art cross-sectional imaging and imaging data analysis

Pancreatic ductal adenocarcinoma (PDAC) represents a deadly disease, prognosticated to become the 2nd most common cause of cancer related death in the western world by 2030. State of the art radiologic high-resolution cross-sectional imaging by computed tomography (CT) and magnetic resonance imaging (MRI) represent advanced techniques for early lesion detection, pre-therapeutic patient staging and therapy response monitoring. In light of molecular taxonomies currently under development, the implementation of advanced imaging data post-processing pipelines and the integration of imaging and clinical data for the development of risk assessment and clinical decision support tools are required. This review will present the current state of cross-sectional radiologic imaging and image post-processing related to PDAC.

Comparison of prediction models with radiological semantic features and radiomics in lung cancer diagnosis of the pulmonary nodules: a case-control study

PURPOSE

To compare the ability of radiological semantic and quantitative texture features in lung cancer diagnosis of pulmonary nodules.

MATERIALS AND METHODS

A total of N = 121 subjects with confirmed non-small-cell lung cancer were matched with 117 controls based on age and gender. Radiological semantic and quantitative texture features were extracted from CT images with or without contrast enhancement. Three different models were compared using LASSO logistic regression: "CS" using clinical and semantic variables, "T" using texture features, and "CST" using clinical, semantic, and texture variables. For each model, we performed 100 trials of fivefold cross-validation and the average receiver operating curve was accessed. The AUC of the cross-validation study (AUC_CV) was calculated together with its 95% confidence interval.

RESULTS

The AUC_CV (and 95% confidence interval) for models T, CS, and CST was 0.85 (0.71-0.96), 0.88 (0.77-0.96), and 0.88 (0.77-0.97), respectively. After separating the data into two groups with or without contrast enhancement, the AUC (without cross-validation) of the model T was 0.86 both for images with and without contrast enhancement, suggesting that contrast enhancement did not impact the utility of texture analysis.

CONCLUSIONS

The models with semantic and texture features provided cross-validated AUCs of 0.85-0.88 for classification of benign versus cancerous nodules, showing potential in aiding the management of patients.

KEY POINTS

• Pretest probability of cancer can aid and direct the physician in the diagnosis and management of pulmonary nodules in a cost-effective way. • Semantic features (qualitative features reported by radiologists to characterize lung lesions) and radiomic (e.g., texture) features can be extracted from CT images. • Input of these variables into a model can generate a pretest likelihood of cancer to aid clinical decision and management of pulmonary nodules.

Matching and Homogenizing Convolution Kernels for Quantitative Studies in Computed Tomography

The sharpness of the kernels used for image reconstruction in computed tomography affects the values of the quantitative image features. We sought to identify the kernels that produce similar feature values to enable a more effective comparison of images produced using scanners from different manufactures. We also investigated a new image filter designed to change the kernel-related component of the frequency spectrum of a postreconstruction image from that of the initial kernel to that of a preferred kernel. A radiomics texture phantom was imaged using scanners from GE, Philips, Siemens, and Toshiba. Images were reconstructed multiple times, varying the kernel from smooth to sharp. The phantom comprised 10 cartridges of various textures. A semiautomated method was used to produce 8 × 2 × 2 cm regions of interest for each cartridge and for all scans. For each region of interest, 38 radiomics features from the categories intensity direct (n = 12), gray-level co-occurrence matrix (n = 21), and neighborhood gray-tone difference matrix (n = 5) were extracted. We then calculated the fractional differences of the features from those of the baseline kernel (GE Standard). To gauge the importance of the differences, we scaled them by the coefficient of variation of the same feature from a cohort of patients with non-small cell lung cancer. The noise power spectra for each kernel were estimated from the phantom's solid acrylic cartridge, and kernel-homogenization filters were developed from these estimates. The Philips C, Siemens B30f, and Toshiba FC24 kernels produced feature values most similar to GE Standard. The kernel homogenization filters reduced the median differences from baseline to less than 1 coefficient of variation in the patient population for all of the GE, Philips, and Siemens kernels except for GE Edge and Toshiba kernels. For prospective computed tomographic radiomics studies, the scanning protocol should specify kernels that have been shown to produce similar feature values. For retrospective studies, kernel homogenization filters can be designed and applied to reduce the kernel-related differences in the feature values.

Textural analysis and lung function study: Predicting lung fitness for radiotherapy from a CT scan

OBJECTIVE

This study tested the hypothesis that shows advanced image analysis can differentiate fit and unfit patients for radical radiotherapy from standard radiotherapy planning imaging, when compared to formal lung function tests, FEV1 (forced expiratory volume in 1 s) and TLCO (transfer factor of carbon monoxide).

METHODS

An apical region of interest (ROI) of lung parenchyma was extracted from a standard radiotherapy planning CT scan. Software using a grey level co-occurrence matrix (GLCM) assigned an entropy score to each voxel, based on its similarity to the voxels around it.

RESULTS

Density and entropy scores were compared between a cohort of 29 fit patients (defined as FEV1 and TLCO above 50 % predicted value) and 32 unfit patients (FEV1 or TLCO below 50% predicted). Mean and median density and median entropy were significantly different between fit and unfit patients (p = 0.005, 0.0008 and 0.0418 respectively; two-sided Mann-Whitney test).

CONCLUSION

Density and entropy assessment can differentiate between fit and unfit patients for radical radiotherapy, using standard CT imaging.

ADVANCES IN KNOWLEDGE

This study shows that a novel assessment can generate further data from standard CT imaging. These data could be combined with existing studies to form a multiorgan patient fitness assessment from a single CT scan.

Task-based assessment of a convolutional neural network for segmenting breast lesions for radiomic analysis

PURPOSE

Radiomics allows for powerful data-mining and feature extraction techniques to guide clinical decision making. Image segmentation is a necessary step in such pipelines and different techniques can significantly affect results. We demonstrate that a convolutional neural network (CNN) segmentation method performs comparably to expert manual segmentations in an established radiomics pipeline.

METHODS

Using the manual regions of interest (ROIs) of an expert radiologist (R1), a CNN was trained to segment breast lesions from dynamic contrast-enhanced MRI (DCE-MRI). Following network training, we segmented lesions for the testing set of a previously established radiomics pipeline for predicting lymph node metastases using DCE-MRI of breast cancer. Prediction accuracy of CNN segmentations relative to manual segmentations by R1 from the original study, a resident (R2), and another expert radiologist (R3) were determined. We then retrained the CNN and radiomics model using R3's manual segmentations to determine the effects of different expert observers on end-to-end prediction.

RESULTS

Using R1's ROIs, the CNN achieved a mean Dice coefficient of 0.71 ± 0.16 in the testing set. When input to our previously published radiomics pipeline, these CNN segmentations achieved comparable prediction performance to R1's manual ROIs, and superior performance to those of the other radiologists. Similar results were seen when training the CNN and radiomics model using R3's ROIs.

CONCLUSION

A CNN architecture is able to provide DCE-MRI breast lesion segmentations which are suitable for input to our radiomics model. Moreover, the previously established radiomics model and CNN can be accurately trained end-to-end using ground truth data provided by distinct experts.

Image-based biomarkers for solid tumor quantification

The last few decades have witnessed tremendous technological developments in image-based biomarkers for tumor quantification and characterization. Initially limited to manual one- and two-dimensional size measurements, image biomarkers have evolved to harness developments not only in image acquisition technology but also in image processing and analysis algorithms. At the same time, clinical validation remains a major challenge for the vast majority of these novel techniques, and there is still a major gap between the latest technological developments and image biomarkers used in everyday clinical practice. Currently, the imaging biomarker field is attracting increasing attention not only because of the tremendous interest in cutting-edge therapeutic developments and personalized medicine but also because of the recent progress in the application of artificial intelligence (AI) algorithms to large-scale datasets. Thus, the goal of the present article is to review the current state of the art for image biomarkers and their use for characterization and predictive quantification of solid tumors. Beginning with an overview of validated imaging biomarkers in current clinical practice, we proceed to a review of AI-based methods for tumor characterization, such as radiomics-based approaches and deep learning.Key Points• Recent years have seen tremendous technological developments in image-based biomarkers for tumor quantification and characterization.• Image-based biomarkers can be used on an ongoing basis, in a non-invasive (or mildly invasive) way, to monitor the development and progression of the disease or its response to therapy.• We review the current state of the art for image biomarkers, as well as the recent developments in artificial intelligence (AI) algorithms for image processing and analysis.

Multisite evaluation of radiomic feature reproducibility and discriminability for identifying peripheral zone prostate tumors on MRI

Recent advances in the field of radiomics have enabled the development of a number of prognostic and predictive imaging-based tools for a variety of diseases. However, wider clinical adoption of these tools is contingent on their generalizability across multiple sites and scanners. This may be particularly relevant in the context of radiomic features derived from T1- or T2-weighted magnetic resonance images (MRIs), where signal intensity values are known to lack tissue-specific meaning and vary based on differing acquisition protocols between institutions. We present the first empirical study of benchmarking five different radiomic feature families in terms of both reproducibility and discriminability in a multisite setting, specifically, for identifying prostate tumors in the peripheral zone on MRI. Our cohort comprised 147 patient T2-weighted MRI datasets from four different sites, all of which are first preprocessed to correct for acquisition-related artifacts such as bias field, differing voxel resolutions, and intensity drift (nonstandardness). About 406 three-dimensional voxel-wise radiomic features from five different families (gray, Haralick, gradient, Laws, and Gabor) were evaluated in a cross-site setting to determine (a) how reproducible they are within a relatively homogeneous nontumor tissue region and (b) how well they could discriminate tumor regions from nontumor regions. Our results demonstrate that a majority of the popular Haralick features are reproducible in over 99% of all cross-site comparisons, as well as achieve excellent cross-site discriminability (classification accuracy of ≈ 0.8 ). By contrast, a majority of Laws features are highly variable across sites (reproducible in < 75 % of all cross-site comparisons) as well as resulting in low cross-site classifier accuracies ( < 0.6 ), likely due to a large number of noisy filter responses that can be extracted. These trends suggest that only a subset of radiomic features and associated parameters may be both reproducible and discriminable enough for use within machine learning classifier schemes.

Radiomics in Kidney Cancer: MR Imaging

Renal tumors encompass a heterogeneous disease spectrum, which confounds patient management and treatment. Percutaneous biopsy is limited by an inability to sample every part of the tumor. Radiomics may provide detail beyond what can be achieved from human interpretation. Understanding what new technologies offer will allow radiologists to play a greater role in caring for patients with renal cell carcinoma. In this article, we review the use of radiomics in renal cell carcinoma, in both the pretreatment assessment of renal masses and posttreatment evaluation of renal cell carcinoma, with special emphasis on the use of multiparametric MR imaging datasets.

Radiomics-Based Pretherapeutic Prediction of Non-response to Neoadjuvant Therapy in Locally Advanced Rectal Cancer

Objective

The aim of this study was to investigate whether pretherapeutic, multiparametric magnetic resonance imaging (MRI) radiomic features can be used for predicting non-response to neoadjuvant therapy in patients with locally advanced rectal cancer (LARC).

Methods

We retrospectively enrolled 425 patients with LARC [allocated in a 3:1 ratio to a primary (n = 318) or validation (n = 107) cohort] who received neoadjuvant therapy before surgery. All patients underwent T1-weighted, T2-weighted, diffusion-weighted, and contrast-enhanced T1-weighted MRI scans before receiving neoadjuvant therapy. We extracted 2424 radiomic features from the pretherapeutic, multiparametric MR images of each patient. The Wilcoxon rank-sum test, Spearman correlation analysis, and least absolute shrinkage and selection operator regression were successively performed for feature selection, whereupon a multiparametric MRI-based radiomic model was established by means of multivariate logistic regression analysis. This feature selection and multivariate logistic regression analysis was also performed on all single-modality MRI data to establish four single-modality radiomic models. The performance of the five radiomic models was evaluated by receiver operating characteristic (ROC) curve analysis in both cohorts.

Results

The multiparametric, MRI-based radiomic model based on 16 features showed good predictive performance in both the primary (p < 0.01) and validation (p < 0.05) cohorts, and performed better than all single-modality models. The area under the ROC curve of this multiparametric MRI-based radiomic model achieved a score of 0.822 (95% CI 0.752–0.891).

Conclusions

We demonstrated that pretherapeutic, multiparametric MRI radiomic features have potential in predicting non-response to neoadjuvant therapy in patients with LARC.

Electronic supplementary material

The online version of this article (10.1245/s10434-019-07300-3) contains supplementary material, which is available to authorized users.

Identification of the presence of ischaemic stroke lesions by means of texture analysis on brain magnetic resonance images

•

Radiomics in conventionally segmented tissues can identify MRI scans that had a stroke.

•

Patient’s advanced age can negatively influence classification results.

•

Feature selection and stroke subtype influence but do not determine accuracy.

•

Stroke subtype cannot be ascertained from texture analysis in brain tissues.

Background

The differential quantification of brain atrophy, white matter hyperintensities (WMH) and stroke lesions is important in studies of stroke and dementia. However, the presence of stroke lesions is usually overlooked by automatic neuroimage processing methods and the-state-of-the-art deep learning schemes, which lack sufficient annotated data. We explore the use of radiomics in identifying whether a brain magnetic resonance imaging (MRI) scan belongs to an individual that had a stroke or not.

Materials and methods

We used 1800 3D sets of MRI data from three prospective studies: one of stroke mechanisms and two of cognitive ageing, evaluated 114 textural features in WMH, cerebrospinal fluid, deep grey and normal-appearing white matter, and attempted to classify the scans using a random forest and support vector machine classifiers with and without feature selection. We evaluated the discriminatory power of each feature independently in each population and corrected the result against Type 1 errors. We also evaluated the influence of clinical parameters in the classification results.

Results

Subtypes of ischaemic strokes (i.e. lacunar vs. cortical) cannot be discerned using radiomics, but the presence of a stroke-type lesion can be ascertained with accuracies ranging from 0.7 < AUC < 0.83. Feature selection, tissue type, stroke subtype and MRI sequence did not seem to determine the classification results. From all clinical variables evaluated, age correlated with the proportion of images classified correctly using either different or the same descriptors (Pearson r = 0.31 and 0.39 respectively, p < 0.001).

Conclusions

Texture features in conventionally automatically segmented tissues may help in the identification of the presence of previous stroke lesions on an MRI scan, and should be taken into account in transfer learning strategies of the-state-of-the-art deep learning schemes.

How clinical imaging can assess cancer biology

Human cancers represent complex structures, which display substantial inter- and intratumor heterogeneity in their genetic expression and phenotypic features. However, cancers usually exhibit characteristic structural, physiologic, and molecular features and display specific biological capabilities named hallmarks. Many of these tumor traits are imageable through different imaging techniques. Imaging is able to spatially map key cancer features and tumor heterogeneity improving tumor diagnosis, characterization, and management. This paper aims to summarize the current and emerging applications of imaging in tumor biology assessment.

Multicenter CT phantoms public dataset for radiomics reproducibility tests

PURPOSE

The aim of this paper is to describe a public, open-access, computed tomography (CT) phantom image set acquired at three centers and collected especially for radiomics reproducibility research. The dataset is useful to test radiomic features reproducibility with respect to various parameters, such as acquisition settings, scanners, and reconstruction algorithms.

ACQUISITION AND VALIDATION METHODS

Three phantoms were scanned in three independent institutions. Images of the following phantoms were acquired: Catphan 700 and COPDGene Phantom II (Phantom Laboratory, Greenwich, NY, USA), and the Triple modality 3D Abdominal Phantom (CIRS, Norfolk, VA, USA). Data were collected at three Dutch medical centers: MAASTRO Clinic (Maastricht, NL), Radboud University Medical Center (Nijmegen, NL), and University Medical Center Groningen (Groningen, NL) with scanners from two different manufacturers Siemens Healthcare and Philips Healthcare. The following acquisition parameter were varied in the phantom scans: slice thickness, reconstruction kernels, and tube current.

DATA FORMAT AND USAGE NOTES

We made the dataset publically available on the Dutch instance of "Extensible Neuroimaging Archive Toolkit-XNAT" (https://xnat.bmia.nl). The dataset is freely available and reusable with attribution (Creative Commons 3.0 license).

POTENTIAL APPLICATIONS

Our goal was to provide a findable, open-access, annotated, and reusable CT phantom dataset for radiomics reproducibility studies. Reproducibility testing and harmonization are fundamental requirements for wide generalizability of radiomics-based clinical prediction models. It is highly desirable to include only reproducible features into models, to be more assured of external validity across hitherto unseen contexts. In this view, phantom data from different centers represent a valuable source of information to exclude CT radiomic features that may already be unstable with respect to simplified structures and tightly controlled scan settings. The intended extension of our shared dataset is to include other modalities and phantoms with more realistic lesion simulations.

Combining Multiple Magnetic Resonance Imaging Sequences Provides Independent Reproducible Radiomics Features

To evaluate the relative contribution of different Magnetic Resonance Imaging (MRI) sequences for the extraction of radiomics features in a cohort of patients with lacrimal gland tumors. This prospective study was approved by the Institutional Review Board and signed informed consent was obtained from all participants. From December 2015 to April 2017, 37 patients with lacrimal gland lesions underwent MRI before surgery, including axial T1-WI, axial Diffusion-WI, coronal DIXON-T2-WI and coronal post-contrast DIXON-T1-WI. Two readers manually delineated both lacrimal glands to assess inter-observer reproducibility, and one reader performed two successive delineations to assess intra-observer reproducibility. Radiomics features were extracted using an in-house software to calculate 85 features per region-of-interest (510 features/patient). Reproducible features were defined as features presenting both an intra-class correlation coefficient ≥0.8 and a concordance correlation coefficient ≥0.9 across combinations of the three delineations. Among these features, the ones yielding redundant information were identified as clusters using hierarchical clustering based on the Spearman correlation coefficient. All the MR sequences provided reproducible radiomics features (range 14(16%)−37(44%)) and non-redundant clusters (range 5–14). The highest numbers of features and clusters were provided by the water and in-phase DIXON T2-WI and water and in-phase post-contrast DIXON T1-WI (37, 26, 26 and 26 features and 14,12, 9 and 11 clusters, respectively). A total of 145 reproducible features grouped into 51 independent clusters was provided by pooling all the MR sequences. All MRI sequences provided reproducible radiomics features yielding independent information which could potentially serve as biomarkers.

The Applications of Radiomics in Precision Diagnosis and Treatment of Oncology: Opportunities and Challenges

Medical imaging can assess the tumor and its environment in their entirety, which makes it suitable for monitoring the temporal and spatial characteristics of the tumor. Progress in computational methods, especially in artificial intelligence for medical image process and analysis, has converted these images into quantitative and minable data associated with clinical events in oncology management. This concept was first described as radiomics in 2012. Since then, computer scientists, radiologists, and oncologists have gravitated towards this new tool and exploited advanced methodologies to mine the information behind medical images. On the basis of a great quantity of radiographic images and novel computational technologies, researchers developed and validated radiomic models that may improve the accuracy of diagnoses and therapy response assessments. Here, we review the recent methodological developments in radiomics, including data acquisition, tumor segmentation, feature extraction, and modelling, as well as the rapidly developing deep learning technology. Moreover, we outline the main applications of radiomics in diagnosis, treatment planning and evaluations in the field of oncology with the aim of developing quantitative and personalized medicine. Finally, we discuss the challenges in the field of radiomics and the scope and clinical applicability of these methods.

Objective risk stratification of prostate cancer using machine learning and radiomics applied to multiparametric magnetic resonance images

Multiparametric magnetic resonance imaging (mpMRI) has become increasingly important for the clinical assessment of prostate cancer (PCa), but its interpretation is generally variable due to its relatively subjective nature. Radiomics and classification methods have shown potential for improving the accuracy and objectivity of mpMRI-based PCa assessment. However, these studies are limited to a small number of classification methods, evaluation using the AUC score only, and a non-rigorous assessment of all possible combinations of radiomics and classification methods. This paper presents a systematic and rigorous framework comprised of classification, cross-validation and statistical analyses that was developed to identify the best performing classifier for PCa risk stratification based on mpMRI-derived radiomic features derived from a sizeable cohort. This classifier performed well in an independent validation set, including performing better than PI-RADS v2 in some aspects, indicating the value of objectively interpreting mpMRI images using radiomics and classification methods for PCa risk assessment.