Machine Learning methods for Quantitative Radiomic Biomarkers

Data Analysis Strategies in Medical Imaging

Radiographic imaging continues to be one of the most effective and clinically useful tools within oncology. Sophistication of artificial intelligence has allowed for detailed quantification of radiographic characteristics of tissues using predefined engineered algorithms or deep learning methods. Precedents in radiology as well as a wealth of research studies hint at the clinical relevance of these characteristics. However, critical challenges are associated with the analysis of medical imaging data. Although some of these challenges are specific to the imaging field, many others like reproducibility and batch effects are generic and have already been addressed in other quantitative fields such as genomics. Here, we identify these pitfalls and provide recommendations for analysis strategies of medical imaging data, including data normalization, development of robust models, and rigorous statistical analyses. Adhering to these recommendations will not only improve analysis quality but also enhance precision medicine by allowing better integration of imaging data with other biomedical data sources. Clin Cancer Res; 24(15); 3492-9. ©2018 AACR.

Artificial intelligence in radiology

Artificial intelligence (AI) algorithms, particularly deep learning, have demonstrated remarkable progress in image-recognition tasks. Methods ranging from convolutional neural networks to variational autoencoders have found myriad applications in the medical image analysis field, propelling it forward at a rapid pace. Historically, in radiology practice, trained physicians visually assessed medical images for the detection, characterization and monitoring of diseases. AI methods excel at automatically recognizing complex patterns in imaging data and providing quantitative, rather than qualitative, assessments of radiographic characteristics. In this Opinion article, we establish a general understanding of AI methods, particularly those pertaining to image-based tasks. We explore how these methods could impact multiple facets of radiology, with a general focus on applications in oncology, and demonstrate ways in which these methods are advancing the field. Finally, we discuss the challenges facing clinical implementation and provide our perspective on how the domain could be advanced.

Artificial intelligence in radiology

Artificial intelligence (AI) algorithms, particularly deep learning, have demonstrated remarkable progress in image-recognition tasks. Methods ranging from convolutional neural networks to variational autoencoders have found myriad applications in the medical image analysis field, propelling it forward at a rapid pace. Historically, in radiology practice, trained physicians visually assessed medical images for the detection, characterization and monitoring of diseases. AI methods excel at automatically recognizing complex patterns in imaging data and providing quantitative, rather than qualitative, assessments of radiographic characteristics. In this Opinion article, we establish a general understanding of AI methods, particularly those pertaining to image-based tasks. We explore how these methods could impact multiple facets of radiology, with a general focus on applications in oncology, and demonstrate ways in which these methods are advancing the field. Finally, we discuss the challenges facing clinical implementation and provide our perspective on how the domain could be advanced.

CNN models discriminating between pulmonary micro-nodules and non-nodules from CT images

Background

Early and automatic detection of pulmonary nodules from CT lung screening is the prerequisite for precise management of lung cancer. However, a large number of false positives appear in order to increase the sensitivity, especially for detecting micro-nodules (diameter < 3 mm), which increases the radiologists’ workload and causes unnecessary anxiety for the patients. To decrease the false positive rate, we propose to use CNN models to discriminate between pulmonary micro-nodules and non-nodules from CT image patches.

Methods

A total of 13,179 micro-nodules and 21,315 non-nodules marked by radiologists are extracted with three different patch sizes (16 × 16, 32 × 32 and 64 × 64) from LIDC/IDRI database and used in the experiments. Three CNN models with different depths (1, 2 or 4 convolutional layers) are designed; their performances are evaluated by the fivefold cross-validation in term of the accuracy, area under the curve (AUC), F-score and sensitivity. The network parameters are also optimized.

Results

It is found that the performance of the CNN models is greatly dependent on the patches size and the number of convolutional layers. The CNN model with two convolutional layers presented the best performance in case of 32 × 32 patches size, achieving an accuracy of 88.28%, an AUC of 0.87, a F-score of 83.45% and a sensitivity of 83.82%.

Conclusions

The CNN models with appropriate depth and size of image patches can effectively discriminate between pulmonary micro-nodules and non-nodules, and reduce the false positives and help manage lung cancer precisely.

The Role of Advanced Brain Tumor Imaging in the Care of Patients with Central Nervous System Malignancies

OPINION STATEMENT

T1-weighted post-contrast and T2-weighted fluid-attenuated inversion recovery (FLAIR) magnetic resonance imaging (MRI) constitute the gold standard for diagnosis and response assessment in neuro-oncologic patients but are limited in their ability to accurately reflect tumor biology and metabolism, particularly over the course of a patient's treatment. Advanced MR imaging methods are sensitized to different biophysical processes in tissue, including blood perfusion, tumor metabolism, and chemical composition of tissue, and provide more specific information on tissue physiology than standard MRI. This review provides an overview of the most common and emerging advanced imaging modalities in the field of brain tumor imaging and their applications in the care of neuro-oncologic patients.

Machine learning algorithms for outcome prediction in (chemo)radiotherapy: An empirical comparison of classifiers

Purpose:

Machine learning classification algorithms (classifiers) for prediction of treatment response are becoming more popular in radiotherapy literature. General Machine learning literature provides evidence in favor of some classifier families (random forest, support vector machine, gradient boosting) in terms of classification performance. The purpose of this study is to compare such classifiers specifically for (chemo)radiotherapy datasets and to estimate their average discriminative performance for radiation treatment outcome prediction.

Methods:

We collected 12 datasets (3496 patients) from prior studies on post-(chemo)radiotherapy toxicity, survival, or tumor control with clinical, dosimetric, or blood biomarker features from multiple institutions and for different tumor sites, that is, (non-)small-cell lung cancer, head and neck cancer, and meningioma. Six common classification algorithms with built-in feature selection (decision tree, random forest, neural network, support vector machine, elastic net logistic regression, Logit-Boost) were applied on each dataset using the popular open-source R package caret. The R code and documentation for the analysis are available online (https://github.com/timodeist/classifier_selection_code). All classifiers were run on each dataset in a 100-repeated nested fivefold cross-validation with hyperparameter tuning. Performance metrics (AUC, calibration slope and intercept, accuracy, Cohen’s kappa, and Brier score) were computed. We ranked classifiers by AUC to determine which classifier is likely to also perform well in future studies. We simulated the benefit for potential investigators to select a certain classifier for a new dataset based on our study (pre-selection based on other datasets) or estimating the best classifier for a dataset (set-specific selection based on information from the new dataset) compared with uninformed classifier selection (random selection).

Results:

Random forest (best in 6/12 datasets) and elastic net logistic regression (best in 4/12 datasets) showed the overall best discrimination, but there was no single best classifier across datasets. Both classifiers had a median AUC rank of 2. Preselection and set-specific selection yielded a significant average AUC improvement of 0.02 and 0.02 over random selection with an average AUC rank improvement of 0.42 and 0.66, respectively.

Conclusion:

Random forest and elastic net logistic regression yield higher discriminative performance in (chemo)radiotherapy outcome and toxicity prediction than other studied classifiers. Thus, one of these two classifiers should be the first choice for investigators when building classification models or to benchmark one’s own modeling results against. Our results also show that an informed preselection of classifiers based on existing datasets can improve discrimination over random selection.

Integrative radiomics expression predicts molecular subtypes of primary clear cell renal cell carcinoma

AIM

To identify combined positron-emission tomography (PET)/magnetic resonance imaging (MRI)-based radiomics as a surrogate biomarker of intratumour disease risk for molecular subtype ccA and ccB in patients with primary clear cell renal cell carcinoma (ccRCC).

MATERIALS AND METHODS

PET/MRI data were analysed retrospectively from eight patients. One hundred and sixty-eight radiomics features for each tumour sampling based on the regionally sampled tumours with 23 specimens were extracted. Sparse partial least squares discriminant analysis (SPLS-DA) was applied to feature screening on high-throughput radiomics features and project the selected features to low-dimensional intrinsic latent components as radiomics signatures. In addition, multilevel omics datasets were leveraged to explore the complementing information and elevate the discriminative ability.

RESULTS

The correct classification rate (CCR) for molecular subtype classification by SPLS-DA using only radiomics features was 86.96% with permutation test p=7×10^-4. When multi-omics datasets including mRNA, microvascular density, and clinical parameters from each specimen were combined with radiomics features to refine the model of SPLS-DA, the best CCR was 95.65% with permutation test, p<10^-4; however, even in the case of generating the classification based on transcription features, which is the reference standard, there is roughly 10% classification ambiguity. Thus, this classification level (86.96-95.65%) of the proposed method represents the discriminating level that is consistent with reality.

CONCLUSION

Featured with high accuracy, an integrated multi-omics model of PET/MRI-based radiomics could be the first non-invasive investigation for disease risk stratification and guidance of treatment in patients with primary ccRCC.

Novel Quantitative Imaging for Predicting Response to Therapy: Techniques and Clinical Applications

The current standard of Response Evaluation Criteria in Solid Tumors (RECIST)-based tumor response evaluation is limited in its ability to accurately monitor treatment response. Radiomics, an approach involving computerized extraction of several quantitative imaging features, has shown promise in predicting as well as monitoring response to therapy. In this article, we provide a brief overview of radiomic approaches and the various analytical methods and techniques, specifically in the context of predicting and monitoring treatment response for non-small cell lung cancer (NSCLC). We briefly summarize some of the various types of radiomic features, including tumor shape and textural patterns, both within the tumor and within the adjacent tumor microenvironment. Additionally, we also discuss work in delta-radiomics or change in radiomic features (e.g., texture within the nodule) across longitudinally interspersed images in time for monitoring changes in therapy. We discuss the utility of these approaches for NSCLC, specifically the role of radiomics as a prognostic marker for treatment effectiveness and early therapy response, including chemoradiation, immunotherapy, and trimodality therapy.

Radiomics in Nuclear Medicine Applied to Radiation Therapy: Methods, Pitfalls, and Challenges

Radiomics is a recent area of research in precision medicine and is based on the extraction of a large variety of features from medical images. In the field of radiation oncology, comprehensive image analysis is crucial to personalization of treatments. A better characterization of local heterogeneity and the shape of the tumor, depicting individual cancer aggressiveness, could guide dose planning and suggest volumes in which a higher dose is needed for better tumor control. In addition, noninvasive imaging features that could predict treatment outcome from baseline scans could help the radiation oncologist to determine the best treatment strategies and to stratify patients as at low risk or high risk of recurrence. Nuclear medicine molecular imaging reflects information regarding biological processes in the tumor thanks to a wide range of radiotracers. Many studies involving ¹⁸F-fluorodeoxyglucose positron emission tomography suggest an added value of radiomics compared with the use of conventional PET metrics such as standardized uptake value for both tumor diagnosis and prediction of recurrence or treatment outcome. However, these promising results should not hide technical difficulties that still currently prevent the approach from being widely studied or clinically used. These difficulties mostly pertain to the variability of the imaging features as a function of the acquisition device and protocol, the robustness of the models with respect to that variability, and the interpretation of the radiomic models. Addressing the impact of the variability in acquisition and reconstruction protocols is needed, as is harmonizing the radiomic feature calculation methods, to ensure the reproducibility of studies in a multicenter context and their implementation in a clinical workflow. In this review, we explain the potential impact of positron emission tomography radiomics for radiation therapy and underline the various aspects that need to be carefully addressed to make the most of this promising approach.

Optimizing a machine learning based glioma grading system using multi-parametric MRI histogram and texture features

Current machine learning techniques provide the opportunity to develop noninvasive and automated glioma grading tools, by utilizing quantitative parameters derived from multi-modal magnetic resonance imaging (MRI) data. However, the efficacies of different machine learning methods in glioma grading have not been investigated.A comprehensive comparison of varied machine learning methods in differentiating low-grade gliomas (LGGs) and high-grade gliomas (HGGs) as well as WHO grade II, III and IV gliomas based on multi-parametric MRI images was proposed in the current study. The parametric histogram and image texture attributes of 120 glioma patients were extracted from the perfusion, diffusion and permeability parametric maps of preoperative MRI. Then, 25 commonly used machine learning classifiers combined with 8 independent attribute selection methods were applied and evaluated using leave-one-out cross validation (LOOCV) strategy. Besides, the influences of parameter selection on the classifying performances were investigated. We found that support vector machine (SVM) exhibited superior performance to other classifiers. By combining all tumor attributes with synthetic minority over-sampling technique (SMOTE), the highest classifying accuracy of 0.945 or 0.961 for LGG and HGG or grade II, III and IV gliomas was achieved. Application of Recursive Feature Elimination (RFE) attribute selection strategy further improved the classifying accuracies. Besides, the performances of LibSVM, SMO, IBk classifiers were influenced by some key parameters such as kernel type, c, gama, K, etc. SVM is a promising tool in developing automated preoperative glioma grading system, especially when being combined with RFE strategy. Model parameters should be considered in glioma grading model optimization.

Machine Learning in Radiation Oncology: Opportunities, Requirements, and Needs

Machine learning (ML) has the potential to revolutionize the field of radiation oncology, but there is much work to be done. In this article, we approach the radiotherapy process from a workflow perspective, identifying specific areas where a data-centric approach using ML could improve the quality and efficiency of patient care. We highlight areas where ML has already been used, and identify areas where we should invest additional resources. We believe that this article can serve as a guide for both clinicians and researchers to start discussing issues that must be addressed in a timely manner.

Toward Automated Pre-Biopsy Thyroid Cancer Risk Estimation in Ultrasound

We propose a computational framework for automated cancer risk estimation of thyroid nodules visualized in ultrasound (US) images. Our framework estimates the probability of nodule malignancy using random forests on a rich set of computational features. An expert radiologist annotated thyroid nodules in 93 biopsy-confirmed patients using semantic image descriptors derived from standardized lexicon. On our dataset, the AUC of the proposed method was 0.70, which was comparable to five baseline expert annotation-based classifiers with AUC values from 0.72 to 0.81. Moreover, the use of the framework for decision making on nodule biopsy could have spared five out of 46 benign nodule biopsies at no cost to the health of patients with malignancies. Our results confirm the feasibility of computer-aided tools for noninvasive malignancy risk estimation in patients with thyroid nodules that could help to decrease the number of unnecessary biopsies and surgeries.

HER3-Mediated Resistance to Hsp90 Inhibition Detected in Breast Cancer Xenografts by Affibody-Based PET Imaging

Purpose: Recent studies have highlighted a role of HER3 in HER2-driven cancers (e.g., breast cancer), implicating the upregulation of the receptor in resistance to HER-targeted therapies and Hsp90 inhibitors (e.g., AUY922). Therefore, we have developed an affibody-based PET radioconjugate that quantitatively assesses HER3 changes induced by Hsp90 inhibition in vivoExperimental Design: ZHER3:8698 affibody molecules were conjugated via the C-terminus cysteine to DFO-maleimide for 89Zr radiolabeling. The probe was characterized in vitro and in vivo in a panel of human breast cell lines and xenograft models with varying HER3 receptor levels. In addition, the radioconjugate was investigated as a tool to monitor the outcome of AUY922, an Hsp90 inhibitor, in an MCF-7 xenograft model.Results: We demonstrated that 89Zr-DFO-ZHER3:8698 can track changes in receptor expression in HER3-positive xenograft models and monitor the outcome of AUY922 treatment. Our in vitro findings showed that MCF-7 cells, which are phenotypically different from BT474, develop resistance to treatment with AUY922 through HER3/IGF-1Rβ-mediated signaling. Of note, the lack of response in vitro due to HER3 recovery was confirmed in vivo using 89Zr-DFO-ZHER3:8698-based imaging. Upon AUY922 treatment, higher radioconjugate uptake was detected in treated MCF-7 xenografts, correlating with an AUY922-induced HER3 upregulation concomitant with an increase in IGF-1Rβ expression.Conclusions: These data underline the potential of HER3-based PET imaging to noninvasively provide information about HER3 expression and to identify patients not responding to targeted therapies due to HER3 recovery. Clin Cancer Res; 24(8); 1853-65. ©2018 AACR.

Fractal-based radiomic approach to predict complete pathological response after chemo-radiotherapy in rectal cancer

The aim of this study was to propose a methodology to investigate the tumour heterogeneity and evaluate its ability to predict pathologically complete response (pCR) after chemo-radiotherapy (CRT) in locally advanced rectal cancer (LARC). This approach consisted in normalising the pixel intensities of the tumour and identifying the different sub-regions using an intensity-based thresholding. The spatial organisation of these subpopulations was quantified using the fractal dimension (FD). This approach was implemented in a radiomic workflow and applied to 198 T2-weighted pre-treatment magnetic resonance (MR) images of LARC patients. Three types of features were extracted from the gross tumour volume (GTV): morphological, statistical and fractal features. Feature selection was performed using the Wilcoxon test and a logistic regression model was calculated to predict the pCR probability after CRT. The model was elaborated considering the patients treated in two institutions: Fondazione Policlinico Universitario "Agostino Gemelli" of Rome (173 cases, training set) and University Medical Centre of Maastricht (25 cases, validation set). The results obtained showed that the fractal parameters of the subpopulations have the highest performance in predicting pCR. The predictive model elaborated had an area under the curve (AUC) equal to 0.77 ± 0.07. The model reliability was confirmed by the validation set (AUC = 0.79 ± 0.09). This study suggests that the fractal analysis can play an important role in radiomics, providing valuable information not only about the GTV structure, but also about its inner subpopulations.

Combination of computer extracted shape and texture features enables discrimination of granulomas from adenocarcinoma on chest computed tomography

Differentiation between benign and malignant nodules is a problem encountered by radiologists when visualizing computed tomography (CT) scans. Adenocarcinomas and granulomas have a characteristic spiculated appearance and may be fluorodeoxyglucose avid, making them difficult to distinguish for human readers. In this retrospective study, we aimed to evaluate whether a combination of radiomic texture and shape features from noncontrast CT scans can enable discrimination between granulomas and adenocarcinomas. Our study is composed of CT scans of 195 patients from two institutions, one cohort for training ([Formula: see text]) and the other ([Formula: see text]) for independent validation. A set of 645 three-dimensional texture and 24 shape features were extracted from CT scans in the training cohort. Feature selection was employed to identify the most informative features using this set. The top ranked features were also assessed in terms of their stability and reproducibility across the training and testing cohorts and between scans of different slice thickness. Three different classifiers were constructed using the top ranked features identified from the training set. These classifiers were then validated on the test set and the best classifier (support vector machine) yielded an area under the receiver operating characteristic curve of 77.8%.

Radiomics in radiooncology - Challenging the medical physicist

PURPOSE

Noticing the fast growing translation of artificial intelligence (AI) technologies to medical image analysis this paper emphasizes the future role of the medical physicist in this evolving field. Specific challenges are addressed when implementing big data concepts with high-throughput image data processing like radiomics and machine learning in a radiooncology environment to support clinical decisions.

METHODS

Based on the experience of our interdisciplinary radiomics working group, techniques for processing minable data, extracting radiomics features and associating this information with clinical, physical and biological data for the development of prediction models are described. A special emphasis was placed on the potential clinical significance of such an approach.

RESULTS

Clinical studies demonstrate the role of radiomics analysis as an additional independent source of information with the potential to influence the radiooncology practice, i.e. to predict patient prognosis, treatment response and underlying genetic changes. Extending the radiomics approach to integrate imaging, clinical, genetic and dosimetric data ('panomics') challenges the medical physicist as member of the radiooncology team.

CONCLUSIONS

The new field of big data processing in radiooncology offers opportunities to support clinical decisions, to improve predicting treatment outcome and to stimulate fundamental research on radiation response both of tumor and normal tissue. The integration of physical data (e.g. treatment planning, dosimetric, image guidance data) demands an involvement of the medical physicist in the radiomics approach of radiooncology. To cope with this challenge national and international organizations for medical physics should organize more training opportunities in artificial intelligence technologies in radiooncology.

Radiomic Analysis Reveals Prognostic Information in T1-Weighted Baseline Magnetic Resonance Imaging in Patients With Glioblastoma

OBJECTIVES

The aim of this study was to investigate whether radiomic analysis with random survival forests (RSFs) can predict overall survival from T1-weighted contrast-enhanced baseline magnetic resonance imaging (MRI) scans in a cohort of glioblastoma multiforme (GBM) patients with uniform treatment.

MATERIALS AND METHODS

This retrospective study was approved by the institutional review board and informed consent was waived. The MRI scans from 66 patients with newly diagnosed GBM from a previous prospective study were analyzed. Tumors were segmented manually on contrast-enhanced 3-dimensional T1-weighted images. Using these segmentations, P = 208 quantitative image features characterizing tumor shape, signal intensity, and texture were calculated in an automated fashion. On this data set, an RSF was trained using 10-fold cross validation to establish a link between image features and overall survival, and the individual risk for each patient was predicted. The mean concordance index was assessed as a measure of prediction accuracy. Association of individual risk with overall survival was assessed using Kaplan-Meier analysis and a univariate proportional hazards model.

RESULTS

Mean overall survival was 14 months (range, 0.8-85 months). Mean concordance index of the 10-fold cross-validated RSF was 0.67. Kaplan-Meier analysis clearly distinguished 2 patient groups with high and low predicted individual risk (P = 5.5 × 10). Low predicted individual mortality was found to be a favorable prognostic factor for overall survival in a univariate Cox proportional hazards model (hazards ratio, 1.038; 95% confidence interval, 1.015-1.062; P = 0.0059).

CONCLUSIONS

This study demonstrates that baseline MRI in GBM patients contains prognostic information, which can be accessed by radiomic analysis using RSFs.

Digital liver biopsy: Bio-imaging of fatty liver for translational and clinical research

The rapidly growing field of functional, molecular and structural bio-imaging is providing an extraordinary new opportunity to overcome the limits of invasive liver biopsy and introduce a "digital biopsy" for in vivo study of liver pathophysiology. To foster the application of bio-imaging in clinical and translational research, there is a need to standardize the methods of both acquisition and the storage of the bio-images of the liver. It can be hoped that the combination of digital, liquid and histologic liver biopsies will provide an innovative synergistic tri-dimensional approach to identifying new aetiologies, diagnostic and prognostic biomarkers and therapeutic targets for the optimization of personalized therapy of liver diseases and liver cancer. A group of experts of different disciplines (Special Interest Group for Personalized Hepatology of the Italian Association for the Study of the Liver, Institute for Biostructures and Bio-imaging of the National Research Council and Bio-banking and Biomolecular Resources Research Infrastructure) discussed criteria, methods and guidelines for facilitating the requisite application of data collection. This manuscript provides a multi-Author review of the issue with special focus on fatty liver.

Radiomic features on MRI enable risk categorization of prostate cancer patients on active surveillance: Preliminary findings

BACKGROUND

Radiomic analysis is defined as computationally extracting features from radiographic images for quantitatively characterizing disease patterns. There has been recent interest in examining the use of MRI for identifying prostate cancer (PCa) aggressiveness in patients on active surveillance (AS).

PURPOSE

To evaluate the performance of MRI-based radiomic features in identifying the presence or absence of clinically significant PCa in AS patients.

STUDY TYPE

Retrospective.

SUBJECTS MODEL

MRI/TRUS (transperineal grid ultrasound) fusion-guided biopsy was performed for 56 PCa patients on AS who had undergone prebiopsy.

FIELD STRENGTH/SEQUENCE

3T, T2 -weighted (T2 w) and diffusion-weighted (DW) MRI.

ASSESSMENT

A pathologist histopathologically defined the presence of clinically significant disease. A radiologist manually delineated lesions on T2 w-MRs. Then three radiologists assessed MRIs using PIRADS v2.0 guidelines. Tumors were categorized into four groups: MRI-negative-biopsy-negative (Group 1, N = 15), MRI-positive-biopsy-positive (Group 2, N = 16), MRI-negative-biopsy-positive (Group 3, N = 10), and MRI-positive-biopsy-negative (Group 4, N = 15). In all, 308 radiomic features (First-order statistics, Gabor, Laws Energy, and Haralick) were extracted from within the annotated lesions on T2 w images and apparent diffusion coefficient (ADC) maps. The top 10 features associated with clinically significant tumors were identified using minimum-redundancy-maximum-relevance and used to construct three machine-learning models that were independently evaluated for their ability to identify the presence and absence of clinically significant disease.

STATISTICAL TESTS

Wilcoxon rank-sum tests with P < 0.05 considered statistically significant.

RESULTS

Seven T2 w-based (First-order Statistics, Haralick, Laws, and Gabor) and three ADC-based radiomic features (Laws, Gradient and Sobel) exhibited statistically significant differences (P < 0.001) between malignant and normal regions in the training groups. The three constructed models yielded overall accuracy improvement of 33, 60, 80% and 30, 40, 60% for patients in testing groups, when compared to PIRADS v2.0 alone.

DATA CONCLUSION

Radiomic features could help in identifying the presence and absence of clinically significant disease in AS patients when PIRADS v2.0 assessment on MRI contradicted pathology findings of MRI-TRUS prostate biopsies.

LEVEL OF EVIDENCE

3 Technical Efficacy: Stage 2 J. Magn. Reson. Imaging 2018.

Radiomic features analysis in computed tomography images of lung nodule classification

Purpose

Radiomics, which extract large amount of quantification image features from diagnostic medical images had been widely used for prognostication, treatment response prediction and cancer detection. The treatment options for lung nodules depend on their diagnosis, benign or malignant. Conventionally, lung nodule diagnosis is based on invasive biopsy. Recently, radiomics features, a non-invasive method based on clinical images, have shown high potential in lesion classification, treatment outcome prediction.

Methods

Lung nodule classification using radiomics based on Computed Tomography (CT) image data was investigated and a 4-feature signature was introduced for lung nodule classification. Retrospectively, 72 patients with 75 pulmonary nodules were collected. Radiomics feature extraction was performed on non-enhanced CT images with contours which were delineated by an experienced radiation oncologist.

Result

Among the 750 image features in each case, 76 features were found to have significant differences between benign and malignant lesions. A radiomics signature was composed of the best 4 features which included Laws_LSL_min, Laws_SLL_energy, Laws_SSL_skewness and Laws_EEL_uniformity. The accuracy using the signature in benign or malignant classification was 84% with the sensitivity of 92.85% and the specificity of 72.73%.

Conclusion

The classification signature based on radiomics features demonstrated very good accuracy and high potential in clinical application.

Machine Learning in Medical Imaging

Advances in both imaging and computers have synergistically led to a rapid rise in the potential use of artificial intelligence in various radiological imaging tasks, such as risk assessment, detection, diagnosis, prognosis, and therapy response, as well as in multi-omics disease discovery. A brief overview of the field is given here, allowing the reader to recognize the terminology, the various subfields, and components of machine learning, as well as the clinical potential. Radiomics, an expansion of computer-aided diagnosis, has been defined as the conversion of images to minable data. The ultimate benefit of quantitative radiomics is to (1) yield predictive image-based phenotypes of disease for precision medicine or (2) yield quantitative image-based phenotypes for data mining with other -omics for discovery (ie, imaging genomics). For deep learning in radiology to succeed, note that well-annotated large data sets are needed since deep networks are complex, computer software and hardware are evolving constantly, and subtle differences in disease states are more difficult to perceive than differences in everyday objects. In the future, machine learning in radiology is expected to have a substantial clinical impact with imaging examinations being routinely obtained in clinical practice, providing an opportunity to improve decision support in medical image interpretation. The term of note is decision support, indicating that computers will augment human decision making, making it more effective and efficient. The clinical impact of having computers in the routine clinical practice may allow radiologists to further integrate their knowledge with their clinical colleagues in other medical specialties and allow for precision medicine.

Radiomics in Brain Tumor: Image Assessment, Quantitative Feature Descriptors, and Machine-Learning Approaches

Radiomics describes a broad set of computational methods that extract quantitative features from radiographic images. The resulting features can be used to inform imaging diagnosis, prognosis, and therapy response in oncology. However, major challenges remain for methodologic developments to optimize feature extraction and provide rapid information flow in clinical settings. Equally important, to be clinically useful, predictive radiomic properties must be clearly linked to meaningful biologic characteristics and qualitative imaging properties familiar to radiologists. Here we use a cross-disciplinary approach to highlight studies in radiomics. We review brain tumor radiologic studies (eg, imaging interpretation) through computational models (eg, computer vision and machine learning) that provide novel clinical insights. We outline current quantitative image feature extraction and prediction strategies with different levels of available clinical classes for supporting clinical decision-making. We further discuss machine-learning challenges and data opportunities to advance radiomic studies.

Radiomics as a Quantitative Imaging Biomarker: Practical Considerations and the Current Standpoint in Neuro-oncologic Studies

Radiomics utilizes high-dimensional imaging data to discover the association with diagnostic, prognostic, predictive endpoint or radiogenomics. It is an emerging field of study that potentially depicts the intratumoral heterogeneity from quantitative and classified high-throughput data. The radiomics approach has an analytic pipeline where the imaging features are extracted, processed and analyzed. At this point, special data handling is essential because it faces issues of a high-dimensional biomarker compared to a single biomarker approach. This article describes the potential role of radiomics in oncologic studies, the basic analytic pipeline and special data handling with high-dimensional data to facilitate the radiomics approach as a tool for personalized medicine in oncology.

Diagnosis of Distant Metastasis of Lung Cancer: Based on Clinical and Radiomic Features

OBJECTIVES

To analyze the distant metastasis possibility based on computed tomography (CT) radiomic features in patients with lung cancer.

METHODS

This was a retrospective analysis of 348 patients with lung cancer enrolled between 2014 and February 2015. A feature set containing clinical features and 485 radiomic features was extracted from the pretherapy CT images. Feature selection via concave minimization (FSV) was used to select effective features. A support vector machine (SVM) was used to evaluate the predictive ability of each feature.

RESULTS

Four radiomic features and three clinical features were obtained by FSV feature selection. Classification accuracy by the proposed SVM with SGD method was 71.02%, and the area under the curve was 72.84% with only the radiomic features extracted from CT. After the addition of clinical features, 89.09% can be achieved.

CONCLUSION

The radiomic features of the pretherapy CT images may be used as predictors of distant metastasis. And it also can be used in combination with the patient's gender and tumor T and N phase information to diagnose the possibility of distant metastasis in lung cancer.

Promises and challenges for the implementation of computational medical imaging (radiomics) in oncology

Medical image processing and analysis (also known as Radiomics) is a rapidly growing discipline that maps digital medical images into quantitative data, with the end goal of generating imaging biomarkers as decision support tools for clinical practice. The use of imaging data from routine clinical work-up has tremendous potential in improving cancer care by heightening understanding of tumor biology and aiding in the implementation of precision medicine. As a noninvasive method of assessing the tumor and its microenvironment in their entirety, radiomics allows the evaluation and monitoring of tumor characteristics such as temporal and spatial heterogeneity. One can observe a rapid increase in the number of computational medical imaging publications-milestones that have highlighted the utility of imaging biomarkers in oncology. Nevertheless, the use of radiomics as clinical biomarkers still necessitates amelioration and standardization in order to achieve routine clinical adoption. This Review addresses the critical issues to ensure the proper development of radiomics as a biomarker and facilitate its implementation in clinical practice.

M. D. Anderson Cancer Center Head and Neck Quantitative Imaging Working Group, Elhalawani H, Kanwar A, Mohamed ASR, White A, Zafereo J, Wong A, Berends J, Abohashem S, Williams B, Aymard JM, Perni S, Messer J, Warren B, Youssef B, Yang P, Meheissen MAM, Kamal M, Elgohari B, Ger RB, Cardenas CE, Fave X, Zhang L, Mackin D, Marai GE, Vock DM, Canahuate GM, Lai SY, Gunn GB, Garden AS, Rosenthal DI, Court L, Fuller CD. Investigation of radiomic signatures for local recurrence using primary tumor texture analysis in oropharyngeal head and neck cancer patients

Radiomics is one such "big data" approach that applies advanced image refining/data characterization algorithms to generate imaging features that can quantitatively classify tumor phenotypes in a non-invasive manner. We hypothesize that certain textural features of oropharyngeal cancer (OPC) primary tumors will have statistically significant correlations to patient outcomes such as local control. Patients from an IRB-approved database dispositioned to (chemo)radiotherapy for locally advanced OPC were included in this retrospective series. Pretreatment contrast CT scans were extracted and radiomics-based analysis of gross tumor volume of the primary disease (GTVp) were performed using imaging biomarker explorer (IBEX) software that runs in Matlab platform. Data set was randomly divided into a training dataset and test and tuning holdback dataset. Machine learning methods were applied to yield a radiomic signature consisting of features with minimal overlap and maximum prognostic significance. The radiomic signature was adapted to discriminate patients, in concordance with other key clinical prognosticators. 465 patients were available for analysis. A signature composed of 2 radiomic features from pre-therapy imaging was derived, based on the Intensity Direct and Neighbor Intensity Difference methods. Analysis of resultant groupings showed robust discrimination of recurrence probability and Kaplan-Meier-estimated local control rate (LCR) differences between "favorable" and "unfavorable" clusters were noted.

Comparative analysis of classification based algorithms for diabetes diagnosis using iris images

Photo-diagnosis is always an intriguing area for the researchers, with the advancement of image processing and computer machine vision techniques it have become more reliable and popular in recent years. The objective of this paper is to study the change in the features of iris, particularly irregularities in the pigmentation of certain areas of the iris with respect to diabetic health of an individual. Apart from the point that iris recognition concentrates on the overall structure of the iris, diagnostic techniques emphasises the local variations in the particular area of iris. Pre-image processing techniques have been applied to extract iris and thereafter, region of interest from the extracted iris have been cropped out. In order to observe the changes in the tissue pigmentation of region of interest, statistical, texture textural and wavelet features have been extracted. At the end, a comparison of accuracies of five different classifiers has been presented to classify two subject groups of diabetic and non-diabetic. Best classification accuracy has been calculated as 89.66% by the random forest classifier. Results have been shown the effectiveness and diagnostic significance of the proposed methodology. Presented piece of work offers a novel systemic perspective of non-invasive and automatic diabetic diagnosis.

Spectral multi-energy CT texture analysis with machine learning for tissue classification: an investigation using classification of benign parotid tumours as a testing paradigm

OBJECTIVE

There is a rich amount of quantitative information in spectral datasets generated from dual-energy CT (DECT). In this study, we compare the performance of texture analysis performed on multi-energy datasets to that of virtual monochromatic images (VMIs) at 65 keV only, using classification of the two most common benign parotid neoplasms as a testing paradigm.

METHODS

Forty-two patients with pathologically proven Warthin tumour (n = 25) or pleomorphic adenoma (n = 17) were evaluated. Texture analysis was performed on VMIs ranging from 40 to 140 keV in 5-keV increments (multi-energy analysis) or 65-keV VMIs only, which is typically considered equivalent to single-energy CT. Random forest (RF) models were constructed for outcome prediction using separate randomly selected training and testing sets or the entire patient set.

RESULTS

Using multi-energy texture analysis, tumour classification in the independent testing set had accuracy, sensitivity, specificity, positive predictive value, and negative predictive value of 92%, 86%, 100%, 100%, and 83%, compared to 75%, 57%, 100%, 100%, and 63%, respectively, for single-energy analysis.

CONCLUSIONS

Multi-energy texture analysis demonstrates superior performance compared to single-energy texture analysis of VMIs at 65 keV for classification of benign parotid tumours.

KEY POINTS

• We present and validate a paradigm for texture analysis of DECT scans. • Multi-energy dataset texture analysis is superior to single-energy dataset texture analysis. • DECT texture analysis has high accura\cy for diagnosis of benign parotid tumours. • DECT texture analysis with machine learning can enhance non-invasive diagnostic tumour evaluation.

Computed tomography-based radiomics for prediction of neoadjuvant chemotherapy outcomes in locally advanced gastric cancer: A pilot study

Objective

The standard treatment for patients with locally advanced gastric cancer has relied on perioperative radio-chemotherapy or chemotherapy and surgery. The aim of this study was to investigate the wealth of radiomics for pre-treatment computed tomography (CT) in the prediction of the pathological response of locally advanced gastric cancer with preoperative chemotherapy.

Methods

Thirty consecutive patients with CT-staged II/III gastric cancer receiving neoadjuvant chemotherapy were enrolled in this study between December 2014 and March 2017. All patients underwent upper abdominal CT during the unenhanced, late arterial phase (AP) and portal venous phase (PP) before the administration of neoadjuvant chemotherapy. In total, 19,985 radiomics features were extracted in the AP and PP for each patient. Four methods were adopted during feature selection and eight methods were used in the process of building the classifier model. Thirty-two combinations of feature selection and classification methods were examined. Receiver operating characteristic (ROC) curves were used to evaluate the capability of each combination of feature selection and classification method to predict a non-good response (non-GR) based on tumor regression grade (TRG).

Results

The mean area under the curve (AUC) ranged from 0.194 to 0.621 in the AP, and from 0.455 to 0.722 in the PP, according to different combinations of feature selection and the classification methods. There was only one cross-combination machine-learning method indicating a relatively higher AUC (>0.600) in the AP, while 12 cross-combination machine-learning methods presented relatively higher AUCs (all >0.600) in the PP. The feature selection method adopted by a filter based on linear discriminant analysis + classifier of random forest achieved a significantly prognostic performance in the PP (AUC, 0.722±0.108; accuracy, 0.793; sensitivity, 0.636; specificity, 0.889; Z=2.039; P=0.041).

Conclusions

It is possible to predict non-GR after neoadjuvant chemotherapy in locally advanced gastric cancers based on the radiomics of CT.

Radiomics for Response and Outcome Assessment for Non-Small Cell Lung Cancer

Routine follow-up visits and radiographic imaging are required for outcome evaluation and tumor recurrence monitoring. Yet more personalized surveillance is required in order to sufficiently address the nature of heterogeneity in nonsmall cell lung cancer and possible recurrences upon completion of treatment. Radiomics, an emerging noninvasive technology using medical imaging analysis and data mining methodology, has been adopted to the area of cancer diagnostics in recent years. Its potential application in response assessment for cancer treatment has also drawn considerable attention. Radiomics seeks to extract a large amount of valuable information from patients' medical images (both pretreatment and follow-up images) and quantitatively correlate image features with diagnostic and therapeutic outcomes. Radiomics relies on computers to identify and analyze vast amounts of quantitative image features that were previously overlooked, unmanageable, or failed to be identified (and recorded) by human eyes. The research area has been focusing on the predictive accuracy of pretreatment features for outcome and response and the early discovery of signs of tumor response, recurrence, distant metastasis, radiation-induced lung injury, death, and other outcomes, respectively. This review summarized the application of radiomics in response assessments in radiotherapy and chemotherapy for non-small cell lung cancer, including image acquisition/reconstruction, region of interest definition/segmentation, feature extraction, and feature selection and classification. The literature search for references of this article includes PubMed peer-reviewed publications over the last 10 years on the topics of radiomics, textural features, radiotherapy, chemotherapy, lung cancer, and response assessment. Summary tables of radiomics in response assessment and treatment outcome prediction in radiation oncology have been developed based on the comprehensive review of the literature.

CT Radiomics in Thoracic Oncology: Technique and Clinical Applications

Precision medicine offers better treatment options and improved survival for cancer patients based on individual variability. As the success of precision medicine depends on robust biomarkers, the requirement for improved imaging biomarkers that reflect tumor biology has grown exponentially. Radiomics, the field of study in which high-throughput data are generated and large amounts of advanced quantitative features are extracted from medical images, has shown great potential as a source of quantitative biomarkers in the field of oncology. Radiomics provides quantitative information about the morphology, texture, and intratumoral heterogeneity of the tumor itself as well as features related to pulmonary function. Hence, radiomics data can be used to build descriptive and predictive clinical models that relate imaging characteristics to tumor biology phenotypes. In this review, we describe the workflow of CT radiomics, types of CT radiomics, and its clinical application in thoracic oncology.

Prediction of outcome using pretreatment 18F-FDG PET/CT and MRI radiomics in locally advanced cervical cancer treated with chemoradiotherapy

PURPOSE

The aim of this study is to determine if radiomics features from ¹⁸fluorodeoxyglucose (FDG) positron emission tomography/computed tomography (PET/CT) and magnetic resonance imaging (MRI) images could contribute to prognoses in cervical cancer.

METHODS

One hundred and two patients (69 for training and 33 for testing) with locally advanced cervical cancer (LACC) receiving chemoradiotherapy (CRT) from 08/2010 to 12/2016 were enrolled in this study. ¹⁸F-FDG PET/CT and MRI examination [T1, T2, T1C, diffusion-weighted imaging (DWI)] were performed for each patient before CRT. Primary tumor volumes were delineated with the fuzzy locally adaptive Bayesian algorithm in the PET images and with 3D Slicer™ in the MRI images. Radiomics features (intensity, shape, and texture) were extracted and their prognostic value was compared with clinical parameters for recurrence-free and locoregional control.

RESULTS

In the training cohort, median follow-up was 3.0 years (range, 0.43-6.56 years) and relapse occurred in 36% of patients. In univariate analysis, FIGO stage (I-II vs. III-IV) and metabolic response (complete vs. non-complete) were probably associated with outcome without reaching statistical significance, contrary to several radiomics features from both PET and MRI sequences. Multivariate analysis in training test identified Grey Level Non Uniformity_GLRLM in PET and Entropy_GLCM in ADC maps from DWI MRI as independent prognostic factors. These had significantly higher prognostic power than clinical parameters, as evaluated in the testing cohort with accuracy of 94% for predicting recurrence and 100% for predicting lack of loco-regional control (versus ~50-60% for clinical parameters).

CONCLUSIONS

In LACC treated with CRT, radiomics features such as EntropyGLCM and GLNUGLRLM from functional imaging DWI-MRI and PET, respectively, are independent predictors of recurrence and loco-regional control with significantly higher prognostic power than usual clinical parameters. Further research is warranted for their validation, which may justify more aggressive treatment in patients identified with high probability of recurrence.

Comparison of machine learning methods for classifying mediastinal lymph node metastasis of non-small cell lung cancer from 18F-FDG PET/CT images

BACKGROUND

This study aimed to compare one state-of-the-art deep learning method and four classical machine learning methods for classifying mediastinal lymph node metastasis of non-small cell lung cancer (NSCLC) from 18F-FDG PET/CT images. Another objective was to compare the discriminative power of the recently popular PET/CT texture features with the widely used diagnostic features such as tumor size, CT value, SUV, image contrast, and intensity standard deviation. The four classical machine learning methods included random forests, support vector machines, adaptive boosting, and artificial neural network. The deep learning method was the convolutional neural networks (CNN). The five methods were evaluated using 1397 lymph nodes collected from PET/CT images of 168 patients, with corresponding pathology analysis results as gold standard. The comparison was conducted using 10 times 10-fold cross-validation based on the criterion of sensitivity, specificity, accuracy (ACC), and area under the ROC curve (AUC). For each classical method, different input features were compared to select the optimal feature set. Based on the optimal feature set, the classical methods were compared with CNN, as well as with human doctors from our institute.

RESULTS

For the classical methods, the diagnostic features resulted in 81~85% ACC and 0.87~0.92 AUC, which were significantly higher than the results of texture features. CNN's sensitivity, specificity, ACC, and AUC were 84, 88, 86, and 0.91, respectively. There was no significant difference between the results of CNN and the best classical method. The sensitivity, specificity, and ACC of human doctors were 73, 90, and 82, respectively. All the five machine learning methods had higher sensitivities but lower specificities than human doctors.

CONCLUSIONS

The present study shows that the performance of CNN is not significantly different from the best classical methods and human doctors for classifying mediastinal lymph node metastasis of NSCLC from PET/CT images. Because CNN does not need tumor segmentation or feature calculation, it is more convenient and more objective than the classical methods. However, CNN does not make use of the import diagnostic features, which have been proved more discriminative than the texture features for classifying small-sized lymph nodes. Therefore, incorporating the diagnostic features into CNN is a promising direction for future research.

Predicting survival time of lung cancer patients using radiomic analysis

OBJECTIVES

This study investigates the prediction of Non-small cell lung cancer (NSCLC) patient survival outcomes based on radiomic texture and shape features automatically extracted from tumor image data.

MATERIALS AND METHODS

Retrospective analysis involves CT scans of 315 NSCLC patients from The Cancer Imaging Archive (TCIA). A total of 24 image features are computed from labeled tumor volumes of patients within groups defined using NSCLC subtype and TNM staging information. Spearman's rank correlation, Kaplan-Meier estimation and log-rank tests were used to identify features related to long/short NSCLC patient survival groups. Automatic random forest classification was used to predict patient survival group from multivariate feature data. Significance is assessed at P < 0.05 following Holm-Bonferroni correction for multiple comparisons.

RESULTS

Significant correlations between radiomic features and survival were observed for four clinical groups: (group, [absolute correlation range]): (large cell carcinoma (LCC) [0.35, 0.43]), (tumor size T2, [0.31, 0.39]), (non lymph node metastasis N0, [0.3, 0.33]), (TNM stage I, [0.39, 0.48]). Significant log-rank relationships between features and survival time were observed for three clinical groups: (group, hazard ratio): (LCC, 3.0), (LCC, 3.9), (T2, 2.5) and (stage I, 2.9). Automatic survival prediction performance (i.e. below/above median) is superior for combined radiomic features with age-TNM in comparison to standard TNM clinical staging information (clinical group, mean area-under-the-ROC-curve (AUC)): (LCC, 75.73%), (N0, 70.33%), (T2, 70.28%) and (TNM-I, 76.17%).

CONCLUSION

Quantitative lung CT imaging features can be used as indicators of survival, in particular for patients with large-cell-carcinoma (LCC), primary-tumor-sizes (T2) and no lymph-node-metastasis (N0).

Tumour functional sphericity from PET images: prognostic value in NSCLC and impact of delineation method

PURPOSE

Sphericity has been proposed as a parameter for characterizing PET tumour volumes, with complementary prognostic value with respect to SUV and volume in both head and neck cancer and lung cancer. The objective of the present study was to investigate its dependency on tumour delineation and the resulting impact on its prognostic value.

METHODS

Five segmentation methods were considered: two thresholds (40% and 50% of SUV_max), ant colony optimization, fuzzy locally adaptive Bayesian (FLAB), and gradient-aided region-based active contour. The accuracy of each method in extracting sphericity was evaluated using a dataset of 176 simulated, phantom and clinical PET images of tumours with associated ground truth. The prognostic value of sphericity and its complementary value with respect to volume for each segmentation method was evaluated in a cohort of 87 patients with stage II/III lung cancer.

RESULTS

Volume and associated sphericity values were dependent on the segmentation method. The correlation between segmentation accuracy and sphericity error was moderate (|ρ| from 0.24 to 0.57). The accuracy in measuring sphericity was not dependent on volume (|ρ| < 0.4). In the patients with lung cancer, sphericity had prognostic value, although lower than that of volume, except for that derived using FLAB for which when combined with volume showed a small improvement over volume alone (hazard ratio 2.67, compared with 2.5). Substantial differences in patient prognosis stratification were observed depending on the segmentation method used.

CONCLUSION

Tumour functional sphericity was found to be dependent on the segmentation method, although the accuracy in retrieving the true sphericity was not dependent on tumour volume. In addition, even accurate segmentation can lead to an inaccurate sphericity value, and vice versa. Sphericity had similar or lower prognostic value than volume alone in the patients with lung cancer, except when determined using the FLAB method for which there was a small improvement in stratification when the parameters were combined.

Residual Convolutional Neural Network for the Determination of IDH Status in Low- and High-Grade Gliomas from MR Imaging

Purpose: Isocitrate dehydrogenase (IDH) mutations in glioma patients confer longer survival and may guide treatment decision making. We aimed to predict the IDH status of gliomas from MR imaging by applying a residual convolutional neural network to preoperative radiographic data.Experimental Design: Preoperative imaging was acquired for 201 patients from the Hospital of University of Pennsylvania (HUP), 157 patients from Brigham and Women's Hospital (BWH), and 138 patients from The Cancer Imaging Archive (TCIA) and divided into training, validation, and testing sets. We trained a residual convolutional neural network for each MR sequence (FLAIR, T2, T1 precontrast, and T1 postcontrast) and built a predictive model from the outputs. To increase the size of the training set and prevent overfitting, we augmented the training set images by introducing random rotations, translations, flips, shearing, and zooming.Results: With our neural network model, we achieved IDH prediction accuracies of 82.8% (AUC = 0.90), 83.0% (AUC = 0.93), and 85.7% (AUC = 0.94) within training, validation, and testing sets, respectively. When age at diagnosis was incorporated into the model, the training, validation, and testing accuracies increased to 87.3% (AUC = 0.93), 87.6% (AUC = 0.95), and 89.1% (AUC = 0.95), respectively.Conclusions: We developed a deep learning technique to noninvasively predict IDH genotype in grade II-IV glioma using conventional MR imaging using a multi-institutional data set. Clin Cancer Res; 24(5); 1073-81. ©2017 AACR.

Machine learning-based quantitative texture analysis of CT images of small renal masses: Differentiation of angiomyolipoma without visible fat from renal cell carcinoma

OBJECTIVE

To evaluate the diagnostic performance of machine-learning based quantitative texture analysis of CT images to differentiate small (≤ 4 cm) angiomyolipoma without visible fat (AMLwvf) from renal cell carcinoma (RCC).

METHODS

This single-institutional retrospective study included 58 patients with pathologically proven small renal mass (17 in AMLwvf and 41 in RCC groups). Texture features were extracted from the largest possible tumorous regions of interest (ROIs) by manual segmentation in preoperative three-phase CT images. Interobserver reliability and the Mann-Whitney U test were applied to select features preliminarily. Then support vector machine with recursive feature elimination (SVM-RFE) and synthetic minority oversampling technique (SMOTE) were adopted to establish discriminative classifiers, and the performance of classifiers was assessed.

RESULTS

Of the 42 extracted features, 16 candidate features showed significant intergroup differences (P < 0.05) and had good interobserver agreement. An optimal feature subset including 11 features was further selected by the SVM-RFE method. The SVM-RFE+SMOTE classifier achieved the best performance in discriminating between small AMLwvf and RCC, with the highest accuracy, sensitivity, specificity and AUC of 93.9 %, 87.8 %, 100 % and 0.955, respectively.

CONCLUSION

Machine learning analysis of CT texture features can facilitate the accurate differentiation of small AMLwvf from RCC.

KEY POINTS

• Although conventional CT is useful for diagnosis of SRMs, it has limitations. • Machine-learning based CT texture analysis facilitate differentiation of small AMLwvf from RCC. • The highest accuracy of SVM-RFE+SMOTE classifier reached 93.9 %. • Texture analysis combined with machine-learning methods might spare unnecessary surgery for AMLwvf.

Fast and Binary Assay for Predicting Radiosensitivity Based on the Theory of ATM Nucleo-Shuttling: Development, Validation, and Performance

PURPOSE

To examine the possibility of predicting clinical radiosensitivity by quantifying the nuclear forms of autophosphorylated ATM protein (pATM) via a specific enzyme-linked immunosorbent assay (ELISA).

METHODS AND MATERIALS

This study was performed on 30 skin fibroblasts from 9 radioresistant patients and 21 patients with adverse tissue reaction events. Patients were divided into 2 groups: radioresistant (toxicity grade <2) and radiosensitive (toxicity grade ≥2). The quantity of nuclear pATM molecules was assessed by the ELISA method at 10 minutes and 1 hour after 2 Gy and compared with pATM immunofluorescence data.

RESULTS

The pATM ELISA data were in quantitative agreement with the immunofluorescence data. A receiver operating characteristic analysis was applied first to 2 data sets (a training set [n=14] and a validating [n=16] set) and thereafter to all the data with a 2-fold cross-validation method. The assay showed an area under the curve value higher than 0.8, a sensitivity of 0.8, and a specificity ranging from 0.75 to 1, which strongly documents the predictive power of the pATM ELISA.

CONCLUSION

This study showed that the assessment of nuclear pATM quantity after 2 Gy via an ELISA technique can be the basis of a predictive assay with the highest statistical performance among the available predictive approaches.

FDG PET/CT radiomics for predicting the outcome of locally advanced rectal cancer

PURPOSE

The aim of this study was to investigate the prognostic value of baseline ¹⁸F-FDG PET/CT textural analysis in locally-advanced rectal cancer (LARC).

METHODS

Eighty-six patients with LARC underwent ¹⁸F-FDG PET/CT before treatment. Maximum and mean standard uptake values (SUVmax and SUVmean), metabolic tumoral volume (MTV), total lesion glycolysis (TLG), histogram-intensity features, as well as 11 local and regional textural features, were evaluated. The relationships of clinical, pathological and PET-derived metabolic parameters with disease-specific survival (DSS), disease-free survival (DFS) and overall survival (OS) were assessed by Cox regression analysis. Logistic regression was used to predict the pathological response by the Dworak tumor regression grade (TRG) in the 66 patients treated with neoadjuvant chemoradiotherapy (nCRT).

RESULTS

The median follow-up of patients was 41 months. Seventeen patients (19.7%) had recurrent disease and 18 (20.9 %) died, either due to cancer progression (n = 10) or from another cause while in complete remission (n = 8). DSS was 95% at 1 year, 93% at 2 years and 87% at 4 years. Weight loss, surgery and the texture parameter coarseness were significantly associated with DSS in multivariate analyses. DFS was 94 % at 1 year, 86 % at 2 years and 79 % at 4 years. From a multivariate standpoint, tumoral differentiation and the texture parameters homogeneity and coarseness were significantly associated with DFS. OS was 93% at 1 year, 87% at 2 years and 79% after 4 years. cT, surgery, SUVmean, dissimilarity and contrast from the neighborhood intensity-difference matrix (contrast_NGTDM) were significantly and independently associated with OS. Finally, RAS-mutational status (KRAS and NRAS mutations) and TLG were significant predictors of pathological response to nCRT (TRG 3-4).

CONCLUSION

Textural analysis of baseline ¹⁸F-FDG PET/CT provides strong independent predictors of survival in patients with LARC, with better predictive power than intensity- and volume-based parameters. The utility of such features, especially coarseness, should be confirmed by larger clinical studies before considering their potential integration into decisional algorithms aimed at personalized medicine.

A comparative study of machine learning methods for time-to-event survival data for radiomics risk modelling

Radiomics applies machine learning algorithms to quantitative imaging data to characterise the tumour phenotype and predict clinical outcome. For the development of radiomics risk models, a variety of different algorithms is available and it is not clear which one gives optimal results. Therefore, we assessed the performance of 11 machine learning algorithms combined with 12 feature selection methods by the concordance index (C-Index), to predict loco-regional tumour control (LRC) and overall survival for patients with head and neck squamous cell carcinoma. The considered algorithms are able to deal with continuous time-to-event survival data. Feature selection and model building were performed on a multicentre cohort (213 patients) and validated using an independent cohort (80 patients). We found several combinations of machine learning algorithms and feature selection methods which achieve similar results, e.g.

, MSR-RF

C-Index = 0.71 and BT-COX: C-Index = 0.70 in combination with Spearman feature selection. Using the best performing models, patients were stratified into groups of low and high risk of recurrence. Significant differences in LRC were obtained between both groups on the validation cohort. Based on the presented analysis, we identified a subset of algorithms which should be considered in future radiomics studies to develop stable and clinically relevant predictive models for time-to-event endpoints.

Radiomics: the bridge between medical imaging and personalized medicine

Radiomics, the high-throughput mining of quantitative image features from standard-of-care medical imaging that enables data to be extracted and applied within clinical-decision support systems to improve diagnostic, prognostic, and predictive accuracy, is gaining importance in cancer research. Radiomic analysis exploits sophisticated image analysis tools and the rapid development and validation of medical imaging data that uses image-based signatures for precision diagnosis and treatment, providing a powerful tool in modern medicine. Herein, we describe the process of radiomics, its pitfalls, challenges, opportunities, and its capacity to improve clinical decision making, emphasizing the utility for patients with cancer. Currently, the field of radiomics lacks standardized evaluation of both the scientific integrity and the clinical relevance of the numerous published radiomics investigations resulting from the rapid growth of this area. Rigorous evaluation criteria and reporting guidelines need to be established in order for radiomics to mature as a discipline. Herein, we provide guidance for investigations to meet this urgent need in the field of radiomics.

2D and 3D CT Radiomics Features Prognostic Performance Comparison in Non-Small Cell Lung Cancer

OBJECTIVE: To compare 2D and 3D radiomics features prognostic performance differences in CT images of non-small cell lung cancer (NSCLC). METHOD: We enrolled 588 NSCLC patients from three independent cohorts. Two sets of 463 patients from two different institutes were used as the training cohort. The remaining cohort with 125 patients was set as the validation cohort. A total of 1014 radiomics features (507 2D features and 507 3D features correspondingly) were assessed. Based on the dichotomized survival data, 2D and 3D radiomics indicators were calculated for each patient by trained classifiers. We used the area under the receiver operating characteristic curve (AUC) to assess the prediction performance of trained classifiers (the support vector machine and logistic regression). Kaplan–Meier and Cox hazard survival analyses were also employed. Harrell's concordance index (C-Index) and Akaike's information criteria (AIC) were applied to assess the trained models. RESULTS: Radiomics indicators were built and compared by AUCs. In the training cohort, 2D_AUC = 0.653, 3D_AUC = 0.671. In the validation cohort, 2D_AUC = 0.755, 3D_AUC = 0.663. Both 2D and 3D trained indicators achieved significant results (P < .05) in the Kaplan-Meier analysis and Cox regression. In the validation cohort, 2D Cox model had a C-Index = 0.683 and AIC = 789.047; 3D Cox model obtained a C-Index = 0.632 and AIC = 799.409. CONCLUSION: Both 2D and 3D CT radiomics features have a certain prognostic ability in NSCLC, but 2D features showed better performance in our tests. Considering the cost of the radiomics features calculation, 2D features are more recommended for use in the current study.

Development and clinical application of radiomics in lung cancer

Since the discovery of X-rays at the end of the 19^th century, medical imageology has progressed for 100 years, and medical imaging has become an important auxiliary tool for clinical diagnosis. With the launch of the human genome project (HGP) and the development of various high-throughput detection techniques, disease exploration in the post-genome era has extended beyond investigations of structural changes to in-depth analyses of molecular abnormalities in tissues, organs and cells, on the basis of gene expression and epigenetics. These techniques have given rise to genomics, proteomics, metabolomics and other systems biology subspecialties, including radiogenomics. Radiogenomics is an important revolution in the traditional visually identifiable imaging technology and constitutes a new branch, radiomics. Radiomics is aimed at extracting quantitative imaging features automatically and developing models to predict lesion phenotypes in a non-invasive manner. Here, we summarize the advent and development of radiomics, the basic process and challenges in clinical practice, with a focus on applications in pulmonary nodule evaluations, including diagnostics, pathological and molecular classifications, treatment response assessments and prognostic predictions, especially in radiotherapy.

An Assessment of Imaging Informatics for Precision Medicine in Cancer

Objectives: Precision medicine requires the measurement, quantification, and cataloging of medical characteristics to identify the most effective medical intervention. However, the amount of available data exceeds our current capacity to extract meaningful information. We examine the informatics needs to achieve precision medicine from the perspective of quantitative imaging and oncology. Methods: The National Cancer Institute (NCI) organized several workshops on the topic of medical imaging and precision medicine. The observations and recommendations are summarized herein. Results: Recommendations include: use of standards in data collection and clinical correlates to promote interoperability; data sharing and validation of imaging tools; clinician's feedback in all phases of research and development; use of open-source architecture to encourage reproducibility and reusability; use of challenges which simulate real-world situations to incentivize innovation; partnership with industry to facilitate commercialization; and education in academic communities regarding the challenges involved with translation of technology from the research domain to clinical utility and the benefits of doing so. Conclusions: This article provides a survey of the role and priorities for imaging informatics to help advance quantitative imaging in the era of precision medicine. While these recommendations were drawn from oncology, they are relevant and applicable to other clinical domains where imaging aids precision medicine.