Investigation of thoracic four-dimensional CT-based dimension reduction technique for extracting the robust radiomic features

Radiomics and dosiomics approaches to estimate lung function after stereotactic body radiation therapy in patients with lung tumors

Lung function assessment is essential for determining the optimal treatment strategy for radiation therapy in patients with lung tumors. This study aimed to develop radiomics and dosiomics approaches to estimate pulmonary function test (PFT) results in post-stereotactic body radiation therapy (SBRT). Sixty-four patients with lung tumors who underwent SBRT were included. Models were created to estimate the PFT results at 0-6 months (Cohort 1) and 6-24 months (Cohort 2) after SBRT. Radiomics and dosiomics features were extracted from the computed tomography (CT) images and dose distributions, respectively. To estimate the PFT results, Models A (dose-volume histogram [DVH] + radiomics features) and B (DVH + radiomics + dosiomics features) were created. In the PFT results, the forced expiratory volume in one second (FEV1) and forced vital capacity (FVC) were estimated using each model, and the ratio of FEV1 to FVC (FEV1/FVC) was calculated. The Pearson's correlation coefficient (Pearson r) and area under the curve (AUC) for FEV1/FVC (< 70%) were calculated. The models were evaluated by comparing them with the conventional calculation formulae (Conventional). The Pearson r (FEV1/FVC) values were 0.30, 0.64, and 0.69 for Conventional and Models A and B (Cohort 2), respectively, and the AUC (FEV1/FVC < 70%) values were 0.63, 0.80, and 0.78, respectively. This study demonstrates the possibility of estimating lung function after SBRT using radiomics and dosiomics features based on planning CT images and dose distributions.

Assessment of a computed tomography-based radiomics approach for assessing lung function in lung cancer patients

PURPOSE

We aimed to assess radiomics approaches for estimating three pulmonary function test (PFT) results (forced expiratory volume in one second [FEV1], forced vital capacity [FVC], and the ratio of FEV1 to FVC [FEV₁/FVC]) using data extracted from chest computed tomography (CT) images.

METHODS

This retrospective study included 85 lung cancer patients (mean age, 75 years ±8; 69 men) who underwent stereotactic body radiotherapy between 2012 and 2020. Their pretreatment chest breath-hold CT and PFT data before radiotherapy were obtained. A total of 107 radiomics features (Shape: 14, Intensity: 18, Texture: 75) were extracted using two methods: extraction of the lung tissue (<-250 HU) (APPROACH 1), and extraction of small blood vessels and lung tissue (APPROACH 2). The PFT results were estimated using the least absolute shrinkage and selection operator regression. Pearson's correlation coefficients (r) were determined for all PFT results, and the area under the curve (AUC) was calculated for FEV₁/FVC (<70 %). Finally, we compared our approaches with the conventional formula (Conventional).

RESULTS

For the estimated FEV₁/FVC, the Pearson's r were 0.21 (P =.06), 0.69 (P <.01), and 0.73 (P <.01) for Conventional, APPROACH 1, and APPROACH 2, respectively; the AUCs for FEV₁/FVC (<70 %) were 0.67 (95 % confidence interval [CI]: 0.55, 0.79), 0.82 (CI: 0.72, 0.91; P =.047) and 0.86 (CI: 0.78, 0.94; P =.01), respectively.

CONCLUSIONS

The radiomics approach performed better than the conventional equation and may be useful for assessing lung function based on CT images.

A deep learning-based radiomics approach to predict head and neck tumor regression for adaptive radiotherapy

Early regression—the regression in tumor volume during the initial phase of radiotherapy (approximately 2 weeks after treatment initiation)—is a common occurrence during radiotherapy. This rapid radiation-induced tumor regression may alter target coordinates, necessitating adaptive radiotherapy (ART). We developed a deep learning-based radiomics (DLR) approach to predict early head and neck tumor regression and thereby facilitate ART. Primary gross tumor volume (GTVp) was monitored in 96 patients and nodal GTV (GTVn) in 79 patients during treatment. All patients underwent two computed tomography (CT) scans: one before the start of radiotherapy for initial planning and one during radiotherapy for boost planning. Patients were assigned to regression and nonregression groups according to their median tumor regression rate (ΔGTV/treatment day from initial to boost CT scan). We input a GTV image into the convolutional neural network model, which was pretrained using natural image datasets, via transfer learning. The deep features were extracted from the last fully connected layer. To clarify the prognostic power of the deep features, machine learning models were trained. The models then predicted the regression and nonregression of GTVp and GTVn and evaluated the predictive performance by 0.632 + bootstrap area under the curve (AUC). Predictive performance for GTVp regression was highest using the InceptionResNetv2 model (mean AUC = 0.75) and that for GTVn was highest using NASNetLarge (mean AUC = 0.73). Both models outperformed the handcrafted radiomics features (mean AUC = 0.63 for GTVp and 0.61 for GTVn) or clinical factors (0.64 and 0.67, respectively). DLR may facilitate ART for improved radiation side-effects and target coverage.

Deep neural network-based approach to improving radiomics analysis reproducibility in liver cancer: effect on image resampling

Objectives.To test the effect of traditional up-sampling slice thickness (ST) methods on the reproducibility of CT radiomics features of liver tumors and investigate the improvement using a deep neural network (DNN) scheme.Methods.CT images with ≤ 1 mm ST in the public dataset were converted to low-resolution (3 mm, 5 mm) CT images. A DNN model was trained for the conversion from 3 mm ST and 5 mm ST to 1 mm ST and compared with conventional interpolation-based methods (cubic, linear, nearest) using structural similarity (SSIM) and peak-signal-to-noise-ratio (PSNR). Radiomics features were extracted from the tumor and tumor ring regions. The reproducibility of features from images converted using DNN and interpolation schemes were assessed using the concordance correlation coefficients (CCC) with the cutoff of 0.85. The paired t-test and Mann-Whitney U test were used to compare the evaluation metrics, where appropriate.Results.CT images of 108 patients were used for training (n = 63), validation (n = 11) and testing (n = 34). The DNN method showed significantly higher PSNR and SSIM values (p < 0.05) than interpolation-based methods. The DNN method also showed a significantly higher CCC value than interpolation-based methods. For features in the tumor region, compared with the cubic interpolation approach, the reproducible features increased from 393 (82%) to 422(88%) for the conversion of 3-1 mm, and from 305(64%) to 353(74%) for the conversion of 5-1 mm. For features in the tumor ring region, the improvement was from 395 (82%) to 431 (90%) and from 290 (60%) to 335 (70%), respectively.Conclusions.The DNN based ST up-sampling approach can improve the reproducibility of CT radiomics features in liver tumors, promoting the standardization of CT radiomics studies in liver cancer.

Optimising use of 4D-CT phase information for radiomics analysis in lung cancer patients treated with stereotactic body radiotherapy

Purpose. 4D-CT is routine imaging for lung cancer patients treated with stereotactic body radiotherapy. No studies have investigated optimal 4D phase selection for radiomics. We aim to determine how phase data should be used to identify prognostic biomarkers for distant failure, and test whether stability assessment is required. A phase selection approach will be developed to aid studies with different 4D protocols and account for patient differences. Methods. 186 features were extracted from the tumour and peritumour on all phases for 258 patients. Feature values were selected from phase features using four methods: (A) mean across phases, (B) median across phases, (C) 50% phase, and (D) the most stable phase (closest in value to two neighbours), coined personalised selection. Four levels of stability assessment were also analysed, with inclusion of: (1) all features, (2) stable features across all phases, (3) stable features across phase and neighbour phases, and (4) features averaged over neighbour phases. Clinical-radiomics models were built for twelve combinations of feature type and assessment method. Model performance was assessed by concordance index (c-index) and fraction of new information from radiomic features. Results. The most stable phase spanned the whole range but was most often near exhale. All radiomic signatures provided new information for distant failure prediction. The personalised model had the highest c-index (0.77), and 58% of new information was provided by radiomic features when no stability assessment was performed. Conclusion. The most stable phase varies per-patient and selecting this improves model performance compared to standard methods. We advise the single most stable phase should be determined by minimising feature differences to neighbour phases. Stability assessment over all phases decreases performance by excessively removing features. Instead, averaging of neighbour phases should be used when stability is of concern. The models suggest that higher peritumoural intensity predicts distant failure.

Impact of feature selection methods and subgroup factors on prognostic analysis with CT-based radiomics in non-small cell lung cancer patients

Background

Radiomics is a new technology to noninvasively predict survival prognosis with quantitative features extracted from medical images. Most radiomics-based prognostic studies of non-small-cell lung cancer (NSCLC) patients have used mixed datasets of different subgroups. Therefore, we investigated the radiomics-based survival prediction of NSCLC patients by focusing on subgroups with identical characteristics.

Methods

A total of 304 NSCLC (Stages I–IV) patients treated with radiotherapy in our hospital were used. We extracted 107 radiomic features (i.e., 14 shape features, 18 first-order statistical features, and 75 texture features) from the gross tumor volume drawn on the free breathing planning computed tomography image. Three feature selection methods [i.e., test–retest and multiple segmentation (FS1), Pearson's correlation analysis (FS2), and a method that combined FS1 and FS2 (FS3)] were used to clarify how they affect survival prediction performance. Subgroup analysis for each histological subtype and each T stage applied the best selection method for the analysis of All data. We used a least absolute shrinkage and selection operator Cox regression model for all analyses and evaluated prognostic performance using the concordance-index (C-index) and the Kaplan–Meier method. For subgroup analysis, fivefold cross-validation was applied to ensure model reliability.

Results

In the analysis of All data, the C-index for the test dataset is 0.62 (FS1), 0.63 (FS2), and 0.62 (FS3). The subgroup analysis indicated that the prediction model based on specific histological subtypes and T stages had a higher C-index for the test dataset than that based on All data (All data, 0.64 vs. SCC_all, 060; ADC_all, 0.69; T1, 0.68; T2, 0.65; T3, 0.66; T4, 0.70). In addition, the prediction models unified for each T stage in histological subtype showed a different trend in the C-index for the test dataset between ADC-related and SCC-related models (ADC_T1–ADC_T4, 0.72–0.83; SCC_T1–SCC_T4, 0.58–0.71).

Conclusions

Our results showed that feature selection methods moderately affected the survival prediction performance. In addition, prediction models based on specific subgroups may improve the prediction performance. These results may prove useful for determining the optimal radiomics-based predication model.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13014-021-01810-9.

Understanding Sources of Variation to Improve the Reproducibility of Radiomics

Radiomics is the method of choice for investigating the association between cancer imaging phenotype, cancer genotype and clinical outcome prediction in the era of precision medicine. The fast dispersal of this new methodology has benefited from the existing advances of the core technologies involved in radiomics workflow: image acquisition, tumor segmentation, feature extraction and machine learning. However, despite the rapidly increasing body of publications, there is no real clinical use of a developed radiomics signature so far. Reasons are multifaceted. One of the major challenges is the lack of reproducibility and generalizability of the reported radiomics signatures (features and models). Sources of variation exist in each step of the workflow; some are controllable or can be controlled to certain degrees, while others are uncontrollable or even unknown. Insufficient transparency in reporting radiomics studies further prevents translation of the developed radiomics signatures from the bench to the bedside. This review article first addresses sources of variation, which is illustrated using demonstrative examples. Then, it reviews a number of published studies and progresses made to date in the investigation and improvement of feature reproducibility and model performance. Lastly, it discusses potential strategies and practical considerations to reduce feature variability and improve the quality of radiomics study. This review focuses on CT image acquisition, tumor segmentation, quantitative feature extraction, and the disease of lung cancer.

Radiomics feature robustness as measured using an MRI phantom

Radiomics involves high-throughput extraction of large numbers of quantitative features from medical images and analysis of these features to predict patients’ outcome and support clinical decision-making. However, radiomics features are sensitive to several factors, including scanning protocols. The purpose of this study was to investigate the robustness of magnetic resonance imaging (MRI) radiomics features with various MRI scanning protocol parameters and scanners using an MRI radiomics phantom. The variability of the radiomics features with different scanning parameters and repeatability measured using a test–retest scheme were evaluated using the coefficient of variation and intraclass correlation coefficient (ICC) for both T1- and T2-weighted images. For variability measures, the features were categorized into three groups: large, intermediate, and small variation. For repeatability measures, the average T1- and T2-weighted image ICCs for the phantom (0.963 and 0.959, respectively) were higher than those for a healthy volunteer (0.856 and 0.849, respectively). Our results demonstrated that various radiomics features are dependent on different scanning parameters and scanners. The radiomics features with a low coefficient of variation and high ICC for both the phantom and volunteer can be considered good candidates for MRI radiomics studies. The results of this study will assist current and future MRI radiomics studies.

Radiomics in medical imaging-"how-to" guide and critical reflection

Radiomics is a quantitative approach to medical imaging, which aims at enhancing the existing data available to clinicians by means of advanced mathematical analysis. Through mathematical extraction of the spatial distribution of signal intensities and pixel interrelationships, radiomics quantifies textural information by using analysis methods from the field of artificial intelligence. Various studies from different fields in imaging have been published so far, highlighting the potential of radiomics to enhance clinical decision-making. However, the field faces several important challenges, which are mainly caused by the various technical factors influencing the extracted radiomic features.The aim of the present review is twofold: first, we present the typical workflow of a radiomics analysis and deliver a practical "how-to" guide for a typical radiomics analysis. Second, we discuss the current limitations of radiomics, suggest potential improvements, and summarize relevant literature on the subject.

Radiomics as a personalized medicine tool in lung cancer: Separating the hope from the hype

Radiomics has become a popular image analysis method in the last few years. Its key hypothesis is that medical images harbor biological, prognostic and predictive information that is not revealed upon visual inspection. In contrast to previous work with a priori defined imaging biomarkers, radiomics instead calculates image features at scale and uses statistical methods to identify those most strongly associated to outcome. This builds on years of research into computer aided diagnosis and pattern recognition. While the potential of radiomics to aid personalized medicine is widely recognized, several technical limitations exist which hinder biomarker translation. Aspects of the radiomic workflow lack repeatability or reproducibility under particular circumstances, which is a key requirement for the translation of imaging biomarkers into clinical practice. One of the most commonly studied uses of radiomics is for personalized medicine applications in Non-Small Cell Lung Cancer (NSCLC). In this review, we summarize reported methodological limitations in CT based radiomic analyses together with suggested solutions. We then evaluate the current NSCLC radiomics literature to assess the risk associated with accepting the published conclusions with respect to these limitations. We review different complementary scoring systems and initiatives that can be used to critically appraise data from radiomics studies. Wider awareness should improve the quality of ongoing and future radiomics studies and advance their potential as clinically relevant biomarkers for personalized medicine in patients with NSCLC.

Robustness of radiomic features in magnetic resonance imaging: review and a phantom study

Radiomic analysis has exponentially increased the amount of quantitative data that can be extracted from a single image. These imaging biomarkers can aid in the generation of prediction models aimed to further personalized medicine. However, the generalizability of the model is dependent on the robustness of these features. The purpose of this study is to review the current literature regarding robustness of radiomic features on magnetic resonance imaging. Additionally, a phantom study is performed to systematically evaluate the behavior of radiomic features under various conditions (signal to noise ratio, region of interest delineation, voxel size change and normalization methods) using intraclass correlation coefficients. The features extracted in this phantom study include first order, shape, gray level cooccurrence matrix and gray level run length matrix. Many features are found to be non-robust to changing parameters. Feature robustness assessment prior to feature selection, especially in the case of combining multi-institutional data, may be warranted. Further investigation is needed in this area of research.

CT radiomics and PET radiomics: ready for clinical implementation?

INTRODUCTION

Today, rapid technical and clinical developments result in an increasing number of treatment options for oncological diseases. Thus, decision support systems are needed to offer the right treatment to the right patient. Imaging biomarkers hold great promise in patient-individual treatment guidance. Routinely performed for diagnosis and staging, imaging datasets are expected to hold more information than used in the clinical practice. Radiomics describes the extraction of a large number of meaningful quantitative features from medical images, such as computed tomography (CT) and positron emission tomography (PET). Due to the non-invasive nature and ability to capture 3D image-based heterogeneity, radiomic features are potential surrogate markers of the cancer phenotype. Several radiomic studies are published per day, owing to encouraging results of many radiomics-based patient outcome models. Despite this comparably large number of studies, radiomics is mainly studied in proof of principle concept. Hence, a translation of radiomics from a hot topic research field into an essential clinical decision-making tool is lacking, but of high clinical interest.

EVIDENCE ACQUISITION

Herein, we present a literature review addressing the clinical evidence of CT and PET radiomics. An extensive literature review was conducted in PubMed, including papers on robustness and clinical applications.

EVIDENCE SYNTHESIS

We summarize image-modality related influences on the robustness of radiomic features and provide an overview of clinical evidence reported in the literature. Today, more evidence has been provided for CT imaging, however, PET imaging offers the promise of direct imaging of biological processes and functions. We provide a summary of future research directions, which needs to be addressed in order to successfully introduce radiomics into clinical medicine. In comparison to CT, more focus should be directed towards harmonization of PET acquisition and reconstruction protocols, which is important for transferable modelling.

CONCLUSIONS

Both CT and PET radiomics are promising pre-treatment and intra-treatment biomarkers for outcome prediction. Most studies are performed in retrospective setting, however their validation in prospective data collections is ongoing.