Variation in algorithm implementation across radiomics software

Understandings 18 FDG PET radiomics and its application to lymphoma

The early identification of lymphoma patients who fail front-line treatment is crucial for optimizing disease management. Positron emission tomography, a well-established tool for staging and response evaluation in lymphoma, is typically assessed visually or semiquantitatively, leaving much of its latent information unexploited. Radiomic analysis, which employs mathematical descriptors, can enable the extraction of quantitative features from baseline images that correlate with the disease's biological characteristics. Emerging radiomic features such as metabolic tumour volume, total lesion glycolysis and markers of disease dissemination and metabolic heterogeneity are proving to be powerful prognostic biomarkers in lymphoma. Texture analysis, the most advanced area of radiomics, offers highly complex features that require further standardization and validation before being adopted as reliable biomarkers. Combining radiomic features with clinical risk factors and genomic data holds promising potential for improving clinical risk prediction. This review explores the current state of radiomic analysis, progress towards its standardization and its incorporation into clinical practice and trial designs. The integration of radiomic markers with circulating tumour DNA may provide a comprehensive approach to developing baseline and dynamic risk scores, facilitating the testing of novel treatments and advancing personalized treatment of aggressive lymphomas.

Radiogenomic explainable AI with neural ordinary differential equation for identifying post-SRS brain metastasis radionecrosis

BACKGROUND

Stereotactic radiosurgery (SRS) is widely used for managing brain metastases (BMs), but an adverse effect, radionecrosis, complicates post-SRS management. Differentiating radionecrosis from tumor recurrence non-invasively remains a major clinical challenge, as conventional imaging techniques often necessitate surgical biopsy for accurate diagnosis. Machine learning and deep learning models have shown potential in distinguishing radionecrosis from tumor recurrence. However, their clinical adoption is hindered by a lack of explainability, limiting understanding and trust in their diagnostic decisions.

PURPOSE

To utilize a novel neural ordinary differential equation (NODE) model for discerning BM post-SRS radionecrosis from recurrence. This approach integrates image-deep features, genomic biomarkers, and non-image clinical parameters within a synthesized latent feature space. The trajectory of each data sample towards the diagnosis decision can be visualized within this feature space, offering a new angle on radiogenomic data analysis foundational for AI explainability.

METHODS

By hypothesizing that deep feature extraction can be modeled as a spatiotemporally continuous process, we designed a novel model based on heavy ball NODE (HBNODE) in which deep feature extraction was governed by a second-order ODE. This approach enabled tracking of deep neural network (DNN) behavior by solving the HBNODE and observing the stepwise derivative evolution. Consequently, the trajectory of each sample within the Image-Genomic-Clinical (I-G-C) space became traceable. A decision-making field (F) was reconstructed within the feature space, with its gradient vectors directing the data samples' trajectories and intensities showing the potential. The evolution of F reflected the cumulative feature contributions at intermediate states to the final diagnosis, enabling quantitative and dynamic comparisons of the relative contribution of each feature category over time. A velocity curve was designed to determine key intermediate states (locoregional ∇F = 0) that are most predictive. Subsequently, a non-parametric model aggregated the optimal solutions from these key states to predict outcomes. Our dataset included 90 BMs from 62 NSCLC patients, and 3-month post-SRS T1+c MR image features, seven NSCLC genomic features, and seven clinical features were analyzed. An 8:2 train/test assignment was employed, and five independent models were trained to ensure robustness. Performance was benchmarked in sensitivity, specificity, accuracy, and ROCAUC, and results were compared against (1) a DNN using only image-based features, and (2) a combined "I+G+C" features without the HBNODE model.

RESULTS

The temporal evolution of gradient vectors and potential fields in F suggested that clinical features contribute the most during the initial stages of the HBNODE implementation, followed by imagery features taking dominance in the latter ones, while genomic features contribute the least throughout the process. The HBNODE model successfully identified and assembled key intermediate states, exhibiting competitive performance with an ROCAUC of 0.88 ± 0.04, sensitivity of 0.79 ± 0.02, specificity of 0.86 ± 0.01, and accuracy of 0.84 ± 0.01, where the uncertainties represent standard deviations. For comparison, the image-only DNN model achieved an ROCAUC of 0.71 ± 0.05 and sensitivity of 0.66 ± 0.32 (p = 0.086), while the "I+G+C" model without HBNODE reported an ROCAUC of 0.81 ± 0.02 and sensitivity of 0.58 ± 0.11 (p = 0.091).

CONCLUSION

The HBNODE model effectively identifies BM radionecrosis from recurrence, enhancing explainability within XAI frameworks. Its performance encourages further exploration in clinical settings and suggests potential applicability across various XAI domains.

Texture Analysis in Musculoskeletal Ultrasonography: A Systematic Review

Background: The objective of this systematic review was to summarize the findings of texture analyses of musculoskeletal ultrasound images and synthesize the information to facilitate the use of texture analysis on assessing skeletal muscle quality in various pathophysiological conditions. Methods: Medline, PubMed, Scopus, Web of Science, and Cochrane databases were searched from their inception until January 2025 using the PRISMA Diagnostic Test Accuracy and was registered at PROSPERO CRD42025636613. Information related to patients, interventions, ultrasound settings, texture analyses, muscles, and findings were extracted. The quality of evidence was evaluated using QUADAS-2. Results: A total of 38 studies using second-order and higher-order texture analysis met the criteria. The results indicated that no studies used an established reference standard (histopathology) to evaluate the accuracy of ultrasound texture analysis in diagnosing muscle quality. Alternative reference standards were compared, including various physiological, pathological, and pre-post intervention comparisons using over 200+ texture features of various muscles on diverse pathophysiological conditions. Conclusions: The findings of these included studies demonstrating that ultrasound texture analysis was able to discriminate changes in muscle quality using texture analysis between patients with pathological conditions and healthy conditions, including popular gray-level co-occurrence matrix (GLCM)-based contrast, correlation, energy, entropy, and homogeneity. Studies also demonstrated that texture analysis can discriminate muscle quality in various muscles under pathophysiological conditions although evidence is low because of bias in subject recruitment and lack of comparison with the established reference standard. This is the first systematic review of the use of texture analysis of musculoskeletal ultrasonography in assessing muscle quality in various muscles under diverse pathophysiological conditions.

Characterizing Muscle Tissue Quality Post-Stroke: Echovariation as a Clinical Indicator

Background/Objectives: Strokes remain a major global health concern, contributing significantly to disability and healthcare costs. Currently, there are no established indicators to accurately assess the degree of muscle tissue impairment in stroke-affected individuals. However, ultrasound imaging with an echotexture analysis shows potential as a quantitative tool to assess muscle tissue quality. This study aimed to identify specific echotexture features in the gastrocnemius medialis that effectively characterize muscle impairment in post-stroke individuals. Methods: An observational study was conducted with 22 post-stroke individuals. A total of 21 echotexture features were extracted and analyzed, including first-order metrics, a grey-level co-occurrence matrix, and a grey-level run length matrix. The modified Heckmatt scale was also applied to correlate with the most informative echotexture features. Results: Among the features analyzed, echovariation (EV), echointensity, and kurtosis emerged as the most informative indicators of muscle tissue quality. The EV was highlighted as the primary feature due to its strong and significant correlation with the modified Heckmatt scale (r = -0.81, p < 0.001) and its clinical and technical robustness. Lower EV values were associated with poorer muscle tissue quality, while higher values indicated better quality. Conclusions: The EV may be used as a quantitative indicator for characterizing the gastrocnemius medialis muscle tissue quality in post-stroke individuals, offering a more nuanced assessment than traditional qualitative scales. Future studies should investigate the correlation between the EV and other clinical outcomes and explore its potential to monitor the treatment efficacy, enhancing its applicability in clinical practice.

Radiogenomics Pilot Study: Association Between Radiomics and Single Nucleotide Polymorphism-Based Microarray Copy Number Variation in Diagnosing Renal Oncocytoma and Chromophobe Renal Cell Carcinoma

RO and ChRCC are kidney tumours with overlapping characteristics, making differentiation between them challenging. The objective of this research is to create a radiogenomics map by correlating radiomic features to molecular phenotypes in ChRCC and RO, using resection as the gold standard. Fourteen patients (6 RO and 8 ChRCC) were included in the prospective study. A total of 1,875 radiomic features were extracted from CT scans, alongside 632 cytobands containing 16,303 genes from the genomic data. Feature selection algorithms applied to the radiomic features resulted in 13 key features. From the genomic data, 24 cytobands highly correlated with histology were selected and cross-correlated with the radiomic features. The analysis identified four radiomic features that were strongly associated with seven genomic features. These findings demonstrate the potential of integrating radiomic and genomic data to enhance the differential diagnosis of RO and ChRCC, paving the way for more precise and non-invasive diagnostic tools in clinical practice.

PET radiomics in lung cancer: advances and translational challenges

Radiomics is an emerging field of medical imaging that aims at improving the accuracy of diagnosis, prognosis, treatment planning and monitoring non-invasively through the automated or semi-automated quantitative analysis of high-dimensional image features. Specifically in the field of nuclear medicine, radiomics utilizes imaging methods such as positron emission tomography (PET) and single photon emission computed tomography (SPECT) to evaluate biomarkers related to metabolism, blood flow, cellular activity and some biological pathways. Lung cancer ranks among the leading causes of cancer-related deaths globally, and radiomics analysis has shown great potential in guiding individualized therapy, assessing treatment response, and predicting clinical outcomes. In this review, we summarize the current state-of-the-art radiomics progress in lung cancer, highlighting the potential benefits and existing limitations of this approach. The radiomics workflow was introduced first including image acquisition, segmentation, feature extraction, and model building. Then the published literatures were described about radiomics-based prediction models for lung cancer diagnosis, differentiation, prognosis and efficacy evaluation. Finally, we discuss current challenges and provide insights into future directions and potential opportunities for integrating radiomics into routine clinical practice.

Characterization of renal masses with MRI-based radiomics: assessment of inter-package and inter-observer reproducibility in a prospective pilot study

OBJECTIVES

To evaluate radiomics features' reproducibility using inter-package/inter-observer measurement analysis in renal masses (RMs) based on MRI and to employ machine learning (ML) models for RM characterization.

METHODS

32 Patients (23M/9F; age 61.8 ± 10.6 years) with RMs (25 renal cell carcinomas (RCC)/7 benign masses; mean size, 3.43 ± 1.73 cm) undergoing resection were prospectively recruited. All patients underwent 1.5 T MRI with T2-weighted (T2-WI), diffusion-weighted (DWI)/apparent diffusion coefficient (ADC), and pre-/post-contrast-enhanced T1-weighted imaging (T1-WI). RMs were manually segmented using volume of interest (VOI) on T2-WI, DWI/ADC, and T1-WI pre-/post-contrast imaging (1-min, 3-min post-injection) by two independent observers using two radiomics software packages for inter-package and inter-observer assessments of shape/histogram/texture features common to both packages (104 features; n = 26 patients). Intra-class correlation coefficients (ICCs) were calculated to assess inter-observer and inter-package reproducibility of radiomics measurements [good (ICC ≥ 0.8)/moderate (ICC = 0.5-0.8)/poor (ICC < 0.5)]. ML models were employed using reproducible features (between observers and packages, ICC > 0.8) to distinguish RCC from benign RM.

RESULTS

Inter-package comparisons demonstrated that radiomics features from T1-WI-post-contrast had the highest proportion of good/moderate ICCs (54.8-58.6% for T1-WI-1 min), while most features extracted from T2-WI, T1-WI-pre-contrast, and ADC exhibited poor ICCs. Inter-observer comparisons found that radiomics measurements from T1-WI pre/post-contrast and T2-WI had the greatest proportion of features with good/moderate ICCs (95.3-99.1% T1-WI-post-contrast 1-min), while ADC measurements yielded mostly poor ICCs. ML models generated an AUC of 0.71 [95% confidence interval = 0.67-0.75] for diagnosis of RCC vs. benign RM.

CONCLUSION

Radiomics features extracted from T1-WI-post-contrast demonstrated greater inter-package and inter-observer reproducibility compared to ADC, with fair accuracy for distinguishing RCC from benign RM.

CLINICAL RELEVANCE

Knowledge of reproducibility of MRI radiomics features obtained on renal masses will aid in future study design and may enhance the diagnostic utility of radiomics models for renal mass characterization.

Advancing equitable and personalized cancer care: Novel applications and priorities of artificial intelligence for fairness and inclusivity in the patient care workflow

Patient care workflows are highly multimodal and intertwined: the intersection of data outputs provided from different disciplines and in different formats remains one of the main challenges of modern oncology. Artificial Intelligence (AI) has the potential to revolutionize the current clinical practice of oncology owing to advancements in digitalization, database expansion, computational technologies, and algorithmic innovations that facilitate discernment of complex relationships in multimodal data. Within oncology, radiation therapy (RT) represents an increasingly complex working procedure, involving many labor-intensive and operator-dependent tasks. In this context, AI has gained momentum as a powerful tool to standardize treatment performance and reduce inter-observer variability in a time-efficient manner. This review explores the hurdles associated with the development, implementation, and maintenance of AI platforms and highlights current measures in place to address them. In examining AI's role in oncology workflows, we underscore that a thorough and critical consideration of these challenges is the only way to ensure equitable and unbiased care delivery, ultimately serving patients' survival and quality of life.

Radiomics analysis with three-dimensional and two-dimensional segmentation to predict survival outcomes in pancreatic cancer

BACKGROUND

Radiomics can assess prognostic factors in several types of tumors, but considering its prognostic ability in pancreatic cancer has been lacking.

AIM

To evaluate the performance of two different radiomics software in assessing survival outcomes in pancreatic cancer patients.

METHODS

We retrospectively reviewed pretreatment contrast-enhanced dual-energy computed tomography images from 48 patients with biopsy-confirmed pancreatic ductal adenocarcinoma who later underwent neoadjuvant chemoradiation and surgery. Tumors were segmented using TexRad software for 2-dimensional (2D) analysis and MIM software for 3D analysis, followed by radiomic feature extraction. Cox proportional hazard modeling correlated texture features with overall survival (OS) and progression-free survival (PFS). Cox regression was used to detect differences in OS related to pretreatment tumor size and residual tumor following treatment. The Wilcoxon test was used to show the relationship between tumor volume and the percent of residual tumor. Kaplan-Meier analysis was used to compare survival in patients with different tumor densities in Hounsfield units for both 2D and 3D analysis.

RESULTS

3D analysis showed that higher mean tumor density [hazard ratio (HR) = 0.971, P = 0.041)] and higher median tumor density (HR = 0.970, P = 0.037) correlated with better OS. 2D analysis showed that higher mean tumor density (HR = 0.963, P = 0.014) and higher mean positive pixels (HR = 0.962, P = 0.014) correlated with better OS; higher skewness (HR = 3.067, P = 0.008) and higher kurtosis (HR = 1.176, P = 0.029) correlated with worse OS. Higher entropy correlated with better PFS (HR = 0.056, P = 0.036). Models determined that patients with increased tumor size greater than 1.35 cm were likely to have a higher percentage of residual tumors of over 10%.

CONCLUSION

Several radiomics features can be used as prognostic tools for pancreatic cancer. However, results vary between 2D and 3D analyses. Mean tumor density was the only variable that could reliably predict OS, irrespective of the analysis used.

Development of a prediction model for head and neck volume reduction by clinical factors, dose-volume histogram parameters and radiomics in head and neck cancer†

In external radiotherapy of head and neck (HN) cancers, the reduction of irradiation accuracy due to HN volume reduction often causes a problem. Adaptive radiotherapy (ART) can effectively solve this problem; however, its application to all cases is impractical because of cost and time. Therefore, finding priority cases is essential. This study aimed to predict patients with HN cancers are more likely to need ART based on a quantitative measure of large HN volume reduction and evaluate model accuracy. The study included 172 cases of patients with HN cancer who received external irradiation. The HN volume was calculated using cone-beam computed tomography (CT) for irradiation-guided radiotherapy for all treatment fractions and classified into two groups: cases with a large reduction in the HN volume and cases without a large reduction. Radiomic features were extracted from the primary gross tumor volume (GTV) and nodal GTV of the planning CT. To develop the prediction model, four feature selection methods and two machine-learning algorithms were tested. Predictive performance was evaluated by the area under the curve (AUC), accuracy, sensitivity and specificity. Predictive performance was the highest for the random forest, with an AUC of 0.662. Furthermore, its accuracy, sensitivity and specificity were 0.692, 0.700 and 0.813, respectively. Selected features included radiomic features of the primary GTV, human papillomavirus in oropharyngeal cancer and the implementation of chemotherapy; thus, these features might be related to HN volume change. Our model suggested the potential to predict ART requirements based on HN volume reduction .

The Promise and Future of Radiomics for Personalized Radiotherapy Dosing and Adaptation

Quantitative image analysis, also known as radiomics, aims to analyze large-scale quantitative features extracted from acquired medical images using hand-crafted or machine-engineered feature extraction approaches. Radiomics has great potential for a variety of clinical applications in radiation oncology, an image-rich treatment modality that utilizes computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET) for treatment planning, dose calculation, and image guidance. A promising application of radiomics is in predicting treatment outcomes after radiotherapy such as local control and treatment-related toxicity using features extracted from pretreatment and on-treatment images. Based on these individualized predictions of treatment outcomes, radiotherapy dose can be sculpted to meet the specific needs and preferences of each patient. Radiomics can aid in tumor characterization for personalized targeting, especially for identifying high-risk regions within a tumor that cannot be easily discerned based on size or intensity alone. Radiomics-based treatment response prediction can aid in developing personalized fractionation and dose adjustments. In order to make radiomics models more applicable across different institutions with varying scanners and patient populations, further efforts are needed to harmonize and standardize the acquisition protocols by minimizing uncertainties within the imaging data.

Impact of Aggregation Methods for Texture Features on Their Robustness Performance: Application to Nasopharyngeal 18F-FDG PET/CT

PURPOSE

This study aims to investigate the impact of aggregation methods used for the generation of texture features on their robustness of nasopharyngeal carcinoma (NPC) based on ¹⁸F-FDG PET/CT images.

METHODS

128 NPC patients were enrolled and 95 texture features were extracted for each patient including six feature families under different aggregation methods. For GLCM and GLRLM features, six aggregation methods were considered. For GLSZM, GLDZM, NGTDM and NGLDM features, three aggregation methods were considered. The robustness of the features affected by aggregation methods was assessed by the pair-wise intra-class correlation coefficient (ICC). Furthermore, the effects of discretization and partial volume correction (PVC) on the percent of ICC categories of all texture features were evaluated by overall ICC instead of the pair-wise ICC.

RESULTS

There were 12 features with excellent pair-wise ICCs varying aggregation methods, namely joint average, sum average, autocorrelation, long run emphasis, high grey level run emphasis, short run high grey level emphasis, long run high grey level emphasis, run length variance, SZM high grey level emphasis, DZM high grey level emphasis, high grey level count emphasis and dependence count percentage. For GLCM and GLRLM features, 19/25 and 14/16 features showed excellent pair-wise ICCs varying aggregation methods (averaged and merged) on the same dimensional features (2D, 2.5D or 3D). Different discretization levels and partial volume corrections lead to consistent robustness of textural features affected by aggregation methods.

CONCLUSION

Different dimensional features with the same aggregation methods showed worse robustness compared with the same dimensional features with different aggregation methods. Different discretization levels and PVC algorithms had a negligible effect on the percent of ICC categories of all texture features.

The ImSURE phantoms: a digital dataset for radiomic software benchmarking and investigation

In radiology and oncology, radiomic models are increasingly employed to predict clinical outcomes, but their clinical deployment has been hampered by lack of standardisation. This hindrance has driven the international Image Biomarker Standardisation Initiative (IBSI) to define guidelines for image pre-processing, standardise the formulation and nomenclature of 169 radiomic features and share two benchmark digital phantoms for software calibration. However, to better assess the concordance of radiomic tools, more heterogeneous phantoms are needed. We created two digital phantoms, called ImSURE phantoms, having isotropic and anisotropic voxel size, respectively, and 90 regions of interest (ROIs) each. To use these phantoms, we designed a systematic feature extraction workflow including 919 different feature values (obtained from the 169 IBSI-standardised features considering all possible combinations of feature aggregation and intensity discretisation methods). The ImSURE phantoms will allow to assess the concordance of radiomic software depending on interpolation, discretisation and aggregation methods, as well as on ROI volume and shape. Eventually, we provide the feature values extracted from these phantoms using five open-source IBSI-compliant software.

Measurement(s)	Radiomic Features
Technology Type(s)	Digital Phantoms and Radiomic Software Tools

Radiomics software comparison using digital phantom and patient data: IBSI-compliance does not guarantee concordance of feature values

Introduction Radiomics is a promising imaging-based tool which could enhance clinical observation and identify representative features. To avoid different interpretations, the Image Biomarker Standardisation Initiative (IBSI) imposed conditions for harmonisation. This study evaluates IBSI-compliant radiomics applications against a known benchmark and clinical datasets for agreements. Materials and methods The applications compared were RadiomiX Research Toolbox, LIFEx v7.0.0, and syngo.via Frontier Radiomics v1.2.5 (based on PyRadiomics v2.1). Basic assessment included comparing feature names and their formulas. The IBSI digital phantom was used for evaluation against reference values. For agreement evaluation (including same software but different versions), two clinical datasets were used: 27 contrast-enhanced computed tomography (CECT) of colorectal liver metastases and 39 magnetic resonance imaging (MRI) of breast cancer, including intravoxel incoherent motion and dynamic contrast-enhanced (DCE) MRI. The lower 95% confidence interval of intraclass correlation coefficient was used to define excellent agreement (>0.9). Results The three radiomics applications share 41 (3 shape, 8 intensity, 30 texture) out of 172, 84 and 110 features for RadiomiX, LIFEx and syngo.via, respectively, as well as wavelet filtering. The naming convention is, however, different between them. Syngo.via had excellent agreement with the IBSI benchmark, while LIFEx and RadiomiX showed slightly worse agreement. Excellent reproducibility was achieved for shape features only, while intensity and texture features varied considerably with the imaging type. For intensity, excellent agreement ranged from 46% for the DCE maps to 100% for CECT, while this lowered to 44% and 73% for texture features, respectively. Wavelet features produced the greatest variation between applications, with an excellent agreement for only 3% to 11% features. Conclusion Even with IBSI-compliance, the reproducibility of features between radiomics applications is not guaranteed. To evaluate variation, quality assurance of radiomics applications should be performed and repeated when updating to a new version or adding a new modality.

Effect of Gray Value Discretization and Image Filtration on Texture Features of the Pancreas Derived from Magnetic Resonance Imaging at 3T

Radiomics of pancreas magnetic resonance (MR) images is positioned well to play an important role in the management of diseases characterized by diffuse involvement of the pancreas. The effect of image pre-processing configurations on these images has been sparsely investigated. Fifteen individuals with definite chronic pancreatitis (an exemplar diffuse disease of the pancreas) and 15 healthy individuals were included in this age- and sex-matched case-control study. MR images of the pancreas were acquired using a single 3T scanner. A total of 93 first-order and second-order texture features of the pancreas were compared between the study groups, by subjecting MR images of the pancreas to 7 image pre-processing configurations related to gray level discretization and image filtration. The studied parameters of intensity discretization did not vary in terms of their effect on the number of significant first-order texture features. The number of statistically significant first-order texture features varied after filtering (7 with the use of logarithm filter and 3 with the use of Laplacian of Gaussian filter with 5 mm σ). Intensity discretization generally affected the number of significant second-order texture features more markedly than filtering. The use of fixed bin number of 16 yielded 42 significant second-order texture features, fixed bin number of 128–38 features, fixed bin width of 6–24 features, and fixed bin width of 42–26 features. The specific parameters of filtration and intensity discretization had differing effects on radiomics signature of the pancreas. Relative discretization with fixed bin number of 16 and use of logarithm filter hold promise as pre-processing configurations of choice in future radiomics studies in diffuse diseases of the pancreas.

Impact of image quality on radiomics applications

Radiomics features extracted from medical images have been widely reported to be useful in the patient specific outcome modeling for variety of assessment and prediction purposes. Successful application of radiomics features as imaging biomarkers, however, is dependent on the robustness of the approach to the variation in each step of the modeling workflow. Variation in the input image quality is one of the main sources that impacts the reproducibility of radiomics analysis when a model is applied to broader range of medical imaging data. The quality of medical image is generally affected by both the scanner related factors such as image acquisition/reconstruction settings and the patient related factors such as patient motion. This article aimed to review the published literatures in this field that reported the impact of various imaging factors on the radiomics features through the change in image quality. The literatures were categorized by different imaging modalities and also tabulated based on the imaging parameters and the class of radiomics features included in the study. Strategies for image quality standardization were discussed based on the relevant literatures and recommendations for reducing the impact of image quality variation on the radiomics in multi-institutional clinical trial were summarized at the end of this article.

Radiomic Signatures Associated with CD8+ Tumour-Infiltrating Lymphocytes: A Systematic Review and Quality Assessment Study

The tumour immune microenvironment influences the efficacy of immune checkpoint inhibitors. Within this microenvironment are CD8-expressing tumour-infiltrating lymphocytes (CD8+ TILs), which are an important mediator and marker of anti-tumour response. In practice, the assessment of CD8+ TILs via tissue sampling involves logistical challenges. Radiomics, the high-throughput extraction of features from medical images, may offer a novel and non-invasive alternative. We performed a systematic review of the available literature reporting radiomic signatures associated with CD8+ TILs. We also aimed to evaluate the methodological quality of the identified studies using the Radiomics Quality Score (RQS) tool, and the risk of bias and applicability with the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool. Articles were searched from inception until 31 December 2021, in three electronic databases, and screened against eligibility criteria. Twenty-seven articles were included. A wide variety of cancers have been studied. The reported radiomic signatures were heterogeneous, with very limited reproducibility between studies of the same cancer group. The overall quality of studies was found to be less than desirable (mean RQS = 33.3%), indicating a need for technical maturation. Some potential avenues for further investigation are also discussed.

Cross-Vendor CT Image Data Harmonization Using CVH-CT

While remarkable advances have been made in Computed Tomography (CT), most of the existing efforts focus on imaging enhancement while reducing radiation dose. How to harmonize CT image data captured using different scanners is vital in cross-center large-scale radiomics studies but remains the boundary to explore. Furthermore, the lack of paired training image problem makes it computationally challenging to adopt existing deep learning models. We propose a novel deep learning approach called CVH-CT for harmonizing CT images captured using scanners from different vendors. The generator of CVH-CT uses a self-attention mechanism to learn the scanner-related information. We also propose a VGG feature based domain loss to effectively extract texture properties from unpaired image data to learn the scanner based texture distributions. The experimental results show that CVH-CT is clearly better than the baselines because of the use of the proposed domain loss, and CVH-CT can effectively reduce the scanner-related variability in terms of radiomic features.

Reproducibility and Repeatability of CBCT-Derived Radiomics Features

PURPOSE

This study was conducted in order to determine the reproducibility and repeatability of cone-beam computed tomography (CBCT) radiomics features.

METHODS

The first-, second-, and fifth-day CBCT images from 10 head and neck (H&N) cancer patients and 10 pelvic cancer patients were retrospectively collected for this study. Eighteen common radiomics features were extracted from the longitudinal CBCT images using two radiomics packages. The reproducibility of CBCT-derived radiomics features was assessed using the first-day image as input and compared across the two software packages. The site-specific intraclass correlation coefficient (ICC) was used to quantitatively assess the agreement between packages. The repeatability of CBCT-based radiomics features was evaluated by comparing the following days of CBCT to the first-day image and quantified using site-specific concordance correlation coefficient (CCC). Furthermore, the correlation with volume for all the features was assessed with linear regression and R 2 as correlation parameters.

RESULTS

The first-order histogram-based features such as skewness and entropy showed good agreement computed in either software package (ICCs ≥ 0.80), while the kurtosis measurements were consistent in H&N patients between the two software tools but not in pelvic cases. The ICCs for GLCM-based features showed good agreement (ICCs ≥ 0.80) between packages in both H&N and pelvic groups except for the GLCM-correction. The GLRLM-based texture features were overall less consistent as calculated by the two different software packages compared with the GLCM-based features. The CCC values of all first-order and second-order GLCM features (except GLCM-energy) were all above 0.80 from the 2-day part test-retest set, while the CCC values all dropped below the cutoff after 5-day treatment scans. All first-order histogram-based and GLCM-texture-based features were not highly correlated with volume, while two GLRLM features, in both H&N and pelvic cohorts, showed R 2 ≥0.8, meaning a high correlation with volume.

CONCLUSION

The reproducibility and repeatability of CBCT-based radiomics features were assessed and compared for the first time on both H&N and pelvic sites. There were overlaps of stable features in both disease sites, yet the overall stability of radiomics features may be disease-/protocol-specific and a function of time between scans.

Radiomics outperforms clinical factors in characterizing human papilloma virus (HPV) for patients with oropharyngeal squamous cell carcinomas

Purpose:To utilize radiomic features extracted from CT images to characterize Human Papilloma Virus (HPV) for patients with oropharyngeal cancer squamous cell carcinoma (OPSCC).Methods:One hundred twenty-eight OPSCC patients with known HPV-status (60-HPV+ and 68-HPV-, confirmed by immunohistochemistry-P16-protein testing) were retrospectively studied. Radiomic features (11 feature-categories) were extracted in 3D from contrast-enhanced (CE)-CT images of gross-tumor-volumes using 'in-house' software ('ROdiomiX') developed and validated following the image-biomarker-standardization-initiative (IBSI) guidelines. Six clinical factors were investigated: Age-at-Diagnosis, Gender, Total-Charlson, Alcohol-Use, Smoking-History, and T-Stage. A Least-Absolute-Shrinkage-and-Selection-Operation (Lasso) technique combined with a Generalized-Linear-Model (Lasso-GLM) were applied to perform regularization in the radiomic and clinical feature spaces to identify the ranking of optimal feature subsets with most representative information for prediction of HPV. Lasso-GLM models/classifiers based on clinical factors only, radiomics only, and combined clinical and radiomics (ensemble/integrated) were constructed using random-permutation-sampling. Tests of significance (One-way ANOVA), average Area-Under-Receiver-Operating-Characteristic (AUC), and Positive and Negative Predictive values (PPV and NPV) were computed to estimate the generalization-error and prediction performance of the classifiers.Results:Five clinical factors, including T-stage, smoking status, and age, and 14 radiomic features, including tumor morphology, and intensity contrast were found to be statistically significant discriminators between HPV positive and negative cohorts. Performances for prediction of HPV for the 3 classifiers were: Radiomics-Lasso-GLM: AUC/PPV/NPV=0.789/0.755/0.805; Clinical-Lasso-GLM: 0.676/0.747/0.672, and Integrated/Ensemble-Lasso-GLM: 0.895/0.874/0.844. Results imply that the radiomics-based classifier enabled better characterization and performance prediction of HPV relative to clinical factors, and that the combination of both radiomics and clinical factors yields even higher accuracy characterization and predictive performance.Conclusion:Albeit subject to confirmation in a larger cohort, this pilot study presents encouraging results in support of the role of radiomic features towards characterization of HPV in patients with OPSCC.

Radiomics for Identification and Prediction in Metastatic Prostate Cancer: A Review of Studies

Metastatic Prostate Cancer (mPCa) is associated with a poor patient prognosis. mPCa spreads throughout the body, often to bones, with spatial and temporal variations that make the clinical management of the disease difficult. The evolution of the disease leads to spatial heterogeneity that is extremely difficult to characterise with solid biopsies. Imaging provides the opportunity to quantify disease spread. Advanced image analytics methods, including radiomics, offer the opportunity to characterise heterogeneity beyond what can be achieved with simple assessment. Radiomics analysis has the potential to yield useful quantitative imaging biomarkers that can improve the early detection of mPCa, predict disease progression, assess response, and potentially inform the choice of treatment procedures. Traditional radiomics analysis involves modelling with hand-crafted features designed using significant domain knowledge. On the other hand, artificial intelligence techniques such as deep learning can facilitate end-to-end automated feature extraction and model generation with minimal human intervention. Radiomics models have the potential to become vital pieces in the oncology workflow, however, the current limitations of the field, such as limited reproducibility, are impeding their translation into clinical practice. This review provides an overview of the radiomics methodology, detailing critical aspects affecting the reproducibility of features, and providing examples of how artificial intelligence techniques can be incorporated into the workflow. The current landscape of publications utilising radiomics methods in the assessment and treatment of mPCa are surveyed and reviewed. Associated studies have incorporated information from multiple imaging modalities, including bone scintigraphy, CT, PET with varying tracers, multiparametric MRI together with clinical covariates, spanning the prediction of progression through to overall survival in varying cohorts. The methodological quality of each study is quantified using the radiomics quality score. Multiple deficits were identified, with the lack of prospective design and external validation highlighted as major impediments to clinical translation. These results inform some recommendations for future directions of the field.

Robustness and performance of radiomic features in diagnosing cystic renal masses

PURPOSE

We study the inter-reader variability in manual delineation of cystic renal masses (CRMs) presented in computerized tomography (CT) images and its effect on the classification performance of a machine learning algorithm in distinguishing benign from potentially malignant CRMs. In addition, we assessed whether the inclusion of higher-order robust radiomic features improves the classification performance over the use of first-order features.

METHODS

230 CRMs were independently delineated by two radiologists. Through a combination of random fluctuations, dilation, and erosion operations over the original region of interests (ROIs), we generated four additional sets of synthetic ROIs to capture the inter-reader variability realistically, as confirmed by dice coefficient measurements and visual assessment. We then identified the robust features based on the intra-class coefficient (ICC > 0.85) across these datasets. We applied a tenfold stratified cross-validation (CV) to train and test the performance of the random forest model for the classification of CRMs into benign and potentially malignant.

RESULTS

The mean area under the curve (AUC), sensitivity, specificity, positive predictive value, and negative predictive value were 0.87, 0.82, 0.90, 0.85, and 0.93, respectively. With the usage of first-order features alone, the corresponding values were nearly identical.

CONCLUSION

AUC ranged for the robust and uncorrelated features from 0.83 ± 0.09 to 0.93 ± 0.04 and for the first-order features from 0.84 ± 0.09 to 0.91 ± 0.04. Our study indicates that the first-order features alone are sufficient for the classification of CRMs, and that inclusion of higher-order features does not necessarily improve performance.

Radiomics feature reliability assessed by intraclass correlation coefficient: a systematic review

Radiomics research is rapidly growing in recent years, but more concerns on radiomics reliability are also raised. This review attempts to update and overview the current status of radiomics reliability research in the ever expanding medical literature from the perspective of a single reliability metric of intraclass correlation coefficient (ICC). To conduct this systematic review, Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed. After literature search and selection, a total of 481 radiomics studies using CT, PET, or MRI, covering a wide range of subject and disease types, were included for review. In these highly heterogeneous studies, feature reliability to image segmentation was much more investigated than reliability to other factors, such as image acquisition, reconstruction, post-processing, and feature quantification. The reported ICCs also suggested high radiomics feature reliability to image segmentation. Image acquisition was found to introduce much more feature variability than image segmentation, in particular for MRI, based on the reported ICC values. Image post-processing and feature quantification yielded different levels of radiomics reliability and might be used to mitigate image acquisition-induced variability. Some common flaws and pitfalls in ICC use were identified, and suggestions on better ICC use were given. Due to the extremely high study heterogeneities and possible risks of bias, the degree of radiomics feature reliability that has been achieved could not yet be safely synthesized or derived in this review. More future researches on radiomics reliability are warranted.

Benchmarking Various Radiomic Toolkit Features While Applying the Image Biomarker Standardization Initiative toward Clinical Translation of Radiomic Analysis

The image biomarkers standardization initiative (IBSI) was formed to address the standardization of extraction of quantifiable imaging metrics. Despite its effort, there remains a lack of consensus or established guidelines regarding radiomic feature terminology, the underlying mathematics and their implementation across various software programs. This creates a scenario where features extracted using different toolboxes cannot be used to build or validate the same model leading to a non-generalization of radiomic results. In this study, IBSI-established phantom and benchmark values were used to compare the variation of the radiomic features while using 6 publicly available software programs and 1 in-house radiomics pipeline. All IBSI-standardized features (11 classes, 173 in total) were extracted. The relative differences between the extracted feature values from the different software programs and the IBSI benchmark values were calculated to measure the inter-software agreement. To better understand the variations, features are further grouped into 3 categories according to their properties: 1) morphology, 2) statistic/histogram and 3)texture features. While a good agreement was observed for a majority of radiomics features across the various tested programs, relatively poor agreement was observed for morphology features. Significant differences were also found in programs that use different gray-level discretization approaches. Since these software programs do not include all IBSI features, the level of quantitative assessment for each category was analyzed using Venn and UpSet diagrams and quantified using two ad hoc metrics. Morphology features earned lowest scores for both metrics, indicating that morphological features are not consistently evaluated among software programs. We conclude that radiomic features calculated using different software programs may not be interchangeable. Further studies are needed to standardize the workflow of radiomic feature extraction.

A deep look into radiomics

Radiomics is a process that allows the extraction and analysis of quantitative data from medical images. It is an evolving field of research with many potential applications in medical imaging. The purpose of this review is to offer a deep look into radiomics, from the basis, deeply discussed from a technical point of view, through the main applications, to the challenges that have to be addressed to translate this process in clinical practice. A detailed description of the main techniques used in the various steps of radiomics workflow, which includes image acquisition, reconstruction, pre-processing, segmentation, features extraction and analysis, is here proposed, as well as an overview of the main promising results achieved in various applications, focusing on the limitations and possible solutions for clinical implementation. Only an in-depth and comprehensive description of current methods and applications can suggest the potential power of radiomics in fostering precision medicine and thus the care of patients, especially in cancer detection, diagnosis, prognosis and treatment evaluation.

Radiomics feature stability of open-source software evaluated on apparent diffusion coefficient maps in head and neck cancer

Radiomics is a promising technique for discovering image based biomarkers of therapy response in cancer. Reproducibility of radiomics features is a known issue that is addressed by the image biomarker standardisation initiative (IBSI), but it remains challenging to interpret previously published radiomics signatures. This study investigates the reproducibility of radiomics features calculated with two widely used radiomics software packages (IBEX, MaZda) in comparison to an IBSI compliant software package (PyRadiomics). Intensity histogram, shape and textural features were extracted from 334 diffusion weighted magnetic resonance images of 59 head and neck cancer (HNC) patients from the PREDICT-HN observational radiotherapy study. Based on name and linear correlation, PyRadiomics shares 83 features with IBEX and 49 features with MaZda, a sub-set of well correlated features are considered reproducible (IBEX: 15 features, MaZda: 18 features). We explore the impact of including non-reproducible radiomics features in a HNC radiotherapy response model. It is possible to classify equivalent patient groups using radiomic features from either software, but only when restricting the model to reliable features using a correlation threshold method. This is relevant for clinical biomarker validation trials as it provides a framework to assess the reproducibility of reported radiomic signatures from existing trials.

Technical Note: On the development of an outcome-driven frequency filter for improving Radiomics-based modeling of Human Papilloma Virus (HPV) in patients with oropharyngeal squamous cell carcinomas

PURPOSE

To implement an outcome-driven frequency filter for improving radiomics-based modeling of human papilloma virus (HPV) for patients with oropharyngeal squamous cell carcinoma (OPSCC).

METHODS AND MATERIALS

One hundred twenty-eight OPSCC patients with known HPV status (60-HPV+ and 68-HPV-, confirmed by immunohistochemistry-P16 protein testing) were retrospectively studied. A 3D Discrete Fourier Transform was applied on contrast-enhanced CT images of patient gross tumor volumes (GTV's) to transform intensity distributions to the frequency domain and estimate frequency power spectrums of HPV- and HPV+ patient cohorts. Statistical analyses were performed to rank frequency bands contributing towards prediction of HPV status. An outcome-driven frequency filter was designed accordingly and applied to GTV frequency information. 3D Inverse-Discrete-Fourier-Transform was applied to reconstruct HPV-related frequency-filtered images. Radiomics features (11 feature-categories) were extracted from pre- and post- frequency filtered images using our previously published 'ROdiomiX' software. Least-Absolute-Shrinkage-and-Selection-Operation (Lasso) combined with a Generalized-Linear-Model (Lasso-GLM) was developed to identify and rank feature subsets with optimal information for prediction of HPV+/-. Radiomics-based Lasso-GLM classifiers (pre- and post-frequency filtered) were constructed and validated using a random permutation sampling and nested cross-validation techniques. Average Area Under Receiver Operating Characteristic (AUC), and Positive and Negative Predictive values (PPV, NPV) were computed to estimate generalization error and prediction performance.

RESULTS

Among 192 radiomic features, 15 features were found to be statistically significant discriminators between HPV+/- cohorts on post-frequency filtered CE-CT images; 14 such radiomic features were observed on pre-frequency filtered datasets. Discriminant features included tumor morphology and intensity contrast. Performances for prediction of HPV for the pre- and post-frequency filtered Lasso-GLM classifiers were: AUC/PPV/NPV = 0.789/0.755/0.805 and 0.850/0.808/0.877 respectively. Nested-CV performances for prediction of HPV for the pre- and post-frequency filtered Lasso-GLM classifiers were: AUC/PPV/NPV = 0.814/0.725/0.877 and 0.890/0.820/0.911 respectively.

CONCLUSION

Albeit subject to confirmation in a larger cohort, this pilot study presents encouraging results on the importance of frequency analysis prior to radiomic feature extraction toward enhancement of model performance for characterizing HPV in patients with OPSCC. This article is protected by copyright. All rights reserved.

Radiomics Prediction of EGFR Status in Lung Cancer-Our Experience in Using Multiple Feature Extractors and The Cancer Imaging Archive Data

We investigated the performance of multiple radiomics feature extractors/software on predicting epidermal growth factor receptor mutation status in 228 patients with non–small cell lung cancer from publicly available data sets in The Cancer Imaging Archive. The imaging and clinical data were split into training (n = 105) and validation cohorts (n = 123). Two of the most cited open-source feature extractors, IBEX (1563 features) and Pyradiomics (1319 features), and our in-house software, Columbia Image Feature Extractor (CIFE) (1160 features), were used to extract radiomics features. Univariate and multivariate analyses were performed sequentially to predict EGFR mutation status using each individual feature extractor. Our univariate analysis integrated an unsupervised clustering method to identify nonredundant and informative candidate features for the creation of prediction models by multivariate analyses. In training, unsupervised clustering-based univariate analysis identified 5, 6, and 4 features from IBEX, Pyradiomics, and CIFE as candidate features, respectively. Multivariate prediction models using these features from IBEX, Pyradiomics, and CIFE yielded similar areas under the receiver operating characteristic curve of 0.68, 0.67, and 0.69. However, in validation, areas under the receiver operating characteristic curve of multivariate prediction models from IBEX, Pyradiomics, and CIFE decreased to 0.54, 0.56 and 0.64, respectively. Different feature extractors select different radiomics features, which leads to prediction models with varying performance. However, correlation between those selected features from different extractors may indicate these features measure similar imaging phenotypes associated with similar biological characteristics. Overall, attention should be paid to the generalizability of individual radiomics features and radiomics prediction models.

Reproducibility of CT-based radiomic features against image resampling and perturbations for tumour and healthy kidney in renal cancer patients

Computed Tomography (CT) is widely used in oncology for morphological evaluation and diagnosis, commonly through visual assessments, often exploiting semi-automatic tools as well. Well-established automatic methods for quantitative imaging offer the opportunity to enrich the radiologist interpretation with a large number of radiomic features, which need to be highly reproducible to be used reliably in clinical practice. This study investigates feature reproducibility against noise, varying resolutions and segmentations (achieved by perturbing the regions of interest), in a CT dataset with heterogeneous voxel size of 98 renal cell carcinomas (RCCs) and 93 contralateral normal kidneys (CK). In particular, first order (FO) and second order texture features based on both 2D and 3D grey level co-occurrence matrices (GLCMs) were considered. Moreover, this study carries out a comparative analysis of three of the most commonly used interpolation methods, which need to be selected before any resampling procedure. Results showed that the Lanczos interpolation is the most effective at preserving original information in resampling, where the median slice resolution coupled with the native slice spacing allows the best reproducibility, with 94.6% and 87.7% of features, in RCC and CK, respectively. GLCMs show their maximum reproducibility when used at short distances.

Reproducibility of lung nodule radiomic features: Multivariable and univariable investigations that account for interactions between CT acquisition and reconstruction parameters

PURPOSE

Recent studies have demonstrated a lack of reproducibility of radiomic features in response to variations in CT parameters. In addition, reproducibility of radiomic features has not been well established in clinical datasets. We aimed to investigate the effects of a wide range of CT acquisition and reconstruction parameters on radiomic features in a realistic setting using clinical low dose lung cancer screening cases. We performed univariable and multivariable explorations to consider the effects of individual parameters and the simultaneous interactions between three different acquisition/reconstruction parameters of radiation dose level, reconstructed slice thickness, and kernel.

METHOD

A cohort of 89 lung cancer screening patients were collected that each had a solid lung nodule >4mm diameter. A computational pipeline was used to perform a simulation of dose reduction of the raw projection data, collected from patient scans. This was followed by reconstruction of raw data with weighted filter back projection (wFBP) algorithm and automatic lung nodule detection and segmentation using a computer-aided detection tool. For each patient, 36 different image datasets were created corresponding to dose levels of 100%, 50%, 25%, and 10% of the original dose level, three slice thicknesses of 0.6 mm, 1 mm, and 2 mm, as well as three reconstruction kernels of smooth, medium, and sharp. For each nodule, 226 well-known radiomic features were calculated at each image condition. The reproducibility of radiomic features was first evaluated by measuring the intercondition agreement of the feature values among the 36 image conditions. Then in a series of univariable analyses, the impact of individual CT parameters was assessed by selecting subsets of conditions with one varying and two constant CT parameters. In each subset, intraparameter agreements were assessed. Overall concordance correlation coefficient (OCCC) served as the measure of agreement. An OCCC ≥ 0.9 implied strong agreement and reproducibility of radiomic features in intercondition or intraparameter comparisons. Furthermore, the interaction of CT parameters in impacting radiomic feature values was investigated via ANOVA.

RESULTS

All included radiomic features lacked intercondition reproducibility (OCCC < 0.9) among all the 36 conditions. Out of 226 radiomic features analyzed, only 17 and 18 features were considered reproducible (OCCC ≥ 0.9) to dose and kernel variation, respectively, within the corresponding condition subsets. Slice thickness demonstrated the largest impact on radiomic feature values where only one to five features were reproducible at a few condition subsets. ANOVA revealed significant interactions (P < 0.05) between CT parameters affecting the variability of >50% of radiomic features.

CONCLUSION

We systematically explored the multidimensional space of CT parameters in affecting lung nodule radiomic features. Univariable and multivariable analyses of this study not only showed the lack of reproducibility of the majority of radiomic features but also revealed existing interactions among CT parameters, meaning that the effect of individual CT parameters on radiomic features can be conditional upon other CT acquisition and reconstruction parameters. Our findings advise on careful radiomic feature selection and attention to the inclusion criteria for CT image acquisition protocols within the datasets of radiomic studies.

The Role of Radiomics in Lung Cancer: From Screening to Treatment and Follow-Up

PURPOSE

Lung cancer represents the first cause of cancer-related death in the world. Radiomics studies arise rapidly in this late decade. The aim of this review is to identify important recent publications to be synthesized into a comprehensive review of the current status of radiomics in lung cancer at each step of the patients' care.

METHODS

A literature review was conducted using PubMed/Medline for search of relevant peer-reviewed publications from January 2012 to June 2020.

RESULTS

We identified several studies at each point of patient's care: detection and classification of lung nodules (n=16), determination of histology and genomic (n=10) and finally treatment outcomes predictions (=23). We reported the methodology of those studies and their results and discuss the limitations and the progress to be made for clinical routine applications.

CONCLUSION

Promising perspectives arise from machine learning applications and radiomics based models in lung cancers, yet further data are necessary for their implementation in daily care. Multicentric collaboration and attention to quality and reproductivity of radiomics studies should be further consider.

Integrating Towed Underwater Video and Multibeam Acoustics for Marine Benthic Habitat Mapping and Fish Population Estimation

The west Florida shelf (WFS; Gulf of Mexico, USA) is an important area for commercial and recreational fishing, yet much of it remains unmapped and unexplored, hindering effective monitoring of fish stocks. The goals of this study were to map the habitat at an intensively fished area on the WFS known as “The Elbow”, assess the differences in fish communities among different habitat types, and estimate the abundance of each fish taxa within the study area. High-resolution multibeam bathymetric and backscatter data were combined with high-definition (HD) video data collected from a near-bottom towed vehicle to characterize benthic habitat as well as identify and enumerate fishes. Two semi-automated statistical classifiers were implemented for obtaining substrate maps. The supervised classification (random forest) performed significantly better (p = 0.001; α = 0.05) than the unsupervised classification (k-means clustering). Additionally, we found it was important to include predictors at a range of spatial scales. Significant differences were found in the fish community composition among the different habitat types, with both substrate and vertical relief found to be important with rock substrate and higher relief areas generally associated with greater fish density. Our results are consistent with the idea that offshore hard-bottom habitats, particularly those of higher vertical relief, serve as “essential fish habitat”, as these rocky habitats account for just 4% of the study area but 65% of the estimated total fish abundance. However, sand contributes 35% to total fish abundance despite comparably low densities due to its large area, indicating the importance of including these habitats in estimates of abundance as well. This work demonstrates the utility of combining towed underwater video sampling and multibeam echosounder maps for habitat mapping and estimation of fish abundance.

Muscle Composition Analysis of Ultrasound Images: A Narrative Review of Texture Analysis

Skeletal muscle composition, often characterized by the degree of intramuscular adipose tissue, deteriorates with aging and disease and contributes to impairments in function and metabolism. Ultrasound can provide surrogate measures of muscle composition through measurement of echo intensity; however, there are several limitations associated with its analysis. More complex image processing features, broadly known as texture analysis, can also provide surrogates of muscle composition and may circumvent some of the limitations associated with muscle echo intensity. Here, texture features from the intensity histogram, gray-level co-occurrence matrix, run-length matrix, local binary pattern, blob analysis, texture anisotropy index and wavelet analysis are discussed. The purpose of this review was to provide a conceptual understanding of texture analysis as it pertains to muscle composition of ultrasound images.

Understanding Sources of Variation to Improve the Reproducibility of Radiomics

Radiomics is the method of choice for investigating the association between cancer imaging phenotype, cancer genotype and clinical outcome prediction in the era of precision medicine. The fast dispersal of this new methodology has benefited from the existing advances of the core technologies involved in radiomics workflow: image acquisition, tumor segmentation, feature extraction and machine learning. However, despite the rapidly increasing body of publications, there is no real clinical use of a developed radiomics signature so far. Reasons are multifaceted. One of the major challenges is the lack of reproducibility and generalizability of the reported radiomics signatures (features and models). Sources of variation exist in each step of the workflow; some are controllable or can be controlled to certain degrees, while others are uncontrollable or even unknown. Insufficient transparency in reporting radiomics studies further prevents translation of the developed radiomics signatures from the bench to the bedside. This review article first addresses sources of variation, which is illustrated using demonstrative examples. Then, it reviews a number of published studies and progresses made to date in the investigation and improvement of feature reproducibility and model performance. Lastly, it discusses potential strategies and practical considerations to reduce feature variability and improve the quality of radiomics study. This review focuses on CT image acquisition, tumor segmentation, quantitative feature extraction, and the disease of lung cancer.

Standardization of imaging methods for machine learning in neuro-oncology

Radiomics is a novel technique in which quantitative phenotypes or features are extracted from medical images. Machine learning enables analysis of large quantities of medical imaging data generated by radiomic feature extraction. A growing number of studies based on these methods have developed tools for neuro-oncology applications. Despite the initial promises, many of these imaging tools remain far from clinical implementation. One major limitation hindering the use of these models is their lack of reproducibility when applied across different institutions and clinical settings. In this article, we discuss the importance of standardization of methodology and reporting in our effort to improve reproducibility. Ongoing efforts of standardization for neuro-oncological imaging are reviewed. Challenges related to standardization and potential disadvantages in over-standardization are also described. Ultimately, greater multi-institutional collaborative effort is needed to provide and implement standards for data acquisition and analysis methods to facilitate research results to be interoperable and reliable for integration into different practice environments.

Lessons learned in transitioning to AI in the medical imaging of COVID-19

The coronavirus disease 2019 (COVID-19) pandemic has wreaked havoc across the world. It also created a need for the urgent development of efficacious predictive diagnostics, specifically, artificial intelligence (AI) methods applied to medical imaging. This has led to the convergence of experts from multiple disciplines to solve this global pandemic including clinicians, medical physicists, imaging scientists, computer scientists, and informatics experts to bring to bear the best of these fields for solving the challenges of the COVID-19 pandemic. However, such a convergence over a very brief period of time has had unintended consequences and created its own challenges. As part of Medical Imaging Data and Resource Center initiative, we discuss the lessons learned from career transitions across the three involved disciplines (radiology, medical imaging physics, and computer science) and draw recommendations based on these experiences by analyzing the challenges associated with each of the three associated transition types: (1) AI of non-imaging data to AI of medical imaging data, (2) medical imaging clinician to AI of medical imaging, and (3) AI of medical imaging to AI of COVID-19 imaging. The lessons learned from these career transitions and the diffusion of knowledge among them could be accomplished more effectively by recognizing their associated intricacies. These lessons learned in the transitioning to AI in the medical imaging of COVID-19 can inform and enhance future AI applications, making the whole of the transitions more than the sum of each discipline, for confronting an emergency like the COVID-19 pandemic or solving emerging problems in biomedicine.

Stratification of cystic renal masses into benign and potentially malignant: applying machine learning to the bosniak classification

PURPOSE

To create a CT texture-based machine learning algorithm that distinguishes benign from potentially malignant cystic renal masses as defined by the Bosniak Classification version 2019.

METHODS

In this IRB-approved, HIPAA-compliant study, 4,454 adult patients underwent renal mass protocol CT or CT urography from January 2011 to June 2018. Of these, 257 cystic renal masses were included in the final study cohort. Each mass was independently classified using Bosniak version 2019 by three radiologists, resulting in 185 benign (Bosniak I or II) and 72 potentially malignant (Bosniak IIF, III or IV) masses. Six texture features: mean, standard deviation, mean of positive pixels, entropy, skewness, kurtosis were extracted using commercial software TexRAD (Feedback PLC, Cambridge, UK). Random forest (RF), logistic regression (LR), and support vector machine (SVM) machine learning algorithms were implemented to classify cystic renal masses into the two groups and tested with tenfold cross validations.

RESULTS

Higher mean, standard deviation, mean of positive pixels, entropy, skewness were statistically associated with the potentially malignant group (P ≤ 0.0015 each). Sensitivity, specificity, positive predictive value, negative predictive value, and area under curve of RF model was 0.67, 0.91, 0.75, 0.88, 0.88; of LR model was 0.63, 0.93, 0.78, 0.86, 0.90, and of SVM model was 0.56, 0.91, 0.71, 0.84, 0.89, respectively.

CONCLUSION

Three CT texture-based machine learning algorithms demonstrated high discriminatory capability in distinguishing benign from potentially malignant cystic renal masses as defined by the Bosniak Classification version 2019. If validated, CT texture-based machine learning algorithms may help reduce interreader variability when applying the Bosniak classification.

Effect of an iterative reconstruction quantum noise reduction technique on computed tomography radiomic features

Purpose: The goal of this study was to quantify the effects of iterative reconstruction on radiomics features of normal anatomic structures on head and neck computed tomography (CT) scans. Methods: Regions of interest (ROI) containing five different tissue types and an ROI containing only air were extracted from CT scans of the head and neck from 108 patients. Each scan was reconstructed using three different iDose 4 reconstruction levels (2, 4, and 6) in addition to bone, thin slice (1-mm slice thickness), and thin-bone reconstructions. From each ROI in all reconstructions, 142 radiomic features were calculated. For each of the six ROIs, features were compared between combinations of iDose levels (2v4, 4v6, and 2v6) with a threshold of α = 0.05 after correcting for multiple comparisons ( p < 0.00006 ). Features from iDose 4 - 2 reconstructions were also compared to bone, thin slice, and thin-bone reconstructions. Spearman's rank correlation coefficient, ρ , quantified the relative feature value agreement across iDose 4 reconstructions. Results: When comparing radiomics features across the three iDose 4 reconstruction levels, over half of all features reflected significant differences for all tissue types, while no features demonstrated significant differences when extracted from air ROIs. When assessing feature value agreement, at least 97% of features reflected excellent agreement ( ρ > 0.9 ) when comparing the three iDose levels for all ROIs. When comparing iDose 4 - 2 to bone, thin slice, and thin-bone reconstructions, more than half of all features demonstrated significant differences for all ROIs and 89 % of features reflected excellent agreement for all ROIs. Conclusion: Many radiomics features are dependent on the iterative reconstruction level, and the magnitude of this dependency is affected by the tissue from which features are extracted. For studies using images reconstructed using varying iDose 4 reconstruction levels, features robust to these should be used.

Reliability and prognostic value of radiomic features are highly dependent on choice of feature extraction platform

OBJECTIVE

To investigate the effects of Image Biomarker Standardisation Initiative (IBSI) compliance, harmonisation of calculation settings and platform version on the statistical reliability of radiomic features and their corresponding ability to predict clinical outcome.

METHODS

The statistical reliability of radiomic features was assessed retrospectively in three clinical datasets (patient numbers: 108 head and neck cancer, 37 small-cell lung cancer, 47 non-small-cell lung cancer). Features were calculated using four platforms (PyRadiomics, LIFEx, CERR and IBEX). PyRadiomics, LIFEx and CERR are IBSI-compliant, whereas IBEX is not. The effects of IBSI compliance, user-defined calculation settings and platform version were assessed by calculating intraclass correlation coefficients and confidence intervals. The influence of platform choice on the relationship between radiomic biomarkers and survival was evaluated using univariable cox regression in the largest dataset.

RESULTS

The reliability of radiomic features calculated by the different software platforms was only excellent (ICC > 0.9) for 4/17 radiomic features when comparing all four platforms. Reliability improved to ICC > 0.9 for 15/17 radiomic features when analysis was restricted to the three IBSI-compliant platforms. Failure to harmonise calculation settings resulted in poor reliability, even across the IBSI-compliant platforms. Software platform version also had a marked effect on feature reliability in CERR and LIFEx. Features identified as having significant relationship to survival varied between platforms, as did the direction of hazard ratios.

CONCLUSION

IBSI compliance, user-defined calculation settings and choice of platform version all influence the statistical reliability and corresponding performance of prognostic models in radiomics.

KEY POINTS

• Reliability of radiomic features varies between feature calculation platforms and with choice of software version. • Image Biomarker Standardisation Initiative (IBSI) compliance improves reliability of radiomic features across platforms, but only when calculation settings are harmonised. • IBSI compliance, user-defined calculation settings and choice of platform version collectively affect the prognostic value of features.

Deep-Learning-Based Artificial Intelligence for PI-RADS Classification to Assist Multiparametric Prostate MRI Interpretation: A Development Study

BACKGROUND

The Prostate Imaging Reporting and Data System (PI-RADS) provides guidelines for risk stratification of lesions detected on multiparametric MRI (mpMRI) of the prostate but suffers from high intra/interreader variability.

PURPOSE

To develop an artificial intelligence (AI) solution for PI-RADS classification and compare its performance with an expert radiologist using targeted biopsy results.

STUDY TYPE

Retrospective study including data from our institution and the publicly available ProstateX dataset.

POPULATION

In all, 687 patients who underwent mpMRI of the prostate and had one or more detectable lesions (PI-RADS score >1) according to PI-RADSv2.

FIELD STRENGTH/SEQUENCE

T2 -weighted, diffusion-weighted imaging (DWI; five evenly spaced b values between b = 0-750 s/mm2 ) for apparent diffusion coefficient (ADC) mapping, high b-value DWI (b = 1500 or 2000 s/mm2 ), and dynamic contrast-enhanced T1 -weighted series were obtained at 3.0T.

ASSESSMENT

PI-RADS lesions were segmented by a radiologist. Bounding boxes around the T2 /ADC/high-b value segmentations were stacked and saved as JPEGs. These images were used to train a convolutional neural network (CNN). The PI-RADS scores obtained by the CNN were compared with radiologist scores. The cancer detection rate was measured from a subset of patients who underwent biopsy.

STATISTICAL TESTS

Agreement between the AI and the radiologist-driven PI-RADS scores was assessed using a kappa score, and differences between categorical variables were assessed with a Wald test.

RESULTS

For the 1034 detection lesions, the kappa score for the AI system vs. the expert radiologist was moderate, at 0.40. However, there was no significant difference in the rates of detection of clinically significant cancer for any PI-RADS score in 86 patients undergoing targeted biopsy (P = 0.4-0.6).

DATA CONCLUSION

We developed an AI system for assignment of a PI-RADS score on segmented lesions on mpMRI with moderate agreement with an expert radiologist and a similar ability to detect clinically significant cancer.

LEVEL OF EVIDENCE

4 TECHNICAL EFFICACY STAGE: 2.

A systematic review and meta-analysis of the prognostic value of radiomics based models in non-small cell lung cancer treated with curative radiotherapy

BACKGROUND AND PURPOSE

Radiomics allows extraction of quantifiable features from imaging. This study performs a systematic review and meta-analysis of the performance of radiomics based prognostic models in non-small cell lung cancer (NSCLC).

MATERIALS AND METHODS

A literature review was performed following PRISMA guidelines. Medline, EMBASE and Cochrane databases were searched for articles investigating radiomics features predictive of overall survival (OS) in NSCLC treated with curative intent radiotherapy. A random-effects meta-analysis of Harrell's Concordance Index (C-index) was performed on the performance of radiomics models.

RESULTS

Of the 2746 articles retrieved, 40 studies of 55 datasets and 6223 patients were eligible for inclusion in the systematic review. There was significant heterogeneity in the methodology for feature selection and model development. Twelve datasets reported the C-index of radiomics based models in predicting OS and were included in the meta-analysis. The C-index random effects estimate was 0.57 (95% CI 0.53-0.62). There was significant heterogeneity (I² = 70.3%).

CONCLUSIONS

Based on this review, radiomics based models for lung cancer have to date demonstrated modest prognostic capabilities. Future research should consider using standardised radiomics features, robust feature selection and model development, and deep learning techniques, absolving the need for pre-defined features, to improve imaging-based models.

Harmonization of radiomic feature variability resulting from differences in CT image acquisition and reconstruction: assessment in a cadaveric liver

Studies investigating the effects of computed tomography (CT) image acquisition and reconstruction parameters have mostly been limited to non-human phantoms to limit exposure to patients. This study investigates these variations using a cadaveric liver and determines harmonization methods to mitigate these variations. A reference CT scan of a cadaveric liver was acquired along with 16 modified scans. Modified scans were obtained with altered image acquisition and reconstruction parameters. In each slice, the liver was segmented and used to calculate 142 features. Student's t-tests assessed differences between reference and modified scans for each feature after correcting for multiple comparisons. Features were harmonized between reference and modified scans using histogram normalization, pixel resampling, Butterworth filtering, resampling and filtering combined, and ComBat harmonization. The number of features reflecting significant differences before and after harmonization were compared across imaging parameters. Reducing the field-of-view (FOV) and using coronal instead of axial scans resulted in the greatest number of features reflecting significant differences (67.6%, and 35.9%, respectively) and resulted in the greatest median relative change in feature values (25.4% and 18.2%, respectively). Changes in tube voltage, pitch, and slice interval resulted in the smallest number of features reflecting significance (0.7%) with median relative changes in feature <2%. Histogram normalization reduced or maintained the number of significantly different features for all scans, while ComBat reduced the number of significantly different features to zero for all scans. The remaining harmonization methods had mixed effects: resampling reduced the number of features reflecting significant differences for half of the imaging parameters, while filtering alone and filtering combined with resampling both reduced the number of features reflecting significance for 10 of the 16 parameters. The dependence of radiomic features on image acquisition and reconstruction parameters varies in a cadaveric liver; however, various harmonization methods have shown promise in mitigating these dependencies, particularly ComBat.

Standardization of CT radiomics features for multi-center analysis: impact of software settings and parameters

The aim of this multicentric study is an inter-center benchmarking, to assess how different set tools applied to the same radiomics workflow affected the radiomics features (RFs) values. This topic is of key importance to start collaboration between different centers and to bring radiomic studies from benchmark to bedside. A per-lesion analysis was performed on 56 metastases (mts) selected from 14 patients. A single radiologist performed the segmentation of all mts, and RFs were extracted from the same segmentation of each mts, using two different software and file formats. Potential sources of discrepancies were evaluated. The intraclass correlation coefficient was used to describe how strongly the same radiomic measurements calculated in the two different centers resemble each other. Moreover, means of the relative changes of each RF were calculated, compared and gradually reduced. We showed that, after matching all formulas, discrepancies in RFs calculation between two centers ranged from 1% to 277%. Therefore, we evaluated other sources of variability using a stepwise approach, which led us to reduce the inter-center discrepancies to 0% for 22/25 RFs and below 2% for 3 RFs out of 25. In this study we demonstrated that different radiomic applications and masks formats might strongly impact the computation of some RFs. Therefore, when dealing with multi-center studies it is mandatory to adopt all strategies that can help in limiting the differences, thus keeping in mind the feasibility of these strategies in large cohort studies.

Radiomics and Bladder Cancer: Current Status

PURPOSE: To systematically review the current literature and discuss the applications and limitations of radiomics and machine-learning augmented radiomics in the management of bladder cancer. METHODS: Pubmed ®, Scopus ®, and Web of Science ® databases were searched systematically for all full-text English-language articles assessing the impact of Artificial Intelligence OR Radiomics OR Machine Learning AND Bladder Cancer AND (staging OR grading OR prognosis) published up to January 2020. RESULTS: Of the 686 articles that were identified, 13 studies met the criteria for quantitative analysis. Staging, Grading and Tumor Classification, Prognosis, and Therapy Response were discussed in 7, 3, 2 and 7 studies, respectively. Data on cost of implementation were not reported. CT and MRI were the most common imaging approaches. CONCLUSION: Radiomics shows potential in bladder cancer detection, staging, grading, and response to therapy, thereby supporting the physician in personalizing patient management. Extension and validation of this promising technology in large multisite prospective trials is warranted to pave the way for its clinical translation.

Optimal co-clinical radiomics: Sensitivity of radiomic features to tumour volume, image noise and resolution in co-clinical T1-weighted and T2-weighted magnetic resonance imaging

Background

Radiomics analyses has been proposed to interrogate the biology of tumour as well as to predict/assess response to therapy in vivo. The objective of this work was to assess the sensitivity of radiomics features to noise, resolution, and tumour volume in the context of a co-clinical trial.

Methods

Triple negative breast cancer (TNBC) patients were recruited into an ongoing co-clinical imaging trial. Sub-typed matched TNBC patient-derived tumour xenografts (PDX) were generated to investigate optimal co-clinical MR radiomic features. The MR imaging protocol included T1-weighed and T2-weighted imaging. To test the sensitivity of radiomics to resolution, PDX were imaged at three different resolutions. Multiple sets of images with varying signal-to-noise ratio (SNR) were generated, and an image independent patch-based method was implemented to measure the noise levels. Forty-eight radiomic features were extracted from manually segmented 2D and 3D segmented tumours and normal tissues of T1- and T2- weighted co-clinical MR images.

Findings

Sixteen radiomics features were identified as volume dependent and corrected for volume-dependency following normalization. Features from grey-level run-length matrix (GLRLM), grey-level size zone matrix (GLSZM) were identified as most sensitive to noise. Radiomic features Kurtosis and Run-length variance (RLV) from GLSZM were most sensitive to changes in resolution in both T1w and T2w MRI. In general, 3D radiomic features were more robust compared to 2D (single slice) measures, although the former exhibited higher variability between subjects.

Interpretation

Tumour volume, noise characteristics, and image resolution significantly impact radiomic analysis in co-clinical studies.

Multi-energy computed tomography and material quantification: Current barriers and opportunities for advancement

Computed tomography (CT) technology has rapidly evolved since its introduction in the 1970s. It is a highly important diagnostic tool for clinicians as demonstrated by the significant increase in utilization over several decades. However, much of the effort to develop and advance CT applications has been focused on improving visual sensitivity and reducing radiation dose. In comparison to these areas, improvements in quantitative CT have lagged behind. While this could be a consequence of the technological limitations of conventional CT, advanced dual-energy CT (DECT) and photon-counting detector CT (PCD-CT) offer new opportunities for quantitation. Routine use of DECT is becoming more widely available and PCD-CT is rapidly developing. This review covers efforts to address an unmet need for improved quantitative imaging to better characterize disease, identify biomarkers, and evaluate therapeutic response, with an emphasis on multi-energy CT applications. The review will primarily discuss applications that have utilized quantitative metrics using both conventional and DECT, such as bone mineral density measurement, evaluation of renal lesions, and diagnosis of fatty liver disease. Other topics that will be discussed include efforts to improve quantitative CT volumetry and radiomics. Finally, we will address the use of quantitative CT to enhance image-guided techniques for surgery, radiotherapy and interventions and provide unique opportunities for development of new contrast agents.

Diagnostic performance of commercially available vs. in-house radiomics software in classification of CT images from patients with pancreatic ductal adenocarcinoma vs. healthy controls

PURPOSE

The purpose of this study is to evaluate diagnostic performance of a commercially available radiomics research prototype vs. an in-house radiomics software in the binary classification of CT images from patients with pancreatic ductal adenocarcinoma (PDAC) vs. healthy controls.

MATERIALS AND METHODS

In this retrospective case-control study, 190 patients with PDAC (97 men, 93 women; 66 ± 9 years) from 2012 to 2017 and 190 healthy potential renal donors (96 men, 94 women; 52 ± 8 years) without known pancreatic disease from 2005 to 2009 were identified from radiology and pathology databases. 3D volume of the pancreas was manually segmented from preoperative CT scans. Four hundred and seventy-eight radiomics features were extracted using in-house radiomics software. Eight hundred and fifty-four radiomics features were extracted using a commercially available research prototype. Random forest classifier was used for binary classification of PDAC vs. normal pancreas. Accuracy, sensitivity, and specificity of commercially available radiomics software were compared to in-house software.

RESULTS

When 40 radiomics features were used in the random forest classification, in-house software achieved superior sensitivity (1.00) and accuracy (0.992) compared to the commercially available research prototype (sensitivity = 0.950, accuracy = 0.968). When the number of features was reduced to five features, diagnostic performance of the in-house software decreased to sensitivity (0.950), specificity (0.923), and accuracy (0.936). Diagnostic performance of the commercially available research prototype was unchanged.

CONCLUSION

Commercially available and in-house radiomics software achieve similar diagnostic performance, which may lower the barrier of entry for radiomics research and allow more clinician-scientists to perform radiomics research.

The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping

Background Radiomic features may quantify characteristics present in medical imaging. However, the lack of standardized definitions and validated reference values have hampered clinical use. Purpose To standardize a set of 174 radiomic features. Materials and Methods Radiomic features were assessed in three phases. In phase I, 487 features were derived from the basic set of 174 features. Twenty-five research teams with unique radiomics software implementations computed feature values directly from a digital phantom, without any additional image processing. In phase II, 15 teams computed values for 1347 derived features using a CT image of a patient with lung cancer and predefined image processing configurations. In both phases, consensus among the teams on the validity of tentative reference values was measured through the frequency of the modal value and classified as follows: less than three matches, weak; three to five matches, moderate; six to nine matches, strong; 10 or more matches, very strong. In the final phase (phase III), a public data set of multimodality images (CT, fluorine 18 fluorodeoxyglucose PET, and T1-weighted MRI) from 51 patients with soft-tissue sarcoma was used to prospectively assess reproducibility of standardized features. Results Consensus on reference values was initially weak for 232 of 302 features (76.8%) at phase I and 703 of 1075 features (65.4%) at phase II. At the final iteration, weak consensus remained for only two of 487 features (0.4%) at phase I and 19 of 1347 features (1.4%) at phase II. Strong or better consensus was achieved for 463 of 487 features (95.1%) at phase I and 1220 of 1347 features (90.6%) at phase II. Overall, 169 of 174 features were standardized in the first two phases. In the final validation phase (phase III), most of the 169 standardized features could be excellently reproduced (166 with CT; 164 with PET; and 164 with MRI). Conclusion A set of 169 radiomics features was standardized, which enabled verification and calibration of different radiomics software. © RSNA, 2020 Online supplemental material is available for this article. See also the editorial by Kuhl and Truhn in this issue.

Effects of variability in radiomics software packages on classifying patients with radiation pneumonitis

Purpose: While radiomics feature values can differ when extracted using different radiomics software, the effects of these variations when applied to a particular clinical task are currently unknown. The goal of our study was to use various radiomics software packages to classify patients with radiation pneumonitis (RP) and to quantify the variation in classification ability among packages. Approach: A database of serial thoracic computed tomography scans was obtained from 105 patients with esophageal cancer. Patients were treated with radiation therapy (RT), resulting in 20 patients developing RP grade ≥ 2 . Regions of interest (ROIs) were randomly placed in the lung volume of the pre-RT scan within high-dose regions ( ≥ 30    Gy ), and corresponding ROIs were anatomically matched in the post-RT scan. Three radiomics packages were compared: A1 (in-house), IBEX v1.0 beta, and PyRadiomics v.2.0.0. Radiomics features robust to deformable registration and common among radiomics packages were calculated: four first-order and four gray-level co-occurrence matrix features. Differences in feature values between time points were calculated for each feature, and logistic regression was used in conjunction with analysis of variance to classify patients with and without RP ( p < 0.006 ). Classification ability for each package was assessed using receiver operating characteristic (ROC) analysis and compared using the area under the ROC curve (AUC). Results: Of the eight radiomics features, five were significantly correlated with RP status for all three packages, whereas one feature was not significantly correlated with RP for all three packages. The remaining two features differed in whether or not they were significantly associated with RP status among the packages. Seven of the eight features agreed among the packages in whether the AUC value was significantly > 0.5 . Conclusions: Radiomics features extracted using different software packages can result in differences in classification ability.

Comparison of radiomics tools for image analyses and clinical prediction in nasopharyngeal carcinoma

Objective:

Radiomics pipelines have been developed to extract novel information from radiological images, which may help in phenotypic profiling of tumours that would correlate to prognosis. Here, we compared two publicly available pipelines for radiomics analyses on head and neck CT and MRI in nasopharynx cancer (NPC).

Methods and materials:

100 biopsy-proven NPC cases stratified by T- and N-categories were enrolled in this study. Two radiomics pipeline, Moddicom (v. 0.51) and Pyradiomics (v. 2.1.2) were used to extract radiomics features of CT and MRI. Segmentation of primary gross tumour volume was performed using Velocity v. 4.0 by consensus agreement between three radiation oncologists. Intraclass correlation between common features of the two pipelines was analysed by Spearman’s rank correlation. Unsupervised hierarchical clustering was used to determine association between radiomics features and clinical parameters.

Results:

We observed a high proportion of correlated features in the CT data set, but not for MRI; 76.1% (51 of 67 common between Moddicom and Pyradiomics) of CT features and 28.6% (20 of 70 common) of MRI features were significantly correlated. Of these, 100% were shape-related for both CT and MRI, 100 and 23.5% were first-order-related, 61.9 and 19.0% were texture-related, respectively. This interpipeline heterogeneity affected the downstream clustering with known prognostic clinical parameters of cTN-status and GTVp. Nonetheless, shape features were the most reproducible predictors of clinical parameters among the different radiomics modules.

Conclusion:

Here, we highlighted significant heterogeneity between two publicly available radiomics pipelines that could affect the downstream association with prognostic clinical factors in NPC

Advances in knowledge:

The present study emphasized the broader importance of selecting stable radiomics features for disease phenotyping, and it is necessary prior to any investigation of multicentre imaging datasets to validate the stability of CT-related radiomics features for clinical prognostication.