Repeatability and Reproducibility of Computed Tomography Radiomics for Pulmonary Nodules: A Multicenter Phantom Study

Tailored 3D Lattice Microstructures for Enhanced Functionality in Blood-Gas Exchange

Current membrane oxygenators for extracorporeal life support (ECLS) are facing their limits regarding gas exchange efficiency and long-term stability. One aspect adding to these limitations is inhomogeneous blood flow distribution inside the oxygenator's membrane structure. Triply periodic minimal surface (TPMS) lattice structures are proposed to provide increased mass transfer efficiency and local adaptability introducing heterogeneous properties. However, the adaptation of these structures for blood flow, as in ECLS, is challenging as a hemocompatible flow distribution must be established. In this study, this study proposes a novel method for the smooth, multi-scale modification of TPMS lattice structures creating a tailored flow distribution suited for blood-gas exchange. It implements this method into an automatic structure optimization within an oxygenator. After manufacturing prototypes, it experimentally evaluate the 3D flow distribution using time-resolved, contrast enhanced computed tomography comparing the optimized structure to reference geometries. The TPMS structure modification provides a significant change in flow distribution, improving homogeneity by up to 12%. The approach to creating tailored 3D TPMS lattice structures can be directly transferred to various other applications in the field of heat and mass transfer to enhance functionality, e.g., for heat exchangers or membrane contactors.

Emerging Trends and Innovations in Radiologic Diagnosis of Thoracic Diseases

ABSTRACT

Over the past decade, Investigative Radiology has published numerous studies that have fundamentally advanced the field of thoracic imaging. This review summarizes key developments in imaging modalities, computational tools, and clinical applications, highlighting major breakthroughs in thoracic diseases-lung cancer, pulmonary nodules, interstitial lung disease (ILD), chronic obstructive pulmonary disease (COPD), COVID-19 pneumonia, and pulmonary embolism-and outlining future directions.Artificial intelligence (AI)-driven computer-aided detection systems and radiomic analyses have notably improved the detection and classification of pulmonary nodules, while photon-counting detector CT (PCD-CT) and low-field MRI offer enhanced resolution or radiation-free strategies. For lung cancer, CT texture analysis and perfusion imaging refine prognostication and therapy planning. ILD assessment benefits from automated diagnostic tools and innovative imaging techniques, such as PCD-CT and functional MRI, which reduce the need for invasive diagnostic procedures while improving accuracy. In COPD, dual-energy CT-based ventilation/perfusion assessment and dark-field radiography enable earlier detection and staging of emphysema, complemented by deep learning approaches for improved quantification. COVID-19 research has underscored the clinical utility of chest CT, radiographs, and AI-based algorithms for rapid triage, disease severity evaluation, and follow-up. Furthermore, tuberculosis remains a significant global health concern, highlighting the importance of AI-assisted chest radiography for early detection and management. Meanwhile, advances in CT pulmonary angiography, including dual-energy reconstructions, allow more sensitive detection of pulmonary emboli.Collectively, these innovations demonstrate the power of merging novel imaging technologies, quantitative functional analysis, and AI-driven tools to transform thoracic disease management. Ongoing progress promises more precise and personalized diagnostic and therapeutic strategies for diverse thoracic diseases.

Integration of radiomic and deep features to reliably differentiate benign renal lesions from renal cell carcinoma

PURPOSE

Accurate differentiation of benign renal lesions from renal cell carcinoma (RCC) is crucial for optimized management, particularly for small renal lesions (≤4 cm in diameter). This study aimed to integrate clinical data, radiomic features, and deep features to improve diagnostic performance in distinguishing benign renal lesions from RCC.

METHODS

In this retrospective study, radiomic and deep scores were constructed using the AutoGluon-Tabular classifier based on radiomic and deep features extracted from the whole region of CT imaging. These scores were combined with clinical score, derived from clinical data, to create a multimodal score. The multimodal score was developed using a training cohort of 1,030 patients, validated in a cohort of 448 patients, and tested in a cohort of 680 patients from two independent institutions.

RESULTS

A total of 2,158 patients with renal lesions were evaluated, including 1,739 (80.6 %) diagnosed with RCC, 419 (19.4 %) with benign renal lesions, and 1,340 (62.1 %) with small renal lesions. The multimodal score demonstrated higher diagnostic performance for both overall renal lesions (AUC: 0.949-0.906 vs 0.926-0.765) and small renal lesions (AUC: 0.929-0.880 vs 0.901-0.657) compared to the clinical score, radiomic score, deep score, and radiologists' interpretations in the validation and test cohorts. The multimodal score also showed satisfactory concordance and the highest net benefit across threshold probabilities exceeding 60 %. The AUC values for subgroup with predicted risk below or above cutoff values for 99 % sensitivity or specificity were 0.964 and 0.897 for overall and small renal lesions in the external test cohort, respectively.

CONCLUSIONS

The multimodal score is a reliable predictor for distinguishing benign renal lesions from RCC in both overall and small renal lesions, and has the potential to spare patients from unnecessary biopsies or surgeries and can aid in guiding the management for renal lesions.

The impact of the novel CovBat harmonization method on enhancing radiomics feature stability and machine learning model performance: A multi-center, multi-device study

PURPOSE

This study aims to assess whether the novel CovBat harmonization method can further reduce radiomics feature variability from different imaging devices in multi-center studies and improve machine learning model performance compared to the ComBat method.

MATERIALS

Non-contrast abdominal CT scans of 1,000 healthy subjects from three medical institutions (from four manufacturers and eight different models) were retrospectively included: Hospital A (n = 513), Hospital B (n = 338), and Hospital C (n = 149). 93 radiomics features were extracted from liver and spleen tissues using PyRadiomics. Performing a binary classification task of liver and spleen tissues on the pooled data from the three institutions: (1) Unharmonized, (2) ComBat, and (3) CovBat. Models were built separately for each radiomics feature classes (First-order, GLCM, GLRLM, GLSZM, NGTD, GLDM), as well as a combined model integrating all feature classes. The Kruskal-Wallis test and principal component analysis (PCA) were used to assess the variability of radiomics features among the groups. Multiple linear regression models were used to analyze the sources of variation. Accuracy, sensitivity, specificity, F1-score, and area under the curve (AUC) were used to evaluate model performance.

RESULTS

After ComBat and CovBat harmonization, the number of consistent features increased by 68.82 % and 73.12 %, respectively, and the feature variability due to hardware differences decreased from 12.32-25.38 % to 1.89-2.01 % with ComBat and 1.19-1.88 % with CovBat. The AUC of the machine learning models improved significantly: Combined (Unharmonized: 0.93, ComBat: 0.99, CovBat: 1.00), First-order (0.93, 0.98, 0.98), GLCM (0.81, 0.93, 0.98), GLRLM (0.78, 0.96, 0.98), NGTDM (0.75, 0.96, 0.98), GLSZM (0.78, 0.93, 0.97), and GLDM (0.83, 0.94, 0.97). DeLong's test showed that the results before and after harmonization were statistically significant (P < 0.05).

CONCLUSION

CovBat further reduced radiomics feature variability caused by different CT scanners and significantly improved the performance of machine learning models, although the degree of improvement varied across different feature categories.

Reproducible Radiomics Features from Multi-MRI-Scanner Test-Retest-Study: Influence on Performance and Generalizability of Models

BACKGROUND

Radiomics models trained on data from one center typically show a decline of performance when applied to data from external centers, hindering their introduction into large-scale clinical practice. Current expert recommendations suggest to use only reproducible radiomics features isolated by multiscanner test-retest experiments, which might help to overcome the problem of limited generalizability to external data.

PURPOSE

To evaluate the influence of using only a subset of robust radiomics features, defined in a prior in vivo multi-MRI-scanner test-retest-study, on the performance and generalizability of radiomics models.

STUDY TYPE

Retrospective.

POPULATION

Patients with monoclonal plasma cell disorders. Training set (117 MRIs from center 1); internal test set (42 MRIs from center 1); external test set (143 MRIs from center 2-8).

FIELD STRENGTH/SEQUENCE

1.5T and 3.0T; T1-weighted turbo spin echo.

ASSESSMENT

The task for the radiomics models was to predict plasma cell infiltration, determined by bone marrow biopsy, noninvasively from MRI. Radiomics machine learning models, including linear regressor, support vector regressor (SVR), and random forest regressor (RFR), were trained on data from center 1, using either all radiomics features, or using only reproducible radiomics features. Models were tested on an internal (center 1) and a multicentric external data set (center 2-8).

STATISTICAL TESTS

Pearson correlation coefficient r and mean absolute error (MAE) between predicted and actual plasma cell infiltration. Fisher's z-transformation, Wilcoxon signed-rank test, Wilcoxon rank-sum test; significance level P < 0.05.

RESULTS

When using only reproducible features compared with all features, the performance of the SVR on the external test set significantly improved (r = 0.43 vs. r = 0.18 and MAE = 22.6 vs. MAE = 28.2). For the RFR, the performance on the external test set deteriorated when using only reproducible instead of all radiomics features (r = 0.33 vs. r = 0.44, P = 0.29 and MAE = 21.9 vs. MAE = 20.5, P = 0.10).

CONCLUSION

Using only reproducible radiomics features improves the external performance of some, but not all machine learning models, and did not automatically lead to an improvement of the external performance of the overall best radiomics model.

LEVEL OF EVIDENCE: 3

TECHNICAL EFFICACY

Stage 2.

Intra-individual radiomic analysis of pericoronary adipose tissue: Photon-counting detector vs energy-integrating detector CT angiography

BACKGROUND

The impact of novel photon-counting detector (PCD)-CT technology on in-vivo radiomics is not fully understood. This study aimed to compare the intra-individual stability and reproducibility of pericoronary adipose tissue (PCAT) radiomic features between PCD-CT and energy-integrating detector (EID)-CT in patients undergoing coronary CT angiography (CCTA) on both systems.

METHODS

Patients undergoing clinically indicated CCTA on an EID-CT were prospectively enrolled for research PCD-CCTA within 30 days. Image acquisition parameters were standardized; PCD-CT datasets were reconstructed both down-sampled to 0.6 mm to match the clinical scan (PCD-CTDS) and at 0.2 mm ultrahigh-resolution mode (PCD-CTUHR). Automatic PCAT segmentation was performed; a total of 110 radiomic feature classes were extracted and compared across the three datasets (EID-CT, PCD-CTDS, and PCD-CDUHR). Feature stability was assessed using paired t-test filtered for false discoveries using Benjamini-Hochberg method, and reproducibility using intraclass correlation coefficient (ICC).

RESULTS

A total of 42 patients (34 male [81.0 %]; 67.9 ± 7.6 years) were included. Feature stability was 91 % for EID-CT vs. PCD-CTDS, but decreased for UHR datasets (EID-CT vs. PCD-CTUHR: 55 %; PCD-CTDS vs. PCD-CTUHR: 51 %). However, inter-scanner reproducibility was poor in both comparisons (EID-CT vs. PCD-CTDS median ICC: 0.43 [0.03-0.69]; EID-CT vs. PCD-CTUHR: 0.29 [0.01-0.51]). Nevertheless, reproducibility improved within PCD-CT datasets (PCD-CTDS vs. PCD-CTUHR: 0.72 [0.48-0.83]), regardless of the difference in slice thickness.

CONCLUSIONS

Most PCAT radiomic features remained stable between EID-CT and PCD-CTDS, although inter-scanner reproducibility was poor, emphasizing the significant impact of detector technology. Conversely, reproducibility of features within PCD-CT datasets showed more consistent results, even when comparing standard to UHR.

Robustness of radiomics among photon-counting detector CT and dual-energy CT systems: a texture phantom study

OBJECTIVES

To evaluate the robustness of radiomics features among photon-counting detector CT (PCD-CT) and dual-energy CT (DECT) systems.

METHODS

A texture phantom consisting of twenty-eight materials was scanned with one PCD-CT and four DECT systems (dual-source, rapid kV-switching, dual-layer, and sequential scanning) at three dose levels twice. Thirty sets of virtual monochromatic images at 70 keV were reconstructed. Regions of interest were delineated for each material with a rigid registration. Ninety-three radiomics were extracted per PyRadiomics. The test-retest repeatability between repeated scans was assessed by Bland-Altman analysis. The intra-system reproducibility between dose levels, and inter-system reproducibility within the same dose level, were evaluated by intraclass correlation coefficient (ICC) and concordance correlation coefficient (CCC). Inter-system variability among five scanners was assessed by coefficient of variation (CV) and quartile coefficient of dispersion (QCD).

RESULTS

The test-retest repeatability analysis presented that 97.1% of features were repeatable between scan-rescans. The mean ± standard deviation ICC and CCC were 0.945 ± 0.079 and 0.945 ± 0.079 for intra-system reproducibility, respectively, and 86.0% and 85.7% of features were with ICC > 0.90 and CCC > 0.90, respectively, between different dose levels. The mean ± standard deviation ICC and CCC were 0.157 ± 0.174 and 0.157 ± 0.174 for inter-system reproducibility, respectively, and none of the features were with ICC > 0.90 or CCC > 0.90 within the same dose level. The inter-system variability suggested that 6.5% and 12.8% of features were with CV < 10% and QCD < 10%, respectively, among five CT systems.

CONCLUSION

The radiomics features were non-reproducible with significant variability in values among different CT techniques.

CLINICAL RELEVANCE STATEMENT

Radiomics features are non-reproducible with significant variability in values among photon-counting detector CT and dual-energy CT systems, necessitating careful attention to improve the cross-system generalizability of radiomic features before implementation of radiomics analysis in clinical routine.

KEY POINTS

CT radiomics stability should be guaranteed before the implementation in the clinical routine. Radiomics robustness was on a low level among photon-counting detectors and dual-energy CT techniques. Limited inter-system robustness of radiomic features may impact the generalizability of models.

Robustness of radiomics within photon-counting detector CT: impact of acquisition and reconstruction factors

OBJECTIVES

To assess the impact of acquisition and reconstruction factors on the robustness of radiomics within photon-counting detector CT (PCD-CT).

METHODS

A phantom with twenty-eight texture materials was scanned with different acquisition and reconstruction factors including reposition, scan mode (standard vs high-pitch), tube voltage (120 kVp vs 140 kVp), slice thickness (1.0 mm vs 0.4 mm), radiation dose level (0.5 mGy, 1.0 mGy, 3.0 mGy, 5.0 mGy, vs 10.0 mGy), quantum iterative reconstruction level (0/4, 2/4, vs 4/4), and reconstruction kernel (Qr40, Qr44, vs Qr48). Thirteen sets of virtual monochromatic images at 70-keV were reconstructed. The regions of interest were drawn with rigid registrations. Ninety-three radiomics features were extracted from each material. The reproducibility of radiomics features was evaluated using the intraclass correlation coefficient (ICC) and concordance correlation coefficient (CCC). The variability of radiomics features was assessed by coefficient of variation (CV) and quartile coefficient of dispersion (QCD).

RESULTS

The percentage of features with ICC > 0.90 and CCC > 0.90 were high when repositioned (88.2% and 88.2%) and tube voltage was changed (87.1% and 87.1%), but none of the features with ICC > 0.90 and CCC > 0.90 when high-pitch scan and different slice thickness were used. The percentage of features with CV < 10% and QCD < 10% were high when repositioned (47.3% and 68.8%) and tube voltage was changed (64.2% and 71.0%), but that with CV < 10% and QCD < 10% were low between standard and high-pitch scans (16.1% and 26.9%) and slice thickness (19.4% and 29.0%).

CONCLUSIONS

The PCD-CT radiomics was robust to tube voltage, radiation dose, reconstruction strength level, and kernel, but brittle to high-pitch scan and slice thickness.

KEY POINTS

Question The stability of radiomics features against acquisition and reconstruction factors within PCD-CT should be fully determined before academic research and clinical application. Findings The radiomics features are robust against tube voltage, radiation dose, reconstruction strength level, and kernel within PCD-CT but brittle to high-pitch scan and slice thickness. Clinical relevance The high-pitch scan and slice thickness that influence voxel size should be set with careful attention within PCD-CT, to allow a higher robustness of radiomics features before the implementation of radiomics analysis in clinical routine.

Enhancing Radiomics Reproducibility: Deep Learning-Based Harmonization of Abdominal Computed Tomography (CT) Images

We assessed the feasibility of using deep learning-based image harmonization to improve the reproducibility of radiomics features in abdominal CT scans. In CT imaging, harmonization adjusts images from different institutions to ensure consistency despite variations in scanners and acquisition protocols. This process is essential because such differences can lead to variability in radiomics features, affecting reproducibility and accuracy. Harmonizing images minimizes these inconsistencies, supporting more reliable and clinically applicable results across diverse settings. A pre-trained harmonization algorithm was applied to 63 dual-energy abdominal CT images, which were reconstructed into four different types, and 10 regions of interest (ROIs) were analyzed. From the original 455 radiomics features per ROI, 387 were used after excluding redundant features. Reproducibility was measured using the intraclass correlation coefficient (ICC), with a threshold of ICC ≥ 0.85 indicating acceptable reproducibility. The region-based analysis revealed significant improvements in reproducibility post-harmonization, especially in vessel features, which increased from 14% to 69%. Other regions, including the spleen, kidney, muscle, and liver parenchyma, also saw notable improvements, although air reproducibility slightly decreased from 95% to 94%, impacting only a few features. In patient-based analysis, reproducible features increased from 18% to 65%, with an average of 179 additional reproducible features per patient after harmonization. These results demonstrate that deep learning-based harmonization can significantly enhance the reproducibility of radiomics features in abdominal CT, offering promising potential for advancing radiomics development and its clinical applications.

Quantifying the reproducibility and longitudinal repeatability of radiomics features in magnetic resonance Image-Guide accelerator Imaging: A phantom study

OBJECTIVE

This study aimed to quantitatively evaluate the inter-platform reproducibility and longitudinal acquisition repeatability of MRI radiomics features in Fluid-Attenuated Inversion Recovery (FLAIR), T2-weighted (T2W), and T1-weighted (T1W) sequences on MR-Linac systems using an American College of Radiology (ACR) phantom.

MATERIALS AND METHODS

This study used two MR-Linac systems (A and B) in different cancer centers. The ACR phantom was scanned on system A daily for 30 consecutive days to evaluate longitudinal repeatability. Additionally, retest data were collected after repositioning the phantom. Inter-platform reproducibility was assessed by conducting scans under identical conditions using system B. Regions of interest were delineated on the T1W sequence from system A and mapped to other sequences via rigid registration. Intra-observer and inter-observer comparisons were conducted. Repeatability and reproducibility were assessed using the intraclass correlation coefficient (ICC) and coefficient of variation (CV). Robust radiomics features were identified based on ICC>0.9 and CV<10 %.

RESULTS

Analysis showed that a higher proportion of radiomics features derived from longitudinal FLAIR sequence (51.65 %) met robustness criteria compared to T2W (48.35 %) and T1W (43.96 %). Additionally, more inter-platform features from the FLAIR sequence (62.64 %) were robust compared to T2W (42.86 %) and T1W (39.56 %). Test-retest and intra-observer repeatability were excellent across all sequences, with a median ICC of 0.99 and CV<5%. However, inter-observer reproducibility was inferior, especially for the T1W sequence.

CONCLUSIONS

Different sequences show variations in repeatability and reproducibility. The FLAIR sequence demonstrated advantages in both longitudinal repeatability and inter-platform reproducibility. Caution is warranted when interpreting data, particularly in longitudinal or multiplatform radiomics studies.

CT-based radiomic consensus clustering association with tumor biological behavior in clinical stage IA adenocarcinoma: a retrospective study

Background

Research has demonstrated that radiomics models are capable of forecasting the characteristics of lung cancer. Nevertheless, due to radiomics' poor interpretability, its applicability in clinical settings remains restricted. This investigation sought to verify the correlation between radiomics features (RFs) and the biological behavior of clinical stage IA adenocarcinomas.

Methods

A retrospective analysis was conducted on patients diagnosed with clinical stage IA lung adenocarcinoma who underwent resection between May 2005 and December 2018. Detailed radiomics examination of the primary tumor was carried out utilizing preoperative computed tomography (CT) images. Subsequently, patients were grouped based on their RFs using consensus clustering, enabling comparison of tumor biological characteristics among the clusters. Survival disparities among the clusters were evaluated through Kaplan-Meier and Cox analyses.

Results

A consensus cluster analysis was performed on 669 patients [median age, 58 years; interquartile range (IQR), 50-64 years, 257 males, 412 females], and three distinct clusters were identified. Cluster 2 was associated with radiological solid adenocarcinoma [119 of 324 (36.7%), P<0.001], larger tumors with median tumor size of 2.1 cm with IQR of 1.7 to 2.5 cm (P<0.001), central tumor [91 of 324 (28.1%), P=0.002], pleural invasion [87 of 324 (26.9%), P<0.001], occult lymph node metastasis (ONM) [106 of 324 (32.7%), P<0.001], and a higher frequency of metastasis or recurrence [62 of 324 (19.1%), P<0.001]. The frequency of histological grade 3 was the highest in Cluster 3 [8 of 34 (23.5%), P<0.001]. Cluster 1 was associated with pure ground glass nodules (pGGNs) [184 of 310 (59.4%), P<0.001], smaller tumors with median tumor size of 1.1 cm with IQR of 0.8 to 1.4 cm (P<0.001), no pleural invasion [276 of 310 (89.0%), P<0.001], histological grade 1 [114 of 248 (46.0%), P<0.001], ONM negative [292 of 310 (94.2%), P<0.001], and a lower rate of metastasis or recurrence [298 of 310 (96.1%), P<0.001].

Conclusions

Differences in tumor biological behavior were detected among consensus clusters based on the RFs of clinical stage IA adenocarcinoma.

Magnetic Resonance Image Radiomic Reproducibility: The Impact of Preprocessing on Extracted Features from Gross and High-Risk Clinical Tumor Volumes in Cervical Cancer Patients before Brachytherapy

Background

Radiomic feature reproducibility assessment is critical in radiomics-based image biomarker discovery. This study aims to evaluate the impact of preprocessing parameters on the reproducibility of magnetic resonance image (MRI) radiomic features extracted from gross tumor volume (GTV) and high-risk clinical tumor volume (HR-CTV) in cervical cancer (CC) patients.

Methods

This study included 99 patients with pathologically confirmed cervical cancer who underwent an MRI prior to receiving brachytherapy. The GTV and HR-CTV were delineated on T2-weighted MRI and inputted into 3D Slicer for radiomic analysis. Before feature extraction, all images were preprocessed to a combination of several parameters of Laplacian of Gaussian (1 and 2), resampling (0.5 and 1), and bin width (5, 10, 25, and 50). The reproducibility of radiomic features was analyzed using the intra-class correlation coefficient (ICC).

Results

Almost all shapes and first-order features had ICC values > 0.95. Most second-order texture features were not reproducible (ICC < 0.95) in GTV and HR-CTV. Furthermore, 20% of all neighboring gray-tone difference matrix texture features had ICC > 0.90 in both GTV and HR-CTV.

Conclusion

The results presented here showed that MRI radiomic features are vulnerable to changes in preprocessing, and this issue must be understood and applied before any clinical decision-making. Features with ICC > 0.90 were considered the most reproducible features. Shape and first-order radiomic features were the most reproducible features in both GTV and HR-CTV. Our results also showed that GTV and HR-CTV radiomic features had similar changes against preprocessing sets.

Repeatability and reproducibility of deep learning features for lung adenocarcinoma subtypes with nodules less than 10 mm in size: a multicenter thin-slice computed tomography phantom and clinical validation study

Background

Deep learning features (DLFs) derived from radiomics features (RFs) fused with deep learning have shown potential in enhancing diagnostic capability. However, the limited repeatability and reproducibility of DLFs across multiple centers represents a challenge in the clinically validation of these features. This study thus aimed to evaluate the repeatability and reproducibility of DLFs and their potential efficiency in differentiating subtypes of lung adenocarcinoma less than 10 mm in size and manifesting as ground-glass nodules (GGNs).

Methods

A chest phantom with nodules was scanned repeatedly using different thin-slice computed tomography (TSCT) scanners with varying acquisition and reconstruction parameters. The robustness of the DLFs was measured using the concordance correlation coefficient (CCC) and intraclass correlation coefficient (ICC). A deep learning approach was used for visualizing the DLFs. To assess the clinical effectiveness and generalizability of the stable and informative DLFs, three hospitals were used to source 275 patients, in whom 405 nodules were pathologically differentially diagnosed as GGN lung adenocarcinoma less than 10 mm in size and were retrospectively reviewed for clinical validation.

Results

A total of 64 DLFs were analyzed, which revealed that the variables of slice thickness and slice interval (ICC, 0.79±0.18) and reconstruction kernel (ICC, 0.82±0.07) were significantly associated with the robustness of DLFs. Feature visualization showed that the DLFs were mainly focused around the nodule areas. In the external validation, a subset of 28 robust DLFs identified as stable under all sources of variability achieved the highest area under curve [AUC =0.65, 95% confidence interval (CI): 0.53-0.76] compared to other DLF models and the radiomics model.

Conclusions

Although different manufacturers and scanning schemes affect the reproducibility of DLFs, certain DLFs demonstrated excellent stability and effectively improved diagnostic the efficacy for identifying subtypes of lung adenocarcinoma. Therefore, as the first step, screening stable DLFs in multicenter DLFs research may improve diagnostic efficacy and promote the application of these features.

Impacts of Adaptive Statistical Iterative Reconstruction-V and Deep Learning Image Reconstruction Algorithms on Robustness of CT Radiomics Features: Opportunity for Minimizing Radiomics Variability Among Scans of Different Dose Levels

This study aims to investigate the influence of adaptive statistical iterative reconstruction-V (ASIR-V) and deep learning image reconstruction (DLIR) on CT radiomics feature robustness. A standardized phantom was scanned under single-energy CT (SECT) and dual-energy CT (DECT) modes at standard and low (20 and 10 mGy) dose levels. Images of SECT 120 kVp and corresponding DECT 120 kVp-like virtual monochromatic images were generated with filtered back-projection (FBP), ASIR-V at 40% (AV-40) and 100% (AV-100) blending levels, and DLIR algorithm at low (DLIR-L), medium (DLIR-M), and high (DLIR-H) strength levels. Ninety-four features were extracted via Pyradiomics. Reproducibility of features was calculated between standard and low dose levels, between reconstruction algorithms in reference to FBP images, and within scan mode, using intraclass correlation coefficient (ICC) and concordance correlation coefficient (CCC). The average percentage of features with ICC > 0.90 and CCC > 0.90 between the two dose levels was 21.28% and 20.75% in AV-40 images, and 39.90% and 35.11% in AV-100 images, respectively, and increased from 15.43 to 45.22% and from 15.43 to 44.15% with an increasing strength level of DLIR. The average percentage of features with ICC > 0.90 and CCC > 0.90 in reference to FBP images was 26.07% and 25.80% in AV-40 images, and 18.88% and 18.62% in AV-100 images, respectively, and decreased from 27.93 to 17.82% and from 27.66 to 17.29% with an increasing strength level of DLIR. DLIR and ASIR-V algorithms showed low reproducibility in reference to FBP images, while the high-strength DLIR algorithm provides an opportunity for minimizing radiomics variability due to dose reduction.

Reproducibility and location-stability of radiomic features derived from cone-beam computed tomography: a phantom study

OBJECTIVES

This study aims to determine the reproducibility and location-stability of cone-beam computed tomography (CBCT) radiomic features.

METHODS

Centrifugal tubes with six concentrations of K2HPO4 solutions (50, 100, 200, 400, 600, and 800 mg ml-1) were imaged within a customized phantom. For each concentration, images were captured twice as test and retest sets. Totally, 69 radiomic features were extracted by LIFEx. The reproducibility was assessed between the test and retest sets. We used the concordance correlation coefficient (CCC) to screen qualified features and then compared the differences in the numbers of them under 24 series (four locations groups * six concentrations). The location-stability was assessed using the Kruskal-Wallis test under different concentration sets; likewise, the numbers of qualified features under six test sets were analyzed.

RESULTS

There were 20 and 23 qualified features in the reproducibility and location-stability experiments, respectively. In the reproducibility experiment, the performance of the peripheral groups and high-concentration sets was significantly better than the center groups and low-concentration sets. The effect of concentration on the location-stability of features was not monotonic, and the number of qualified features in the low-concentration sets was greater than that in the high-concentration sets. No features were qualified in both experiments.

CONCLUSIONS

The density and location of the target object can affect the number of reproducible radiomic features, and its density can also affect the number of location-stable radiomic features. The problem of feature reliability should be treated cautiously in radiomic research on CBCT.

Phantom-based radiomics feature test-retest stability analysis on photon-counting detector CT

OBJECTIVES

Radiomics image data analysis offers promising approaches in research but has not been implemented in clinical practice yet, partly due to the instability of many parameters. The aim of this study is to evaluate the stability of radiomics analysis on phantom scans with photon-counting detector CT (PCCT).

METHODS

Photon-counting CT scans of organic phantoms consisting of 4 apples, kiwis, limes, and onions each were performed at 10 mAs, 50 mAs, and 100 mAs with 120-kV tube current. The phantoms were segmented semi-automatically and original radiomics parameters were extracted. This was followed by statistical analysis including concordance correlation coefficients (CCC), intraclass correlation coefficients (ICC), as well as random forest (RF) analysis, and cluster analysis to determine the stable and important parameters.

RESULTS

Seventy-three of the 104 (70%) extracted features showed excellent stability with a CCC value > 0.9 when compared in a test and retest analysis, and 68 features (65.4%) were stable compared to the original in a rescan after repositioning. Between the test scans with different mAs values, 78 (75%) features were rated with excellent stability. Eight radiomics features were identified that had an ICC value greater than 0.75 in at least 3 of 4 groups when comparing the different phantoms in a phantom group. In addition, the RF analysis identified many features that are important for distinguishing the phantom groups.

CONCLUSION

Radiomics analysis using PCCT data provides high feature stability on organic phantoms, which may facilitate the implementation of radiomics analysis likewise in clinical routine.

KEY POINTS

• Radiomics analysis using photon-counting computed tomography provides high feature stability. • Photon-counting computed tomography may pave the way for implementation of radiomics analysis in clinical routine.

Lung dual energy CT: Impact of different technological solutions on quantitative analysis

PURPOSE

To evaluated the accuracy of spectral parameters quantification of four different CT scanners in dual energy examinations of the lung using a dedicated phantom.

METHOD

Measurements were made with different technologies of the same vendor: one dual source CT scanner (DSCT), one TwinBeam (i.e. split filter) and two sequential acquisition single source scanners (SSCT). Angular separation of Calcium and Iodine signals were calculated from scatter plots of low-kVp versus high-kVp HUs. Electron density (ρe), effective atomic number (Zeff) and Iodine concentration (Iconc) were measured using Syngo.via software. Accuracy (A) of ρe, Zeff and Iconc was evaluated as the absolute percentage difference (D%) between reference values and measured ones, while precision (P) was evaluated as the variability σ obtained by repeating the measurement with different acquisition/reconstruction settings.

RESULTS

Angular separation was significantly larger for DSCT (α = 9.7°) and for sequential SSCT (α = 9.9°) systems. TwinBeam was less performing in material separation (α = 5.0°). The lowest average A was observed for TwinBeam (A_ρe = [4.7 ± 1.0], A_Z = [9.1 ± 3.1], A_Iconc = [19.4 ± 4.4]), while the best average A was obtained for Flash (A_ρe = [1.8 ± 0.4], A_Z = [3.5 ± 0.7], A_Iconc = [7.3 ± 1.8]). TwinBeam presented inferior average P (P_ρe = [0.6 ± 0.1], P_Z = [1.1 ± 0.2], P_Iconc = [10.9 ± 4.9]), while other technologies demonstrate a comparable average.

CONCLUSIONS

Different technologies performed material separation and spectral parameter quantification with different degrees of accuracy and precision. DSCT performed better while TwinBeam demonstrated not excellent performance. Iodine concentration measurements exhibited high variability due to low Iodine absolute content in lung nodules, thus limiting its clinical usefulness in pulmonary applications.

Development and validation of a deep learning signature for predicting lymph node metastasis in lung adenocarcinoma: comparison with radiomics signature and clinical-semantic model

OBJECTIVE

To develop and validate a deep learning (DL) signature for predicting lymph node (LN) metastasis in patients with lung adenocarcinoma.

METHODS

A total of 612 patients with pathologically-confirmed lung adenocarcinoma were retrospectively enrolled and were randomly divided into training cohort (n = 489) and internal validation cohort (n = 123). Besides, 108 patients were enrolled and constituted an independent test cohort (n = 108). Patients' clinical characteristics and CT semantic features were collected. The radiomics features were derived from contrast-enhanced CT images. The clinical-semantic model and radiomics signature were built to predict LN metastasis. Furthermore, Swin Transformer was adopted to develop a DL signature predictive of LN metastasis. Model performance was evaluated by area under the receiver operating characteristic curve (AUC), sensitivity, specificity, calibration curve, and decision curve analysis. The comparisons of AUC were conducted by the DeLong test.

RESULTS

The proposed DL signature yielded an AUC of 0.948-0.961 across all three cohorts, significantly superior to both clinical-semantic model and radiomics signature (all p < 0.05). The calibration curves show that DL signature predicted probabilities fit well the actual observed probabilities of LN metastasis. DL signature gained a higher net benefit than both clinical-semantic model and radiomics signature. The incorporation of radiomics signature or clinical-semantic risk predictors failed to reveal an incremental value over the DL signature.

CONCLUSIONS

The proposed DL signature based on Swin Transformer achieved a promising performance in predicting LN metastasis and could confer important information in noninvasive mediastinal LN staging and individualized therapeutic options.

KEY POINTS

• Accurate prediction for lymph node metastasis is crucial to formulate individualized therapeutic options for patients with lung adenocarcinoma. • The deep learning signature yielded an AUC of 0.948-0.961 across all three cohorts in predicting lymph node metastasis, superior to both radiomics signature and clinical-semantic model. • The incorporation of radiomics signature or clinical-semantic risk predictors into deep learning signature failed to reveal an incremental value over deep learning signature.

Influence of Image Processing on Radiomic Features From Magnetic Resonance Imaging

OBJECTIVE

Before implementing radiomics in routine clinical practice, comprehensive knowledge about the repeatability and reproducibility of radiomic features is required. The aim of this study was to systematically investigate the influence of image processing parameters on radiomic features from magnetic resonance imaging (MRI) in terms of feature values as well as test-retest repeatability.

MATERIALS AND METHODS

Utilizing a phantom consisting of 4 onions, 4 limes, 4 kiwifruits, and 4 apples, we acquired a test-retest dataset featuring 3 of the most commonly used MRI sequences on a 3 T scanner, namely, a T1-weighted, a T2-weighted, and a fluid-attenuated inversion recovery sequence, each at high and low resolution. After semiautomatic image segmentation, image processing with systematic variation of image processing parameters was performed, including spatial resampling, intensity discretization, and intensity rescaling. For each respective image processing setting, a total of 45 radiomic features were extracted, corresponding to the following 7 matrices/feature classes: conventional indices, histogram matrix, shape matrix, gray-level zone length matrix, gray-level run length matrix, neighboring gray-level dependence matrix, and gray-level cooccurrence matrix. Systematic differences of individual features between different resampling steps were assessed using 1-way analysis of variance with Tukey-type post hoc comparisons to adjust for multiple testing. Test-retest repeatability of radiomic features was measured using the concordance correlation coefficient, dynamic range, and intraclass correlation coefficient.

RESULTS

Image processing influenced radiological feature values. Regardless of the acquired sequence and feature class, significant differences ( P < 0.05) in feature values were found when the size of the resampled voxels was too large, that is, bigger than 3 mm. Almost all higher-order features depended strongly on intensity discretization. The effects of intensity rescaling were negligible except for some features derived from T1-weighted sequences. For all sequences, the percentage of repeatable features (concordance correlation coefficient and dynamic range ≥ 0.9) varied considerably depending on the image processing settings. The optimal image processing setting to achieve the highest percentage of stable features varied per sequence. Irrespective of image processing, the fluid-attenuated inversion recovery sequence in high-resolution overall yielded the highest number of stable features in comparison with the other sequences (89% vs 64%-78% for the respective optimal image processing settings). Across all sequences, the most repeatable features were generally obtained for a spatial resampling close to the originally acquired voxel size and an intensity discretization to at least 32 bins.

CONCLUSION

Variation of image processing parameters has a significant impact on the values of radiomic features as well as their repeatability. Furthermore, the optimal image processing parameters differ for each MRI sequence. Therefore, it is recommended that these processing parameters be determined in corresponding test-retest scans before clinical application. Extensive repeatability, reproducibility, and validation studies as well as standardization are required before quantitative image analysis and radiomics can be reliably translated into routine clinical care.

Differentiation of MOGAD in ADEM-like presentation children based on FLAIR MRI features

OBJECTIVE

The differences in magnetic resonance imaging (MRI) between children with classic acute disseminated encephalomyelitis (ADEM) and myelinal oligodendrocyte glycoprotein antibody associated disease (MOGAD) with ADEM-like presentation are controversial. The purpose of this study was to investigate whether the radiological characteristics of the MRI-FLAIR sequence can predict MOGAD in children with ADEM-like presentation and to further explore its imaging differences.

METHODS

We extracted 1041 radiomics features from MRI-FLAIR lesions. Then we used the redundancy analysis (Spearman correlation coefficient), significance test (student test or Mann-Whitney U test), least absolute contraction and selection operator (LASSO) to select potential predictors from the feature groups. The selected potential predictors and MOG antibody test results were used to fit the machine learning model for classification. Combined with feature selection and machine learning classifiers, the optimal model for each subgroup was derived. The resulting models have been evaluated using the receiver operator characteristic curve (ROC) at the lesion level and the model performance was evaluated at the case level using decision curve analysis.

RESULTS

We retrospectively reviewed and re-diagnosed 70 ADEM-like presentation cases in our center from April 2015 to January 2020. Including 49 cases with classic ADEM and 21 cases with MOGAD. 30(43%) were female, with a median age of 5.3 years. On the four subgroups by age and gender, the area under the curve (AUC) of the optimal models were 89%, 90%, 98%, and 99%, and the MOGAD detection rates (Specificity) were 83%, 83%, 92%, and 75%, respectively.

CONCLUSIONS

The machine learning model trained on radiomics features of MR-FLAIR images can effectively predict patients' MOGAD. This study provides a fast, objective, and quantifiable method for MOGAD diagnosis.

Deep learning image reconstruction algorithm reduces image noise while alters radiomics features in dual-energy CT in comparison with conventional iterative reconstruction algorithms: a phantom study

OBJECTIVES

To compare image quality between a deep learning image reconstruction (DLIR) algorithm and conventional iterative reconstruction (IR) algorithms in dual-energy CT (DECT) and to assess the impact of these algorithms on radiomics robustness.

METHODS

A phantom with clinical-relevant densities was imaged on seven DECT scanners with the same voxel size using typical abdominal-pelvis examination protocols. On one DECT scanner, raw data were reconstructed using both conventional IR (adaptive statistical iterative reconstruction-V, ASIR-V) and DLIR. Nine sets of corresponding images were generated on other six DECT scanners using scanner-equipped conventional IR. Regions of interest were delineated through rigid registrations. Image quality was compared. Pyradiomics platform was used for radiomics feature extraction. Test-retest repeatability was assessed by Bland-Altman analysis for repeated scans. Inter-reconstruction algorithm reproducibility between conventional IR and DLIR was tested by intraclass correlation coefficient (ICC) and concordance correlation coefficient (CCC). Inter-scanner reproducibility was evaluated by coefficient of variation (CV) and quartile coefficient of dispersion (QCD). Robust features were identified.

RESULTS

DLIR significantly improved image quality. Ninety-four radiomics features were extracted and nine features were considered as robust. 93.87% features were repeatable between repeated scans. ASIR-V images showed higher reproducibility to other conventional IR than DLIR (ICC mean, 0.603 vs 0.558, p = 0.001; CCC mean, 0.554 vs 0.510, p = 0.004). 7.45% and 26.83% features were reproducible among scanners evaluated by CV and QCD, respectively.

CONCLUSIONS

DLIR improves quality of DECT images but may alter radiomics features compared to conventional IR. Nine robust DECT radiomics features were identified.

KEY POINTS

• DLIR improves DECT image quality in terms of signal-to-noise ratio and contrast-to-noise ratio compared with ASIR-V and showed the highest noise reduction rate and lowest peak frequency shift. • Most of radiomics features are repeatable between repeated DECT scans, while inter-reconstruction algorithm reproducibility between conventional IR and DLIR, and inter-scanner reproducibility, are low. • Although DLIR may alter radiomics features compared to IR algorithms, nine radiomics features survived repeatability and reproducibility analysis among DECT scanners and reconstruction algorithms, which allows further validation and clinical-relevant analysis.

Radiomic and quantitative-semantic models of low-dose computed tomography for predicting the poorly differentiated invasive non-mucinous pulmonary adenocarcinoma

PURPOSE

Poorly differentiated invasive non-mucinous pulmonary adenocarcinoma (IPA), based on the novel grading system, was related to poor prognosis, with a high risk of lymph node metastasis and local recurrence. This study aimed to build the radiomic and quantitative-semantic models of low-dose computed tomography (LDCT) to preoperatively predict the poorly differentiated IPA in nodules with solid component, and compare their diagnostic performance with radiologists.

MATERIALS AND METHODS

A total of 396 nodules from 388 eligible patients, who underwent LDCT scan within 2 weeks before surgery and were pathologically diagnosed with IPA, were retrospectively enrolled between July 2018 and December 2021. Nodules were divided into two independent cohorts according to scanners: primary cohort (195 well/moderate differentiated and 64 poorly differentiated) and validation cohort (104 well/moderate differentiated and 33 poorly differentiated). The radiomic and quantitative-semantic models were built using multivariable logistic regression. The diagnostic performance of the models and radiologists was assessed by area under curve (AUC) of receiver operating characteristic (ROC) curve, accuracy, sensitivity, and specificity.

RESULTS

No significant differences of AUCs were found between the radiomic and quantitative-semantic model in primary and validation cohorts (0.921 vs. 0.923, P = 0.846 and 0.938 vs. 0.911, P = 0.161). Both the models outperformed three radiologists in the validation cohort (all P < 0.05).

CONCLUSIONS

The radiomic and quantitative-semantic models of LDCT, which could identify the poorly differentiated IPA with excellent diagnostic performance, might provide guidance for therapeutic decision making, such as choosing appropriate surgical method or adjuvant chemotherapy.

Can quantitative peritumoral CT radiomics features predict the prognosis of patients with non-small cell lung cancer? A systematic review

OBJECTIVES

To provide an overarching evaluation of the value of peritumoral CT radiomics features for predicting the prognosis of non-small cell lung cancer and to assess the quality of the available studies.

METHODS

The PubMed, Embase, Web of Science, and Cochrane Library databases were searched for studies predicting the prognosis in patients with non-small cell lung cancer (NSCLC) using CT-based peritumoral radiomics features. Information about the patient, CT-scanner, and radiomics analyses were all extracted for the included studies. Study quality was assessed using the Radiomics Quality Score (RQS) and the Prediction Model Risk of Bias Assessment Tool (PROBAST).

RESULTS

Thirteen studies were included with 2942 patients from 2017 to 2022. Only one study was prospective, and the others were all retrospectively designed. Manual segmentation and multicenter studies were performed by 69% and 46% of the included studies, respectively. 3D-Slicer and MATLAB software were most commonly used for the segmentation of lesions and extraction of features. The peritumoral region was most frequently defined as dilated from the tumor boundary of 15 mm, 20 mm, or 30 mm. The median RQS of the studies was 13 (range 4-19), while all of included studies were assessed as having a high risk of bias (ROB) overall.

CONCLUSIONS

Peritumoral radiomics features based on CT images showed promise in predicting the prognosis of NSCLC, although well-designed studies and further biological validation are still needed.

KEY POINTS

• Peritumoral radiomics features based on CT images are promising and encouraging for predicting the prognosis of non-small cell lung cancer. • The peritumoral region was often dilated from the tumor boundary of 15 mm or 20 mm because these were considered safe margins. • The median Radiomics Quality Score of the included studies was 13 (range 4-19), and all of studies were considered to have a high risk of bias overall.

Combining Deep Learning and Radiomics for Automated, Objective, Comprehensive Bone Marrow Characterization From Whole-Body MRI: A Multicentric Feasibility Study

OBJECTIVES

Disseminated bone marrow (BM) involvement is frequent in multiple myeloma (MM). Whole-body magnetic resonance imaging (wb-MRI) enables to evaluate the whole BM. Reading of such whole-body scans is time-consuming, and yet radiologists can transfer only a small fraction of the information of the imaging data set to the report. This limits the influence that imaging can have on clinical decision-making and in research toward precision oncology. The objective of this feasibility study was to implement a concept for automatic, comprehensive characterization of the BM from wb-MRI, by automatic BM segmentation and subsequent radiomics analysis of 30 different BM spaces (BMS).

MATERIALS AND METHODS

This retrospective multicentric pilot study used a total of 106 wb-MRI from 102 patients with (smoldering) MM from 8 centers. Fifty wb-MRI from center 1 were used for training of segmentation algorithms (nnU-Nets) and radiomics algorithms. Fifty-six wb-MRI from 8 centers, acquired with a variety of different MRI scanners and protocols, were used for independent testing. Manual segmentations of 2700 BMS from 90 wb-MRI were performed for training and testing of the segmentation algorithms. For each BMS, 296 radiomics features were calculated individually. Dice score was used to assess similarity between automatic segmentations and manual reference segmentations.

RESULTS

The "multilabel nnU-Net" segmentation algorithm, which performs segmentation of 30 BMS and labels them individually, reached mean dice scores of 0.88 ± 0.06/0.87 ± 0.06/0.83 ± 0.11 in independent test sets from center 1/center 2/center 3-8 (interrater variability between radiologists, 0.88 ± 0.01). The subset from the multicenter, multivendor test set (center 3-8) that was of high imaging quality was segmented with high precision (mean dice score, 0.87), comparable to the internal test data from center 1. The radiomic BM phenotype consisting of 8880 descriptive parameters per patient, which result from calculation of 296 radiomics features for each of the 30 BMS, was calculated for all patients. Exemplary cases demonstrated connections between typical BM patterns in MM and radiomic signatures of the respective BMS. In plausibility tests, predicted size and weight based on radiomics models of the radiomic BM phenotype significantly correlated with patients' actual size and weight ( P = 0.002 and P = 0.003, respectively).

CONCLUSIONS

This pilot study demonstrates the feasibility of automatic, objective, comprehensive BM characterization from wb-MRI in multicentric data sets. This concept allows the extraction of high-dimensional phenotypes to capture the complexity of disseminated BM disorders from imaging. Further studies need to assess the clinical potential of this method for automatic staging, therapy response assessment, or prediction of biopsy results.