Ultrasound-based deep learning radiomics in the assessment of pathological complete response to neoadjuvant chemotherapy in locally advanced breast cancer

Multi-task learning for joint prediction of breast cancer histological indicators in dynamic contrast-enhanced magnetic resonance imaging

OBJECTIVES

Achieving efficient analysis of multiple pathological indicators has great significance for breast cancer prognosis and therapeutic decision-making. In this study, we aim to explore a deep multi-task learning (MTL) framework for collaborative prediction of histological grade and proliferation marker (Ki-67) status in breast cancer using multi-phase dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI).

METHODS

In the novel design of hybrid multi-task architecture (HMT-Net), co-representative features are explicitly distilled using a feature extraction backbone. A customized prediction network is then introduced to perform soft-parameter sharing between two correlated tasks. Specifically, task-common and task-specific knowledge is transmitted into tower layers for informative interactions. Furthermore, low-level feature maps containing tumor edges and texture details are recaptured by a hard-parameter sharing branch, which are then incorporated into the tower layer for each subtask. Finally, the probabilities of two histological indicators, predicted in the multi-phase DCE-MRI, are separately fused using a decision-level fusion strategy.

RESULTS

Experimental results demonstrate that the proposed HMT-Net achieves optimal discriminative performance over other recent MTL architectures and deep models based on single image series, with the area under the receiver operating characteristic curve of 0.908 for tumor grade and 0.694 for Ki-67 status.

CONCLUSIONS

Benefiting from the innovative HMT-Net, our proposed method elucidates its strong robustness and flexibility in the collaborative prediction task of breast biomarkers. Multi-phase DCE-MRI is expected to contribute valuable dynamic information for breast cancer pathological assessment in a non-invasive manner.

Predicting hepatocellular carcinoma response to TACE: A machine learning study based on 2.5D CT imaging and deep features analysis

OBJECTIVES

Prior to the commencement of treatment, it is essential to establish an objective method for accurately predicting the prognosis of patients with hepatocellular carcinoma (HCC) undergoing transarterial chemoembolization (TACE). In this study, we aimed to develop a machine learning (ML) model to predict the response of HCC patients to TACE based on CT images analysis.

MATERIALS AND METHODS

Public dataset from The Cancer Imaging Archive (TCIA), uploaded in August 2022, comprised a total of 105 cases, including 68 males and 37 females. The external testing dataset was collected from March 1, 2019 to July 1, 2022, consisting of total of 26 patients who underwent TACE treatment at our institution and were followed up for at least 3 months after TACE, including 22 males and 4 females. The public dataset was utilized for ResNet50 transfer learning and ML model construction, while the external testing dataset was used for model performance evaluation. All CT images with the largest lesions in axial, sagittal, and coronal orientations were selected to construct 2.5D images. Pre-trained ResNet50 weights were adapted through transfer learning to serve as a feature extractor to derive deep features for building ML models. Model performance was assessed using area under the curve (AUC), accuracy, F1-Score, confusion matrix analysis, decision curves, and calibration curves.

RESULTS

The AUC values for the external testing dataset were 0.90, 0.90, 0.91, and 0.89 for random forest classifier (RFC), support vector classifier (SVC), logistic regression (LR), and extreme gradient boosting (XGB), respectively. The accuracy values for the external testing dataset were 0.79, 0.81, 0.80, and 0.80 for RFC, SVC, LR, and XGB, respectively. The F1-score values for the external testing dataset were 0.75, 0.77, 0.78, and 0.79 for RFC, SVC, LR, and XGB, respectively.

CONCLUSION

The ML model constructed using deep features from 2.5D images has the potential to be applied in predicting the prognosis of HCC patients following TACE treatment.

Development and validation of ultrasound-based radiomics deep learning model to identify bone erosion in rheumatoid arthritis

OBJECTIVE

To develop and validate a deep learning radiomics fusion model (DLR) based on ultrasound (US) images to identify bone erosion in rheumatoid arthritis (RA) patients.

METHODS

A total of 432 patients with RA at two institutions were collected. Three hundred twelve patients from center 1 were randomly divided into a training set (N = 218) and an internal test set (N = 94) in a 7:3 ratio; meanwhile, 124 patients from center 2 were as an external test set. Radiomics (Rad) and deep learning (DL) features were extracted based on hand-crafted radiomics and deep transfer learning networks. The least absolute shrinkage and selection operator regression was employed to establish DLR fusion feature from the Rad and DL features. Subsequently, 10 machine learning algorithms were used to construct models and the final optimal model was selected. The performance of models was evaluated using receiver operating characteristic (ROC) and decision curve analysis (DCA). The diagnostic efficacy of sonographers was compared with and without the assistance of the optimal model.

RESULTS

LR was chosen as the optimal algorithm for model construction account for superior performance (Rad/DL/DLR: area under the curve [AUC] = 0.906/0.974/0.979) in the training set. In the internal test set, DLR_LR as the final model had the highest AUC (AUC = 0.966), which was also validated in the external test set (AUC = 0.932). With the aid of DLR_LR model, the overall performance of both junior and senior sonographers improved significantly (P < 0.05), and there was no significant difference between the junior sonographer with DLR_LR model assistance and the senior sonographer without assistance (P > 0.05).

CONCLUSION

DLR model based on US images is the best performer and is expected to become an important tool for identifying bone erosion in RA patients. Key Points • DLR model based on US images is the best performer in identifying BE in RA patients. • DLR model may assist the sonographers to improve the accuracy of BE evaluations.

Machine learning prediction of pathological complete response to neoadjuvant chemotherapy with peritumoral breast tumor ultrasound radiomics: compare with intratumoral radiomics and clinicopathologic predictors

PURPOSE

Noninvasive, accurate and novel approaches to predict patients who will achieve pathological complete response (pCR) after neoadjuvant chemotherapy (NAC) could assist treatment strategies. The aim of this study was to explore the application of machine learning (ML) based peritumoral ultrasound radiomics signature (PURS), compared with intratumoral radiomics (IURS) and clinicopathologic factors, for early prediction of pCR.

METHODS

We analyzed 358 locally advanced breast cancer patients (250 in the training set and 108 in the test set), who accepted NAC and post NAC surgery at our institution. The clinical and pathological data were analyzed using the independent t test and the Chi-square test to determine the factors associated with pCR. The PURS and IURS of baseline breast tumors were extracted by using 3D-slicer and PyRadiomics software. Five ML classifiers including linear discriminant analysis (LDA), support vector machine (SVM), random forest (RF), logistic regression (LR), and adaptive boosting (AdaBoost) were applied to construct radiomics predictive models. The performance of PURS, IURS models and clinicopathologic predictors were assessed with respect to sensitivity, specificity, accuracy and the areas under the curve (AUCs).

RESULTS

Ninety-seven patients achieved pCR. The clinicopathologic predictors obtained an AUC of 0.759. Among PURS models, the RF classifier achieved better efficacy (AUC of 0.889) than LR (0.849), AdaBoost (0.823), SVM (0.746) and LDA (0.732). The RF classifier also obtained a maximum AUC of 0.931 than 0.920 (AdaBoost), 0.875 (LR), 0.825 (SVM), and 0.798 (LDA) in IURS models in the test set. The RF based PURS yielded higher predictive ability (AUC 0.889; 95% CI 0.814, 0.947) than clinicopathologic factors (AUC 0.759; 95% CI 0.657, 0.861; p < 0.05), but lower efficacy compared with IURS (AUC 0.931; 95% CI 0.865, 0.980; p < 0.05).

CONCLUSION

The peritumoral US radiomics, as a novel potential biomarker, can assist clinical therapy decisions.

[Clinical Ultrasound Part II - Sonopsychology or Psychological Interactions using Ultrasound]

In contrast to cross-sectional imaging using computed tomography, magnetic resonance imaging or positron emission tomography, ultrasound examinations enable direct real-time interaction between examiner and patient and their companions. In this review, we highlight general patient-relevant aspects, whereby endpoints such as emotional factors of general and physical stress caused by the examination are discussed. On the other hand, we take a closer look at specific psychosocial interactions during ultrasound examinations in primary care, gastroenterology, oncology, palliative care, pediatrics, obstetrics and gynecology. Furthermore, we consider ultrasound not only as an intervention in the sense of a needle-guiding procedure, but also as an opportunity to change relationships and initiate lifestyle modifications. The psychological impact of incidental findings and the importance of adequate communication of findings and prognosis is discussed from the patient's perspective.

A multimodal and fully automated system for prediction of pathological complete response to neoadjuvant chemotherapy in breast cancer

Accurately predicting pathological complete response (pCR) before neoadjuvant chemotherapy (NAC) is crucial for patients with breast cancer. In this study, we developed a multimodal integrated fully automated pipeline system (MIFAPS) in forecasting pCR to NAC, using a multicenter and prospective dataset of 1004 patients with locally advanced breast cancer, incorporating pretreatment magnetic resonance imaging, whole slide image, and clinical risk factors. The results demonstrated that MIFAPS offered a favorable predictive performance in both the pooled external test set [area under the curve (AUC) = 0.882] and the prospective test set (AUC = 0.909). In addition, MIFAPS significantly outperformed single-modality models (P < 0.05). Furthermore, the high deep learning scores were associated with immune-related pathways and the promotion of antitumor cells in the microenvironment during biological basis exploration. Overall, our study demonstrates a promising approach for improving the prediction of pCR to NAC in patients with breast cancer through the integration of multimodal data.

A retrospective study on predicting clinically significant prostate cancer via a bi-parametric ultrasound-based deep learning radiomics model

Purpose

This study aimed to establish and evaluate a model utilizing bi-parametric ultrasound-based deep learning radiomics (DLR) in conjunction with clinical factors to anticipate clinically significant prostate cancer (csPCa).

Methods

We retrospectively analyzed 232 participants from our institution who underwent both B-mode ultrasound and shear wave elastography (SWE) prior to prostate biopsy between June 2022 and December 2023. A random allocation placed the participants into training and test cohorts with a 7:3 distribution. We developed a nomogram that integrates DLR with clinical factors within the training cohort, which was subsequently validated using the test cohort. The diagnostic performance and clinical applicability were evaluated with receiver operating characteristic (ROC) curve analysis and decision curve analysis.

Results

In our study, the bi-parametric ultrasound-based DLR model demonstrated an area under the curve (AUC) of 0.80 (95%CI: 0.70-0.91) in the test set, surpassing the performance of both the radiomics and deep learning models individually. By integrating clinical factors, a composite model, presented as the nomogram, was developed and exhibited superior diagnostic performance, achieving an AUC of 0.87 (95%CI: 0.77-0.95) in the test set. The performance exceeded that of the DLR (P = 0.049) and the clinical model (AUC = 0.79, 95%CI: 0.69-0.86, P = 0.041). Furthermore, the decision curve analysis indicated that the composite model provided a greater net benefit across a various high-risk threshold than the DLR or the clinical model alone.

Conclusion

To our knowledge, this is the first proposal of a nomogram integrating ultrasound-based DLR with clinical indicators for predicting csPCa. This nomogram can improve the accuracy of csPCa prediction and may help physicians make more confident decisions regarding interventions, particularly in settings where MRI is unavailable.

New progress in imaging diagnosis and immunotherapy of breast cancer

Breast cancer (BC) is a predominant malignancy among women globally, with its etiology remaining largely elusive. Diagnosis primarily relies on invasive histopathological methods, which are often limited by sample representation and processing time. Consequently, non-invasive imaging techniques such as mammography, ultrasound, and Magnetic Resonance Imaging (MRI) are indispensable for BC screening, diagnosis, staging, and treatment monitoring. Recent advancements in imaging technologies and artificial intelligence-driven radiomics have enhanced precision medicine by enabling early detection, accurate molecular subtyping, and personalized therapeutic strategies. Despite reductions in mortality through traditional treatments, challenges like tumor heterogeneity and therapeutic resistance persist. Immunotherapies, particularly PD-1/PD-L1 inhibitors, have emerged as promising alternatives. This review explores recent developments in BC imaging diagnostics and immunotherapeutic approaches, aiming to inform clinical practices and optimize therapeutic outcomes.

A Multicenter Cohort Study on Ultrasound-based Deep Learning Nomogram for Predicting Post-Neoadjuvant Chemotherapy Axillary Lymph Node Status in Breast Cancer Patients

RATIONALE AND OBJECTIVES

The aim of this study was to evaluate the capability of an ultrasound (US)-based deep learning (DL) nomogram for predicting axillary lymph node (ALN) status after neoadjuvant chemotherapy (NAC) in breast cancer patients and its potential to assist radiologists in diagnosis.

METHODS

Two medical centers retrospectively recruited 535 node-positive breast cancer patients who had undergone NAC. Center 1 included 288 patients in the training cohort and 123 patients in the internal validation cohort, while center 2 enrolled 124 patients for the external validation cohort. Five DL models (ResNet 34, ResNet 50, VGG19, GoogLeNet, and DenseNet 121) were trained on pre- and post-NAC US images, and the best model was chosen. A US-based DL nomogram was constructed using DL predictive probabilities and clinicopathological characteristics. Furthermore, the performances of radiologists were compared with and without the assistance of the nomogram.

RESULT

ResNet 50 performed best among all DL models, achieving areas under the curve (AUCs) of 0.837 and 0.850 in the internal and external validation cohorts, respectively. The US-based DL nomogram demonstrated strong predictive ability for ALN status post-NAC, with AUCs of 0.890 and 0.870 in the internal and external validation cohorts, respectively, outperforming both the clinical model and the DL model (p all < 0.05, except p = 0.19 for DL model in external validation cohort). Moreover, the nomogram significantly improved radiologists' diagnostic ability.

CONCLUSION

The US-based DL nomogram is promising for predicting ALN status post-NAC and could assist radiologists for better diagnostic performance.

Advances in Novel Diagnostic Techniques for Alveolar Echinococcosis

Alveolar echinococcosis (AE), caused by the larval stage of the tapeworm Echinococcus multilocularis, is a serious parasitic disease that presents significant health risks and challenges for both patients and healthcare systems. Accurate and timely diagnosis is essential for effective management and improved patient outcomes. This review summarizes the latest diagnostic methods for AE, focusing on serological tests and imaging techniques such as ultrasonography (US), computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography/computed tomography (PET/CT). Each imaging modality has its strengths and limitations in detecting and characterizing AE lesions, such as their location, size, and invasiveness. US is often the first-line method due to its non-invasiveness and cost-effectiveness, but it may have limitations in assessing complex lesions. CT provides detailed anatomical information and is particularly useful for assessing bone involvement and calcification. MRI, with its excellent soft tissue contrast, is superior for delineating the extent of AE lesions and their relationship to adjacent structures. PET/CT combines functional and morphological imaging to provide insights into the metabolic activity of lesions, which is valuable for monitoring treatment response and detecting recurrence. Overall, this review emphasizes the importance of a multifaceted diagnostic approach that combines serological and imaging techniques for accurate and early AE diagnosis, which is crucial for effective management and improved patient outcomes.

Predicting the efficacy of neoadjuvant chemotherapy in breast cancer patients based on ultrasound longitudinal temporal depth network fusion model

OBJECTIVE

The aim of this study was to develop and validate a deep learning radiomics (DLR) model based on longitudinal ultrasound data and clinical features to predict pathologic complete response (pCR) after neoadjuvant chemotherapy (NAC) in breast cancer patients.

METHODS

Between January 2018 and June 2023, 312 patients with histologically confirmed breast cancer were enrolled and randomly assigned to a training cohort (n = 219) and a test cohort (n = 93) in a 7:3 ratio. Next, pre-NAC and post-treatment 2-cycle ultrasound images were collected, and radiomics and deep learning features were extracted from NAC pre-treatment (Pre), post-treatment 2 cycle (Post), and Delta (pre-NAC-NAC 2 cycle) images. In the training cohort, to filter features, the intraclass correlation coefficient test, the Boruta algorithm, and the least absolute shrinkage and selection operator (LASSO) logistic regression were used. Single-modality models (Pre, Post, and Delta) were constructed based on five machine-learning classifiers. Finally, based on the classifier with the optimal predictive performance, the DLR model was constructed by combining Pre, Post, and Delta ultrasound features and was subsequently combined with clinical features to develop a combined model (Integrated). The discriminative power, predictive performance, and clinical utility of the models were further evaluated in the test cohort. Furthermore, patients were assigned into three subgroups, including the HR+/HER2-, HER2+, and TNBC subgroups, according to molecular typing to validate the predictability of the model across the different subgroups.

RESULTS

After feature screening, 16, 13, and 10 features were selected to construct the Pre model, Post model, and Delta model based on the five machine learning classifiers, respectively. The three single-modality models based on the XGBoost classifier displayed optimal predictive performance. Meanwhile, the DLR model (AUC of 0.827) was superior to the single-modality model (Pre, Post, and Delta AUCs of 0.726, 0.776, and 0.710, respectively) in terms of prediction performance. Moreover, multivariate logistic regression analysis identified Her-2 status and histological grade as independent risk factors for NAC response in breast cancer. In both the training and test cohorts, the Integrated model, which included Pre, Post, and Delta ultrasound features and clinical features, exhibited the highest predictive ability, with AUC values of 0.924 and 0.875, respectively. Likewise, the Integrated model displayed the highest predictive performance across the different subgroups.

CONCLUSION

The Integrated model, which incorporated pre-NAC treatment and early treatment ultrasound data and clinical features, accurately predicted pCR after NAC in breast cancer patients and provided valuable insights for personalized treatment strategies, allowing for timely adjustment of chemotherapy regimens.

Habitat-Based Radiomics for Revealing Tumor Heterogeneity and Predicting Residual Cancer Burden Classification in Breast Cancer

PURPOSE

To investigate the feasibility of characterizing tumor heterogeneity in breast cancer ultrasound images using habitat analysis technology and establish a radiomics machine learning model for predicting response to neoadjuvant chemotherapy (NAC).

METHODS

Ultrasound images from patients with pathologically confirmed breast cancer who underwent neoadjuvant therapy at our institution between July 2021 and December 2023 were retrospectively reviewed. Initially, the region of interest was delineated and segmented into multiple habitat areas using local feature delineation and cluster analysis techniques. Subsequently, radiomics features were extracted from each habitat area to construct 3 machine learning models. Finally, the model's efficacy was assessed through operating characteristic (ROC) curve analysis, decision curve analysis (DCA), and calibration curve evaluation.

RESULTS

A total of 945 patients were enrolled, with 333 demonstrating a favorable response to NAC and 612 exhibiting an unfavorable response to NAC. Through the application of habitat analysis techniques, 3 distinct habitat regions within the tumor were identified. Subsequently, a predictive model was developed by incorporating 19 radiomics features, and all 3 machine learning models demonstrated excellent performance in predicting treatment outcomes. Notably, extreme gradient boosting (XGBoost) exhibited superior performance with an area under the curve (AUC) of 0.872 in the training cohort and 0.740 in the testing cohort. Additionally, DCA and calibration curves were employed for further evaluation.

CONCLUSIONS

The habitat analysis technique effectively distinguishes distinct biological subregions of breast cancer, while the established radiomics machine learning model predicts NAC response by forecasting residual cancer burden (RCB) classification.

Development of an Ultrasound-Based Radiomics Nomogram for Preoperative Prediction of HER-2 Status in Invasive Breast Cancer

RATIONALE AND OBJECTIVES

This study aimed to create a radiomics nomogram using grayscale ultrasound (US) to predict human epidermal growth factor receptor 2 (HER-2) expression status preoperatively in invasive breast cancer (IBC) patients.

MATERIALS AND METHODS

The study population was randomly divided into a training dataset (360 patients, 99 HER-2-positive) and a validation dataset (155 patients, 42 HER-2-positive). Clinical data, including US features, were collected. Radiomics features were extracted from grayscale US images, followed by feature selection to establish a radiomics score (Radscore) model. Univariate and multivariate logistic regression analyses identified independent risk factors for the clinical and radiomics nomogram models. Model performance was evaluated using receiver operating characteristic curves, calibration curves, decision curve analysis, net reclassification improvement, and integrated discrimination improvement.

RESULTS

16 radiomics features were selected for the Radscore model. Tumor margin and calcification emerged as significant preoperative risk factors for HER-2 status, forming the basis of a clinical prediction model. The integrated radiomics nomogram, combining tumor margin, calcification, and Radscore, demonstrated strong discrimination with area under the curve values of 0.810 in the training dataset and 0.807 in the validation dataset.

CONCLUSION

The US-based radiomics nomogram shows substantial promise for preoperatively predicting HER-2 status in IBC patients.

Deep Learning in Breast Cancer Imaging: A Decade of Progress and Future Directions

Breast cancer has reached the highest incidence rate worldwide among all malignancies since 2020. Breast imaging plays a significant role in early diagnosis and intervention to improve the outcome of breast cancer patients. In the past decade, deep learning has shown remarkable progress in breast cancer imaging analysis, holding great promise in interpreting the rich information and complex context of breast imaging modalities. Considering the rapid improvement in deep learning technology and the increasing severity of breast cancer, it is critical to summarize past progress and identify future challenges to be addressed. This paper provides an extensive review of deep learning-based breast cancer imaging research, covering studies on mammograms, ultrasound, magnetic resonance imaging, and digital pathology images over the past decade. The major deep learning methods and applications on imaging-based screening, diagnosis, treatment response prediction, and prognosis are elaborated and discussed. Drawn from the findings of this survey, we present a comprehensive discussion of the challenges and potential avenues for future research in deep learning-based breast cancer imaging.

Deep Learning and Radiomics in Triple-Negative Breast Cancer: Predicting Long-Term Prognosis and Clinical Outcomes

Triple-negative breast cancer (TNBC) is a unique breast cancer subtype characterized by the lack of estrogen receptor (ER), progesterone receptor (PR), and human epidermal growth factor receptor 2 (HER2) expression in tumor cells. TNBC represents about 15% to 20% of all breast cancers and is aggressive and highly malignant. Currently, TNBC diagnosis primarily depends on pathological examination, while treatment efficacy is assessed through imaging, biomarker detection, pathological evaluation, and clinical symptom improvement. Among these, biomarker detection and pathological assessments are invasive, time-intensive procedures that may be difficult for patients with severe comorbidities and high complication risks. Thus, there is an urgent need for new, supportive tools in TNBC diagnosis and treatment. Deep learning and radiomics techniques represent advanced machine learning methodologies and are also emerging outcomes in the medical-engineering field in recent years. They are extensions of conventional imaging diagnostic methods and have demonstrated tremendous potential in image segmentation, reconstruction, recognition, and classification. These techniques hold certain application prospects for the diagnosis of TNBC, assessment of treatment response, and long-term prognosis prediction. This article reviews recent progress in the application of deep learning, ultrasound, MRI, and radiomics for TNBC diagnosis and treatment, based on research from both domestic and international scholars.

Machine learning for predicting neoadjuvant chemotherapy effectiveness using ultrasound radiomics features and routine clinical data of patients with breast cancer

Background

This study explores the clinical value of a machine learning (ML) model based on ultrasound radiomics features of primary foci, combined with clinicopathologic factors to predict the pathological complete response (pCR) of neoadjuvant chemotherapy (NAC) for patients with breast cancer (BC).

Method

We retrospectively analyzed ultrasound images and clinical information from 231 participants with BC who received NAC. These patients were randomly assigned to training and validation cohorts. Tumor regions of interest (ROI) were delineated, and radiomics features were extracted. Z-score normalization, Pearson correlation analysis, and the least absolute shrinkage selection operator (LASSO) were utilized for further screening ultrasound radiomics and clinical features. Univariate and multivariate logistic regression analysis were performed to identify the CFs that were independently associated with pCR. We compared 10 ML models based on radiomics features: support vector machine (SVM), logistic regression (LR), random forest, extra trees (ET), naïve Bayes (NB), k-nearest neighbor (KNN), multilayer perceptron (MLP), gradient boosting ML (GBM), light GBM (LGBM), and adaptive boost (AB). Diagnostic performance was evaluated using the receiver operating characteristic (ROC) area under the curve (AUC), accuracy, sensitivity, and specificity, and the Rad score was calculated. Subsequently, construction of clinical predictive models and Rad score joint clinical predictive models using ML algorithms for optimal diagnostic performance. The diagnostic process of the ML model was visualized and analyzed using SHapley Additive exPlanation (SHAP).

Results

Out of 231 participants with BC, 98 (42.42%) achieved pCR, and 133 (57.58%) did not. Twelve radiomics features were identified, with the GBM model demonstrating the best predictive performance (AUC of 0.851, accuracy of 0.75, sensitivity of 0.821, and specificity of 0.698). The clinical feature prediction model using the GBM algorithm had an AUC of 0.819 and an accuracy of 0.739. Combining the Rad score with clinical features in the GBM model resulted in superior predictive performance (AUC of 0.939 and an accuracy of 0.87). SHAP analysis indicated that participants with a high Rad score, PR-negative, ER-negative and human epidermal growth factor receptor-2 (HER-2) positive were more possibly to reach pCR. Based on the decision curve analysis, it was shown that the combined model of GBM provided higher clinical benefits.

Conclusion

The GBM model based on ultrasound radiomics features and routine clinical date of BC patients had high performance in predicting pCR. SHAP analysis provided a clear explanation for the prediction results of the GBM model, revealing that patients with a high Rad score, PR-negative status, ER-negative status and HER-2-positive status are more likely to achieve pCR.

Delta Radiomics Based on MRI for Predicting Axillary Lymph Node Pathologic Complete Response After Neoadjuvant Chemotherapy in Breast Cancer Patients

PURPOSE

To develop and test a radiomics nomogram based on magnetic resonance imaging (MRI) and clinicopathological factors for predicting the axillary pathologic complete response (apCR) to neoadjuvant chemotherapy (NAC) in breast cancer patients with axillary lymph node (ALN) metastases.

MATERIALS AND METHODS

A total of 319 patients who underwent MRI examination and received NAC treatment were enrolled from two centers, and the presence of ALN metastasis was confirmed by biopsy pathology before NAC. The radiomics features were extracted from regions of interest of ALNs before (pre-radiomics) and after (post-radiomics) NAC. The difference of features before and after NAC, named delta radiomics, was calculated. The variance threshold, selectKbest and least absolute shrinkage and selection operator algorithm were used to select radiomics features. Radscore was calculated by a linear combination of selected features, weighted by their respective coefficients. The univariate and multivariate logistic regression was used to select the clinicopathological factors and radscores, and a radiomics nomogram was built by multivariable logistic regression analysis. The performance of the nomogram was evaluated by the area under the receiver operator characteristic curve (AUC), decision curve analysis (DCA) and calibration curves. Furthermore, to explore the biological basis of radiomics nomogram, 16 patients with RNA-sequence data were included for genetic analysis.

RESULTS

The radiomics nomogram was constructed by two radscores (post- and delta- radscores) and one clinicopathological factor (progesterone hormone, PR), and showed powerful predictive performance in both internal and external test sets, with AUCs of 0.894 (95% confidence interval [CI], 0.877-0.959) and 0.903 (95% CI, 0.801-0.986), respectively. The calibration curves and DCA showed favorable consistency and clinical utility. With the assistance of nomogram, the rate of unnecessary ALND would be reduced from 60.42% to 21.88%, and the rate of final benefit rate would be increased from 39.58% to 70.83%. Moreover, genetic analysis revealed that high apCR prediction scores were associated with the upregulation of immune-mediated genes and pathways.

CONCLUSION

The radiomics nomogram showed great performance in predicting apCR after NAC for breast cancer patients, which could help clinicians to identify patients with apCR and avoid unnecessary axillary lymph node dissection.

Ultrasound-Based Deep Learning Radiomics Nomogram for Tumor and Axillary Lymph Node Status Prediction After Neoadjuvant Chemotherapy

RATIONALE AND OBJECTIVES

This study aims to explore the feasibility of the deep learning radiomics nomogram (DLRN) for predicting tumor status and axillary lymph node metastasis (ALNM) after neoadjuvant chemotherapy (NAC) in patients with breast cancer. Additionally, we employ a Cox regression model for survival analysis to validate the effectiveness of the fusion algorithm.

MATERIALS AND METHODS

A total of 243 patients who underwent NAC were retrospectively included between October 2014 and July 2022. The DLRN integrated clinical characteristics as well as radiomics and deep transfer learning features extracted from ultrasound (US) images. The diagnostic performance of DLRN was evaluated by constructing ROC curves, and the clinical usefulness of models was assessed using decision curve analysis (DCA). A survival model was developed to validate the effectiveness of the fusion algorithm.

RESULTS

In the training cohort, the DLRN yielded area under the receiver operating characteristic curve values of 0.984 and 0.985 for the tumor and LNM, while 0.892 and 0.870, respectively, in the test cohort. The consistency indices (C-index) of the nomogram were 0.761 and 0.731, respectively, in the training and test cohorts. The Kaplan-Meier survival curves showed that patients in the high-risk group had significantly poorer overall survival than patients in the low-risk group (P < 0.05).

CONCLUSION

The US-based DLRN model could hold promise as clinical guidance for predicting the status of tumors and LNM after NAC in patients with breast cancer. This fusion model can also predict the prognosis of patients, which could help clinicians make better clinical decisions.

Deep Learning for Distinguishing Mucinous Breast Carcinoma From Fibroadenoma on Ultrasound

PURPOSE

Mucinous breast carcinoma (MBC) tends to be misdiagnosed as fibroadenomas (FA) due to its benign imaging characteristics. We aimed to develop a deep learning (DL) model to differentiate MBC and FA based on ultrasound (US) images. The model could contribute to the diagnosis of MBC for radiologists.

METHODS

In this retrospective study, 884 eligible patients (700 FA patients and 184 MBC patients) with 2257 US images were enrolled. The images were randomly divided into a training set (n = 1805 images) and a test set (n = 452 images) in a ratio of 8:2. First, we used the training set to establish DL model, DL+ age-cutoff model and DL+ age-tree model. Then, we compared the diagnostic performance of three models to get the optimal model. Finally, we evaluated the diagnostic performance of radiologists (4 junior and 4 senior radiologists) with and without the assistance of the optimal model in the test set.

RESULTS

The DL+ age-tree model yielded higher areas under the receiver operating characteristic curve (AUC) than DL model and DL+ age-cutoff model (0.945 vs. 0.835, P < .001; 0.945 vs. 0.931, P < .001, respectively). With the assistance of DL+ age-tree model, both junior and senior radiologists' AUC had significant improvement (0.746-0.818, P = .010, 0.827-0.860, P = .005, respectively).

CONCLUSIONS

The DL+ age-tree model based on US images and age showed excellent performance in the differentiation of MBC and FA. Moreover, it can effectively improve the performance of radiologists with different degrees of experience that may contribute to reducing the misdiagnosis of MBC.

Dynamic ultrasound-based modeling predictive of response to neoadjuvant chemotherapy in patients with early breast cancer

Early prediction of patient responses to neoadjuvant chemotherapy (NACT) is essential for the precision treatment of early breast cancer (EBC). Therefore, this study aims to noninvasively and early predict pathological complete response (pCR). We used dynamic ultrasound (US) imaging changes acquired during NACT, along with clinicopathological features, to create a nomogram and construct a machine learning model. This retrospective study included 304 EBC patients recruited from multiple centers. All enrollees had completed NACT regimens, and underwent US examinations at baseline and at each NACT cycle. We subsequently determined that percentage reduction of tumor maximum diameter from baseline to third cycle of NACT serves to independent predictor for pCR, enabling creation of a nomogram ([Formula: see text]). Our predictive accuracy further improved ([Formula: see text]) by combining dynamic US data and clinicopathological features in a machine learning model. Such models may offer a means of accurately predicting NACT responses in this setting, helping to individualize patient therapy. Our study may provide additional insights into the US-based response prediction by focusing on the dynamic changes of the tumor in the early and full NACT cycle.

Integration of Longitudinal and Transverse Radiomics from Ultrasound Images with Clinical Factors for HER-2 Status Prediction in Invasive Breast Cancer Patients

OBJECTIVE

This study developed a nomogram combining longitudinal and transverse ultrasound radiomics with clinical factors to identify human epidermal growth factor receptor 2 (HER2) status in invasive breast cancer (BC).

MATERIALS AND METHODS

We analyzed 537 invasive BC patients from two hospitals: 436 in the training cohort (Hospital A) and 101 in the test cohort (Hospital B). From longitudinal and transverse ultrasound planes, 788 radiomics features were extracted, with dimensionality reduced using least absolute shrinkage and selection operator regression. A radiomics nomogram integrating clinical predictors and radiomics scores (Rad-scores) was constructed.

RESULTS

Fifteen and sixteen features from longitudinal and transverse ultrasound planes, respectively, were selected to generate Rad-scores, which differed significantly between HER2-positive and HER2-negative groups in both cohorts (p < 0.05). The combined radiomics model outperformed individual models with AUCs of 0.783 and 0.762 in the training and external test cohorts, respectively. Tumor size was an independent clinical predictor. The nomogram, incorporating Rad-scores and tumor size, achieved AUCs of 0.790 (training cohort) and 0.774 (test cohort). Decision curve analysis demonstrated its potential clinical utility.

CONCLUSION

A biplanar ultrasound radiomics nomogram effectively predicts HER2 status in invasive BC, potentially reducing the need for biopsies and supporting personalized treatment strategies.

Deep learning of pretreatment multiphase CT images for predicting response to lenvatinib and immune checkpoint inhibitors in unresectable hepatocellular carcinoma

OBJECTIVES

Combination therapy of lenvatinib and immune checkpoint inhibitors (CLICI) has emerged as a promising approach for managing unresectable hepatocellular carcinoma (HCC). However, the response to such treatment is observed in only a subset of patients, underscoring the pressing need for reliable methods to identify potential responders.

MATERIALS & METHODS

This was a retrospective analysis involving 120 patients with unresectable HCC. They were divided into training (n = 72) and validation (n = 48) cohorts. We developed an interpretable deep learning model using multiphase computed tomography (CT) images to predict whether patients will respond or not to CLICI treatment, based on the Response Evaluation Criteria in Solid Tumors, version 1.1 (RECIST v1.1). We evaluated the models' performance and analyzed the impact of each CT phase. Critical regions influencing predictions were identified and visualized through heatmaps.

RESULTS

The multiphase model outperformed the best biphase and uniphase models, achieving an area under the curve (AUC) of 0.802 (95% CI = 0.780-0.824). The portal phase images were found to significantly enhance the model's predictive accuracy. Heatmaps identified six critical features influencing treatment response, offering valuable insights to clinicians. Additionally, we have made this model accessible via a web server at http://uhccnet.com/ for ease of use.

CONCLUSIONS

The integration of multiphase CT images with deep learning-generated heatmaps for predicting treatment response provides a robust and practical tool for guiding CLICI therapy in patients with unresectable HCC.

Differentiation between invasive ductal carcinoma and ductal carcinoma in situ by combining intratumoral and peritumoral ultrasound radiomics

BACKGROUND

This study aimed to develop and validate an ultrasound radiomics model for distinguishing invasive ductal carcinoma (IDC) from ductal carcinoma in situ (DCIS) by combining intratumoral and peritumoral features.

METHODS

Retrospective analysis was performed on 454 patients from Chengzhong Hospital. The patients were randomly divided in accordance with a ratio of 8:2 into a training group (363 cases) and validation group (91 cases). In addition, 175 patients from Yanghu Hospital were used as the external test group. The peritumoral ranges were set to 2, 4, 6, 8, and 10 mm. Mann-Whitney U-test, recursive feature elimination, and a least absolute shrinkage and selection operator were used to in the dimension reduction of the radiomics features and clinical knowledge, and machine learning logistic regression classifiers were utilized to construct the diagnostic model. The area under the curve (AUC) of the receiver operating characteristics, accuracy, sensitivity, and specificity were used to evaluate the model performance.

RESULTS

By combining peritumoral features of different ranges, the AUC of the radiomics model was improved in the validation and test groups. In the validation group, the maximum increase in AUC was 9.7% (P = 0.031, AUC = 0.803) when the peritumoral range was 8 mm. Similarly, when the peritumoral range was only 8 mm in the test group, the maximum increase in AUC was 4.9% (P = 0.005, AUC = 0.770). In this study, the best prediction performance was achieved when the peritumoral range was only 8 mm.

CONCLUSIONS

The ultrasound-based radiomics model that combined intratumoral and peritumoral features exhibits good ability to distinguish between IDC and DCIS. The selection of peritumoral range size exerts an important effect on the prediction performance of the radiomics model.

CT-based deep learning model for predicting the success of extracorporeal shock wave lithotripsy in treating ureteral stones larger than 1 cm

OBJECTIVES

To develop a deep learning (DL) model based on computed tomography (CT) images to predict the success of extracorporeal shock wave lithotripsy (SWL) treatment for patients with ureteral stones larger than 1 cm.

MATERIALS AND METHODS

We enrolled 333 patients who underwent SWL treatment for ureteral stones and randomly divided them into training and test sets. A DL model was built based on CT images of ureteral stones to predict SWL outcomes. The predictive efficacy of the DL model was assessed by comparing it with traditional and radiomics models.

RESULTS

The DL model demonstrated significantly better predictive performance in both training and test sets compared to radiomics (training set, AUC: 0.993 vs. 0.923, P < 0.001; test set AUC: 0.982 vs. 0.846, P < 0.001) and traditional models (training set AUC: 0.993 vs. 0.75, P = 0.005; test set AUC: 0.982 vs. 0.677, P < 0.001). Decision curve analysis (DCA) also proved that the DL model brought more benefit in predicting the success of SWL treatment than other methods.

CONCLUSION

The DL model based on CT images showed excellent ability to predict the probability of success of SWL treatment for patients with ureteral stones larger than 1 cm, providing a new auxiliary tool for clinical treatment decision-making.

Deep learning-assisted distinguishing breast phyllodes tumours from fibroadenomas based on ultrasound images: a diagnostic study

OBJECTIVES

To evaluate the performance of ultrasound-based deep learning (DL) models in distinguishing breast phyllodes tumours (PTs) from fibroadenomas (FAs) and their clinical utility in assisting radiologists with varying diagnostic experiences.

METHODS

We retrospectively collected 1180 ultrasound images from 539 patients (247 PTs and 292 FAs). Five DL network models with different structures were trained and validated using nodule regions annotated by radiologists on breast ultrasound images. DL models were trained using the methods of transfer learning and 3-fold cross-validation. The model demonstrated the best evaluation index in the 3-fold cross-validation was selected for comparison with radiologists' diagnostic decisions. Two-round reader studies were conducted to investigate the value of DL model in assisting 6 radiologists with different levels of experience.

RESULTS

Upon testing, Xception model demonstrated the best diagnostic performance (area under the receiver-operating characteristic curve: 0.87; 95% CI, 0.81-0.92), outperforming all radiologists (all P < .05). Additionally, the DL model enhanced the diagnostic performance of radiologists. Accuracy demonstrated improvements of 4%, 4%, and 3% for senior, intermediate, and junior radiologists, respectively.

CONCLUSIONS

The DL models showed superior predictive abilities compared to experienced radiologists in distinguishing breast PTs from FAs. Utilizing the model led to improved efficiency and diagnostic performance for radiologists with different levels of experience (6-25 years of work).

ADVANCES IN KNOWLEDGE

We developed and validated a DL model based on the largest available dataset to assist in diagnosing PTs. This model has the potential to allow radiologists to discriminate 2 types of breast tumours which are challenging to identify with precision and accuracy, and subsequently to make more informed decisions about surgical plans.

Deep learning nomogram for predicting neoadjuvant chemotherapy response in locally advanced gastric cancer patients

PURPOSE

Developed and validated a deep learning radiomics nomogram using multi-phase contrast-enhanced computed tomography (CECT) images to predict neoadjuvant chemotherapy (NAC) response in locally advanced gastric cancer (LAGC) patients.

METHODS

This multi-center study retrospectively included 322 patients diagnosed with gastric cancer from January 2013 to June 2023 at two hospitals. Handcrafted radiomics technique and the EfficientNet V2 neural network were applied to arterial, portal venous, and delayed phase CT images to extract two-dimensional handcrafted and deep learning features. A nomogram model was built by integrating the handcrafted signature, the deep learning signature, with clinical features. Discriminative ability was assessed using the receiver operating characteristics (ROC) curve and the precision-recall (P-R) curve. Model fitting was evaluated using calibration curves, and clinical utility was assessed through decision curve analysis (DCA).

RESULTS

The nomogram exhibited excellent performance. The area under the ROC curve (AUC) was 0.848 [95% confidence interval (CI), 0.793-0.893)], 0.802 (95% CI 0.688-0.889), and 0.751 (95% CI 0.652-0.833) for the training, internal validation, and external validation sets, respectively. The AUCs of the P-R curves were 0.838 (95% CI 0.756-0.895), 0.541 (95% CI 0.329-0.740), and 0.556 (95% CI 0.376-0.722) for the corresponding sets. The nomogram outperformed the clinical model and handcrafted signature across all sets (all P < 0.05). The nomogram model demonstrated good calibration and provided greater net benefit within the relevant threshold range compared to other models.

CONCLUSION

This study created a deep learning nomogram using CECT images and clinical data to predict NAC response in LAGC patients undergoing surgical resection, offering personalized treatment insights.

Nomogram based on multimodal ultrasound features for evaluating breast nonmass lesions: a single center study

BACKGROUND

It is challenging to correctly identify and diagnose breast nonmass lesions. This study aimed to explore the multimodal ultrasound features associated with malignant breast nonmass lesions (NMLs), and evaluate their combined diagnostic performance.

METHODS

This retrospective analysis was conducted on 573 breast NMLs, including 309 were benign and 264 were malignant, their multimodal ultrasound features (B-mode, color Doppler and strain elastography) were assessed by two experienced radiologists. Univariate and multivariate logistic regression analysises were used to explore multimodal ultrasound features associated with malignancy, and a nomogram was developed. Diagnostic performance and clinical utility were evaluated and validated by the receiver operating characteristic (ROC) curve, calibration curve and decision curve in the training and validation cohorts.

RESULTS

Multimodal ultrasound features including linear (odds ratio [OR] = 4.69) or segmental distribution (OR = 7.67), posterior shadowing (OR = 3.14), calcification (OR = 7.40), hypovascularity (OR = 0.38), elasticity scored 4 (OR = 7.00) and 5 (OR = 15.77) were independent factors associated with malignant breast NMLs. The nomogram based on these features exhibited diagnostic performance in the training and validation cohorts were comparable to that of experienced radiologists, with superior specificity (89.4%, 89.5% vs. 81.2%) and positive predictive value (PPV) (89.2%, 90.4% vs. 82.4%). The nomogram also demonstrated good calibration in both training and validation cohorts (all P > 0.05). Decision curve analysis indicated that interventions guided by the nomogram would be beneficial across a wide range of threshold probabilities (0.05-1 in the training cohort and 0.05-0.93 in the validation cohort).

CONCLUSIONS

The combined use of linear or segmental distribution, posterior shadowing, calcification, hypervascularity and high elasticity score, displayed as a nomogram, demonstrated satisfied diagnostic performance for malignant breast NMLs, which may contribute to the imaging interpretation and clinical management of tumors.

Advancing personalized oncology: a systematic review on the integration of artificial intelligence in monitoring neoadjuvant treatment for breast cancer patients

PURPOSE

Despite suffering from the same disease, each patient exhibits a distinct microbiological profile and variable reactivity to prescribed treatments. Most doctors typically use a standardized treatment approach for all patients suffering from a specific disease. Consequently, the challenge lies in the effectiveness of this standardized treatment and in adapting it to each individual patient. Personalized medicine is an emerging field in which doctors use diagnostic tests to identify the most effective medical treatments for each patient. Prognosis, disease monitoring, and treatment planning rely on manual, error-prone methods. Artificial intelligence (AI) uses predictive techniques capable of automating prognostic and monitoring processes, thus reducing the error rate associated with conventional methods.

METHODS

This paper conducts an analysis of current literature, encompassing the period from January 2015 to 2023, based on Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA).

RESULTS

In assessing 25 pertinent studies concerning predicting neoadjuvant treatment (NAT) response in breast cancer (BC) patients, the studies explored various imaging modalities (Magnetic Resonance Imaging, Ultrasound, etc.), evaluating results based on accuracy, sensitivity, and area under the curve. Additionally, the technologies employed, such as machine learning (ML), deep learning (DL), statistics, and hybrid models, were scrutinized. The presentation of datasets used for predicting complete pathological response (PCR) was also considered.

CONCLUSION

This paper seeks to unveil crucial insights into the application of AI techniques in personalized oncology, particularly in the monitoring and prediction of responses to NAT for BC patients. Finally, the authors suggest avenues for future research into AI-based monitoring systems.

Ultrasound-Based Deep Learning Radiomics Nomogram for the Assessment of Lymphovascular Invasion in Invasive Breast Cancer: A Multicenter Study

RATIONALE AND OBJECTIVES

The aim of this study was to develop a deep learning radiomics nomogram (DLRN) based on B-mode ultrasound (BMUS) and color doppler flow imaging (CDFI) images for preoperative assessment of lymphovascular invasion (LVI) status in invasive breast cancer (IBC).

MATERIALS AND METHODS

In this multicenter, retrospective study, 832 pathologically confirmed IBC patients were recruited from eight hospitals. The samples were divided into training, internal test, and external test sets. Deep learning and handcrafted radiomics features reflecting tumor phenotypes on BMUS and CDFI images were extracted. The BMUS score and CDFI score were calculated after radiomics feature selection. Subsequently, a DLRN was developed based on the scores and independent clinic-ultrasonic risk variables. The performance of the DLRN was evaluated for calibration, discrimination, and clinical usefulness.

RESULTS

The DLRN predicted the LVI with accuracy, achieving an area under the receiver operating characteristic curve of 0.93 (95% CI 0.90-0.95), 0.91 (95% CI 0.87-0.95), and 0.91 (95% CI 0.86-0.94) in the training, internal test, and external test sets, respectively, with good calibration. The DLRN demonstrated superior performance compared to the clinical model and single scores across all three sets (p < 0.05). Decision curve analysis and clinical impact curve confirmed the clinical utility of the model. Furthermore, significant enhancements in net reclassification improvement (NRI) and integrated discrimination improvement (IDI) indicated that the two scores could serve as highly valuable biomarkers for assessing LVI.

CONCLUSION

The DLRN exhibited strong predictive value for LVI in IBC, providing valuable information for individualized treatment decisions.

Explainable breast cancer molecular expression prediction using multi-task deep-learning based on 3D whole breast ultrasound

OBJECTIVES

To noninvasively estimate three breast cancer biomarkers, estrogen receptor (ER), progesterone receptor (PR), and human epidermal growth factor receptor 2 (HER2) and enhance performance and interpretability via multi-task deep learning.

METHODS

The study included 388 breast cancer patients who received the 3D whole breast ultrasound system (3DWBUS) examinations at Xijing Hospital between October 2020 and September 2021. Two predictive models, a single-task and a multi-task, were developed; the former predicts biomarker expression, while the latter combines tumor segmentation with biomarker prediction to enhance interpretability. Performance evaluation included individual and overall prediction metrics, and Delong's test was used for performance comparison. The models' attention regions were visualized using Grad-CAM + + technology.

RESULTS

All patients were randomly split into a training set (n = 240, 62%), a validation set (n = 60, 15%), and a test set (n = 88, 23%). In the individual evaluation of ER, PR, and HER2 expression prediction, the single-task and multi-task models achieved respective AUCs of 0.809 and 0.735 for ER, 0.688 and 0.767 for PR, and 0.626 and 0.697 for HER2, as observed in the test set. In the overall evaluation, the multi-task model demonstrated superior performance in the test set, achieving a higher macro AUC of 0.733, in contrast to 0.708 for the single-task model. The Grad-CAM + + method revealed that the multi-task model exhibited a stronger focus on diseased tissue areas, improving the interpretability of how the model worked.

CONCLUSION

Both models demonstrated impressive performance, with the multi-task model excelling in accuracy and offering improved interpretability on noninvasive 3DWBUS images using Grad-CAM + + technology.

CRITICAL RELEVANCE STATEMENT

The multi-task deep learning model exhibits effective prediction for breast cancer biomarkers, offering direct biomarker identification and improved clinical interpretability, potentially boosting the efficiency of targeted drug screening.

KEY POINTS

Tumoral biomarkers are paramount for determining breast cancer treatment. The multi-task model can improve prediction performance, and improve interpretability in clinical practice. The 3D whole breast ultrasound system-based deep learning models excelled in predicting breast cancer biomarkers.

Radiomics in breast cancer: Current advances and future directions

Breast cancer is a common disease that causes great health concerns to women worldwide. During the diagnosis and treatment of breast cancer, medical imaging plays an essential role, but its interpretation relies on radiologists or clinical doctors. Radiomics can extract high-throughput quantitative imaging features from images of various modalities via traditional machine learning or deep learning methods following a series of standard processes. Hopefully, radiomic models may aid various processes in clinical practice. In this review, we summarize the current utilization of radiomics for predicting clinicopathological indices and clinical outcomes. We also focus on radio-multi-omics studies that bridge the gap between phenotypic and microscopic scale information. Acknowledging the deficiencies that currently hinder the clinical adoption of radiomic models, we discuss the underlying causes of this situation and propose future directions for advancing radiomics in breast cancer research.

Correlation and predictive value of pathological complete response and ultrasound characteristic parameters in neoadjuvant chemotherapy for breast

BACKGROUND

Breast cancer ranks as one of the most prevalent malignant tumors among women, significantly endangering their health and lives. While radical surgery has been a pivotal method for halting disease progression, it alone is insufficient for enhancing the quality of life for patients.

AIM

To investigate the correlation between ultrasound characteristic parameters of breast cancer lesions and clinical efficacy in patients undergoing neoadjuvant chemotherapy (NAC).

METHODS

Employing a case-control study design, this research involved 178 breast cancer patients treated with NAC at our hospital from July 2019 to June 2022. According to the Miller-Payne grading system, the pathological response, i.e. efficacy, of the NAC in the initial breast lesion after NAC was evaluated. Of these, 59 patients achieved a pathological complete response (PCR), while 119 did not (non-PCR group). Ultrasound characteristics prior to NAC were compared between these groups, and the association of various factors with NAC efficacy was analyzed using univariate and multivariate approaches.

RESULTS

In the PCR group, the incidence of posterior echo attenuation, lesion diameter ≥ 2.0 cm, and Alder blood flow grade ≥ II were significantly lower compared to the non-PCR group (P < 0.05). The area under the curve values for predicting NAC efficacy using posterior echo attenuation, lesion diameter, and Alder grade were 0.604, 0.603, and 0.583, respectively. Also, rates of pathological stage II, lymph node metastasis, vascular invasion, and positive Ki-67 expression were significantly lower in the PCR group (P < 0.05). Logistic regression analysis identified posterior echo attenuation, lesion diameter ≥ 2.0 cm, Alder blood flow grade ≥ II, pathological stage III, vascular invasion, and positive Ki-67 expression as independent predictors of poor response to NAC in breast cancer patients (P < 0.05).

CONCLUSION

While ultrasound characteristics such as posterior echo attenuation, lesion diameter ≥ 2.0 cm, and Alder blood flow grade ≥ II exhibit limited predictive value for NAC efficacy, they are significantly associated with poor response to NAC in breast cancer patients.

A deep learning radiomics model based on CT images for predicting the biological activity of hepatic cystic echinococcosis

Introduction: Hepatic cystic echinococcosis (HCE) is a widely seen parasitic infection. Biological activity is crucial for treatment planning. This work aims to explore the potential applications of a deep learning radiomics (DLR) model, based on CT images, in predicting the biological activity grading of hepatic cystic echinococcosis. Methods: A retrospective analysis of 160 patients with hepatic echinococcosis was performed (127 and 33 in training and validation sets). Volume of interests (VOIs) were drawn, and radiomics features and deep neural network features were extracted. Feature selection was performed on the training set, and radiomics score (Rad Score) and deep learning score (Deep Score) were calculated. Seven diagnostics models (based on logistic regression algorithm) for the biological activity grading were constructed using the selected radiomics features and two deep model features respectively. All models were evaluated using the receiver operating characteristic curve, and the area under the curve (AUC) was calculated. A nomogram was constructed using the combined model, and its calibration, discriminatory ability, and clinical utility were assessed. Results: 12, 6 and 10 optimal radiomics features, deep learning features were selected from two deep learning network (DLN) features, respectively. For biological activity grading of hepatic cystic echinococcosis, the combined model demonstrated strong diagnostic performance, with an AUC value of 0.888 (95% CI: 0.837-0.936) in the training set and 0.876 (0.761-0.964) in the validation set. The clinical decision analysis curve indicated promising results, while the calibration curve revealed that the nomogram's prediction result was highly compatible with the actual result. Conclusion: The DLR model can be used for predicting the biological activity grading of hepatic echinococcosis.

Development of an Ultrasound-based Nomogram for Predicting Pathologic Complete Response and Axillary Response in Node-Positive Patients with Triple- Negative Breast Cancer

BACKGROUND

The accurate prediction of pathological complete response (pCR) in the breast and axillary lymph nodes (ALN) before neoadjuvant chemotherapy (NAC) is of utmost importance for the development of treatment strategies. We aim to construct a nomogram on ultrasound (US) and clinical-pathologic factors to predict breast and ALN pCR in node-positive triple-negative breast cancers (TNBCs).

METHODS

Patients identified with TNBCs from institution 1 (n = 328) were used for training cohort and those from institution 2 (n = 192) were for validation cohort. US was conducted before and after NAC, and characteristics were obtained from medical records. Univariate and multivariate regression analysis were performed to identify US and clinical-pathologic factors associated with breast and ALN pCR in the training cohort. The assessment of predictive performance was conducted using the receiving operating characteristic curve (ROC), discrimination, and calibration.

RESULTS

Overall, 34.6% of patients achieved breast pCR and 48.1% of patients achieved ALN pCR. The nomogram 1 used for predicting pCR in the breast (AUC, 0.84; 95% CI: 0.79, 0.88) outperformed the clinical (AUC, 0.73; 95% CI: 0.68, 0.78) and US models (AUC, 0.79; 95% CI: 0.74, 0.83). The nomogram 2 used for predicting pCR in the axllia (AUC, 0.83; 95% CI: 0.78, 0.87) also outperformed the clinical (AUC, 0.64; 95% CI: 0.58, 0.69) and US models (AUC, 0.80; 95% CI: 0.75, 0.84). The calibration curve and discrimination curve indicate that the nomogram has good calibration performance and clinical applicability.

CONCLUSION

The nomogram showed promising predictive performance for predicting breast and ALN pCR in patients with TNBCs.

The prediction of pCR and chemosensitivity for breast cancer patients using DLG3, RADL and Pathomics signatures based on machine learning and deep learning

BACKGROUND

Limited studies have investigated the predictive value of multiomics signatures (radiomics, deep learning features, pathological features and DLG3) in breast cancer patients who underwent neoadjuvant chemotherapy (NAC). However, no study has explored the relationships among radiomic, pathomic signatures and chemosensitivity. This study aimed to predict pathological complete response (pCR) using multiomics signatures, and to evaluate the predictive utility of radiomic and pathomic signatures for guiding chemotherapy selection.

METHODS

The oncogenic function of DLG3 was explored in breast cancer cells via DLG3 knockdown. Immunohistochemistry (IHC) was used to evaluate the relationship between DLG3 expression and docetaxel/epirubin sensitivity. Machine learning (ML) and deep learning (DL) algorithms were used to develop multiomics signatures. Survival analysis was conducted by K-M curves and log-rank. Multivariate logistic regression analysis was used to develop nomograms.

RESULTS

A total of 311 patients with malignant breast tumours who underwent NAC were retrospectively included in this multicentre study. Multiomics (DLG3, RADL and PATHO) signatures could accurately predict pCR (AUC: training: 0.900; testing: 0.814; external validation: 0.792). Its performance is also superior to that of clinical TNM staging and the single RADL signature in different cohorts. Patients in the low DLG3 group more easily achieved pCR, and those in the high RADL Signature_pCR and PATHO_Signature_pCR (OR = 7.93, 95 % CI: 3.49-18, P < 0.001) groups more easily achieved pCR. In the TEC regimen NAC group, patients who achieved pCR had a lower DLG3 score (4.00 ± 2.33 vs. 6.43 ± 3.01, P < 0.05). Patients in the low RADL_Signature_DLG3 and PATHO_Signature_DLG3 groups had lower DLG3 IHC scores (P < 0.05). Patients in the high RADL signature, PATHO signature and DLG3 signature groups had worse DFS and OS.

CONCLUSIONS

Multiomics signatures (RADL, PATHO and DLG3) demonstrated great potential in predicting the pCR of breast cancer patients who underwent NAC. The RADL and PATHO signatures are associated with DLG3 status and could help doctors or patients choose proper neoadjuvant chemotherapy regimens (TEC regimens). This simple, structured, convenient and inexpensive multiomics model could help clinicians and patients make treatment decisions.

Predicting hormone receptor status in invasive breast cancer through radiomics analysis of long-axis and short-axis ultrasound planes

The hormone receptor (HR) status plays a significant role in breast cancer, serving as the primary guide for treatment decisions and closely correlating with prognosis. This study aims to investigate the predictive value of radiomics analysis in long-axis and short-axis ultrasound planes for distinguishing between HR-positive and HR-negative breast cancers. A cohort of 505 patients from two hospitals was stratified into discovery (Institute 1, 416 patients) and validation (Institute 2, 89 patients) cohorts. A comprehensive set of 788 ultrasound radiomics features was extracted from both long-axis and short-axis ultrasound planes, respectively. Utilizing least absolute shrinkage and selection operator (LASSO) regression analysis, distinct models were constructed for the long-axis and short-axis data. Subsequently, radiomics scores (Rad-scores) were computed for each patient. Additionally, a combined model was formulated by integrating data from long-axis and short-axis Rad-scores along with clinical factors. The diagnostic efficacy of all models was evaluated by the area under the receiver operating characteristic (ROC) curve (AUC). The long-axis and short-axis models, consisting of 11 features and 15 features, respectively, were established, yielding AUCs of 0.743 and 0.751 in the discovery cohort, and 0.795 and 0.744 in the validation cohort. The calculated long-axis and short-axis Rad-scores exhibited significant differences between HR-positive and HR-negative groups across all cohorts (all p < 0.001). Univariate analysis identified ultrasound-reported tumor size as an independent predictor. The combined model, incorporating long-axis and short-axis Rad-scores along with tumor size, achieved superior AUCs of 0.788 and 0.822 in the discovery and validation cohorts, respectively. The combined model effectively distinguishes between HR-positive and HR-negative breast cancers based on ultrasound radiomics features and tumor size, which may offer a valuable tool to facilitate treatment decision making and prognostic assessment.

Ultrasound-based deep learning radiomics nomogram for differentiating mass mastitis from invasive breast cancer

BACKGROUND

The purpose of this study is to develop and validate the potential value of the deep learning radiomics nomogram (DLRN) based on ultrasound to differentiate mass mastitis (MM) and invasive breast cancer (IBC).

METHODS

50 cases of MM and 180 cases of IBC with ultrasound Breast Imaging Reporting and Data System 4 category were recruited (training cohort, n = 161, validation cohort, n = 69). Based on PyRadiomics and ResNet50 extractors, radiomics and deep learning features were extracted, respectively. Based on supervised machine learning methods such as logistic regression, random forest, and support vector machine, as well as unsupervised machine learning methods using K-means clustering analysis, the differences in features between MM and IBC were analyzed to develop DLRN. The performance of DLRN had been evaluated by receiver operating characteristic curve, calibration, and clinical practicality.

RESULTS

Supervised machine learning results showed that compared with radiomics models, especially random forest models, deep learning models were better at recognizing MM and IBC. The area under the curve (AUC) of the validation cohort was 0.84, the accuracy was 0.83, the sensitivity was 0.73, and the specificity was 0.83. Compared to radiomics or deep learning models, DLRN even further improved discrimination ability (AUC of 0.90 and 0.90, accuracy of 0.83 and 0.88 for training and validation cohorts), which had better clinical benefits and good calibratability. In addition, the information heterogeneity of deep learning features in MM and IBC was validated again through unsupervised machine learning clustering analysis, indicating that MM had a unique features phenotype.

CONCLUSION

The DLRN developed based on radiomics and deep learning features of ultrasound images has potential clinical value in effectively distinguishing between MM and IBC. DLRN breaks through visual limitations and quantifies more image information related to MM based on computers, further utilizing machine learning to effectively utilize this information for clinical decision-making. As DLRN becomes an autonomous screening system, it will improve the recognition rate of MM in grassroots hospitals and reduce the possibility of incorrect treatment and overtreatment.

Magnetic resonance imaging-based radiomics and deep learning models for predicting lymph node metastasis of squamous cell carcinoma of the tongue

OBJECTIVE

This study aimed to establish a combined method of radiomics and deep learning (DL) in magnetic resonance imaging (MRI) to predict lymph node metastasis (LNM) preoperatively in patients with squamous cell carcinoma of the tongue.

STUDY DESIGN

In total, MR images of 196 patients with lingual squamous cell carcinoma were divided into training (n = 156) and test (n = 40) cohorts. Radiomics and DL features were extracted from MR images and selected to construct machine learning models. A DL radiomics nomogram was established via multivariate logistic regression by incorporating the radiomics signature, the DL signature, and MRI-reported LN status.

RESULTS

Nine radiomics and 3 DL features were selected. In the radiomics test cohort, the multilayer perceptron model performed best with an area under the receiver operating characteristic curve (AUC) of 0.747, but in the DL cohort, the best model (logistic regression) performed less well (AUC = 0.655). The DL radiomics nomogram showed good calibration and performance with an AUC of 0.934 (outstanding discrimination ability) in the training cohort and 0.757 (acceptable discrimination ability) in the test cohort. The decision curve analysis demonstrated that the nomogram could offer more net benefit than a single radiomics or DL signature.

CONCLUSION

The DL radiomics nomogram exhibited promising performance in predicting LNM, which facilitates personalized treatment of tongue cancer.

Prediction value study of breast cancer tumor infiltrating lymphocyte levels based on ultrasound imaging radiomics

Objective

Construct models based on grayscale ultrasound and radiomics and compare the efficacy of different models in preoperatively predicting the level of tumor-infiltrating lymphocytes in breast cancer.

Materials and methods

This study retrospectively collected clinical data and preoperative ultrasound images from 185 breast cancer patients confirmed by surgical pathology. Patients were randomly divided into a training set (n=111) and a testing set (n=74) using a 6:4 ratio. Based on a 10% threshold for tumor-infiltrating lymphocytes (TIL) levels, patients were classified into low-level and high-level groups. Radiomic features were extracted and selected using the training set. The evaluation included assessing the relationship between TIL levels and both radiomic features and grayscale ultrasound features. Subsequently, grayscale ultrasound models, radiomic models, and nomograms combining radiomics score (Rad-score) and grayscale ultrasound features were established. The predictive performance of different models was evaluated through receiver operating characteristic (ROC) analysis. Calibration curves assessed the fit of the nomograms, and decision curve analysis (DCA) evaluated the clinical effectiveness of the models.

Results

Univariate analyses and multivariate logistic regression analyses revealed that indistinct margin (P<0.001, Odds Ratio [OR]=0.214, 95% Confidence Interval [CI]: 0.103-1.026), posterior acoustic enhancement (P=0.027, OR=2.585, 95% CI: 1.116-5.987), and ipsilateral axillary lymph node enlargement (P=0.001, OR=4.214, 95% CI: 1.798-9.875) were independent predictive factors for high levels of TIL in breast cancer. In comparison to grayscale ultrasound model (Training set: Area under curve [AUC] 0.795; Testing set: AUC 0.720) and radiomics model (Training set: AUC 0.803; Testing set: AUC 0.759), the nomogram demonstrated superior discriminative ability on both the training (AUC 0.884) and testing (AUC 0.820) datasets. Calibration curves indicated high consistency between the nomogram model's predicted probability of breast cancer TIL levels and the actual occurrence probability. DCA revealed that the radiomics model and the nomogram model achieved higher clinical net benefits compared to the grayscale ultrasound model.

Conclusion

The nomogram based on preoperative ultrasound radiomics features exhibits robust predictive capacity for the non-invasive evaluation of breast cancer TIL levels, potentially providing a significant basis for individualized treatment decisions in breast cancer.

Ultrasound-based radiomics for early predicting response to neoadjuvant chemotherapy in patients with breast cancer: a systematic review with meta-analysis

OBJECTIVE

This study aims to evaluate the diagnostic accuracy of ultrasound imaging (US)-based radiomics for the early prediction of response to neoadjuvant chemotherapy (NAC) in breast cancer patients.

METHODS

We comprehensively searched PubMed, Cochrane Library, Embase, and Web of Science databases up to 1 January 2023 for eligible studies. We assessed the methodological quality of the enrolled studies with Radiomics Quality Score (RQS) and the Quality Assessment of Diagnostic Accuracy Studies-2 tools. We performed meta-analyses to summarize the diagnostic efficacy of US-based radiomics in response to NAC in breast cancer patients.

RESULTS

Eight studies proved eligible. Eligible studies exhibited an average RQS score of 12.88 (35.8% of the total score), with the RQS score ranging from 8 to 19. In the meta-analyses, the pooled sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, and diagnostic odds ratio were 0.87 (95% CI 0.81-0.92), 0.78 (95% CI 0.72-0.83), 4.02 (95% CI 3.18-5.08), 0.16 (95% CI 0.10-0.25), and 25.17 (95% CI 15.10-41.95), respectively. Results from subgroup analyses indicated that prospective studies apparently exhibited more optimal sensitivity than retrospective studies. Sensitivity analyses exhibited similar results to the primary analyses.

CONCLUSION

US-based radiomics may be a potentially crucial adjuvant method for evaluating the response of breast cancer to NAC. Due to limited data available and low quality of eligible studies, more multicenter prospective studies with rigorous methods are required to confirm our findings.

Prediction of Parkinson's disease by transcranial sonography-based deep learning

OBJECTIVES

Transcranial sonography has been used as a valid neuroimaging tool to diagnose Parkinson's disease (PD). This study aimed to develop a modified transcranial sonography (TCS) technique based on a deep convolutional neural network (DCNN) model to predict Parkinson's disease.

METHODS

This retrospective diagnostic study was conducted using 1529 transcranial sonography images collected from 854 patients with PD and 775 normal controls admitted to the Second Affiliated Hospital of Soochow University (Suzhou, Jiangsu, China) between September 2019 and May 2022. The data set was divided into training cohorts (570 PD patients and 541 normal controls), and the validation set (184 PD patients and 234 normal controls). Using these datasets, we developed four different DCNN models (ResNet18, ResNet50, ResNet152, and DenseNet121). We then assessed their diagnostic performance, including the area under the receiver operating characteristic (AUROC) curve, specificity, sensitivity, positive predictive value (PPV), negative predictive value (NPV), and F1 score and compared with traditional diagnostic criteria.

RESULTS

Among the 1529 TCS images, 570 PD patients and 541 normal controls from 4 of 6 sonographers of the TCS team were selected as the training cohort, and 184 PD patients and 234 normal controls from the other 2 sonographers were chosen as the validation cohort. There were no sex and age differences between PD patients and normal control subjects in the training and validation cohorts (P values > 0.05). All DCNN models achieved good performance in distinguishing PD patients from normal control subjects on the validation datasets, with diagnostic AUROCs and accuracy of 0.949 (95% CI 0.925, 0.965) and 86.60 for the RestNet18 model, 0.949 (95% CI 0.929, 0.971) and 87.56 for ResNet50, 0.945 (95% CI 0.931, 0.969) and 88.04 for ResNet152, 0.953 (95% CI 0.935, 0.971) and 87.80 for DenseNet121, respectively. On the other hand, the diagnostic accuracy of the traditional diagnostic method was 82.30. The accuracy of all DCNN models was higher than that of traditional diagnostic method. Moreover, the 5k-fold cross-validation results in train datasets showed that these DCNN models are robust.

CONCLUSION

The developed transcranial sonography-based DCNN models performed better than traditional diagnostic criteria, thus improving the sonographer's accuracy in diagnosing PD.

Ultrasound-based radiomics-clinical nomogram for noninvasive prediction of residual cancer burden grading in breast cancer

PURPOSE

To assess the predictive value of an ultrasound-based radiomics-clinical nomogram for grading residual cancer burden (RCB) in breast cancer patients.

METHODS

This retrospective study of breast cancer patients who underwent neoadjuvant therapy (NAC) and ultrasound scanning between November 2020 and July 2023. First, a radiomics model was established based on ultrasound images. Subsequently, multivariate LR (logistic regression) analysis incorporating both radiomic scores and clinical factors was performed to construct a nomogram. Finally, Receiver operating characteristics (ROC) curve analysis and decision curve analysis (DCA) were employed to evaluate and validate the diagnostic accuracy and effectiveness of the nomogram.

RESULTS

A total of 1122 patients were included in this study. Among them, 427 patients exhibited a favorable response to NAC chemotherapy, while 695 patients demonstrated a poor response to NAC therapy. The radiomics model achieved an AUC value of 0.84 in the training cohort and 0.83 in the validation cohort. The ultrasound-based radiomics-clinical nomogram achieved an AUC value of 0.90 in the training cohort and 0.91 in the validation cohort.

CONCLUSIONS

Ultrasound-based radiomics-clinical nomogram can accurately predict the effectiveness of NAC therapy by predicting RCB grading in breast cancer patients.

Prediction of heart failure and all-cause mortality using cardiac ultrasomics in patients with breast cancer

Breast cancer chemotherapy/immunotherapy can be associated with treatment-limiting cardiotoxicity. Radiomics techniques applied to ultrasound, known as ultrasomics, can be used in cardio-oncology to leverage echocardiography for added prognostic value. To utilize ultrasomics features collected prior to antineoplastic therapy to enhance prediction of mortality and heart failure (HF) in patients with breast cancer. Patients were retrospectively recruited in a study at the West Virginia University Cancer Institute. The final inclusion criteria were met by a total of 134 patients identified for the study. Patients were imaged using echocardiography in the parasternal long axis prior to receiving chemotherapy. All-cause mortality and HF, developed during treatment, were the primary outcomes. 269 features were assessed, grouped into four major classes: demographics (n = 21), heart function (n = 7), antineoplastic medication (n = 17), and ultrasomics (n = 224). Data was split into an internal training (60%, n = 81) and testing (40%, n = 53) set. Ultrasomics features augmented classification of mortality (area under the curve (AUC) 0.89 vs. 0.65, P = 0.003), when compared to demographic variables. When developing a risk prediction score for each feature category, ultrasomics features were significantly associated with both mortality (P = 0.031, log-rank test) and HF (P = 0.002, log-rank test). Further, only ultrasomics features provided significant improvement over demographic variables when predicting mortality (C-Index: 0.78 vs. 0.65, P = 0.044) and HF (C-Index: 0.77 vs. 0.60, P = 0.017), respectively. With further investigation, a clinical decision support tool could be developed utilizing routinely obtained patient data alongside ultrasomics variables to augment treatment regimens.

Comparison of different nutritional screening tools in nutritional screening of patients with cirrhosis: A cross-sectional observational study

Aims

The Royal Free Hospital Nutritional Prioritizing Tool (RFH-NPT), the Liver Disease Undernutrition Screening Tool (LDUST) and Nutritional Risk Screening 2002 (NRS2002) were used by nurses to screen, compare, and analyze the nutritional status of patients with liver cirrhosis. The application value of different screening tools was summarized in the nutritional screening of patients with liver cirrhosis.

Methods

In this study, LDUST, RFH-NPT, and NRS2002 were used by nurses to screen the nutritional status of hospitalized patients with liver cirrhosis within 24-48 h after admission. The study calculated validity indicators such as sensitivity, specificity, the area under the receiver operating curve (AUC), and reliability indicators such as the Kappa coefficient. The efficacy of these screening tools in the nutritional screening of patients with liver cirrhosis was compared.

Results

Among the 207 patients, LDUST and NRS2002 identified 72.9 % and 23.7 % as undernourished, respectively. The sensitivity of LDUST and NRS2002 were 92.1 % and 30.0 %, respectively. The Kappa value of LDUST and RFH-NPT was 0.620, and the Kappa value of LDUST compared with NRS2002 was 0.144.

Conclusion

This study shows that the Liver Disease Undernutrition Screening Tool, a special screening tool for patients with liver cirrhosis, has a more reliable screening effect and higher sensitivity than NRS2002. The Liver Disease Undernutrition Screening Tool is recommended for nutritional screening in patients with liver cirrhosis.

Deep learning driven diagnosis of malignant soft tissue tumors based on dual-modal ultrasound images and clinical indexes

Background

Soft tissue tumors (STTs) are benign or malignant superficial neoplasms arising from soft tissues throughout the body with versatile pathological types. Although Ultrasonography (US) is one of the most common imaging tools to diagnose malignant STTs, it still has several drawbacks in STT diagnosis that need improving.

Objectives

The study aims to establish this deep learning (DL) driven Artificial intelligence (AI) system for predicting malignant STTs based on US images and clinical indexes of the patients.

Methods

We retrospectively enrolled 271 malignant and 462 benign masses to build the AI system using 5-fold validation. A prospective dataset of 44 malignant masses and 101 benign masses was used to validate the accuracy of system. A multi-data fusion convolutional neural network, named ultrasound clinical soft tissue tumor net (UC-STTNet), was developed to combine gray scale and color Doppler US images and clinic features for malignant STTs diagnosis. Six radiologists (R1-R6) with three experience levels were invited for reader study.

Results

The AI system achieved an area under receiver operating curve (AUC) value of 0.89 in the retrospective dataset. The diagnostic performance of the AI system was higher than that of one of the senior radiologists (AUC of AI vs R2: 0.89 vs. 0.84, p=0.022) and all of the intermediate and junior radiologists (AUC of AI vs R3, R4, R5, R6: 0.89 vs 0.75, 0.81, 0.80, 0.63; p <0.01). The AI system also achieved an AUC of 0.85 in the prospective dataset. With the assistance of the system, the diagnostic performances and inter-observer agreement of the radiologists was improved (AUC of R3, R5, R6: 0.75 to 0.83, 0.80 to 0.85, 0.63 to 0.69; p<0.01).

Conclusion

The AI system could be a useful tool in diagnosing malignant STTs, and could also help radiologists improve diagnostic performance.

Delta Radiomics Based on Longitudinal Dual-modal Ultrasound Can Early Predict Response to Neoadjuvant Chemotherapy in Breast Cancer Patients

RATIONALE AND OBJECTIVES

To develop a monitoring model using radiomics analysis based on longitudinal B-mode ultrasound (BUS) and shear wave elastography (SWE) to early predict pathological response to neoadjuvant chemotherapy (NAC) in breast cancer patients.

MATERIALS AND METHODS

In this prospective study, 112 breast cancer patients who received NAC between September 2016 and March 2022 were included. The BUS and SWE data of breast cancer were obtained prior to treatment as well as after two and four cycles of NAC. Radiomics features were extracted followed by measuring the changes in radiomics features compared to baseline after the second and fourth cycles of NAC (△R [C2], △R [C4]), respectively. The delta radiomics signatures were established using a support vector machine classifier.

RESULTS

The area under receiver operating characteristic curve (AUC) values of △RBUS (C2) and △RBUS (C4) for predicting the response to NAC were 0.83 and 0.84, while those of △RSWE (C2) and △RSWE (C4) were 0.88 and 0.90, respectively. △RSWE exhibited significantly superior performance to △RBUS for predicting NAC response (Delong test, p < 0.01). No significant differences were observed in the performances between △R (C2) and △R (C4) based on BUS or SWE data. The longitudinal dual-modal ultrasound radiomics (LDUR) model had an excellent discrimination, good calibration and clinical usefulness, with the AUC, sensitivity and specificity of 0.97, 95.52% and 91.11%, respectively.

CONCLUSION

The LDUR model achieved excellent performance in predicting the pathological response to chemotherapy during the early stages of NAC for breast cancer.

Study on the differential diagnosis of benign and malignant breast lesions using a deep learning model based on multimodal images

OBJECTIVE

To establish a multimodal model for distinguishing benign and malignant breast lesions.

MATERIALS AND METHODS

Clinical data, mammography, and MRI images (including T2WI, diffusion-weighted images (DWI), apparent diffusion coefficient (ADC), and DCE-MRI images) of 132 benign and breast cancer patients were analyzed retrospectively. The region of interest (ROI) in each image was marked and segmented using MATLAB software. The mammography, T2WI, DWI, ADC, and DCE-MRI models based on the ResNet34 network were trained. Using an integrated learning method, the five models were used as a basic model, and voting methods were used to construct a multimodal model. The dataset was divided into a training set and a prediction set. The accuracy, sensitivity, specificity, positive predictive value, and negative predictive value of the model were calculated. The diagnostic efficacy of each model was analyzed using a receiver operating characteristic curve (ROC) and an area under the curve (AUC). The diagnostic value was determined by the DeLong test with statistically significant differences set at P < 0.05.

RESULTS

We evaluated the ability of the model to classify benign and malignant tumors using the test set. The AUC values of the multimodal model, mammography model, T2WI model, DWI model, ADC model and DCE-MRI model were 0.943, 0.645, 0.595, 0.905, 0.900, and 0.865, respectively. The diagnostic ability of the multimodal model was significantly higher compared with that of the mammography and T2WI models. However, compared with the DWI, ADC, and DCE-MRI models, there was no significant difference in the diagnostic ability of these models.

CONCLUSION

Our deep learning model based on multimodal image training has practical value for the diagnosis of benign and malignant breast lesions.

Can multi-modal radiomics using pretreatment ultrasound and tomosynthesis predict response to neoadjuvant systemic treatment in breast cancer?

OBJECTIVES

Response assessment to neoadjuvant systemic treatment (NAST) to guide individualized treatment in breast cancer is a clinical research priority. We aimed to develop an intelligent algorithm using multi-modal pretreatment ultrasound and tomosynthesis radiomics features in addition to clinical variables to predict pathologic complete response (pCR) prior to the initiation of therapy.

METHODS

We used retrospective data on patients who underwent ultrasound and tomosynthesis before starting NAST. We developed a support vector machine algorithm using pretreatment ultrasound and tomosynthesis radiomics features in addition to patient and tumor variables to predict pCR status (ypT0 and ypN0). Findings were compared to the histopathologic evaluation of the surgical specimen. The main outcome measures were area under the curve (AUC) and false-negative rate (FNR).

RESULTS

We included 720 patients, 504 in the development set and 216 in the validation set. Median age was 51.6 years and 33.6% (242 of 720) achieved pCR. The addition of radiomics features significantly improved the performance of the algorithm (AUC 0.72 to 0.81; p = 0.007). The FNR of the multi-modal radiomics and clinical algorithm was 6.7% (10 of 150 with missed residual cancer). Surface/volume ratio at tomosynthesis and peritumoral entropy characteristics at ultrasound were the most relevant radiomics. Hormonal receptors and HER-2 status were the most important clinical predictors.

CONCLUSION

A multi-modal machine learning algorithm with pretreatment clinical, ultrasound, and tomosynthesis radiomics features may aid in predicting residual cancer after NAST. Pending prospective validation, this may facilitate individually tailored NAST regimens.

CLINICAL RELEVANCE STATEMENT

Multi-modal radiomics using pretreatment ultrasound and tomosynthesis showed significant improvement in assessing response to NAST compared to an algorithm using clinical variables only. Further prospective validation of our findings seems warranted to enable individualized predictions of NAST outcomes.

KEY POINTS

• We proposed a multi-modal machine learning algorithm with pretreatment clinical, ultrasound, and tomosynthesis radiomics features to predict response to neoadjuvant breast cancer treatment. • Compared with the clinical algorithm, the AUC of this integrative algorithm is significantly higher. • Used prior to the initiative of therapy, our algorithm can identify patients who will experience pathologic complete response following neoadjuvant therapy with a high negative predictive value.

Preliminary Evidence of the Use of Generative AI in Health Care Clinical Services: Systematic Narrative Review

BACKGROUND

Generative artificial intelligence tools and applications (GenAI) are being increasingly used in health care. Physicians, specialists, and other providers have started primarily using GenAI as an aid or tool to gather knowledge, provide information, train, or generate suggestive dialogue between physicians and patients or between physicians and patients' families or friends. However, unless the use of GenAI is oriented to be helpful in clinical service encounters that can improve the accuracy of diagnosis, treatment, and patient outcomes, the expected potential will not be achieved. As adoption continues, it is essential to validate the effectiveness of the infusion of GenAI as an intelligent technology in service encounters to understand the gap in actual clinical service use of GenAI.

OBJECTIVE

This study synthesizes preliminary evidence on how GenAI assists, guides, and automates clinical service rendering and encounters in health care The review scope was limited to articles published in peer-reviewed medical journals.

METHODS

We screened and selected 0.38% (161/42,459) of articles published between January 1, 2020, and May 31, 2023, identified from PubMed. We followed the protocols outlined in the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines to select highly relevant studies with at least 1 element on clinical use, evaluation, and validation to provide evidence of GenAI use in clinical services. The articles were classified based on their relevance to clinical service functions or activities using the descriptive and analytical information presented in the articles.

RESULTS

Of 161 articles, 141 (87.6%) reported using GenAI to assist services through knowledge access, collation, and filtering. GenAI was used for disease detection (19/161, 11.8%), diagnosis (14/161, 8.7%), and screening processes (12/161, 7.5%) in the areas of radiology (17/161, 10.6%), cardiology (12/161, 7.5%), gastrointestinal medicine (4/161, 2.5%), and diabetes (6/161, 3.7%). The literature synthesis in this study suggests that GenAI is mainly used for diagnostic processes, improvement of diagnosis accuracy, and screening and diagnostic purposes using knowledge access. Although this solves the problem of knowledge access and may improve diagnostic accuracy, it is oriented toward higher value creation in health care.

CONCLUSIONS

GenAI informs rather than assisting or automating clinical service functions in health care. There is potential in clinical service, but it has yet to be actualized for GenAI. More clinical service-level evidence that GenAI is used to streamline some functions or provides more automated help than only information retrieval is needed. To transform health care as purported, more studies related to GenAI applications must automate and guide human-performed services and keep up with the optimism that forward-thinking health care organizations will take advantage of GenAI.

Clinical and radiomics integrated nomogram for preoperative prediction of tumor-infiltrating lymphocytes in patients with triple-negative breast cancer

Objectives

The present study aimed to develop a radiomics nomogram based on conventional ultrasound (CUS) to preoperatively distinguish high tumor-infiltrating lymphocytes (TILs) and low TILs in triple-negative breast cancer (TNBC) patients.

Methods

In the present study, 145 TNBC patients were retrospectively included. Pathological evaluation of TILs in the hematoxylin and eosin sections was set as the gold standard. The patients were randomly allocated into training dataset and validation dataset with a ratio of 7:3. Clinical features (age and CUS features) and radiomics features were collected. Then, the Rad-score model was constructed after the radiomics feature selection. The clinical features model and clinical features plus Rad-score (Clin+RS) model were built using logistic regression analysis. Furthermore, the performance of the models was evaluated by analyzing the receiver operating characteristic (ROC) curve, calibration curve, and decision curve analysis (DCA).

Results

Univariate analysis and LASSO regression were employed to identify a subset of 25 radiomics features from a pool of 837 radiomics features, followed by the calculation of Rad-score. The Clin+RS integrated model, which combined posterior echo and Rad-score, demonstrated better predictive performance compared to both the Rad-score model and clinical model, achieving AUC values of 0.848 in the training dataset and 0.847 in the validation dataset.

Conclusion

The Clin+RS integrated model, incorporating posterior echo and Rad-score, demonstrated an acceptable preoperative evaluation of the TIL level. The Clin+RS integrated nomogram holds tremendous potential for preoperative individualized prediction of the TIL level in TNBC.