Distinguishing benign and malignant lesions on contrast-enhanced breast cone-beam CT with deep learning neural architecture search

Cone-beam Breast CT Features Associated With Lymphovascular Invasion in Patients With Breast Cancer

RATIONALE AND OBJECTIVES

To explore the association between contrast-enhanced cone-beam breast CT (CE-CBBCT) imaging features and lymphovascular invasion (LVI) status.

MATERIALS AND METHODS

Female patients with breast cancer by postoperative histopathology who underwent preoperative CE-CBBCT from August 2020 to December 2023 were retrospectively enrolled. Two radiologists reviewed the CBBCT image features independently. Clinicopathologic and CBBCT characteristics between LVI-positive and LVI-negative were compared by χ2 or Fisher's exact tests and Student's t or Mann-Whitney U test, as appropriate. Multivariate logistic regression analysis was performed to identify independent predictive factors of LVI. The receiver operating characteristic curve was used to evaluate predictive performance.

RESULTS

A total of 401 women were enrolled. LVI status of breast cancer was significantly associated with histologic type, Ki-67 index, adjacent vessel sign (AVS), increased ipsilateral whole-breast vascularity (IIV) number, and IIV degree (all p<0.05). In mass, calcification, AVS, IIV number, and IIV degree were significantly associated with LVI (all p<0.05). In non-mass enhancement (NME), AVS, IIV number, and IIV degree were associated with LVI (all p<0.05). Multivariate logistic regression showed AVS (OR=4.367, p<0.001) and IIV degree (OR of moderate and prominent IIV=4.732, 3.641, both p<0.005) as independent risk factors for LVI. Specifically, in mass, AVS (OR=4.397, p<0.001) and moderate-to-prominent IIV (OR=4.815, 3.563, both p<0.01) were independent predictors. For NME, moderate-to-prominent IIV (OR=13.695, 4.054, both p=0.001) was also an independent factor. The combined LVI prediction model which included AVS and IIV degree showed excellent performance (AUC=0.804).

CONCLUSION

CBBCT imaging features can help identify LVI status in breast cancer patients, which will guide the accurate planning of treatment management.

A multicenter study of neurofibromatosis type 1 utilizing deep learning for whole body tumor identification

Deep-learning models have shown promise in differentiating between benign and malignant lesions. Previous studies have primarily focused on specific anatomical regions, overlooking tumors occurring throughout the body with highly heterogeneous whole-body backgrounds. Using neurofibromatosis type 1 (NF1) as an example, this study developed highly accurate MRI-based deep-learning models for the early automated screening of malignant peripheral nerve sheath tumors (MPNSTs) against complex whole-body background. In a Chinese seven-center cohort, data from 347 subjects were analyzed. Our one-step model incorporated normal tissue/organ labels to provide contextual information, offering a solution for tumors with complex backgrounds. To address privacy concerns, we utilized a lightweight deep neural network suitable for hospital deployment. The final model achieved an accuracy of 85.71% for MPNST diagnosis in the validation cohort and 84.75% accuracy in the independent test set, outperforming another classic two-step model. This success suggests potential for AI models in screening other whole-body primary/metastatic tumors.

A review of AutoML optimization techniques for medical image applications

Automatic analysis of medical images using machine learning techniques has gained significant importance over the years. A large number of approaches have been proposed for solving different medical image analysis tasks using machine learning and deep learning approaches. These approaches are quite effective thanks to their ability to analyze large volume of medical imaging data. Moreover, they can also identify patterns that may be difficult for human experts to detect. Manually designing and tuning the parameters of these algorithms is a challenging and time-consuming task. Furthermore, designing a generalized model that can handle different imaging modalities is difficult, as each modality has specific characteristics. To solve these problems and automate the whole pipeline of different medical image analysis tasks, numerous Automatic Machine Learning (AutoML) techniques have been proposed. These techniques include Hyper-parameter Optimization (HPO), Neural Architecture Search (NAS), and Automatic Data Augmentation (ADA). This study provides an overview of several AutoML-based approaches for different medical imaging tasks in terms of optimization search strategies. The usage of optimization techniques (evolutionary, gradient-based, Bayesian optimization, etc.) is of significant importance for these AutoML approaches. We comprehensively reviewed existing AutoML approaches, categorized them, and performed a detailed analysis of different proposed approaches. Furthermore, current challenges and possible future research directions are also discussed.

State-of-the-Art of Breast Cancer Diagnosis in Medical Images via Convolutional Neural Networks (CNNs)

Early detection of breast cancer is crucial for a better prognosis. Various studies have been conducted where tumor lesions are detected and localized on images. This is a narrative review where the studies reviewed are related to five different image modalities: histopathological, mammogram, magnetic resonance imaging (MRI), ultrasound, and computed tomography (CT) images, making it different from other review studies where fewer image modalities are reviewed. The goal is to have the necessary information, such as pre-processing techniques and CNN-based diagnosis techniques for the five modalities, readily available in one place for future studies. Each modality has pros and cons, such as mammograms might give a high false positive rate for radiographically dense breasts, while ultrasounds with low soft tissue contrast result in early-stage false detection, and MRI provides a three-dimensional volumetric image, but it is expensive and cannot be used as a routine test. Various studies were manually reviewed using particular inclusion and exclusion criteria; as a result, 91 recent studies that classify and detect tumor lesions on breast cancer images from 2017 to 2022 related to the five image modalities were included. For histopathological images, the maximum accuracy achieved was around 99 % , and the maximum sensitivity achieved was 97.29 % by using DenseNet, ResNet34, and ResNet50 architecture. For mammogram images, the maximum accuracy achieved was 96.52 % using a customized CNN architecture. For MRI, the maximum accuracy achieved was 98.33 % using customized CNN architecture. For ultrasound, the maximum accuracy achieved was around 99 % by using DarkNet-53, ResNet-50, G-CNN, and VGG. For CT, the maximum sensitivity achieved was 96 % by using Xception architecture. Histopathological and ultrasound images achieved higher accuracy of around 99 % by using ResNet34, ResNet50, DarkNet-53, G-CNN, and VGG compared to other modalities for either of the following reasons: use of pre-trained architectures with pre-processing techniques, use of modified architectures with pre-processing techniques, use of two-stage CNN, and higher number of studies available for Artificial Intelligence (AI)/machine learning (ML) researchers to reference. One of the gaps we found is that only a single image modality is used for CNN-based diagnosis; in the future, a multiple image modality approach can be used to design a CNN architecture with higher accuracy.

Radiomics nomogram for predicting axillary lymph node metastasis-a potential method to address the limitation of axilla coverage in cone-beam breast CT: a bi-center retrospective study

PURPOSE

Cone-beam breast CT (CBBCT) has an inherent limitation that the axilla cannot be imaged in its entirety. We aimed to develop and validate a nomogram based on clinical factors and contrast-enhanced (CE) CBBCT radiomics features to predict axillary lymph node (ALN) metastasis and complement limited axilla coverage.

MATERIAL AND METHODS

This retrospective study included 312 patients with breast cancer from two hospitals who underwent CE-CBBCT examination in a clinical trial (NCT01792999) during 2012-2020. Patients from TCIH comprised training set (n = 176) and validation set (n = 43), and patients from SYSUCC comprised external test set (n = 93). 3D ROIs were delineated manually and radiomics features were extracted by 3D Slicer software. RadScore was calculated and radiomics model was constructed after feature selection. Clinical model was built on independent predictors. Nomogram was developed with independent clinical predictors and RadScore. Diagnostic performance was compared among three models by ROC curve, and decision curve analysis (DCA) was used to evaluate the clinical utility of nomogram.

RESULTS

A total of 139 patients were ALN positive and 173 patients were negative. Twelve radiomics features remained after feature selection. Location and focality were selected as independent predictors for ALN status. The AUC of nomogram in external test set was higher than that of clinical model (0.80 vs. 0.66, p = 0.012). DCA demonstrated that the nomogram had higher overall net benefit than that of clinical model.

CONCLUSION

The nomogram combined CE-CBBCT-based radiomics features and clinical factors could have potential in distinguishing ALN positive from negative and addressing the limitation of axilla coverage in CBBCT.

A Comparative Evaluation of Mediastinal Nodal SUVmax and Derived Ratios from 18F-FDG PET/CT Imaging to Predict Nodal Metastases in Non-Small Cell Lung Cancer

18F-FDG positron emission tomography with computed tomography (PET/CT) is a standard imaging modality for the nodal staging of non-small cell lung cancer (NSCLC). To improve the accuracy of pre-operative staging, we compare the staging accuracy of mediastinal lymph node (LN) standard uptake values (SUV) with four derived SUV ratios based on the SUV values of primary tumours (TR), the mediastinal blood pool (MR), liver (LR), and nodal size (SR). In 2015-2017, 53 patients (29 women and 24 men, mean age 67.4 years, range 53-87) receiving surgical resection have pre-operative evidence of mediastinal nodal involvement (cN2). Among these, 114 mediastinal nodes are resected and available for correlative PET/CT analysis. cN2 status accuracy is low, with only 32.5% of the cN2 cases confirmed pathologically. Using receiver operating characteristic (ROC) curve analyses, a SUVmax of N2 LN performs well in predicting the presence of N2 disease (AUC, 0.822). Based on the respective selected thresholds for each ROC curve, normalisation of LN SUVmax to that for mediastinum, liver and tumour improved sensitivities of LN SUVmax from 68% to 81.1-89.2% while maintaining acceptable specificity (68-70.1%). In conclusion, normalised SUV ratios (particularly LR) improve current pre-operative staging performance in detecting mediastinal nodal involvement.

Accurate preoperative staging and HER2 status prediction of gastric cancer by the deep learning system based on enhanced computed tomography

Purpose

To construct the deep learning system (DLS) based on enhanced computed tomography (CT) images for preoperative prediction of staging and human epidermal growth factor receptor 2 (HER2) status in gastric cancer patients.

Methods

The raw enhanced CT image dataset consisted of CT images of 389 patients in the retrospective cohort, The Cancer Imaging Archive (TCIA) cohort, and the prospective cohort. DLS was developed by transfer learning for tumor detection, staging, and HER2 status prediction. The pre-trained Yolov5, EfficientNet, EfficientNetV2, Vision Transformer (VIT), and Swin Transformer (SWT) were studied. The tumor detection and staging dataset consisted of 4860 enhanced CT images and annotated tumor bounding boxes. The HER2 state prediction dataset consisted of 38900 enhanced CT images.

Results

The DetectionNet based on Yolov5 realized tumor detection and staging and achieved a mean Average Precision (IoU=0.5) (mAP_0.5) of 0.909 in the external validation cohort. The VIT-based PredictionNet performed optimally in HER2 status prediction with the area under the receiver operating characteristics curve (AUC) of 0.9721 and 0.9995 in the TCIA cohort and prospective cohort, respectively. DLS included DetectionNet and PredictionNet had shown excellent performance in CT image interpretation.

Conclusion

This study developed the enhanced CT-based DLS to preoperatively predict the stage and HER2 status of gastric cancer patients, which will help in choosing the appropriate treatment to improve the survival of gastric cancer patients.

Assessment of Cone-Beam Breast Computed Tomography for Predicting Pathologic Response to Neoadjuvant Chemotherapy in Breast Cancer: A Prospective Study

Background

Response surveillance of neoadjuvant chemotherapy is needed to facilitate treatment decisions. We aimed to assess the imaging features of cone-beam breast computed tomography (CBBCT) for predicting the pathologic response of breast cancer after neoadjuvant chemotherapy.

Methods

This prospective study included 81 women with locally advanced breast cancer who underwent neoadjuvant chemotherapy from August 2017 to January 2021. All patients underwent CBBCT before treatment, and 55 and 65 patients underwent CT examinations during the midtreatment (3 cycles) and late-treatment phases (7 cycles), respectively. Clinical information and quantitative parameters such as the diameter, volume, surface area, and CT density were compared between pathologic responders and nonresponders using the T–test and the Mann–Whitney U test. The performance of meaningful parameters was evaluated with the receiver operating characteristic curve, sensitivity, and specificity.

Results

The quantitative results for the segmented volume, segmented surface area, segmented volume reduction, maximum enhancement ratio, wash-in rate and two-minute enhancement value in the mid- and late-treatment periods had predictive value for pathologic complete response. The area under the curve for the prediction model after multivariate regression analysis was 0.874.

Conclusion

After comparing the outcomes of each timepoint, mid- and late-treatment parameters can be used to predict pathologic outcome. The late-treatment parameters showed significant value with a predictive model.

Artificial Intelligence and COVID-19 Using Chest CT Scan and Chest X-ray Images: Machine Learning and Deep Learning Approaches for Diagnosis and Treatment

OBJECTIVE

To report an overview and update on Artificial Intelligence (AI) and COVID-19 using chest Computed Tomography (CT) scan and chest X-ray images (CXR). Machine Learning and Deep Learning Approaches for Diagnosis and Treatment were identified.

METHODS

Several electronic datasets were analyzed. The search covered the years from January 2019 to June 2021. The inclusion criteria were studied evaluating the use of AI methods in COVID-19 disease reporting performance results in terms of accuracy or precision or area under Receiver Operating Characteristic (ROC) curve (AUC).

RESULTS

Twenty-two studies met the inclusion criteria: 13 papers were based on AI in CXR and 10 based on AI in CT. The summarized mean value of the accuracy and precision of CXR in COVID-19 disease were 93.7% ± 10.0% of standard deviation (range 68.4-99.9%) and 95.7% ± 7.1% of standard deviation (range 83.0-100.0%), respectively. The summarized mean value of the accuracy and specificity of CT in COVID-19 disease were 89.1% ± 7.3% of standard deviation (range 78.0-99.9%) and 94.5 ± 6.4% of standard deviation (range 86.0-100.0%), respectively. No statistically significant difference in summarized accuracy mean value between CXR and CT was observed using the Chi square test (p value > 0.05).

CONCLUSIONS

Summarized accuracy of the selected papers is high but there was an important variability; however, less in CT studies compared to CXR studies. Nonetheless, AI approaches could be used in the identification of disease clusters, monitoring of cases, prediction of the future outbreaks, mortality risk, COVID-19 diagnosis, and disease management.