Efficient automated detection of mitotic cells from breast histological images using deep convolution neutral network with wavelet decomposed patches

Advancing breast ultrasound diagnostics through hybrid deep learning models

Today, doctors rely heavily on medical imaging to identify abnormalities. Proper classification of these abnormalities enables them to take informed actions, leading to early diagnosis and treatment. This paper introduces the "EfficientKNN" model, a novel hybrid deep learning approach that combines the advanced feature extraction capabilities of EfficientNetB3 with the simplicity and effectiveness of the k-Nearest Neighbors (k-NN) algorithm. Initially, EfficientNetB3, pre-trained on ImageNet, is repurposed to serve as a feature extractor. Subsequently, a GlobalAveragePooling2D layer is applied, followed by an optional Principal Component Analysis (PCA) to reduce dimensionality while preserving critical information. PCA is used selectively when deemed necessary. The extracted features are then classified using an optimized k-NN algorithm, fine-tuned through meticulous cross-validation.Our model underwent rigorous training using a curated dataset containing benign, malignant, and normal medical images. Data augmentation techniques, including rotations, shifts, flips, and zooms, were employed to help the model generalize and efficiently handle new, unseen data. To enhance the model's ability to identify the important features necessary for accurate predictions, the dataset was refined using segmentation and overlay techniques. The training utilized an ensemble of optimization algorithms-SGD, Adam, and RMSprop-with hyperparameters set at a learning rate of 0.00045, a batch size of 32, and up to 120 epochs, facilitated by early stopping to prevent overfitting.The results demonstrate that the EfficientKNN model outperforms traditional models such as VGG16, AlexNet, and VGG19 in terms of accuracy, precision, and F1-score. Additionally, the model showed better results compared to EfficientNetB3 alone. Achieving a 100 % accuracy rate on multiple tests, the EfficientKNN model has significant potential for real-world diagnostic applications. This study highlights the model's scalability, efficient use of cloud storage, and real-time prediction capabilities, all while minimizing computational demands.By integrating the strengths of EfficientNetB3's deep learning architecture with the interpretability of k-NN, EfficientKNN presents a significant advancement in medical image classification, promising improved diagnostic accuracy and clinical applicability.

Two-Stage Hybrid Convolutional-Transformer Models for Breast Cancer Histopathology

In this study, we present a two-stage algorithm utilizing hybrid Convolutional-Transformer models, specifically ConvMixer and Coatnet, for breast cancer histopathology image classification. Our methodology focuses on two critical stages: training and mitosis detection. The training stage incorporates advanced color normalization and data augmentation techniques, enhancing the models' ability to process complex histopathological images. This stage prepares the models to accurately identify mitotic figures using the MITOS-ATYPIA-14 and a real-world dataset from Cherbourg Hospital. In the mitosis detection stage, the trained models are applied to detect and classify mitotic figures, leveraging the hybrid architecture's strengths in capturing both local and global features. Our results demonstrate that Coatnet slightly outperforms ConvMixer, owing to its efficient combination of convolutional and transformer layers. This two-stage approach addresses the challenges of incomplete cell annotations and showcases the hybrid models' potential in advancing medical image analysis, particularly in breast cancer diagnosis.

Modeling Epidemiology Data with Machine Learning Technique to Detect Risk Factors for Gastric Cancer

PURPOSE

Gastric cancer (GC) ranks as the 7th most common cancer worldwide and a leading cause of cancer mortality. In Iran, stomach malignancies are the most common fatal cancers with higher than world average incidence. In recent years, methods like machine learning that provide the opportunity of merging health issues with computational power and learning capacity have caught considerable attention for prediction and diagnosis of diseases. In this study, we aimed to model GC data to find risk factors and identify GC cases in Golestan Cohort Study (GCS), using gradient boosting as a machine learning technique.

METHODS

Since the GC class (280) was smaller than not-GC (49,467), "Synthetic Minority Oversampling Technique" was used to balance the dataset. Seventy percent of the data was used to train the gradient boosting algorithm and find effective factors on gastric cancer, and the remaining 30% was used for accuracy assessment.

RESULTS

Our results indicated that out of 19 factors, age, social economical status, tea temperature, body mass index, gender, and education were the top six effective factors with impact rates of 0.24, 0.16, 0.13, 0.13, and 0.07, respectively. The trained model classified 70 out of 72 GC patients in the test set, correctly.

CONCLUSION

The results indicate that this model can effectively detect gastric cancer (GC) by utilizing important risk factors, thus avoiding the need for invasive procedures. The model's performance is reliable when provided with an adequate amount of input data, and as the dataset expands, its accuracy and generalization improve significantly. Overall, the trained system's success stems from its ability to identify risk factors and identify cancer patients.

How to use AI in pathology

AI plays an important role in pathology, both in clinical practice supporting pathologists in their daily work, and in research discovering novel biomarkers for improved patient care. Still, AI is in its starting phase, and many pathology labs still need to transition to a digital workflow to be able to enjoy the benefits of AI. In this perspective, we explain the major benefits of AI in pathology, highlight key requirements that need to be met and example how to use it in a typical workflow.

Artificial Hummingbird Algorithm with Transfer-Learning-Based Mitotic Nuclei Classification on Histopathologic Breast Cancer Images

Recently, artificial intelligence (AI) is an extremely revolutionized domain of medical image processing. Specifically, image segmentation is a task that generally aids in such an improvement. This boost performs great developments in the conversion of AI approaches in the research lab to real medical applications, particularly for computer-aided diagnosis (CAD) and image-guided operation. Mitotic nuclei estimates in breast cancer instances have a prognostic impact on diagnosis of cancer aggressiveness and grading methods. The automated analysis of mitotic nuclei is difficult due to its high similarity with nonmitotic nuclei and heteromorphic form. This study designs an artificial hummingbird algorithm with transfer-learning-based mitotic nuclei classification (AHBATL-MNC) on histopathologic breast cancer images. The goal of the AHBATL-MNC technique lies in the identification of mitotic and nonmitotic nuclei on histopathology images (HIs). For HI segmentation process, the PSPNet model is utilized to identify the candidate mitotic patches. Next, the residual network (ResNet) model is employed as feature extractor, and extreme gradient boosting (XGBoost) model is applied as a classifier. To enhance the classification performance, the parameter tuning of the XGBoost model takes place by making use of the AHBA approach. The simulation values of the AHBATL-MNC system are tested on medical imaging datasets and the outcomes are investigated in distinct measures. The simulation values demonstrate the enhanced outcomes of the AHBATL-MNC method compared to other current approaches.

The Role of Deep Learning in Advancing Breast Cancer Detection Using Different Imaging Modalities: A Systematic Review

Breast cancer is among the most common and fatal diseases for women, and no permanent treatment has been discovered. Thus, early detection is a crucial step to control and cure breast cancer that can save the lives of millions of women. For example, in 2020, more than 65% of breast cancer patients were diagnosed in an early stage of cancer, from which all survived. Although early detection is the most effective approach for cancer treatment, breast cancer screening conducted by radiologists is very expensive and time-consuming. More importantly, conventional methods of analyzing breast cancer images suffer from high false-detection rates. Different breast cancer imaging modalities are used to extract and analyze the key features affecting the diagnosis and treatment of breast cancer. These imaging modalities can be divided into subgroups such as mammograms, ultrasound, magnetic resonance imaging, histopathological images, or any combination of them. Radiologists or pathologists analyze images produced by these methods manually, which leads to an increase in the risk of wrong decisions for cancer detection. Thus, the utilization of new automatic methods to analyze all kinds of breast screening images to assist radiologists to interpret images is required. Recently, artificial intelligence (AI) has been widely utilized to automatically improve the early detection and treatment of different types of cancer, specifically breast cancer, thereby enhancing the survival chance of patients. Advances in AI algorithms, such as deep learning, and the availability of datasets obtained from various imaging modalities have opened an opportunity to surpass the limitations of current breast cancer analysis methods. In this article, we first review breast cancer imaging modalities, and their strengths and limitations. Then, we explore and summarize the most recent studies that employed AI in breast cancer detection using various breast imaging modalities. In addition, we report available datasets on the breast-cancer imaging modalities which are important in developing AI-based algorithms and training deep learning models. In conclusion, this review paper tries to provide a comprehensive resource to help researchers working in breast cancer imaging analysis.

MiNuGAN: Dual Segmentation of Mitoses and Nuclei Using Conditional GANs on Multi-center Breast H&E Images

Breast cancer is the second most commonly diagnosed type of cancer among women as of 2021. Grading of histopathological images is used to guide breast cancer treatment decisions and a critical component of this is a mitotic score, which is related to tumor aggressiveness. Manual mitosis counting is an extremely tedious manual task, but automated approaches can be used to overcome inefficiency and subjectivity. In this paper, we propose an automatic mitosis and nuclear segmentation method for a diverse set of H&E breast cancer pathology images. The method is based on a conditional generative adversarial network to segment both mitoses and nuclei at the same time. Architecture optimizations are investigated, including hyper parameters and the addition of a focal loss. The accuracy of the proposed method is investigated using images from multiple centers and scanners, including TUPAC16, ICPR14 and ICPR12 datasets. In TUPAC16, we use 618 carefully annotated images of size 256×256 scanned at 40×. TUPAC16 is used to train the model, and segmentation performance is measured on the test set for both nuclei and mitoses. Results on 200 held-out testing images from the TUPAC16 dataset were mean DSC = 0.784 and 0.721 for nuclear and mitosis, respectively. On 202 ICPR12 images, mitosis segmentation accuracy had a mean DSC = 0.782, indicating the model generalizes well to unseen datasets. For datasets that had mitosis centroid annotations, which included 200 TUPAC16, 202 ICPR12 and 524 ICPR14, a mean F1-score of 0.854 was found indicating high mitosis detection accuracy.

Automated knowledge-assisted mitosis cells detection framework in breast histopathology images

Based on the Nottingham Histopathology Grading (NHG) system, mitosis cells detection is one of the important criteria to determine the grade of breast carcinoma. Mitosis cells detection is a challenging task due to the heterogeneous microenvironment of breast histopathology images. Recognition of complex and inconsistent objects in the medical images could be achieved by incorporating domain knowledge in the field of interest. In this study, the strategies of the histopathologist and domain knowledge approach were used to guide the development of the image processing framework for automated mitosis cells detection in breast histopathology images. The detection framework starts with color normalization and hyperchromatic nucleus segmentation. Then, a knowledge-assisted false positive reduction method is proposed to eliminate the false positive (i.e., non-mitosis cells). This stage aims to minimize the percentage of false positive and thus increase the F1-score. Next, features extraction was performed. The mitosis candidates were classified using a Support Vector Machine (SVM) classifier. For evaluation purposes, the knowledge-assisted detection framework was tested using two datasets: a custom dataset and a publicly available dataset (i.e., MITOS dataset). The proposed knowledge-assisted false positive reduction method was found promising by eliminating at least 87.1% of false positive in both the dataset producing promising results in the F1-score. Experimental results demonstrate that the knowledge-assisted detection framework can achieve promising results in F1-score (custom dataset: 89.1%; MITOS dataset: 88.9%) and outperforms the recent works.

Breast histopathological image analysis using image processing techniques for diagnostic puposes: A methodological review

Breast cancer in women is the second most common cancer worldwide. Early detection of breast cancer can reduce the risk of human life. Non-invasive techniques such as mammograms and ultrasound imaging are popularly used to detect the tumour. However, histopathological analysis is necessary to determine the malignancy of the tumour as it analyses the image at the cellular level. Manual analysis of these slides is time consuming, tedious, subjective and are susceptible to human errors. Also, at times the interpretation of these images are inconsistent between laboratories. Hence, a Computer-Aided Diagnostic system that can act as a decision support system is need of the hour. Moreover, recent developments in computational power and memory capacity led to the application of computer tools and medical image processing techniques to process and analyze breast cancer histopathological images. This review paper summarizes various traditional and deep learning based methods developed to analyze breast cancer histopathological images. Initially, the characteristics of breast cancer histopathological images are discussed. A detailed discussion on the various potential regions of interest is presented which is crucial for the development of Computer-Aided Diagnostic systems. We summarize the recent trends and choices made during the selection of medical image processing techniques. Finally, a detailed discussion on the various challenges involved in the analysis of BCHI is presented along with the future scope.

Development of a computed tomography-based radiomics nomogram for prediction of transarterial chemoembolization refractoriness in hepatocellular carcinoma

BACKGROUND

Some patients with hepatocellular carcinoma (HCC) are more likely to experience disease progression despite continuous transarterial chemoembolization (TACE), which is called TACE refractoriness. At present, it is still difficult to predict TACE refractoriness, although some models/scoring systems have been developed. At present, radiological-based radiomics models have been successfully applied to predict cancer patient prognosis.

AIM

To develop and validate a computed tomography (CT)-based radiomics nomogram for the pre-treatment prediction of TACE refractoriness.

METHODS

This retrospective study consisted of a training dataset (n = 137) and an external validation dataset (n = 81) of patients with clinically/pathologically confirmed HCC who underwent repeated TACE from March 2009 to March 2016. Radiomics features were retrospectively extracted from preoperative CT images of the arterial phase. The pre-treatment radiomics signature was generated using least absolute shrinkage and selection operator Cox regression analysis. A CT-based radiomics nomogram incorporating clinical risk factors and the radiomics signature was built and verified by calibration curve and decision curve analyses. The usefulness of the CT-based radiomics nomogram was assessed by Kaplan-Meier curve analysis. We used the concordance index to conduct head-to-head comparisons of the radiomics nomogram with the other four models (Assessment for Retreatment with Transarterial Chemoembolization score; α-fetoprotein, Barcelona Clinic Liver Cancer, Child-Pugh, and Response score; CT-based radiomics signature; and clinical model). All analyses were conducted according to the transparent reporting of a multivariable prediction model for individual prognosis or diagnosis statement.

RESULTS

The median duration of follow-up was 61.3 mo (interquartile range, 25.5-69.3 mo) for the training cohort and 67.1 mo (interquartile range, 32.4-71.3 mo) for the validation cohort. The median number of TACE sessions was 4 (range, 3-7) in both cohorts. Eight radiomics features were chosen from 869 candidate features to build a radiomics signature. The CT-based radiomics nomogram included the radiomics score (hazard ratio = 3.9, 95% confidence interval: 3.1-8.8, P < 0.001) and four clinical factors and classified patients into high-risk (score > 3.5) and low-risk (score ≤ 3.5) groups with markedly different prognoses (overall survival: 12.3 mo vs 23.6 mo, P < 0.001). The accuracy of the nomogram was considerably higher than that of the other four models. The calibration curve and decision curve analyses verified the usefulness of the CT-based radiomics nomogram for clinical practice.

CONCLUSION

The newly constructed CT-based radiomics nomogram can be used for the pre-treatment prediction of TACE refractoriness, which may provide better guidance for decision making regarding further TACE treatment.

Application of machine learning in the diagnosis of gastric cancer based on noninvasive characteristics

Background

The diagnosis of gastric cancer mainly relies on endoscopy, which is invasive and costly. The aim of this study is to develop a predictive model for the diagnosis of gastric cancer based on noninvasive characteristics.

Aims

To construct a predictive model for the diagnosis of gastric cancer with high accuracy based on noninvasive characteristics.

Methods

A retrospective study of 709 patients at Zhejiang Provincial People's Hospital was conducted. Variables of age, gender, blood cell count, liver function, kidney function, blood lipids, tumor markers and pathological results were analyzed. We used gradient boosting decision tree (GBDT), a type of machine learning method, to construct a predictive model for the diagnosis of gastric cancer and evaluate the accuracy of the model.

Results

Of the 709 patients, 398 were diagnosed with gastric cancer; 311 were health people or diagnosed with benign gastric disease. Multivariate analysis showed that gender, age, neutrophil lymphocyte ratio, hemoglobin, albumin, carcinoembryonic antigen (CEA), carbohydrate antigen 125 (CA125) and carbohydrate antigen 199 (CA199) were independent characteristics associated with gastric cancer. We constructed a predictive model using GBDT, and the area under the receiver operating characteristic curve (AUC) of the model was 91%. For the test dataset, sensitivity was 87.0% and specificity 84.1% at the optimal threshold value of 0.56. The overall accuracy was 83.0%. Positive and negative predictive values were 83.0% and 87.8%, respectively.

Conclusion

We construct a predictive model to diagnose gastric cancer with high sensitivity and specificity. The model is noninvasive and may reduce the medical cost.

Predicting the response to neoadjuvant chemotherapy for breast cancer: wavelet transforming radiomics in MRI

Background

The purpose of this study was to investigate the value of wavelet-transformed radiomic MRI in predicting the pathological complete response (pCR) to neoadjuvant chemotherapy (NAC) for patients with locally advanced breast cancer (LABC).

Methods

Fifty-five female patients with LABC who underwent contrast-enhanced MRI (CE-MRI) examination prior to NAC were collected for the retrospective study. According to the pathological assessment after NAC, patient responses to NAC were categorized into pCR and non-pCR. Three groups of radiomic textures were calculated in the segmented lesions, including (1) volumetric textures, (2) peripheral textures, and (3) wavelet-transformed textures. Six models for the prediction of pCR were Model I: group (1), Model II: group (1) + (2), Model III: group (3), Model IV: group (1) + (3), Model V: group (2) + (3), and Model VI: group (1) + (2) + (3). The performance of predicting models was compared using the area under the receiver operating characteristic (ROC) curves (AUC).

Results

The AUCs of the six models for the prediction of pCR were 0.816 ± 0.033 (Model I), 0.823 ± 0.020 (Model II), 0.888 ± 0.025 (Model III), 0.876 ± 0.015 (Model IV), 0.885 ± 0.030 (Model V), and 0.874 ± 0.019 (Model VI). The performance of four models with wavelet-transformed textures (Models III, IV, V, and VI) was significantly better than those without wavelet-transformed textures (Model I and II). In addition, the inclusion of volumetric textures or peripheral textures or both did not result in any improvements in performance.

Conclusions

Wavelet-transformed textures outperformed volumetric and/or peripheral textures in the radiomic MRI prediction of pCR to NAC for patients with LABC, which can potentially serve as a surrogate biomarker for the prediction of the response of LABC to NAC.