1
|
Patel AN, Srinivasan K. Deep learning paradigms in lung cancer diagnosis: A methodological review, open challenges, and future directions. Phys Med 2025; 131:104914. [PMID: 39938402 DOI: 10.1016/j.ejmp.2025.104914] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/13/2024] [Revised: 12/19/2024] [Accepted: 01/30/2025] [Indexed: 02/14/2025] Open
Abstract
Lung cancer is the leading cause of global cancer-related deaths, which emphasizes the critical importance of early diagnosis in enhancing patient outcomes. Deep learning has demonstrated significant promise in lung cancer diagnosis, excelling in nodule detection, classification, and prognosis prediction. This methodological review comprehensively explores deep learning models' application in lung cancer diagnosis, uncovering their integration across various imaging modalities. Deep learning consistently achieves state-of-the-art performance, occasionally surpassing human expert accuracy. Notably, deep neural networks excel in detecting lung nodules, distinguishing between benign and malignant nodules, and predicting patient prognosis. They have also led to the development of computer-aided diagnosis systems, enhancing diagnostic accuracy for radiologists. This review follows the specified criteria for article selection outlined by PRISMA framework. Despite challenges such as data quality and interpretability limitations, this review emphasizes the potential of deep learning to significantly improve the precision and efficiency of lung cancer diagnosis, facilitating continued research efforts to overcome these obstacles and fully harness neural network's transformative impact in this field.
Collapse
Affiliation(s)
- Aryan Nikul Patel
- School of Computer Science and Engineering, Vellore Institute of Technology, Vellore, India.
| | - Kathiravan Srinivasan
- School of Computer Science and Engineering, Vellore Institute of Technology, Vellore, India.
| |
Collapse
|
2
|
Yadav DP, Sharma B, Noonia A, Mehbodniya A. Explainable label guided lightweight network with axial transformer encoder for early detection of oral cancer. Sci Rep 2025; 15:6391. [PMID: 39984521 PMCID: PMC11845714 DOI: 10.1038/s41598-025-87627-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2024] [Accepted: 01/21/2025] [Indexed: 02/23/2025] Open
Abstract
Oral cavity cancer exhibits high morbidity and mortality rates. Therefore, it is essential to diagnose the disease at an early stage. Machine learning and convolution neural networks (CNN) are powerful tools for diagnosing mouth and oral cancer. In this study, we design a lightweight explainable network (LWENet) with label-guided attention (LGA) to provide a second opinion to the expert. The LWENet contains depth-wise separable convolution layers to reduce the computation costs. Moreover, the LGA module provides label consistency to the neighbor pixel and improves the spatial features. Furthermore, AMSA (axial multi-head self-attention) based ViT encoder incorporated in the model to provide global attention. Our ViT (vision transformer) encoder is computationally efficient compared to the classical ViT encoder. We tested LWRNet performance on the MOD (mouth and oral disease) and OCI (oral cancer image) datasets, and results are compared with the other CNN and ViT (vision transformer) based methods. The LWENet achieved a precision and F1-scores of 96.97% and 98.90% on the MOD dataset, and 99.48% and 98.23% on the OCI dataset, respectively. By incorporating Grad-CAM, we visualize the decision-making process, enhancing model interpretability. This work demonstrates the potential of LWENet with LGA in facilitating early oral cancer detection.
Collapse
Affiliation(s)
- Dhirendra Prasad Yadav
- Department of Computer Engineering & Applications, GLA University Mathura, Mathura, India
| | - Bhisham Sharma
- Centre for Research Impact & Outcome, Chitkara University Institute of Engineering and Technology, Chitkara University, Rajpura, Punjab, 140401, India.
| | - Ajit Noonia
- Department of Computer Science and Engineering, Manipal University Jaipur, Jaipur, Rajasthan, India
| | - Abolfazl Mehbodniya
- Department of Electronics and Communication Engineering, Kuwait College of Science and Technology (KCST), Doha Area, 7th Ring Road, Kuwait City, Kuwait
| |
Collapse
|
3
|
Shifat-E-Rabbi M, Ironside N, Pathan NS, Ozolek JA, Singh R, Pantanowitz L, Rohde GK. Quantifying Nuclear Structures of Digital Pathology Images Across Cancers Using Transport-Based Morphometry. Cytometry A 2025; 107:98-110. [PMID: 39982036 DOI: 10.1002/cyto.a.24917] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2024] [Revised: 10/25/2024] [Accepted: 01/27/2025] [Indexed: 02/22/2025]
Abstract
Alterations in nuclear morphology are useful adjuncts and even diagnostic tools used by pathologists in the diagnosis and grading of many tumors, particularly malignant tumors. Large datasets such as TCGA and the Human Protein Atlas, in combination with emerging machine learning and statistical modeling methods, such as feature extraction and deep learning techniques, can be used to extract meaningful knowledge from images of nuclei, particularly from cancerous tumors. Here, we describe a new technique based on the mathematics of optimal transport for modeling the information content related to nuclear chromatin structure directly from imaging data. In contrast to other techniques, our method represents the entire information content of each nucleus relative to a template nucleus using a transport-based morphometry (TBM) framework. We demonstrate that the model is robust to different staining patterns and imaging protocols, and can be used to discover meaningful and interpretable information within and across datasets and cancer types. In particular, we demonstrate morphological differences capable of distinguishing nuclear features along the spectrum from benign to malignant categories of tumors across different cancer tissue types, including tumors derived from liver parenchyma, thyroid gland, lung mesothelium, and skin epithelium. We believe these proof-of-concept calculations demonstrate that the TBM framework can provide the quantitative measurements necessary for performing meaningful comparisons across a wide range of datasets and cancer types that can potentially enable numerous cancer studies, technologies, and clinical applications and help elevate the role of nuclear morphometry into a more quantitative science.
Collapse
Affiliation(s)
- Mohammad Shifat-E-Rabbi
- Department of Electrical and Computer Engineering, North South University, Dhaka, Bangladesh
| | - Natasha Ironside
- Imaging and Data Science Laboratory, Charlottesville, USA
- Department of Neurological Surgery, University of Virginia, Charlottesville, USA
| | - Naqib Sad Pathan
- Imaging and Data Science Laboratory, Charlottesville, USA
- Department of Electrical & Computer Engineering, University of Virginia, Charlottesville, USA
| | - John A Ozolek
- Department of Pathology, Anatomy, and Laboratory Medicine, West Virginia University, Morgantown, West Virginia, USA
| | | | - Liron Pantanowitz
- Department of Pathology, University of Michigan Medical School, Ann Arbor, Michigan, USA
| | - Gustavo K Rohde
- Imaging and Data Science Laboratory, Charlottesville, USA
- Department of Electrical & Computer Engineering, University of Virginia, Charlottesville, USA
- Department of Biomedical Engineering, University of Virginia, Charlottesville, USA
| |
Collapse
|
4
|
Yadav DP, Sharma B, Webber JL, Mehbodniya A, Chauhan S. EDTNet: A spatial aware attention-based transformer for the pulmonary nodule segmentation. PLoS One 2024; 19:e0311080. [PMID: 39546546 PMCID: PMC11567627 DOI: 10.1371/journal.pone.0311080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2024] [Accepted: 09/11/2024] [Indexed: 11/17/2024] Open
Abstract
Accurate segmentation of lung lesions in CT-scan images is essential to diagnose lung cancer. The challenges in lung nodule diagnosis arise due to their small size and diverse nature. We designed a transformer-based model EDTNet (Encoder Decoder Transformer Network) for PNS (Pulmonary Nodule Segmentation). Traditional CNN-based encoders and decoders are hindered by their inability to capture long-range spatial dependencies, leading to suboptimal performance in complex object segmentation tasks. To address the limitation, we leverage an enhanced spatial attention-based Vision Transformer (ViT) as an encoder and decoder in the EDTNet. The EDTNet integrates two successive transformer blocks, a patch-expanding layer, down-sampling layers, and up-sampling layers to improve segmentation capabilities. In addition, ESLA (Enhanced spatial aware local attention) and EGLA (Enhanced global aware local attention) blocks are added to provide attention to the spatial features. Furthermore, skip connections are introduced to facilitate symmetrical interaction between the corresponding encoder and decoder layer, enabling the retrieval of intricate details in the output. The EDTNet performance is compared with several models on DS1 and DS2, including Unet, ResUNet++, U-NET 3+, DeepLabV3+, SegNet, Trans-Unet, and Swin-UNet, demonstrates superior quantitative and visual results. On DS1, the EDTNet achieved 96.27%, 95.81%, 96.15% precision, IoU (Intersection over Union), and DSC (Sorensen-Dice coefficient). Moreover, the model has demonstrated sensitivity, IoU and SDC of 98.84%, 96.06% and 97.85% on DS2.
Collapse
Affiliation(s)
| | - Bhisham Sharma
- Chitkara University Institute of Engineering and Technology, Centre for Research Impact & Outcome, Chitkara University, Rajpura, Punjab, India
| | - Julian L. Webber
- Department of Electronics and Communication Engineering, Kuwait College of Science and Technology (KCST), Doha Area, Kuwait
| | - Abolfazl Mehbodniya
- Department of Electronics and Communication Engineering, Kuwait College of Science and Technology (KCST), Doha Area, Kuwait
| | - Shivank Chauhan
- Department of Computer Engineering & Applications, G.L.A. University, Mathura, India
| |
Collapse
|
5
|
Leung JH, Karmakar R, Mukundan A, Thongsit P, Chen MM, Chang WY, Wang HC. Systematic Meta-Analysis of Computer-Aided Detection of Breast Cancer Using Hyperspectral Imaging. Bioengineering (Basel) 2024; 11:1060. [PMID: 39593720 PMCID: PMC11591395 DOI: 10.3390/bioengineering11111060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2024] [Revised: 10/19/2024] [Accepted: 10/21/2024] [Indexed: 11/28/2024] Open
Abstract
The most commonly occurring cancer in the world is breast cancer with more than 500,000 cases across the world. The detection mechanism for breast cancer is endoscopist-dependent and necessitates a skilled pathologist. However, in recent years many computer-aided diagnoses (CADs) have been used to diagnose and classify breast cancer using traditional RGB images that analyze the images only in three-color channels. Nevertheless, hyperspectral imaging (HSI) is a pioneering non-destructive testing (NDT) image-processing technique that can overcome the disadvantages of traditional image processing which analyzes the images in a wide-spectrum band. Eight studies were selected for systematic diagnostic test accuracy (DTA) analysis based on the results of the Quadas-2 tool. Each of these studies' techniques is categorized according to the ethnicity of the data, the methodology employed, the wavelength that was used, the type of cancer diagnosed, and the year of publication. A Deeks' funnel chart, forest charts, and accuracy plots were created. The results were statistically insignificant, and there was no heterogeneity among these studies. The methods and wavelength bands that were used with HSI technology to detect breast cancer provided high sensitivity, specificity, and accuracy. The meta-analysis of eight studies on breast cancer diagnosis using HSI methods reported average sensitivity, specificity, and accuracy of 78%, 89%, and 87%, respectively. The highest sensitivity and accuracy were achieved with SVM (95%), while CNN methods were the most commonly used but had lower sensitivity (65.43%). Statistical analyses, including meta-regression and Deeks' funnel plots, showed no heterogeneity among the studies and highlighted the evolving performance of HSI techniques, especially after 2019.
Collapse
Affiliation(s)
- Joseph-Hang Leung
- Department of Radiology, Ditmanson Medical Foundation Chia-Yi Christian Hospital, Chiayi City 600566, Taiwan;
| | - Riya Karmakar
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Rd., Min Hsiung, Chiayi City 62102, Taiwan; (R.K.); (A.M.)
| | - Arvind Mukundan
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Rd., Min Hsiung, Chiayi City 62102, Taiwan; (R.K.); (A.M.)
| | - Pacharasak Thongsit
- Faculty of Mechanical Engineering, King Mongkut’s University of Technology North Bangkok, Pracharat 1 Road, Wongsawang, Bangsue, Bangkok 10800, Thailand;
| | - Meei-Maan Chen
- Center for Innovative Research on Aging Society (CIRAS), National Chung Cheng University, 168, University Rd., Min Hsiung, Chiayi 62102, Taiwan;
| | - Wen-Yen Chang
- Department of General Surgery, Kaohsiung Armed Forces General Hospital, 2, Zhongzheng 1st.Rd., Lingya District, Kaohsiung City 80284, Taiwan
| | - Hsiang-Chen Wang
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Rd., Min Hsiung, Chiayi City 62102, Taiwan; (R.K.); (A.M.)
- Department of Medical Research, Dalin Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, No. 2, Minsheng Road, Dalin, Chiayi 62247, Taiwan
- Hitspectra Intelligent Technology Co., Ltd., 4F., No. 2, Fuxing 4th Rd., Qianzhen Dist., Kaohsiung City 80661, Taiwan
| |
Collapse
|
6
|
Islam T, Hoque ME, Ullah M, Islam T, Nishu NA, Islam R. CNN-based deep learning approach for classification of invasive ductal and metastasis types of breast carcinoma. Cancer Med 2024; 13:e70069. [PMID: 39215495 PMCID: PMC11364780 DOI: 10.1002/cam4.70069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2023] [Revised: 04/04/2024] [Accepted: 07/23/2024] [Indexed: 09/04/2024] Open
Abstract
OBJECTIVE Breast cancer is one of the leading cancer causes among women worldwide. It can be classified as invasive ductal carcinoma (IDC) or metastatic cancer. Early detection of breast cancer is challenging due to the lack of early warning signs. Generally, a mammogram is recommended by specialists for screening. Existing approaches are not accurate enough for real-time diagnostic applications and thus require better and smarter cancer diagnostic approaches. This study aims to develop a customized machine-learning framework that will give more accurate predictions for IDC and metastasis cancer classification. METHODS This work proposes a convolutional neural network (CNN) model for classifying IDC and metastatic breast cancer. The study utilized a large-scale dataset of microscopic histopathological images to automatically perceive a hierarchical manner of learning and understanding. RESULTS It is evident that using machine learning techniques significantly (15%-25%) boost the effectiveness of determining cancer vulnerability, malignancy, and demise. The results demonstrate an excellent performance ensuring an average of 95% accuracy in classifying metastatic cells against benign ones and 89% accuracy was obtained in terms of detecting IDC. CONCLUSIONS The results suggest that the proposed model improves classification accuracy. Therefore, it could be applied effectively in classifying IDC and metastatic cancer in comparison to other state-of-the-art models.
Collapse
Affiliation(s)
- Tobibul Islam
- Department of Biomedical EngineeringMilitary Institute of Science and TechnologyDhakaBangladesh
| | - Md Enamul Hoque
- Department of Biomedical EngineeringMilitary Institute of Science and TechnologyDhakaBangladesh
| | - Mohammad Ullah
- Center for Advance Intelligent MaterialsUniversiti Malaysia PahangKuantanMalaysia
| | - Toufiqul Islam
- Department of SurgeryM Abdur Rahim Medical CollegeDinajpurBangladesh
| | | | - Rabiul Islam
- Department of Electrical and Computer EngineeringTexas A&M UniversityCollege StationTexasUSA
| |
Collapse
|
7
|
Dogra A, Goyal B, Lepcha DC, Alkhayyat A, Singh D, Bavirisetti DP, Kukreja V. Effective image fusion strategies in scientific signal processing disciplines: Application to cancer and carcinoma treatment planning. PLoS One 2024; 19:e0301441. [PMID: 38995975 PMCID: PMC11244787 DOI: 10.1371/journal.pone.0301441] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Accepted: 03/15/2024] [Indexed: 07/14/2024] Open
Abstract
Multimodal medical image fusion is a perennially prominent research topic that can obtain informative medical images and aid radiologists in diagnosing and treating disease more effectively. However, the recent state-of-the-art methods extract and fuse features by subjectively defining constraints, which easily distort the exclusive information of source images. To overcome these problems and get a better fusion method, this study proposes a 2D data fusion method that uses salient structure extraction (SSE) and a swift algorithm via normalized convolution to fuse different types of medical images. First, salient structure extraction (SSE) is used to attenuate the effect of noise and irrelevant data in the source images by preserving the significant structures. The salient structure extraction is performed to ensure that the pixels with a higher gradient magnitude impact the choices of their neighbors and further provide a way to restore the sharply altered pixels to their neighbors. In addition, a Swift algorithm is used to overcome the excessive pixel values and modify the contrast of the source images. Furthermore, the method proposes an efficient method for performing edge-preserving filtering using normalized convolution. In the end,the fused image are obtained through linear combination of the processed image and the input images based on the properties of the filters. A quantitative function composed of structural loss and region mutual data loss is designed to produce restrictions for preserving data at feature level and the structural level. Extensive experiments on CT-MRI images demonstrate that the proposed algorithm exhibits superior performance when compared to some of the state-of-the-art methods in terms of providing detailed information, edge contour, and overall contrasts.
Collapse
Affiliation(s)
- Ayush Dogra
- Chitkara University Institute of Engineering and Technology, Chitkara University, Punjab, India
| | - Bhawna Goyal
- Department of ECE and UCRD, Chandigarh University, Mohali, Punjab, India
| | | | - Ahmed Alkhayyat
- College of Technical Engineering, The Islamic University, Najaf, Iraq
| | - Devendra Singh
- Department of Computer science & Engineering, Uttaranchal Institute of Technology, Uttaranchal University, Dehradun, India
| | - Durga Prasad Bavirisetti
- Department of Computer Science, Norwegian University of Science and Technology, Trondheim, Norway
| | - Vinay Kukreja
- Chitkara University Institute of Engineering and Technology, Chitkara University, Punjab, India
| |
Collapse
|
8
|
Dhingra S, Goyal S, Thirumal D, Sharma P, Kaur G, Mittal N. Mesoporous silica nanoparticles: a versatile carrier platform in lung cancer management. Nanomedicine (Lond) 2024; 19:1331-1346. [PMID: 39105754 PMCID: PMC11318747 DOI: 10.1080/17435889.2024.2348438] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2024] [Accepted: 04/24/2024] [Indexed: 08/07/2024] Open
Abstract
Mesoporous silica nanoparticles (MSNPs) are inorganic nanoparticles that have been comprehensively investigated and are intended to deliver therapeutic agents. MSNPs have revolutionized the therapy for various conditions, especially cancer and infectious diseases. In this article, the viability of MSNPs' administration for lung cancer therapy has been reviewed. However, certain challenges lay ahead in the successful translation such as toxicology, immunology, large-scale production, and regulatory matters have made it extremely difficult to translate such discoveries from the bench to the bedside. This review highlights recent developments, characteristics, mechanism of action and customization for targeted delivery. This review also covers the most recent data that sheds light on MSNPs' extraordinary therapeutic potential in fighting lung cancer as well as future hurdles.
Collapse
Affiliation(s)
- Smriti Dhingra
- Chitkara College of Pharmacy, Chitkara University, Punjab, 140401, India
| | - Shuchi Goyal
- Chitkara College of Pharmacy, Chitkara University, Punjab, 140401, India
| | - Divya Thirumal
- Manipal College of Pharmaceutical Sciences, Manipal Academy of Higher Education, Manipal, 576104,India
| | - Preety Sharma
- Chitkara College of Pharmacy, Chitkara University, Punjab, 140401, India
| | - Gurpreet Kaur
- Department of Pharmaceutical Sciences & Drug Research, Punjabi University, Patiala, Punjab, 147002, India
| | - Neeraj Mittal
- Chitkara College of Pharmacy, Chitkara University, Punjab, 140401, India
| |
Collapse
|
9
|
Krishnappa SG, Udaya Kumar Reddy KR. Enhancing Histopathology Breast Cancer Detection and Classification with the Deep Ensemble Graph Network. SN COMPUTER SCIENCE 2024; 5:487. [DOI: 10.1007/s42979-024-02855-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/04/2024] [Accepted: 04/01/2024] [Indexed: 01/03/2025]
|
10
|
Grignaffini F, Barbuto F, Troiano M, Piazzo L, Simeoni P, Mangini F, De Stefanis C, Onetti Muda A, Frezza F, Alisi A. The Use of Artificial Intelligence in the Liver Histopathology Field: A Systematic Review. Diagnostics (Basel) 2024; 14:388. [PMID: 38396427 PMCID: PMC10887838 DOI: 10.3390/diagnostics14040388] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Revised: 02/02/2024] [Accepted: 02/06/2024] [Indexed: 02/25/2024] Open
Abstract
Digital pathology (DP) has begun to play a key role in the evaluation of liver specimens. Recent studies have shown that a workflow that combines DP and artificial intelligence (AI) applied to histopathology has potential value in supporting the diagnosis, treatment evaluation, and prognosis prediction of liver diseases. Here, we provide a systematic review of the use of this workflow in the field of hepatology. Based on the PRISMA 2020 criteria, a search of the PubMed, SCOPUS, and Embase electronic databases was conducted, applying inclusion/exclusion filters. The articles were evaluated by two independent reviewers, who extracted the specifications and objectives of each study, the AI tools used, and the results obtained. From the 266 initial records identified, 25 eligible studies were selected, mainly conducted on human liver tissues. Most of the studies were performed using whole-slide imaging systems for imaging acquisition and applying different machine learning and deep learning methods for image pre-processing, segmentation, feature extractions, and classification. Of note, most of the studies selected demonstrated good performance as classifiers of liver histological images compared to pathologist annotations. Promising results to date bode well for the not-too-distant inclusion of these techniques in clinical practice.
Collapse
Affiliation(s)
- Flavia Grignaffini
- Department of Information Engineering, Electronics and Telecommunications (DIET), “La Sapienza”, University of Rome, 00184 Rome, Italy; (F.G.); (F.B.); (L.P.); (F.M.); (F.F.)
| | - Francesco Barbuto
- Department of Information Engineering, Electronics and Telecommunications (DIET), “La Sapienza”, University of Rome, 00184 Rome, Italy; (F.G.); (F.B.); (L.P.); (F.M.); (F.F.)
| | - Maurizio Troiano
- Research Unit of Genetics of Complex Phenotypes, Bambino Gesù Children’s Hospital, IRCCS, 00165 Rome, Italy; (M.T.); (C.D.S.)
| | - Lorenzo Piazzo
- Department of Information Engineering, Electronics and Telecommunications (DIET), “La Sapienza”, University of Rome, 00184 Rome, Italy; (F.G.); (F.B.); (L.P.); (F.M.); (F.F.)
| | - Patrizio Simeoni
- National Transport Authority (NTA), D02 WT20 Dublin, Ireland;
- Faculty of Lifelong Learning, South East Technological University (SETU), R93 V960 Carlow, Ireland
| | - Fabio Mangini
- Department of Information Engineering, Electronics and Telecommunications (DIET), “La Sapienza”, University of Rome, 00184 Rome, Italy; (F.G.); (F.B.); (L.P.); (F.M.); (F.F.)
| | - Cristiano De Stefanis
- Research Unit of Genetics of Complex Phenotypes, Bambino Gesù Children’s Hospital, IRCCS, 00165 Rome, Italy; (M.T.); (C.D.S.)
| | | | - Fabrizio Frezza
- Department of Information Engineering, Electronics and Telecommunications (DIET), “La Sapienza”, University of Rome, 00184 Rome, Italy; (F.G.); (F.B.); (L.P.); (F.M.); (F.F.)
| | - Anna Alisi
- Research Unit of Genetics of Complex Phenotypes, Bambino Gesù Children’s Hospital, IRCCS, 00165 Rome, Italy; (M.T.); (C.D.S.)
| |
Collapse
|
11
|
Swami R, Vij S, Sharma S. Unlocking the power of sugar: carbohydrate ligands as key players in nanotherapeutic-assisted targeted cancer therapy. Nanomedicine (Lond) 2024; 19:431-453. [PMID: 38288611 DOI: 10.2217/nnm-2023-0276] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/01/2024] Open
Abstract
Cancer cells need as much as 40-times more sugar than their normal cell counterparts. This sugar demand is attained by the excessive expression of inimitable transporters on the surface of cancer cells, driven by their voracious appetite for carbohydrates. Nanotechnological advances drive research utilizing ligand-directed therapeutics and diverse carbohydrate analogs. The precise delivery of these therapeutic cargos not only mitigates toxicity associated with chemotherapy but also reduces the grim toll of mortality and morbidity among patients. This in-depth review explores the potential of these ligands in advanced cancer treatment using nanoparticles. It offers a broader perspective beyond the usual ways we deliver drugs, potentially changing the way we fight cancer.
Collapse
Affiliation(s)
- Rajan Swami
- Chitkara College of Pharmacy, Chitkara University, Punjab, 140401, India
| | - Sahil Vij
- Maharishi Markandeshwar College of Pharmacy, Maharishi Markandeshwar University, Mullana, Haryana, 133203, India
| | - Shubham Sharma
- Maharishi Markandeshwar College of Pharmacy, Maharishi Markandeshwar University, Mullana, Haryana, 133203, India
| |
Collapse
|
12
|
Priya C V L, V G B, B R V, Ramachandran S. Deep learning approaches for breast cancer detection in histopathology images: A review. Cancer Biomark 2024; 40:1-25. [PMID: 38517775 PMCID: PMC11191493 DOI: 10.3233/cbm-230251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/24/2024]
Abstract
BACKGROUND Breast cancer is one of the leading causes of death in women worldwide. Histopathology analysis of breast tissue is an essential tool for diagnosing and staging breast cancer. In recent years, there has been a significant increase in research exploring the use of deep-learning approaches for breast cancer detection from histopathology images. OBJECTIVE To provide an overview of the current state-of-the-art technologies in automated breast cancer detection in histopathology images using deep learning techniques. METHODS This review focuses on the use of deep learning algorithms for the detection and classification of breast cancer from histopathology images. We provide an overview of publicly available histopathology image datasets for breast cancer detection. We also highlight the strengths and weaknesses of these architectures and their performance on different histopathology image datasets. Finally, we discuss the challenges associated with using deep learning techniques for breast cancer detection, including the need for large and diverse datasets and the interpretability of deep learning models. RESULTS Deep learning techniques have shown great promise in accurately detecting and classifying breast cancer from histopathology images. Although the accuracy levels vary depending on the specific data set, image pre-processing techniques, and deep learning architecture used, these results highlight the potential of deep learning algorithms in improving the accuracy and efficiency of breast cancer detection from histopathology images. CONCLUSION This review has presented a thorough account of the current state-of-the-art techniques for detecting breast cancer using histopathology images. The integration of machine learning and deep learning algorithms has demonstrated promising results in accurately identifying breast cancer from histopathology images. The insights gathered from this review can act as a valuable reference for researchers in this field who are developing diagnostic strategies using histopathology images. Overall, the objective of this review is to spark interest among scholars in this complex field and acquaint them with cutting-edge technologies in breast cancer detection using histopathology images.
Collapse
Affiliation(s)
- Lakshmi Priya C V
- Department of Electronics and Communication Engineering, College of Engineering Trivandrum, Kerala, India
| | - Biju V G
- Department of Electronics and Communication Engineering, College of Engineering Munnar, Kerala, India
| | - Vinod B R
- Department of Electronics and Communication Engineering, College of Engineering Trivandrum, Kerala, India
| | - Sivakumar Ramachandran
- Department of Electronics and Communication Engineering, Government Engineering College Wayanad, Kerala, India
| |
Collapse
|
13
|
Thapa K, Khan H, Kaur G, Kumar P, Singh TG. Therapeutic targeting of angiopoietins in tumor angiogenesis and cancer development. Biochem Biophys Res Commun 2023; 687:149130. [PMID: 37944468 DOI: 10.1016/j.bbrc.2023.149130] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2023] [Revised: 10/12/2023] [Accepted: 10/17/2023] [Indexed: 11/12/2023]
Abstract
The formation and progression of tumors in humans are linked to the abnormal development of new blood vessels known as neo-angiogenesis. Angiogenesis is a broad word that encompasses endothelial cell migration, proliferation, tube formation, and intussusception, as well as peri-EC recruitment and extracellular matrix formation. Tumor angiogenesis is regulated by angiogenic factors, out of which some of the most potent angiogenic factors such as vascular endothelial growth factor and Angiopoietins (ANGs) in the body are produced by macrophages and other immune cells within the tumor microenvironment. ANGs have a distinct function in tumor angiogenesis and behavior. ANG1, ANG 2, ANG 3, and ANG 4 are the family members of ANG out of which ANG2 has been extensively investigated owing to its unique role in modifying angiogenesis and its tight association with tumor progression, growth, and invasion/metastasis, which makes it an excellent candidate for therapeutic intervention in human malignancies. ANG modulators have demonstrated encouraging outcomes in the treatment of tumor development, either alone or in conjunction with VEGF inhibitors. Future development of more ANG modulators targeting other ANGs is needed. The implication of ANG1, ANG3, and ANG4 as probable therapeutic targets for anti-angiogenesis treatment in tumor development should be also evaluated. The article has described the role of ANG in tumor angiogenesis as well as tumor growth and the treatment strategies modulating ANGs in tumor angiogenesis as demonstrated in clinical studies. The pharmacological modulation of ANGs and ANG-regulated pathways that are responsible for tumor angiogenesis and cancer development should be evaluated for the development of future molecular therapies.
Collapse
Affiliation(s)
- Komal Thapa
- Chitkara School of Pharmacy, Chitkara University, 174103, Himachal Pradesh, India
| | - Heena Khan
- Chitkara College of Pharmacy, Chitkara University, 140401, Punjab, India
| | - Gagandeep Kaur
- Chitkara School of Pharmacy, Chitkara University, 174103, Himachal Pradesh, India
| | - Puneet Kumar
- Department of Pharmacology, Central University of Punjab, Ghudda, 151401, Bathinda, India
| | | |
Collapse
|
14
|
Wang Q, Jia X, Luo T, Yu J, Xia S. Deep learning algorithm using bispectrum analysis energy feature maps based on ultrasound radiofrequency signals to detect breast cancer. Front Oncol 2023; 13:1272427. [PMID: 38179175 PMCID: PMC10766103 DOI: 10.3389/fonc.2023.1272427] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2023] [Accepted: 11/15/2023] [Indexed: 01/06/2024] Open
Abstract
Background Ultrasonography is an important imaging method for clinical breast cancer screening. As the original echo signals of ultrasonography, ultrasound radiofrequency (RF) signals provide abundant tissue macroscopic and microscopic information and have important development and utilization value in breast cancer detection. Methods In this study, we proposed a deep learning method based on bispectrum analysis feature maps to process RF signals and realize breast cancer detection. The bispectrum analysis energy feature maps with frequency subdivision were first proposed and applied to breast cancer detection in this study. Our deep learning network was based on a weight sharing network framework for the input of multiple feature maps. A feature map attention module was designed for multiple feature maps input of the network to adaptively learn both feature maps and features that were conducive to classification. We also designed a similarity constraint factor, learning the similarity and difference between feature maps by cosine distance. Results The experiment results showed that the areas under the receiver operating characteristic curves of our proposed method in the validation set and two independent test sets for benign and malignant breast tumor classification were 0.913, 0.900, and 0.885, respectively. The performance of the model combining four ultrasound bispectrum analysis energy feature maps in breast cancer detection was superior to that of the model using an ultrasound grayscale image and the model using a single bispectrum analysis energy feature map in this study. Conclusion The combination of deep learning technology and our proposed ultrasound bispectrum analysis energy feature maps effectively realized breast cancer detection and was an efficient method of feature extraction and utilization of ultrasound RF signals.
Collapse
Affiliation(s)
- Qingmin Wang
- School of Information Science and Engineering, Fudan University, Shanghai, China
| | - Xiaohong Jia
- Ruijin Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| | - Ting Luo
- Ruijin Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| | - Jinhua Yu
- School of Information Science and Engineering, Fudan University, Shanghai, China
| | - Shujun Xia
- Ruijin Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
15
|
Katal N, Gupta S, Verma P, Sharma B. Deep-Learning-Based Arrhythmia Detection Using ECG Signals: A Comparative Study and Performance Evaluation. Diagnostics (Basel) 2023; 13:3605. [PMID: 38132188 PMCID: PMC10742760 DOI: 10.3390/diagnostics13243605] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 10/24/2023] [Accepted: 10/27/2023] [Indexed: 12/23/2023] Open
Abstract
Heart diseases is the world's principal cause of death, and arrhythmia poses a serious risk to the health of the patient. Electrocardiogram (ECG) signals can be used to detect arrhythmia early and accurately, which is essential for immediate treatment and intervention. Deep learning approaches have played an important role in automatically identifying complicated patterns from ECG data, which can be further used to identify arrhythmia. In this paper, deep-learning-based methods for arrhythmia identification using ECG signals are thoroughly studied and their performances evaluated on the basis of accuracy, specificity, precision, and F1 score. We propose the development of a small CNN, and its performance is compared against pretrained models like GoogLeNet. The comparative study demonstrates the promising potential of deep-learning-based arrhythmia identification using ECG signals.
Collapse
Affiliation(s)
- Nitish Katal
- School of Electronics Engineering, Vellore Institute of Technology, Chennai 600127, Tamil Nadu, India;
| | - Saurav Gupta
- School of Electronics Engineering, Vellore Institute of Technology, Chennai 600127, Tamil Nadu, India;
| | - Pankaj Verma
- University Centre for Research and Development, Academic Unit 2, Chandigarh University, Mohali 140413, Punjab, India;
| | - Bhisham Sharma
- Chitkara University Institute of Engineering and Technology, Chitkara University, Rajpura 140401, Punjab, India
| |
Collapse
|
16
|
Labrada A, Barkana BD. A Comprehensive Review of Computer-Aided Models for Breast Cancer Diagnosis Using Histopathology Images. Bioengineering (Basel) 2023; 10:1289. [PMID: 38002413 PMCID: PMC10669627 DOI: 10.3390/bioengineering10111289] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2023] [Revised: 10/20/2023] [Accepted: 10/25/2023] [Indexed: 11/26/2023] Open
Abstract
Breast cancer is the second most common cancer in women who are mainly middle-aged and older. The American Cancer Society reported that the average risk of developing breast cancer sometime in their life is about 13%, and this incident rate has increased by 0.5% per year in recent years. A biopsy is done when screening tests and imaging results show suspicious breast changes. Advancements in computer-aided system capabilities and performance have fueled research using histopathology images in cancer diagnosis. Advances in machine learning and deep neural networks have tremendously increased the number of studies developing computerized detection and classification models. The dataset-dependent nature and trial-and-error approach of the deep networks' performance produced varying results in the literature. This work comprehensively reviews the studies published between 2010 and 2022 regarding commonly used public-domain datasets and methodologies used in preprocessing, segmentation, feature engineering, machine-learning approaches, classifiers, and performance metrics.
Collapse
Affiliation(s)
- Alberto Labrada
- Department of Electrical Engineering, The University of Bridgeport, Bridgeport, CT 06604, USA;
| | - Buket D. Barkana
- Department of Biomedical Engineering, The University of Akron, Akron, OH 44325, USA
| |
Collapse
|
17
|
Hung SC, Wang YT, Tseng MH. An Interpretable Three-Dimensional Artificial Intelligence Model for Computer-Aided Diagnosis of Lung Nodules in Computed Tomography Images. Cancers (Basel) 2023; 15:4655. [PMID: 37760624 PMCID: PMC10526230 DOI: 10.3390/cancers15184655] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Revised: 09/16/2023] [Accepted: 09/17/2023] [Indexed: 09/29/2023] Open
Abstract
Lung cancer is typically classified into small-cell carcinoma and non-small-cell carcinoma. Non-small-cell carcinoma accounts for approximately 85% of all lung cancers. Low-dose chest computed tomography (CT) can quickly and non-invasively diagnose lung cancer. In the era of deep learning, an artificial intelligence (AI) computer-aided diagnosis system can be developed for the automatic recognition of CT images of patients, creating a new form of intelligent medical service. For many years, lung cancer has been the leading cause of cancer-related deaths in Taiwan, with smoking and air pollution increasing the likelihood of developing the disease. The incidence of lung adenocarcinoma in never-smoking women has also increased significantly in recent years, resulting in an important public health problem. Early detection of lung cancer and prompt treatment can help reduce the mortality rate of patients with lung cancer. In this study, an improved 3D interpretable hierarchical semantic convolutional neural network named HSNet was developed and validated for the automatic diagnosis of lung cancer based on a collection of lung nodule images. The interpretable AI model proposed in this study, with different training strategies and adjustment of model parameters, such as cyclic learning rate and random weight averaging, demonstrated better diagnostic performance than the previous literature, with results of a four-fold cross-validation procedure showing calcification: 0.9873 ± 0.006, margin: 0.9207 ± 0.009, subtlety: 0.9026 ± 0.014, texture: 0.9685 ± 0.006, sphericity: 0.8652 ± 0.021, and malignancy: 0.9685 ± 0.006.
Collapse
Affiliation(s)
- Sheng-Chieh Hung
- Master Program in Medical Informatics, Chung Shan Medical University, Taichung 402, Taiwan;
| | - Yao-Tung Wang
- School of Medicine, Chung Shan Medical University, Taichung 402, Taiwan;
- Division of Pulmonary Medicine, Department of Internal Medicine, Chung Shan Medical University Hospital, Taichung 402, Taiwan
| | - Ming-Hseng Tseng
- Master Program in Medical Informatics, Chung Shan Medical University, Taichung 402, Taiwan;
- Department of Medical Informatics, Chung Shan Medical University, Taichung 402, Taiwan
- Information Technology Office, Chung Shan Medical University Hospital, Taichung 402, Taiwan
| |
Collapse
|
18
|
Drioua WR, Benamrane N, Sais L. Breast Cancer Histopathological Images Segmentation Using Deep Learning. SENSORS (BASEL, SWITZERLAND) 2023; 23:7318. [PMID: 37687772 PMCID: PMC10490494 DOI: 10.3390/s23177318] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 08/10/2023] [Accepted: 08/18/2023] [Indexed: 09/10/2023]
Abstract
Hospitals generate a significant amount of medical data every day, which constitute a very rich database for research. Today, this database is still not exploitable because to make its valorization possible, the images require an annotation which remains a costly and difficult task. Thus, the use of an unsupervised segmentation method could facilitate the process. In this article, we propose two approaches for the semantic segmentation of breast cancer histopathology images. On the one hand, an autoencoder architecture for unsupervised segmentation is proposed, and on the other hand, an improvement U-Net architecture for supervised segmentation is proposed. We evaluate these models on a public dataset of histological images of breast cancer. In addition, the performance of our segmentation methods is measured using several evaluation metrics such as accuracy, recall, precision and F1 score. The results are competitive with those of other modern methods.
Collapse
Affiliation(s)
- Wafaa Rajaa Drioua
- Laboratoire SIMPA, Département d’Informatique, Université des Sciences et de la Technologie d’Oran Mohamed Boudiaf (USTO-MB), Oran 31000, Algeria;
| | - Nacéra Benamrane
- Laboratoire SIMPA, Département d’Informatique, Université des Sciences et de la Technologie d’Oran Mohamed Boudiaf (USTO-MB), Oran 31000, Algeria;
| | - Lakhdar Sais
- Centre de Recherche en Informatique de Lens, CRIL, CNRS, Université d’Artois, 62307 Lens, France;
| |
Collapse
|
19
|
Khazaee Fadafen M, Rezaee K. Ensemble-based multi-tissue classification approach of colorectal cancer histology images using a novel hybrid deep learning framework. Sci Rep 2023; 13:8823. [PMID: 37258631 DOI: 10.1038/s41598-023-35431-x] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Accepted: 05/17/2023] [Indexed: 06/02/2023] Open
Abstract
Colorectal cancer (CRC) is the second leading cause of cancer death in the world, so digital pathology is essential for assessing prognosis. Due to the increasing resolution and quantity of whole slide images (WSIs), as well as the lack of annotated information, previous methodologies cannot be generalized as effective decision-making systems. Since deep learning (DL) methods can handle large-scale applications, they can provide a viable alternative to histopathology image (HI) analysis. DL architectures, however, may not be sufficient to classify CRC tissues based on anatomical histopathology data. A dilated ResNet (dResNet) structure and attention module are used to generate deep feature maps in order to classify multiple tissues in HIs. In addition, neighborhood component analysis (NCA) overcomes the constraint of computational complexity. Data is fed into a deep support vector machine (SVM) based on an ensemble learning algorithm called DeepSVM after the features have been selected. CRC-5000 and NCT-CRC-HE-100 K datasets were analyzed to validate and test the hybrid procedure. We demonstrate that the hybrid model achieves 98.75% and 99.76% accuracy on CRC datasets. The results showed that only pathologists' labels could successfully classify unseen WSIs. Furthermore, the hybrid deep learning method outperforms state-of-the-art approaches in terms of computational efficiency and time. Using the proposed mechanism for tissue analysis, it will be possible to correctly predict CRC based on accurate pathology image classification.
Collapse
Affiliation(s)
- Masoud Khazaee Fadafen
- Department of Electrical Engineering, Technical and Vocational University (TVU), Tehran, Iran
| | - Khosro Rezaee
- Department of Biomedical Engineering, Meybod University, Meybod, Iran.
| |
Collapse
|
20
|
Chaudhury S, Sau K. A BERT encoding with Recurrent Neural Network and Long-Short Term Memory for breast cancer image classification. DECISION ANALYTICS JOURNAL 2023; 6:100177. [DOI: 10.1016/j.dajour.2023.100177] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/19/2023]
|
21
|
A Framework for Interactive Medical Image Segmentation Using Optimized Swarm Intelligence with Convolutional Neural Networks. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:7935346. [PMID: 36059415 PMCID: PMC9433214 DOI: 10.1155/2022/7935346] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 07/09/2022] [Accepted: 07/27/2022] [Indexed: 11/23/2022]
Abstract
Recent improvements in current technology have had a significant impact on a wide range of image processing applications, including medical imaging. Classification, detection, and segmentation are all important aspects of medical imaging technology. An enormous need exists for the segmentation of diagnostic images, which can be applied to a wide variety of medical research applications. It is important to develop an effective segmentation technique based on deep learning algorithms for optimal identification of regions of interest and rapid segmentation. To cover this gap, a pipeline for image segmentation using traditional Convolutional Neural Network (CNN) as well as introduced Swarm Intelligence (SI) for optimal identification of the desired area has been proposed. Fuzzy C-means (FCM), K-means, and improvisation of FCM with Particle Swarm Optimization (PSO), improvisation of K-means with PSO, improvisation of FCM with CNN, and improvisation of K-means with CNN are the six modules examined and evaluated. Experiments are carried out on various types of images such as Magnetic Resonance Imaging (MRI) for brain data analysis, dermoscopic for skin, microscopic for blood leukemia, and computed tomography (CT) scan images for lungs. After combining all of the datasets, we have constructed five subsets of data, each of which had a different number of images: 50, 100, 500, 1000, and 2000. Each of the models was executed and trained on the selected subset of the datasets. From the experimental analysis, it is observed that the performance of K-means with CNN is better than others and achieved 96.45% segmentation accuracy with an average time of 9.09 seconds.
Collapse
|
22
|
Brindha V, Jayashree P, Karthik P, Manikandan P. Tumor grading model employing geometric analysis of histopathological images with characteristic nuclei dictionary. Comput Biol Med 2022; 149:106008. [PMID: 36030720 DOI: 10.1016/j.compbiomed.2022.106008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2022] [Revised: 08/10/2022] [Accepted: 08/14/2022] [Indexed: 11/03/2022]
Abstract
Histopathological study has been shown to improve diagnosis of various disease classifications effectively as any disease condition is correlated to characteristic set of changes in the tissue structure. This study aims at developing an automated neural network system for grading brain tumors (Glioblastoma Multiforme) from histopathological images within the Whole Slide Images (WSI) of hematoxylin and eosin (H&E) stains with significant accuracy. Hematoxylin channels are extracted from the histopathological image patches using color de-convolution. Cell nuclei are precisely segmented using three level Otsu thresholding. From each segmented image, nuclei boundaries are extracted to extract nucleus level features based on their shape and size. Geometric features including ellipse eccentricities, nucleus perimeter, area, and polygon edge counts are extracted using geometric algorithms to define the nuclei boundaries of the segmented image. These features are collected for a large number of nuclei and the nuclei are clustered using the K-Means algorithm in order to create a dictionary. One of the major contributions involves the creation of dictionary of a fixed number of representative cell nuclei to speed up patch level classification. This optimal dictionary is used for clustering extracted cell nuclei and a fixed length histogram of counts on different types of nuclei is obtained. The proposed system has been tested with a total of 239600 TCGA patches of GBM and 206000 patches of LGG collected from GDC data portal and it showed good diagnosis performance with auto-classification accuracy of 97.2% compared to other state-of-art methods. Our results on segmentation and classification are encouraging, with better attainment with regard to precision and accuracy in contrast with previous models. The auto grading proposed system will act as a potential guide for pathologists to make more accurate decisions.
Collapse
Affiliation(s)
- V Brindha
- Department of Computer Technology, Anna University - MIT Campus, Chennai, India.
| | - P Jayashree
- Department of Computer Technology, Anna University - MIT Campus, Chennai, India
| | - P Karthik
- Department of Computer Technology, Anna University - MIT Campus, Chennai, India
| | - P Manikandan
- Department of Neurosurgery, Mahatma Gandhi Medical College and Research Institute, Pondicherry, India
| |
Collapse
|
23
|
Wang W, Jiang R, Cui N, Li Q, Yuan F, Xiao Z. Semi-supervised vision transformer with adaptive token sampling for breast cancer classification. Front Pharmacol 2022; 13:929755. [PMID: 35935827 PMCID: PMC9353650 DOI: 10.3389/fphar.2022.929755] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Accepted: 06/29/2022] [Indexed: 12/24/2022] Open
Abstract
Various imaging techniques combined with machine learning (ML) models have been used to build computer-aided diagnosis (CAD) systems for breast cancer (BC) detection and classification. The rise of deep learning models in recent years, represented by convolutional neural network (CNN) models, has pushed the accuracy of ML-based CAD systems to a new level that is comparable to human experts. Existing studies have explored the usage of a wide spectrum of CNN models for BC detection, and supervised learning has been the mainstream. In this study, we propose a semi-supervised learning framework based on the Vision Transformer (ViT). The ViT is a model that has been validated to outperform CNN models on numerous classification benchmarks but its application in BC detection has been rare. The proposed method offers a custom semi-supervised learning procedure that unifies both supervised and consistency training to enhance the robustness of the model. In addition, the method uses an adaptive token sampling technique that can strategically sample the most significant tokens from the input image, leading to an effective performance gain. We validate our method on two datasets with ultrasound and histopathology images. Results demonstrate that our method can consistently outperform the CNN baselines for both learning tasks. The code repository of the project is available at https://github.com/FeiYee/Breast-area-TWO.
Collapse
Affiliation(s)
- Wei Wang
- Department of Breast Surgery, Hubei Provincial Clinical Research Center for Breast Cancer, Hubei Cancer Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, China
| | - Ran Jiang
- Department of Thyroid and Breast Surgery, Maternal and Child Health Hospital of Hubei Province, Wuhan, Hubei, China
| | - Ning Cui
- Department of Ultrasound, Hubei Cancer Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, China
| | - Qian Li
- Department of Ultrasound, Hubei Cancer Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, China
| | - Feng Yuan
- Department of Breast Surgery, Hubei Provincial Clinical Research Center for Breast Cancer, Hubei Cancer Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, China
| | - Zhifeng Xiao
- School of Engineering,Penn State Erie, The Behrend College, Erie, PA, United States
| |
Collapse
|
24
|
Liu X, Yuan P, Li R, Zhang D, An J, Ju J, Liu C, Ren F, Hou R, Li Y, Yang J. Predicting breast cancer recurrence and metastasis risk by integrating color and texture features of histopathological images and machine learning technologies. Comput Biol Med 2022; 146:105569. [DOI: 10.1016/j.compbiomed.2022.105569] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Revised: 04/24/2022] [Accepted: 04/25/2022] [Indexed: 12/11/2022]
|
25
|
Rojas F, Hernandez S, Lazcano R, Laberiano-Fernandez C, Parra ER. Multiplex Immunofluorescence and the Digital Image Analysis Workflow for Evaluation of the Tumor Immune Environment in Translational Research. Front Oncol 2022; 12:889886. [PMID: 35832550 PMCID: PMC9271766 DOI: 10.3389/fonc.2022.889886] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Accepted: 05/27/2022] [Indexed: 11/13/2022] Open
Abstract
A robust understanding of the tumor immune environment has important implications for cancer diagnosis, prognosis, research, and immunotherapy. Traditionally, immunohistochemistry (IHC) has been regarded as the standard method for detecting proteins in situ, but this technique allows for the evaluation of only one cell marker per tissue sample at a time. However, multiplexed imaging technologies enable the multiparametric analysis of a tissue section at the same time. Also, through the curation of specific antibody panels, these technologies enable researchers to study the cell subpopulations within a single immunological cell group. Thus, multiplexed imaging gives investigators the opportunity to better understand tumor cells, immune cells, and the interactions between them. In the multiplexed imaging technology workflow, once the protocol for a tumor immune micro environment study has been defined, histological slides are digitized to produce high-resolution images in which regions of interest are selected for the interrogation of simultaneously expressed immunomarkers (including those co-expressed by the same cell) by using an image analysis software and algorithm. Most currently available image analysis software packages use similar machine learning approaches in which tissue segmentation first defines the different components that make up the regions of interest and cell segmentation, then defines the different parameters, such as the nucleus and cytoplasm, that the software must utilize to segment single cells. Image analysis tools have driven dramatic evolution in the field of digital pathology over the past several decades and provided the data necessary for translational research and the discovery of new therapeutic targets. The next step in the growth of digital pathology is optimization and standardization of the different tasks in cancer research, including image analysis algorithm creation, to increase the amount of data generated and their accuracy in a short time as described herein. The aim of this review is to describe this process, including an image analysis algorithm creation for multiplex immunofluorescence analysis, as an essential part of the optimization and standardization of the different processes in cancer research, to increase the amount of data generated and their accuracy in a short time.
Collapse
|
26
|
AlEisa HN, Touiti W, Ali ALHussan A, Ben Aoun N, Ejbali R, Zaied M, Saadia A. Breast Cancer Classification Using FCN and Beta Wavelet Autoencoder. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:8044887. [PMID: 35785059 PMCID: PMC9246636 DOI: 10.1155/2022/8044887] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/12/2022] [Accepted: 06/04/2022] [Indexed: 11/17/2022]
Abstract
In this paper, a new classification approach of breast cancer based on Fully Convolutional Networks (FCNs) and Beta Wavelet Autoencoder (BWAE) is presented. FCN, as a powerful image segmentation model, is used to extract the relevant information from mammography images. It will identify the relevant zones to model while WAE is used to model the extracted information for these zones. In fact, WAE has proven its superiority to the majority of the features extraction approaches. The fusion of these two techniques have improved the feature extraction phase and this by keeping and modeling only the relevant and useful features for the identification and description of breast masses. The experimental results showed the effectiveness of our proposed method which has given very encouraging results in comparison with the states of the art approaches on the same mammographic image base. A precision rate of 94% for benign and 93% for malignant was achieved with a recall rate of 92% for benign and 95% for malignant. For the normal case, we were able to reach a rate of 100%.
Collapse
Affiliation(s)
- Hussah Nasser AlEisa
- Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
| | - Wajdi Touiti
- Research Team in Intelligent Machines, National School of Engineers of Gabes, B. P. W 6072, Gabes, Tunisia
| | - Amel Ali ALHussan
- Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
| | - Najib Ben Aoun
- College of Computer Science and Information Technology, Al Baha University, Al Baha, Saudi Arabia
- REGIM-Lab, Research Groups in Intelligent Machines, National School of Engineers of Sfax (ENIS), University of Sfax, Sfax, Tunisia
| | - Ridha Ejbali
- Research Team in Intelligent Machines, National School of Engineers of Gabes, B. P. W 6072, Gabes, Tunisia
| | - Mourad Zaied
- Research Team in Intelligent Machines, National School of Engineers of Gabes, B. P. W 6072, Gabes, Tunisia
| | - Ayesha Saadia
- Department of Computer Science, Faculty of Computing and Artificial Intelligence, Air University, PAF Complex, Islamabad, Pakistan
| |
Collapse
|
27
|
Shankar K, Dutta AK, Kumar S, Joshi GP, Doo IC. Chaotic Sparrow Search Algorithm with Deep Transfer Learning Enabled Breast Cancer Classification on Histopathological Images. Cancers (Basel) 2022; 14:cancers14112770. [PMID: 35681749 PMCID: PMC9179470 DOI: 10.3390/cancers14112770] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2022] [Revised: 05/30/2022] [Accepted: 05/30/2022] [Indexed: 11/16/2022] Open
Abstract
Simple Summary Cancer is considered the most significant public health issue which severely threatens people’s health. The occurrence and mortality rate of breast cancer have been growing consistently. Initial precise diagnostics act as primary factors in improving the endurance rate of patients. Even though there are several means to identify breast cancer, histopathological diagnosis is now considered the gold standard in the diagnosis of cancer. However, the difficulty of histopathological image and the rapid rise in workload render this process time-consuming, and the outcomes might be subjected to pathologists’ subjectivity. Hence, the development of a precise and automatic histopathological image analysis method is essential for the field. Recently, the deep learning method for breast cancer pathological image classification has made significant progress, which has become mainstream in this field. Therefore, in this work, we focused on the design of metaheuristics with deep learning based breast cancer classification process. The proposed model is found to be an effective tool to assist physicians in the decision making process. Abstract Breast cancer is the major cause behind the death of women worldwide and is responsible for several deaths each year. Even though there are several means to identify breast cancer, histopathological diagnosis is now considered the gold standard in the diagnosis of cancer. However, the difficulty of histopathological image and the rapid rise in workload render this process time-consuming, and the outcomes might be subjected to pathologists’ subjectivity. Hence, the development of a precise and automatic histopathological image analysis method is essential for the field. Recently, the deep learning method for breast cancer pathological image classification has made significant progress, which has become mainstream in this field. This study introduces a novel chaotic sparrow search algorithm with a deep transfer learning-enabled breast cancer classification (CSSADTL-BCC) model on histopathological images. The presented CSSADTL-BCC model mainly focused on the recognition and classification of breast cancer. To accomplish this, the CSSADTL-BCC model primarily applies the Gaussian filtering (GF) approach to eradicate the occurrence of noise. In addition, a MixNet-based feature extraction model is employed to generate a useful set of feature vectors. Moreover, a stacked gated recurrent unit (SGRU) classification approach is exploited to allot class labels. Furthermore, CSSA is applied to optimally modify the hyperparameters involved in the SGRU model. None of the earlier works have utilized the hyperparameter-tuned SGRU model for breast cancer classification on HIs. The design of the CSSA for optimal hyperparameter tuning of the SGRU model demonstrates the novelty of the work. The performance validation of the CSSADTL-BCC model is tested by a benchmark dataset, and the results reported the superior execution of the CSSADTL-BCC model over recent state-of-the-art approaches.
Collapse
Affiliation(s)
- K. Shankar
- Big Data and Machine Learning Laboratory, South Ural State University, 454080 Chelyabinsk, Russia; (K.S.); (S.K.)
| | - Ashit Kumar Dutta
- Department of Computer Science and Information System, College of Applied Sciences, AlMaarefa University, Riyadh 11597, Saudi Arabia;
| | - Sachin Kumar
- Big Data and Machine Learning Laboratory, South Ural State University, 454080 Chelyabinsk, Russia; (K.S.); (S.K.)
| | - Gyanendra Prasad Joshi
- Department of Computer Science and Engineering, Sejong University, Seoul 05006, Korea
- Correspondence: (G.P.J.); (I.C.D.)
| | - Ill Chul Doo
- Artificial Intelligence Education, Hankuk University of Foreign Studies, Dongdaemun-gu, Seoul 02450, Korea
- Correspondence: (G.P.J.); (I.C.D.)
| |
Collapse
|
28
|
Manouchehri N, Bouguila N. A nonparametric Bayesian learning model using accelerated variational inference on multivariate Beta mixture models for medical applications. INTERNATIONAL JOURNAL OF SEMANTIC COMPUTING 2022. [DOI: 10.1142/s1793351x22500039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
29
|
Hu H, Qiao S, Hao Y, Bai Y, Cheng R, Zhang W, Zhang G. Breast cancer histopathological images recognition based on two-stage nuclei segmentation strategy. PLoS One 2022; 17:e0266973. [PMID: 35482728 PMCID: PMC9049370 DOI: 10.1371/journal.pone.0266973] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2021] [Accepted: 03/30/2022] [Indexed: 11/19/2022] Open
Abstract
Pathological examination is the gold standard for breast cancer diagnosis. The recognition of histopathological images of breast cancer has attracted a lot of attention in the field of medical image processing. In this paper, on the base of the Bioimaging 2015 dataset, a two-stage nuclei segmentation strategy, that is, a method of watershed segmentation based on histopathological images after stain separation, is proposed to make the dataset recognized to be the carcinoma and non-carcinoma recognition. Firstly, stain separation is performed on breast cancer histopathological images. Then the marker-based watershed segmentation method is used for images obtained from stain separation to achieve the nuclei segmentation target. Next, the completed local binary pattern is used to extract texture features from the nuclei regions (images after nuclei segmentation), and color features were extracted by using the color auto-correlation method on the stain-separated images. Finally, the two kinds of features were fused and the support vector machine was used for carcinoma and non-carcinoma recognition. The experimental results show that the two-stage nuclei segmentation strategy proposed in this paper has significant advantages in the recognition of carcinoma and non-carcinoma on breast cancer histopathological images, and the recognition accuracy arrives at 91.67%. The proposed method is also applied to the ICIAR 2018 dataset to realize the automatic recognition of carcinoma and non-carcinoma, and the recognition accuracy arrives at 92.50%.
Collapse
Affiliation(s)
- Hongping Hu
- School of Science, North University of China, Taiyuan, China
| | - Shichang Qiao
- School of Science, North University of China, Taiyuan, China
| | - Yan Hao
- School of Information and Communication Engineering, North University of China, Taiyuan, China
| | - Yanping Bai
- School of Science, North University of China, Taiyuan, China
| | - Rong Cheng
- School of Science, North University of China, Taiyuan, China
| | - Wendong Zhang
- School of Instrument and Electronics, State Key Laboratory of Dynamic Testing Technology, North University of China, Taiyuan, China
| | - Guojun Zhang
- School of Instrument and Electronics, State Key Laboratory of Dynamic Testing Technology, North University of China, Taiyuan, China
| |
Collapse
|
30
|
Connecting Patients with Pre-diagnosis: A Multiple Graph Regularized Method for Mental Disorder Diagnosis. ARTIF INTELL 2022. [DOI: 10.1007/978-3-031-20500-2_30] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
|
31
|
Deep Learning in Cancer Diagnosis and Prognosis Prediction: A Minireview on Challenges, Recent Trends, and Future Directions. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2021; 2021:9025470. [PMID: 34754327 PMCID: PMC8572604 DOI: 10.1155/2021/9025470] [Citation(s) in RCA: 45] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Revised: 09/30/2021] [Accepted: 10/05/2021] [Indexed: 12/30/2022]
Abstract
Deep learning (DL) is a branch of machine learning and artificial intelligence that has been applied to many areas in different domains such as health care and drug design. Cancer prognosis estimates the ultimate fate of a cancer subject and provides survival estimation of the subjects. An accurate and timely diagnostic and prognostic decision will greatly benefit cancer subjects. DL has emerged as a technology of choice due to the availability of high computational resources. The main components in a standard computer-aided design (CAD) system are preprocessing, feature recognition, extraction and selection, categorization, and performance assessment. Reduction of costs associated with sequencing systems offers a myriad of opportunities for building precise models for cancer diagnosis and prognosis prediction. In this survey, we provided a summary of current works where DL has helped to determine the best models for the cancer diagnosis and prognosis prediction tasks. DL is a generic model requiring minimal data manipulations and achieves better results while working with enormous volumes of data. Aims are to scrutinize the influence of DL systems using histopathology images, present a summary of state-of-the-art DL methods, and give directions to future researchers to refine the existing methods.
Collapse
|
32
|
Classification of breast cancer types, sub-types and grade from histopathological images using deep learning technique. HEALTH AND TECHNOLOGY 2021. [DOI: 10.1007/s12553-021-00592-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
|
33
|
Liew XY, Hameed N, Clos J. A Review of Computer-Aided Expert Systems for Breast Cancer Diagnosis. Cancers (Basel) 2021; 13:2764. [PMID: 34199444 PMCID: PMC8199592 DOI: 10.3390/cancers13112764] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2021] [Revised: 05/25/2021] [Accepted: 05/28/2021] [Indexed: 11/18/2022] Open
Abstract
A computer-aided diagnosis (CAD) expert system is a powerful tool to efficiently assist a pathologist in achieving an early diagnosis of breast cancer. This process identifies the presence of cancer in breast tissue samples and the distinct type of cancer stages. In a standard CAD system, the main process involves image pre-processing, segmentation, feature extraction, feature selection, classification, and performance evaluation. In this review paper, we reviewed the existing state-of-the-art machine learning approaches applied at each stage involving conventional methods and deep learning methods, the comparisons within methods, and we provide technical details with advantages and disadvantages. The aims are to investigate the impact of CAD systems using histopathology images, investigate deep learning methods that outperform conventional methods, and provide a summary for future researchers to analyse and improve the existing techniques used. Lastly, we will discuss the research gaps of existing machine learning approaches for implementation and propose future direction guidelines for upcoming researchers.
Collapse
Affiliation(s)
- Xin Yu Liew
- Jubilee Campus, University of Nottingham, Wollaton Road, Nottingham NG8 1BB, UK; (N.H.); (J.C.)
| | | | | |
Collapse
|
34
|
Kaushal C, Singla A. Automated segmentation technique with self‐driven post‐processing for histopathological breast cancer images. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY 2020. [DOI: 10.1049/trit.2019.0077] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022] Open
Affiliation(s)
- Chetna Kaushal
- Chitkara University Institute of Engineering and TechnologyChitkara UniversityPunjabIndia
| | - Anshu Singla
- Chitkara University Institute of Engineering and TechnologyChitkara UniversityPunjabIndia
| |
Collapse
|