1
|
Alom MR, Farid FA, Rahaman MA, Rahman A, Debnath T, Miah ASM, Mansor S. An explainable AI-driven deep neural network for accurate breast cancer detection from histopathological and ultrasound images. Sci Rep 2025; 15:17531. [PMID: 40394112 PMCID: PMC12092800 DOI: 10.1038/s41598-025-97718-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2024] [Accepted: 04/07/2025] [Indexed: 05/22/2025] Open
Abstract
Breast cancer represents a significant global health challenge, which makes it essential to detect breast cancer early and accurately to improve patient prognosis and reduce mortality rates. However, traditional diagnostic processes relying on manual analysis of medical images are inherently complex and subject to variability between observers, highlighting the urgent need for robust automated breast cancer detection systems. While deep learning has demonstrated potential, many current models struggle with limited accuracy and lack of interpretability. This research introduces the Deep Neural Breast Cancer Detection (DNBCD) model, an explainable AI-based framework that utilizes deep learning methods for classifying breast cancer using histopathological and ultrasound images. The proposed model employs Densenet121 as a foundation, integrating customized Convolutional Neural Network (CNN) layers including GlobalAveragePooling2D, Dense, and Dropout layers along with transfer learning to achieve both high accuracy and interpretability for breast cancer diagnosis. The proposed DNBCD model integrates several preprocessing techniques, including image normalization and resizing, and augmentation techniques to enhance the model's robustness and address class imbalances using class weight. It employs Grad-CAM (Gradient-weighted Class Activation Mapping) to offer visual justifications for its predictions, increasing trust and transparency among healthcare providers. The model was assessed using two benchmark datasets: Breakhis-400x (B-400x) and Breast Ultrasound Images Dataset (BUSI) containing 1820 and 1578 images, respectively. We systematically divided the datasets into training (70%), testing (20%,) and validation (10%) sets, ensuring efficient model training and evaluation obtaining accuracies of 93.97% for B-400x dataset having benign and malignant classes and 89.87% for BUSI dataset having benign, malignant, and normal classes for breast cancer detection. Experimental results demonstrate that the proposed DNBCD model significantly outperforms existing state-of-the-art approaches with potential uses in clinical environments. We also made all the materials publicly accessible for the research community at: https://github.com/romzanalom/XAI-Based-Deep-Neural-Breast-Cancer-Detection .
Collapse
Affiliation(s)
- Md Romzan Alom
- Department of Computer Science and Engineering, Green University of Bangladesh (GUB), Purbachal American City, Kanchon, Dhaka, 1460, Bangladesh
| | - Fahmid Al Farid
- Faculty of Artificial Intelligence and Engineering, Multimedia University, 63100, Cyberjaya, Malaysia
| | - Muhammad Aminur Rahaman
- Department of Computer Science and Engineering, Green University of Bangladesh (GUB), Purbachal American City, Kanchon, Dhaka, 1460, Bangladesh.
| | - Anichur Rahman
- Department of Computer Science and Engineering, National Institute of Textile Engineering and Research (NITER), Constituent Institute of the University of Dhaka, Savar, Dhaka, 1350, Bangladesh.
- Department of Computer Science and Engineering, Mawlana Bhashani Science and Technology University, Tangail, Bangladesh.
| | - Tanoy Debnath
- Department of Computer Science, Stony Brook University, Stony Brook, NY, USA
| | - Abu Saleh Musa Miah
- Department of Computer Science and Engineering, Bangladesh Army University of Science and Technology (BAUST), Nilphamari, Bangladesh
| | - Sarina Mansor
- Faculty of Artificial Intelligence and Engineering, Multimedia University, 63100, Cyberjaya, Malaysia.
| |
Collapse
|
2
|
Chen C, Mat Isa NA, Liu X. A review of convolutional neural network based methods for medical image classification. Comput Biol Med 2025; 185:109507. [PMID: 39631108 DOI: 10.1016/j.compbiomed.2024.109507] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2024] [Revised: 11/20/2024] [Accepted: 11/28/2024] [Indexed: 12/07/2024]
Abstract
This study systematically reviews CNN-based medical image classification methods. We surveyed 149 of the latest and most important papers published to date and conducted an in-depth analysis of the methods used therein. Based on the selected literature, we organized this review systematically. First, the development and evolution of CNN in the field of medical image classification are analyzed. Subsequently, we provide an in-depth overview of the main techniques of CNN applied to medical image classification, which is also the current research focus in this field, including data preprocessing, transfer learning, CNN architectures, and explainability, and their role in improving classification accuracy and efficiency. In addition, this overview summarizes the main public datasets for various diseases. Although CNN has great potential in medical image classification tasks and has achieved good results, clinical application is still difficult. Therefore, we conclude by discussing the main challenges faced by CNNs in medical image analysis and pointing out future research directions to address these challenges. This review will help researchers with their future studies and can promote the successful integration of deep learning into clinical practice and smart medical systems.
Collapse
Affiliation(s)
- Chao Chen
- School of Electrical and Electronic Engineering, Engineering Campus, Universiti Sains Malaysia, 14300, Nibong Tebal, Pulau Pinang, Malaysia; School of Automation and Information Engineering, Sichuan University of Science and Engineering, Yibin, 644000, China
| | - Nor Ashidi Mat Isa
- School of Electrical and Electronic Engineering, Engineering Campus, Universiti Sains Malaysia, 14300, Nibong Tebal, Pulau Pinang, Malaysia.
| | - Xin Liu
- School of Electrical and Electronic Engineering, Engineering Campus, Universiti Sains Malaysia, 14300, Nibong Tebal, Pulau Pinang, Malaysia
| |
Collapse
|
3
|
Lin N, Paul R, Guerra S, Liu Y, Doulgeris J, Shi M, Lin M, Engeberg ED, Hashemi J, Vrionis FD. The Frontiers of Smart Healthcare Systems. Healthcare (Basel) 2024; 12:2330. [PMID: 39684952 DOI: 10.3390/healthcare12232330] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2024] [Revised: 11/14/2024] [Accepted: 11/15/2024] [Indexed: 12/18/2024] Open
Abstract
Artificial Intelligence (AI) is poised to revolutionize numerous aspects of human life, with healthcare among the most critical fields set to benefit from this transformation. Medicine remains one of the most challenging, expensive, and impactful sectors, with challenges such as information retrieval, data organization, diagnostic accuracy, and cost reduction. AI is uniquely suited to address these challenges, ultimately improving the quality of life and reducing healthcare costs for patients worldwide. Despite its potential, the adoption of AI in healthcare has been slower compared to other industries, highlighting the need to understand the specific obstacles hindering its progress. This review identifies the current shortcomings of AI in healthcare and explores its possibilities, realities, and frontiers to provide a roadmap for future advancements.
Collapse
Affiliation(s)
- Nan Lin
- Department of Gastroenterology, The Affiliated Hospital of Putian University, Putian 351100, China
| | - Rudy Paul
- Department of Ocean & Mechanical Engineering, Florida Atlantic University, Boca Raton, FL 33431, USA
| | - Santiago Guerra
- Department of Ocean & Mechanical Engineering, Florida Atlantic University, Boca Raton, FL 33431, USA
| | - Yan Liu
- Department of Gastroenterology, The Affiliated Hospital of Putian University, Putian 351100, China
- Department of Neurosurgery, Marcus Neuroscience Institute, Boca Raton Regional Hospital, Boca Raton, FL 33486, USA
| | - James Doulgeris
- Department of Biomedical Engineering, Florida Atlantic University, Boca Raton, FL 33431, USA
| | - Min Shi
- Harvard Ophthalmology AI Lab, Schepens Eye Research Institute of Massachusetts Eye and Ear, Harvard Medical School, Boston, MA 02115, USA
- School of Computing and Informatics, University of Louisiana, Lafayette, LA 70504, USA
| | - Maohua Lin
- Department of Biomedical Engineering, Florida Atlantic University, Boca Raton, FL 33431, USA
| | - Erik D Engeberg
- Department of Ocean & Mechanical Engineering, Florida Atlantic University, Boca Raton, FL 33431, USA
- Department of Biomedical Engineering, Florida Atlantic University, Boca Raton, FL 33431, USA
- Center for Complex Systems and Brain Science, Florida Atlantic University, Boca Raton, FL 33431, USA
| | - Javad Hashemi
- Department of Biomedical Engineering, Florida Atlantic University, Boca Raton, FL 33431, USA
| | - Frank D Vrionis
- Department of Neurosurgery, Marcus Neuroscience Institute, Boca Raton Regional Hospital, Boca Raton, FL 33486, USA
| |
Collapse
|
4
|
Rahaman MM, Millar EKA, Meijering E. Generalized deep learning for histopathology image classification using supervised contrastive learning. J Adv Res 2024:S2090-1232(24)00532-0. [PMID: 39551131 DOI: 10.1016/j.jare.2024.11.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2024] [Revised: 10/07/2024] [Accepted: 11/10/2024] [Indexed: 11/19/2024] Open
Abstract
INTRODUCTION Cancer is a leading cause of death worldwide, necessitating effective diagnostic tools for early detection and treatment. Histopathological image analysis is crucial for cancer diagnosis but is often hindered by human error and variability. This study introduces HistopathAI, a hybrid network designed for histopathology image classification, aimed at enhancing diagnostic precision and efficiency in clinical pathology. OBJECTIVES The primary goal of this study is to demonstrate that HistopathAI, leveraging supervised contrastive learning (SCL) and hybrid deep feature fusion (HDFF), can significantly improve the accuracy of histopathological image classification, including scenarios involving imbalanced datasets. METHODS HistopathAI integrates features from EfficientNetB3 and ResNet50, using HDFF to provide a rich representation of histopathology images. The framework employs a sequential methodology, transitioning from feature learning to classifier learning, mirroring the essence of contrastive learning with the aim of producing superior feature representations. The model combines SCL for feature representation with cross-entropy (CE) loss for classification. We evaluated HistopathAI across seven publicly available datasets and one private dataset, covering various histopathology domains. RESULTS HistopathAI achieved state-of-the-art classification accuracy across all datasets, demonstrating superior performance in both binary and multiclass classification tasks. Statistical testing confirmed that HistopathAI's performance is significantly better than baseline models, ensuring robust and reliable improvements. CONCLUSION HistopathAI offers a robust tool for histopathology image classification, enhancing diagnostic accuracy and supporting the transition to digital pathology. This framework has the potential to improve cancer diagnosis and patient outcomes, paving the way for broader clinical application. The code is available on https://github.com/Mamunur-20/HistopathAI.
Collapse
Affiliation(s)
- Md Mamunur Rahaman
- School of Computer Science and Engineering, University of New South Wales, Sydney, NSW 2052, Australia.
| | - Ewan K A Millar
- Department of Anatomical Pathology, NSW Health Pathology, St. George Hospital, Sydney NSW 2217, Australia; St. George and Sutherland Clinical School, University of New South Wales, Sydney NSW 2052, Australia; Faculty of Medicine & Health Sciences, Western Sydney University, Sydney NSW 2560, Australia.
| | - Erik Meijering
- School of Computer Science and Engineering, University of New South Wales, Sydney, NSW 2052, Australia.
| |
Collapse
|
5
|
Nandagopal M, Seerangan K, Govindaraju T, Abi NE, Balusamy B, Selvarajan S. A Deep Auto-Optimized Collaborative Learning (DACL) model for disease prognosis using AI-IoMT systems. Sci Rep 2024; 14:10280. [PMID: 38704423 PMCID: PMC11069552 DOI: 10.1038/s41598-024-59846-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2023] [Accepted: 04/16/2024] [Indexed: 05/06/2024] Open
Abstract
In modern healthcare, integrating Artificial Intelligence (AI) and Internet of Medical Things (IoMT) is highly beneficial and has made it possible to effectively control disease using networks of interconnected sensors worn by individuals. The purpose of this work is to develop an AI-IoMT framework for identifying several of chronic diseases form the patients' medical record. For that, the Deep Auto-Optimized Collaborative Learning (DACL) Model, a brand-new AI-IoMT framework, has been developed for rapid diagnosis of chronic diseases like heart disease, diabetes, and stroke. Then, a Deep Auto-Encoder Model (DAEM) is used in the proposed framework to formulate the imputed and preprocessed data by determining the fields of characteristics or information that are lacking. To speed up classification training and testing, the Golden Flower Search (GFS) approach is then utilized to choose the best features from the imputed data. In addition, the cutting-edge Collaborative Bias Integrated GAN (ColBGaN) model has been created for precisely recognizing and classifying the types of chronic diseases from the medical records of patients. The loss function is optimally estimated during classification using the Water Drop Optimization (WDO) technique, reducing the classifier's error rate. Using some of the well-known benchmarking datasets and performance measures, the proposed DACL's effectiveness and efficiency in identifying diseases is evaluated and compared.
Collapse
Affiliation(s)
- Malarvizhi Nandagopal
- Department of CSE, School of Computing, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Chennai, Tamil Nadu, 600062, India
| | - Koteeswaran Seerangan
- Department of CSE (AI&ML), S.A. Engineering College (Autonomous), Chennai, Tamil Nadu, 600077, India
| | - Tamilmani Govindaraju
- Department of Computational Intelligence, SRM Institute of Science and Technology, Kattankulathur, Chennai, Tamil Nadu, 603203, India
| | - Neeba Eralil Abi
- Department of Information Technology, Rajagiri School of Engineering and Technology, Kochi, Kerala, 682039, India
| | - Balamurugan Balusamy
- Shiv Nadar (Institution of Eminence Deemed to be University), Greater Noida, Uttar Pradesh, 201314, India
| | - Shitharth Selvarajan
- Department of Computer Science, Kebri Dehar University, 250, Kebri Dehar, Ethiopia.
- School of Built Environment, Engineering and Computing, Leeds Beckett University, LS1 3HE, Leeds, UK.
| |
Collapse
|
6
|
Almalki J, Alshahrani SM, Khan NA. A comprehensive secure system enabling healthcare 5.0 using federated learning, intrusion detection and blockchain. PeerJ Comput Sci 2024; 10:e1778. [PMID: 38259900 PMCID: PMC10803090 DOI: 10.7717/peerj-cs.1778] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Accepted: 12/05/2023] [Indexed: 01/24/2024]
Abstract
Recently, the use of the Internet of Medical Things (IoMT) has gained popularity across various sections of the health sector. The historical security risks of IoMT devices themselves and the data flowing from them are major concerns. Deploying many devices, sensors, services, and networks that connect the IoMT systems is gaining popularity. This study focuses on identifying the use of blockchain in innovative healthcare units empowered by federated learning. A collective use of blockchain with intrusion detection management (IDM) is beneficial to detect and prevent malicious activity across the storage nodes. Data accumulated at a centralized storage node is analyzed with the help of machine learning algorithms to diagnose disease and allow appropriate medication to be prescribed by a medical healthcare professional. The model proposed in this study focuses on the effective use of such models for healthcare monitoring. The amalgamation of federated learning and the proposed model makes it possible to reach 93.89 percent accuracy for disease analysis and addiction. Further, intrusion detection ensures a success rate of 97.13 percent in this study.
Collapse
Affiliation(s)
- Jameel Almalki
- Department of Computer Science, College of Computer in Al-Lith, Umm Al-Qura University, Makkah, Makkah, Saudi Arabia
| | - Saeed M. Alshahrani
- Department of Computer Science, College of Computing and Information Technology, Shaqra University, Shaqra, Riyadh, Saudi Arabia
| | - Nayyar Ahmed Khan
- Department of Computer Science, College of Computing and Information Technology, Shaqra University, Shaqra, Riyadh, Saudi Arabia
| |
Collapse
|