1
|
Alphonse S, Mathew F, Dhanush K, Dinesh V. Federated learning with integrated attention multiscale model for brain tumor segmentation. Sci Rep 2025; 15:11889. [PMID: 40195402 PMCID: PMC11976911 DOI: 10.1038/s41598-025-96416-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2024] [Accepted: 03/27/2025] [Indexed: 04/09/2025] Open
Abstract
Brain tumors are an extremely deadly condition and the growth of abnormal cells that have formed inside the brain causes the illness. According to studies, Magnetic Resonance Imaging (MRI) is a fundamental imaging method that is frequently used in medical diagnostics to identify, treat, and routinely check for brain cancers. These images include extremely private and delicate details regarding the brain health of the individuals and it must be treated with much care to ensure anonymity of patients. However, traditional brain tumor segmentation techniques usually rely on centralized data storage and analysis, which might result in privacy issues and violations. Federated learning offers a solution by enabling the cooperative development of brain tumor segmentation models without necessitating the transfer of raw patient data to a centralized location. All the data are held securely within their institution. A Reinforcement Learning-based Federated Averaging (RL-FedAvg) model is proposed that fuses the Federated Averaging (FedAvg) model with Reinforcement Learning (RL). To optimize the global model for image segmentation jobs as well as to govern the consumption of client resources, the model dynamically updates client hyperparameters upon real-time performance feedback. A Double Attention-based Multiscale Dense-U-Net model, known as mixed-fed-UNet, is proposed in the work that uses the RL-FedAvg algorithm. The proposed technique achieves 98.24% accuracy and 93.28% dice coefficient on BraTs 2020 dataset. While comparing the developed model with the other existing methods, the proposed methodology shows better performance.
Collapse
Affiliation(s)
- Sherly Alphonse
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India.
| | - Fidal Mathew
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - K Dhanush
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - V Dinesh
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| |
Collapse
|
2
|
Ghorpade H, Kolhar S, Jagtap J, Chakraborty J. An optimized two stage U-Net approach for segmentation of pancreas and pancreatic tumor. MethodsX 2024; 13:102995. [PMID: 39435045 PMCID: PMC11491966 DOI: 10.1016/j.mex.2024.102995] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2024] [Accepted: 10/03/2024] [Indexed: 10/23/2024] Open
Abstract
The segmentation of pancreas and pancreatic tumor remain a persistent challenge for radiologists. Consequently, it is essential to develop automated segmentation methods to address this task. U-Net based models are most often used among various deep learning-based techniques in tumor segmentation. This paper introduces an innovative hybrid two-stage U-Net model for segmenting both the pancreas and pancreatic tumors. The optimization technique, used in this approach, involves a combination of meta-heuristic optimization algorithms namely, Grey Wolf Border Collie Optimization (GWBCO) technique, combining the Grey Wolf Optimization algorithm and the Border Collie Optimization algorithm. Our approach is evaluated using key parameters, such as Dice Similarity Coefficient (DSC), Jaccard Index (JI), sensitivity, specificity and precision to assess its effectiveness and achieves a DSC of 93.33 % for pancreas segmentation. Additionally, the model also achieves high DSC of 91.46 % for pancreatic tumor segmentation. This method helps in improving the diagnostic accuracy and assists medical professionals to provide treatment at an early stage with precise intervention. The method offers•Two-stage U-Net model addresses both pancreas and tumor segmentation.•Combination of two metaheuristic optimization algorithms, Grey Wolf and Border Collie for enhanced performance.•High dice similarity coefficient for pancreas and tumor segmentation.
Collapse
Affiliation(s)
- Himali Ghorpade
- Symbiosis Institute of Technology, Symbiosis International (Deemed University), Pune, Maharashtra, India
| | - Shrikrishna Kolhar
- Symbiosis Institute of Technology, Symbiosis International (Deemed University), Pune, Maharashtra, India
| | - Jayant Jagtap
- Marik Institute of Computing, Artificial Intelligence, Robotics and Cybernetics, NIMS University Rajasthan, Jaipur, India
| | | |
Collapse
|
3
|
Liu W, Zhang B, Liu T, Jiang J, Liu Y. Artificial Intelligence in Pancreatic Image Analysis: A Review. SENSORS (BASEL, SWITZERLAND) 2024; 24:4749. [PMID: 39066145 PMCID: PMC11280964 DOI: 10.3390/s24144749] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2024] [Revised: 07/15/2024] [Accepted: 07/16/2024] [Indexed: 07/28/2024]
Abstract
Pancreatic cancer is a highly lethal disease with a poor prognosis. Its early diagnosis and accurate treatment mainly rely on medical imaging, so accurate medical image analysis is especially vital for pancreatic cancer patients. However, medical image analysis of pancreatic cancer is facing challenges due to ambiguous symptoms, high misdiagnosis rates, and significant financial costs. Artificial intelligence (AI) offers a promising solution by relieving medical personnel's workload, improving clinical decision-making, and reducing patient costs. This study focuses on AI applications such as segmentation, classification, object detection, and prognosis prediction across five types of medical imaging: CT, MRI, EUS, PET, and pathological images, as well as integrating these imaging modalities to boost diagnostic accuracy and treatment efficiency. In addition, this study discusses current hot topics and future directions aimed at overcoming the challenges in AI-enabled automated pancreatic cancer diagnosis algorithms.
Collapse
Affiliation(s)
- Weixuan Liu
- Sydney Smart Technology College, Northeastern University at Qinhuangdao, Qinhuangdao 066004, China; (W.L.); (B.Z.)
| | - Bairui Zhang
- Sydney Smart Technology College, Northeastern University at Qinhuangdao, Qinhuangdao 066004, China; (W.L.); (B.Z.)
| | - Tao Liu
- School of Mathematics and Statistics, Northeastern University at Qinhuangdao, Qinhuangdao 066004, China;
| | - Juntao Jiang
- College of Control Science and Engineering, Zhejiang University, Hangzhou 310058, China
| | - Yong Liu
- College of Control Science and Engineering, Zhejiang University, Hangzhou 310058, China
| |
Collapse
|
4
|
Sandhu SS, Gorji HT, Tavakolian P, Tavakolian K, Akhbardeh A. Medical Imaging Applications of Federated Learning. Diagnostics (Basel) 2023; 13:3140. [PMID: 37835883 PMCID: PMC10572559 DOI: 10.3390/diagnostics13193140] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2023] [Revised: 10/03/2023] [Accepted: 10/03/2023] [Indexed: 10/15/2023] Open
Abstract
Since its introduction in 2016, researchers have applied the idea of Federated Learning (FL) to several domains ranging from edge computing to banking. The technique's inherent security benefits, privacy-preserving capabilities, ease of scalability, and ability to transcend data biases have motivated researchers to use this tool on healthcare datasets. While several reviews exist detailing FL and its applications, this review focuses solely on the different applications of FL to medical imaging datasets, grouping applications by diseases, modality, and/or part of the body. This Systematic Literature review was conducted by querying and consolidating results from ArXiv, IEEE Xplorer, and PubMed. Furthermore, we provide a detailed description of FL architecture, models, descriptions of the performance achieved by FL models, and how results compare with traditional Machine Learning (ML) models. Additionally, we discuss the security benefits, highlighting two primary forms of privacy-preserving techniques, including homomorphic encryption and differential privacy. Finally, we provide some background information and context regarding where the contributions lie. The background information is organized into the following categories: architecture/setup type, data-related topics, security, and learning types. While progress has been made within the field of FL and medical imaging, much room for improvement and understanding remains, with an emphasis on security and data issues remaining the primary concerns for researchers. Therefore, improvements are constantly pushing the field forward. Finally, we highlighted the challenges in deploying FL in medical imaging applications and provided recommendations for future directions.
Collapse
Affiliation(s)
- Sukhveer Singh Sandhu
- Biomedical Engineering Program, University of North Dakota, Grand Forks, ND 58202, USA; (H.T.G.); (P.T.)
| | - Hamed Taheri Gorji
- Biomedical Engineering Program, University of North Dakota, Grand Forks, ND 58202, USA; (H.T.G.); (P.T.)
- SafetySpect Inc., 4200 James Ray Dr., Grand Forks, ND 58202, USA
| | - Pantea Tavakolian
- Biomedical Engineering Program, University of North Dakota, Grand Forks, ND 58202, USA; (H.T.G.); (P.T.)
| | - Kouhyar Tavakolian
- Biomedical Engineering Program, University of North Dakota, Grand Forks, ND 58202, USA; (H.T.G.); (P.T.)
| | | |
Collapse
|
5
|
Yang M, Zhang Y, Chen H, Wang W, Ni H, Chen X, Li Z, Mao C. AX-Unet: A Deep Learning Framework for Image Segmentation to Assist Pancreatic Tumor Diagnosis. Front Oncol 2022; 12:894970. [PMID: 35719964 PMCID: PMC9202000 DOI: 10.3389/fonc.2022.894970] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2022] [Accepted: 04/19/2022] [Indexed: 11/13/2022] Open
Abstract
Image segmentation plays an essential role in medical imaging analysis such as tumor boundary extraction. Recently, deep learning techniques have dramatically improved performance for image segmentation. However, an important factor preventing deep neural networks from going further is the information loss during the information propagation process. In this article, we present AX-Unet, a deep learning framework incorporating a modified atrous spatial pyramid pooling module to learn the location information and to extract multi-level contextual information to reduce information loss during downsampling. We also introduce a special group convolution operation on the feature map at each level to achieve information decoupling between channels. In addition, we propose an explicit boundary-aware loss function to tackle the blurry boundary problem. We evaluate our model on two public Pancreas-CT datasets, NIH Pancreas-CT dataset, and the pancreas part in medical segmentation decathlon (MSD) medical dataset. The experimental results validate that our model can outperform the state-of-the-art methods in pancreas CT image segmentation. By comparing the extracted feature output of our model, we find that the pancreatic region of normal people and patients with pancreatic tumors shows significant differences. This could provide a promising and reliable way to assist physicians for the screening of pancreatic tumors.
Collapse
Affiliation(s)
- Minqiang Yang
- School of Information Science Engineering, Lanzhou University, Lanzhou, China
| | - Yuhong Zhang
- School of Information Science Engineering, Lanzhou University, Lanzhou, China
| | - Haoning Chen
- School of Statistics and Data Science, Nankai University, Tianjin, China
| | - Wei Wang
- School of Intelligent Systems Engineering, Sun Yat-sen University, Shenzhen, China
| | - Haixu Ni
- Department of General Surgery, First Hospital of Lanzhou University, Lanzhou, China
| | - Xinlong Chen
- First Clinical Medical College, Lanzhou University, Lanzhou, China
| | - Zhuoheng Li
- School of Information Science Engineering, Lanzhou University, Lanzhou, China
| | - Chengsheng Mao
- Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University, Chicago, IL, United States
| |
Collapse
|
6
|
Naz S, Phan KT, Chen YP. A comprehensive review of federated learning for COVID-19 detection. INT J INTELL SYST 2022; 37:2371-2392. [PMID: 37520859 PMCID: PMC9015599 DOI: 10.1002/int.22777] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2021] [Revised: 10/31/2021] [Accepted: 11/16/2021] [Indexed: 11/09/2022]
Abstract
The coronavirus of 2019 (COVID-19) was declared a global pandemic by World Health Organization in March 2020. Effective testing is crucial to slow the spread of the pandemic. Artificial intelligence and machine learning techniques can help COVID-19 detection using various clinical symptom data. While deep learning (DL) approach requiring centralized data is susceptible to a high risk of data privacy breaches, federated learning (FL) approach resting on decentralized data can preserve data privacy, a critical factor in the health domain. This paper reviews recent advances in applying DL and FL techniques for COVID-19 detection with a focus on the latter. A model FL implementation use case in health systems with a COVID-19 detection using chest X-ray image data sets is studied. We have also reviewed applications of previously published FL experiments for COVID-19 research to demonstrate the applicability of FL in tackling health research issues. Last, several challenges in FL implementation in the healthcare domain are discussed in terms of potential future work.
Collapse
Affiliation(s)
- Sadaf Naz
- Department of Computer Science and Information Technology, School of Engineering and Mathematical SciencesLa Trobe UniversityBundooraVictoriaAustralia
| | - Khoa T. Phan
- Department of Computer Science and Information Technology, School of Engineering and Mathematical SciencesLa Trobe UniversityBundooraVictoriaAustralia
| | - Yi‐Ping Phoebe Chen
- Department of Computer Science and Information Technology, School of Engineering and Mathematical SciencesLa Trobe UniversityBundooraVictoriaAustralia
| |
Collapse
|