1
|
Hage Chehade A, Abdallah N, Marion JM, Hatt M, Oueidat M, Chauvet P. Advancing chest X-ray diagnostics: A novel CycleGAN-based preprocessing approach for enhanced lung disease classification in ChestX-Ray14. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2025; 259:108518. [PMID: 39615193 DOI: 10.1016/j.cmpb.2024.108518] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/21/2024] [Revised: 10/28/2024] [Accepted: 11/15/2024] [Indexed: 12/11/2024]
Abstract
BACKGROUND AND OBJECTIVE Chest radiography is a medical imaging technique widely used to diagnose thoracic diseases. However, X-ray images may contain artifacts such as irrelevant objects, medical devices, wires and electrodes that can introduce unnecessary noise, making difficult the distinction of relevant anatomical structures, and hindering accurate diagnoses. We aim in this study to address the issue of these artifacts in order to improve lung diseases classification results. METHODS In this paper we present a novel preprocessing approach which begins by detecting images that contain artifacts and then we reduce the artifacts' noise effect by generating sharper images using a CycleGAN model. The DenseNet-121 model, used for the classification, incorporates channel and spatial attention mechanisms to specifically focus on relevant parts of the image. Additional information contained in the dataset, namely clinical characteristics, were also integrated into the model. RESULTS We evaluated the performance of the classification model before and after applying our proposed artifact preprocessing approach. These results clearly demonstrate that our preprocessing approach significantly improves the model's AUC by 5.91% for pneumonia and 6.44% for consolidation classification, outperforming previous studies for the 14 diseases in the ChestX-Ray14 dataset. CONCLUSION This research highlights the importance of considering the presence of artifacts when diagnosing lung diseases from radiographic images. By eliminating unwanted noise, our approach enables models to focus on relevant diagnostic features, thereby improving their performance. The results demonstrated that our approach is promising, highlighting its potential for broader applications in lung disease classification.
Collapse
Affiliation(s)
| | | | | | - Mathieu Hatt
- LaTIM, INSERM UMR 1101, University of Brest, Brest, France
| | | | | |
Collapse
|
2
|
Shafi SM, Chinnappan SK. Hybrid transformer-CNN and LSTM model for lung disease segmentation and classification. PeerJ Comput Sci 2024; 10:e2444. [PMID: 39896390 PMCID: PMC11784776 DOI: 10.7717/peerj-cs.2444] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Accepted: 10/01/2024] [Indexed: 02/04/2025]
Abstract
According to the World Health Organization (WHO) report, lung disorders are the third leading cause of mortality worldwide. Approximately three million individuals are affected with various types of lung disorders annually. This issue alarms us to take control measures related to early diagnostics, accurate treatment procedures, etc. The precise identification through the assessment of medical images is crucial for pulmonary disease diagnosis. Also, it remains a formidable challenge due to the diverse and unpredictable nature of pathological lung appearances and shapes. Therefore, the efficient lung disease segmentation and classification model is essential. By taking this initiative, a novel lung disease segmentation with a hybrid LinkNet-Modified LSTM (L-MLSTM) model is proposed in this research article. The proposed model utilizes four essential and fundamental steps for its implementation. The first step is pre-processing, where the input lung images are pre-processed using median filtering. Consequently, an improved Transformer-based convolutional neural network (CNN) model (ITCNN) is proposed to segment the affected region in the segmentation process. After segmentation, essential features such as texture, shape, color, and deep features are retrieved. Specifically, texture features are extracted using modified Local Gradient Increasing Pattern (LGIP) and Multi-texton analysis. Then, the classification step utilizes a hybrid model, the L-MLSTM model. This work leverages two datasets such as the COVID-19 normal pneumonia-CT images dataset (Dataset 1) and the Chest CT scan images dataset (Dataset 2). The dataset is crucial for training and evaluating the model, providing a comprehensive basis for robust and generalizable results. The L-MLSTM model outperforms several existing models, including HDE-NN, DBN, LSTM, LINKNET, SVM, Bi-GRU, RNN, CNN, and VGG19 + CNN, with accuracies of 89% and 95% at learning percentages of 70 and 90, respectively, for datasets 1 and 2. The improved accuracy achieved by the L-MLSTM model highlights its capability to better handle the complexity and variability in lung images. This hybrid approach enhances the model's ability to distinguish between different types of lung diseases and reduces diagnostic errors compared to existing methods.
Collapse
|
3
|
Zhang M, He G, Pan C, Yun B, Shen D, Meng M. Discrimination of benign and malignant breast lesions on dynamic contrast-enhanced magnetic resonance imaging using deep learning. J Cancer Res Ther 2023; 19:1589-1596. [PMID: 38156926 DOI: 10.4103/jcrt.jcrt_325_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2023] [Accepted: 09/26/2023] [Indexed: 01/03/2024]
Abstract
PURPOSE To evaluate the capability of deep transfer learning (DTL) and fine-tuning methods in differentiating malignant from benign lesions in breast dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI). METHODS The diagnostic efficiencies of the VGG19, ResNet50, and DenseNet201 models were tested under the same dataset. The model with the highest performance was selected and modified utilizing three fine-tuning strategies (S1-3). Fifty additional lesions were selected to form the validation set to verify the generalization abilities of these models. The accuracy (Ac) of the different models in the training and test sets, as well as the precision (Pr), recall rate (Rc), F1 score (), and area under the receiver operating characteristic curve (AUC), were primary performance indicators. Finally, the kappa test was used to compare the degree of agreement between the DTL models and pathological diagnosis in differentiating malignant from benign breast lesions. RESULTS The Pr, Rc, f1, and AUC of VGG19 (86.0%, 0.81, 0.81, and 0.81, respectively) were higher than those of DenseNet201 (70.0%, 0.61, 0.63, and 0.61, respectively) and ResNet50 (61.0%, 0.59, 0.59, and 0.59). After fine-tuning, the Pr, Rc, f1, and AUC of S1 (87.0%, 0.86, 0.86, and 0.86, respectively) were higher than those of VGG19. Notably, the degree of agreement between S1 and pathological diagnosis in differentiating malignant from benign breast lesions was 0.720 (κ = 0.720), which was higher than that of DenseNet201 (κ = 0.440), VGG19 (κ = 0.640), and ResNet50 (κ = 0.280). CONCLUSION The VGG19 model is an effective method for identifying benign and malignant breast lesions on DCE-MRI, and its performance can be further improved via fine-tuning. Overall, our findings insinuate that this technique holds potential clinical application value.
Collapse
Affiliation(s)
- Ming Zhang
- Department of Radiology, The Affiliated Changzhou No. 2 People's Hospital, Nanjing Medical University, Changzhou, Jiangsu Province, P.R. China
| | - Guangyuan He
- Department of Radiology, The Affiliated Changzhou No. 2 People's Hospital, Nanjing Medical University, Changzhou, Jiangsu Province, P.R. China
| | - Changjie Pan
- Department of Radiology, The Affiliated Changzhou No. 2 People's Hospital, Nanjing Medical University, Changzhou, Jiangsu Province, P.R. China
| | - Bing Yun
- Teaching and Research Department of English, Nanjing Forestry University Nanjing 210037, Jiangsu Province, P.R. China
| | - Dong Shen
- Department of Radiology, The Affiliated Changzhou No. 2 People's Hospital, Nanjing Medical University, Changzhou, Jiangsu Province, P.R. China
| | - Mingzhu Meng
- Department of Radiology, The Affiliated Changzhou No. 2 People's Hospital, Nanjing Medical University, Changzhou, Jiangsu Province, P.R. China
| |
Collapse
|
4
|
Li M, Chen C, Cao Y, Zhou P, Deng X, Liu P, Wang Y, Lv X, Chen C. CIABNet: Category imbalance attention block network for the classification of multi-differentiated types of esophageal cancer. Med Phys 2023; 50:1507-1527. [PMID: 36272103 DOI: 10.1002/mp.16067] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Revised: 08/25/2022] [Accepted: 09/09/2022] [Indexed: 11/12/2022] Open
Abstract
BACKGROUND Esophageal cancer has become one of the important cancers that seriously threaten human life and health, and its incidence and mortality rate are still among the top malignant tumors. Histopathological image analysis is the gold standard for diagnosing different differentiation types of esophageal cancer. PURPOSE The grading accuracy and interpretability of the auxiliary diagnostic model for esophageal cancer are seriously affected by small interclass differences, imbalanced data distribution, and poor model interpretability. Therefore, we focused on developing the category imbalance attention block network (CIABNet) model to try to solve the previous problems. METHODS First, the quantitative metrics and model visualization results are integrated to transfer knowledge from the source domain images to better identify the regions of interest (ROI) in the target domain of esophageal cancer. Second, in order to pay attention to the subtle interclass differences, we propose the concatenate fusion attention block, which can focus on the contextual local feature relationships and the changes of channel attention weights among different regions simultaneously. Third, we proposed a category imbalance attention module, which treats each esophageal cancer differentiation class fairly based on aggregating different intensity information at multiple scales and explores more representative regional features for each class, which effectively mitigates the negative impact of category imbalance. Finally, we use feature map visualization to focus on interpreting whether the ROIs are the same or similar between the model and pathologists, thus better improving the interpretability of the model. RESULTS The experimental results show that the CIABNet model outperforms other state-of-the-art models, which achieves the most advanced results in classifying the differentiation types of esophageal cancer with an average classification accuracy of 92.24%, an average precision of 93.52%, an average recall of 90.31%, an average F1 value of 91.73%, and an average AUC value of 97.43%. In addition, the CIABNet model has essentially similar or identical to the ROI of pathologists in identifying histopathological images of esophageal cancer. CONCLUSIONS Our experimental results prove that our proposed computer-aided diagnostic algorithm shows great potential in histopathological images of multi-differentiated types of esophageal cancer.
Collapse
Affiliation(s)
- Min Li
- College of Information Science and Engineering, Xinjiang University, Urumqi, China
- Key Laboratory of Signal Detection and Processing, Xinjiang University, Urumqi, China
| | - Chen Chen
- College of Information Science and Engineering, Xinjiang University, Urumqi, China
- Xinjiang Cloud Computing Application Laboratory, Karamay, China
| | - Yanzhen Cao
- Department of Pathology, The Affiliated Tumor Hospital of Xinjiang Medical University, Urumqi, China
| | - Panyun Zhou
- College of Software, Xinjiang University, Urumqi, China
| | - Xin Deng
- College of Software, Xinjiang University, Urumqi, China
| | - Pei Liu
- College of Information Science and Engineering, Xinjiang University, Urumqi, China
| | - Yunling Wang
- The First Affiliated Hospital of Xinjiang Medical University, Urumqi, China
| | - Xiaoyi Lv
- College of Information Science and Engineering, Xinjiang University, Urumqi, China
- Key Laboratory of Signal Detection and Processing, Xinjiang University, Urumqi, China
- Xinjiang Cloud Computing Application Laboratory, Karamay, China
- College of Software, Xinjiang University, Urumqi, China
- Key Laboratory of software engineering technology, Xinjiang University, Urumqi, China
| | - Cheng Chen
- College of Software, Xinjiang University, Urumqi, China
| |
Collapse
|
5
|
Maturana CR, de Oliveira AD, Nadal S, Bilalli B, Serrat FZ, Soley ME, Igual ES, Bosch M, Lluch AV, Abelló A, López-Codina D, Suñé TP, Clols ES, Joseph-Munné J. Advances and challenges in automated malaria diagnosis using digital microscopy imaging with artificial intelligence tools: A review. Front Microbiol 2022; 13:1006659. [PMID: 36458185 PMCID: PMC9705958 DOI: 10.3389/fmicb.2022.1006659] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Accepted: 09/26/2022] [Indexed: 09/03/2023] Open
Abstract
Malaria is an infectious disease caused by parasites of the genus Plasmodium spp. It is transmitted to humans by the bite of an infected female Anopheles mosquito. It is the most common disease in resource-poor settings, with 241 million malaria cases reported in 2020 according to the World Health Organization. Optical microscopy examination of blood smears is the gold standard technique for malaria diagnosis; however, it is a time-consuming method and a well-trained microscopist is needed to perform the microbiological diagnosis. New techniques based on digital imaging analysis by deep learning and artificial intelligence methods are a challenging alternative tool for the diagnosis of infectious diseases. In particular, systems based on Convolutional Neural Networks for image detection of the malaria parasites emulate the microscopy visualization of an expert. Microscope automation provides a fast and low-cost diagnosis, requiring less supervision. Smartphones are a suitable option for microscopic diagnosis, allowing image capture and software identification of parasites. In addition, image analysis techniques could be a fast and optimal solution for the diagnosis of malaria, tuberculosis, or Neglected Tropical Diseases in endemic areas with low resources. The implementation of automated diagnosis by using smartphone applications and new digital imaging technologies in low-income areas is a challenge to achieve. Moreover, automating the movement of the microscope slide and image autofocusing of the samples by hardware implementation would systemize the procedure. These new diagnostic tools would join the global effort to fight against pandemic malaria and other infectious and poverty-related diseases.
Collapse
Affiliation(s)
- Carles Rubio Maturana
- Microbiology Department, Vall d’Hebron Research Institute, Vall d’Hebron Hospital Campus, Barcelona, Spain
- Universitat Autònoma de Barcelona (UAB), Barcelona, Spain
| | - Allisson Dantas de Oliveira
- Computational Biology and Complex Systems Group, Physics Department, Universitat Politècnica de Catalunya (UPC), Castelldefels, Spain
| | - Sergi Nadal
- Data Base Technologies and Information Group, Engineering Services and Information Systems Department, Universitat Politècnica de Catalunya (UPC), Barcelona, Spain
| | - Besim Bilalli
- Data Base Technologies and Information Group, Engineering Services and Information Systems Department, Universitat Politècnica de Catalunya (UPC), Barcelona, Spain
| | - Francesc Zarzuela Serrat
- Microbiology Department, Vall d’Hebron Research Institute, Vall d’Hebron Hospital Campus, Barcelona, Spain
| | - Mateu Espasa Soley
- Universitat Autònoma de Barcelona (UAB), Barcelona, Spain
- Clinical Laboratories, Microbiology Department, Hospital Universitari Parc Taulí, Sabadell, Spain
| | - Elena Sulleiro Igual
- Microbiology Department, Vall d’Hebron Research Institute, Vall d’Hebron Hospital Campus, Barcelona, Spain
- Universitat Autònoma de Barcelona (UAB), Barcelona, Spain
- CIBERINFEC, ISCIII- CIBER de Enfermedades Infecciosas, Instituto de Salud Carlos III, Madrid, Spain
| | | | | | - Alberto Abelló
- Data Base Technologies and Information Group, Engineering Services and Information Systems Department, Universitat Politècnica de Catalunya (UPC), Barcelona, Spain
| | - Daniel López-Codina
- Computational Biology and Complex Systems Group, Physics Department, Universitat Politècnica de Catalunya (UPC), Castelldefels, Spain
| | - Tomàs Pumarola Suñé
- Microbiology Department, Vall d’Hebron Research Institute, Vall d’Hebron Hospital Campus, Barcelona, Spain
- Universitat Autònoma de Barcelona (UAB), Barcelona, Spain
| | - Elisa Sayrol Clols
- Image Processing Group, Telecommunications and Signal Theory Group, Universitat Politècnica de Catalunya (UPC), Barcelona, Spain
| | - Joan Joseph-Munné
- Microbiology Department, Vall d’Hebron Research Institute, Vall d’Hebron Hospital Campus, Barcelona, Spain
| |
Collapse
|
6
|
Wan C, Fang L, Cao S, Luo J, Jiang Y, Wei Y, Lv C, Si W. Research on classification algorithm of cerebral small vessel disease based on convolutional neural network. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2022. [DOI: 10.3233/jifs-213212] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/07/2022]
Abstract
The investigation on brain magnetic resonance imaging (MRI) of cerebral small vessel disease (CSVD) classification algorithm based on deep learning is particularly important in medical image analyses and has not been reported. This paper proposes an MRI classification algorithm based on convolutional neural network (MRINet), for accurately classifying CSVD and improving the classification performance. The working method includes five main stages: fabricating dataset, designing network model, configuring the training options, training model and testing performance. The actual training and testing datasets of MRI of CSVD are fabricated, the MRINet model is designed for extracting more detailedly features, a smooth categorical-cross-entropy loss function and Adam optimization algorithm are adopted, and the appropriate training parameters are set. The network model is trained and tested in the fabricated datasets, and the classification performance of CSVD is fully investigated. Experimental results show that the loss and accuracy curves demonstrate the better classification performance in the training process. The confusion matrices confirm that the designed network model demonstrates the better classification results, especially for luminal infarction. The average classification accuracy of MRINet is up to 80.95% when classifying MRI of CSVD, which demonstrates the superior classification performance over others. This work provides a sound experimental foundation for further improving the classification accuracy and enhancing the actual application in medical image analyses.
Collapse
Affiliation(s)
- Chenxia Wan
- College of Information and Communication Engineering, Harbin Engineering University, Harbin, China
| | - Liqun Fang
- Forth Affiliated Hospital of Harbin Medical University, Harbin, China
| | - Shaodong Cao
- Forth Affiliated Hospital of Harbin Medical University, Harbin, China
| | - Jiaji Luo
- College of Information and Communication Engineering, Harbin Engineering University, Harbin, China
| | - Yijing Jiang
- Forth Affiliated Hospital of Harbin Medical University, Harbin, China
| | - Yuanxiao Wei
- Forth Affiliated Hospital of Harbin Medical University, Harbin, China
| | - Cancan Lv
- Forth Affiliated Hospital of Harbin Medical University, Harbin, China
| | - Weijian Si
- College of Information and Communication Engineering, Harbin Engineering University, Harbin, China
| |
Collapse
|
7
|
Sriporn K, Tsai CF, Tsai CE, Wang P. Analyzing Malaria Disease Using Effective Deep Learning Approach. Diagnostics (Basel) 2020; 10:diagnostics10100744. [PMID: 32987888 PMCID: PMC7601431 DOI: 10.3390/diagnostics10100744] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2020] [Revised: 09/23/2020] [Accepted: 09/23/2020] [Indexed: 11/16/2022] Open
Abstract
Medical tools used to bolster decision-making by medical specialists who offer malaria treatment include image processing equipment and a computer-aided diagnostic system. Malaria images can be employed to identify and detect malaria using these methods, in order to monitor the symptoms of malaria patients, although there may be atypical cases that need more time for an assessment. This research used 7000 images of Xception, Inception-V3, ResNet-50, NasNetMobile, VGG-16 and AlexNet models for verification and analysis. These are prevalent models that classify the image precision and use a rotational method to improve the performance of validation and the training dataset with convolutional neural network models. Xception, using the state of the art activation function (Mish) and optimizer (Nadam), improved the effectiveness, as found by the outcomes of the convolutional neural model evaluation of these models for classifying the malaria disease from thin blood smear images. In terms of the performance, recall, accuracy, precision, and F1 measure, a combined score of 99.28% was achieved. Consequently, 10% of all non-dataset training and testing images were evaluated utilizing this pattern. Notable aspects for the improvement of a computer-aided diagnostic to produce an optimum malaria detection approach have been found, supported by a 98.86% accuracy level.
Collapse
Affiliation(s)
- Krit Sriporn
- Department of Tropical Agriculture and International Cooperation, National Pingtung University of Science and Technology, Neipu, Pingtung 91201, Taiwan;
- Department of Information Technology, Suratthani Rajabhat University, Suratthani 84100, Thailand
| | - Cheng-Fa Tsai
- Department of Management Information Systems, National Pingtung University of Science and Technology, Pingtung 91201, Taiwan
- Correspondence: ; Tel.: +886-08-770-3202 (ext. 7906)
| | - Chia-En Tsai
- Department of Biochemistry and Molecular Biology, National Cheng Kung University, Tainan 70101, Taiwan;
| | - Paohsi Wang
- Department of Food and Beverage Management, Cheng Shiu University, Kaohsiung 83347, Taiwan;
| |
Collapse
|