1
|
Shafi SM, Chinnappan SK. Segmenting and classifying lung diseases with M-Segnet and Hybrid Squeezenet-CNN architecture on CT images. PLoS One 2024; 19:e0302507. [PMID: 38753712 PMCID: PMC11098347 DOI: 10.1371/journal.pone.0302507] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2024] [Accepted: 04/07/2024] [Indexed: 05/18/2024] Open
Abstract
Diagnosing lung diseases accurately and promptly is essential for effectively managing this significant public health challenge on a global scale. This paper introduces a new framework called Modified Segnet-based Lung Disease Segmentation and Severity Classification (MSLDSSC). The MSLDSSC model comprises four phases: "preprocessing, segmentation, feature extraction, and classification." Initially, the input image undergoes preprocessing using an improved Wiener filter technique. This technique estimates the power spectral density of the noisy and original images and computes the SNR assisted by PSNR to evaluate image quality. Next, the preprocessed image undergoes Segmentation to identify and separate the RoI from the background objects in the lung image. We employ a Modified Segnet mechanism that utilizes a proposed hard tanh-Softplus activation function for effective Segmentation. Following Segmentation, features such as MLDN, entropy with MRELBP, shape features, and deep features are extracted. Following the feature extraction phase, the retrieved feature set is input into a hybrid severity classification model. This hybrid model comprises two classifiers: SDPA-Squeezenet and DCNN. These classifiers train on the retrieved feature set and effectively classify the severity level of lung diseases.
Collapse
Affiliation(s)
- Syed Mohammed Shafi
- School of Computer Science and Engineering Vellore Institute of Technology, Vellore, India
| | | |
Collapse
|
2
|
肖 汉, 李 焕, 冉 智, 张 启, 张 勃, 韦 羽, 祝 秀. [Corona virus disease 2019 lesion segmentation network based on an adaptive joint loss function]. SHENG WU YI XUE GONG CHENG XUE ZA ZHI = JOURNAL OF BIOMEDICAL ENGINEERING = SHENGWU YIXUE GONGCHENGXUE ZAZHI 2023; 40:743-752. [PMID: 37666765 PMCID: PMC10477394 DOI: 10.7507/1001-5515.202206051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 06/26/2022] [Revised: 05/30/2023] [Indexed: 09/06/2023]
Abstract
Corona virus disease 2019 (COVID-19) is an acute respiratory infectious disease with strong contagiousness, strong variability, and long incubation period. The probability of misdiagnosis and missed diagnosis can be significantly decreased with the use of automatic segmentation of COVID-19 lesions based on computed tomography images, which helps doctors in rapid diagnosis and precise treatment. This paper introduced the level set generalized Dice loss function (LGDL) in conjunction with the level set segmentation method based on COVID-19 lesion segmentation network and proposed a dual-path COVID-19 lesion segmentation network (Dual-SAUNet++) to address the pain points such as the complex symptoms of COVID-19 and the blurred boundaries that are challenging to segment. LGDL is an adaptive weight joint loss obtained by combining the generalized Dice loss of the mask path and the mean square error of the level set path. On the test set, the model achieved Dice similarity coefficient of (87.81 ± 10.86)%, intersection over union of (79.20 ± 14.58)%, sensitivity of (94.18 ± 13.56)%, specificity of (99.83 ± 0.43)% and Hausdorff distance of 18.29 ± 31.48 mm. Studies indicated that Dual-SAUNet++ has a great anti-noise capability and it can segment multi-scale lesions while simultaneously focusing on their area and border information. The method proposed in this paper assists doctors in judging the severity of COVID-19 infection by accurately segmenting the lesion, and provides a reliable basis for subsequent clinical treatment.
Collapse
Affiliation(s)
- 汉光 肖
- 重庆理工大学 两江人工智能学院(重庆 401135)School of Artificial Intelligence, Chongqing University of Technology, Chongqing 401135, P. R. China
| | - 焕琪 李
- 重庆理工大学 两江人工智能学院(重庆 401135)School of Artificial Intelligence, Chongqing University of Technology, Chongqing 401135, P. R. China
| | - 智强 冉
- 重庆理工大学 两江人工智能学院(重庆 401135)School of Artificial Intelligence, Chongqing University of Technology, Chongqing 401135, P. R. China
| | - 启航 张
- 重庆理工大学 两江人工智能学院(重庆 401135)School of Artificial Intelligence, Chongqing University of Technology, Chongqing 401135, P. R. China
| | - 勃龙 张
- 重庆理工大学 两江人工智能学院(重庆 401135)School of Artificial Intelligence, Chongqing University of Technology, Chongqing 401135, P. R. China
| | - 羽佳 韦
- 重庆理工大学 两江人工智能学院(重庆 401135)School of Artificial Intelligence, Chongqing University of Technology, Chongqing 401135, P. R. China
| | - 秀红 祝
- 重庆理工大学 两江人工智能学院(重庆 401135)School of Artificial Intelligence, Chongqing University of Technology, Chongqing 401135, P. R. China
| |
Collapse
|
3
|
Shanthi A, Koppu S. Remora Namib Beetle Optimization Enabled Deep Learning for Severity of COVID-19 Lung Infection Identification and Classification Using CT Images. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23115316. [PMID: 37300043 DOI: 10.3390/s23115316] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/16/2022] [Revised: 02/26/2023] [Accepted: 04/14/2023] [Indexed: 06/12/2023]
Abstract
Coronavirus disease 2019 (COVID-19) has seen a crucial outburst for both females and males worldwide. Automatic lung infection detection from medical imaging modalities provides high potential for increasing the treatment for patients to tackle COVID-19 disease. COVID-19 detection from lung CT images is a rapid way of diagnosing patients. However, identifying the occurrence of infectious tissues and segmenting this from CT images implies several challenges. Therefore, efficient techniques termed as Remora Namib Beetle Optimization_ Deep Quantum Neural Network (RNBO_DQNN) and RNBO_Deep Neuro Fuzzy Network (RNBO_DNFN) are introduced for the identification as well as classification of COVID-19 lung infection. Here, the pre-processing of lung CT images is performed utilizing an adaptive Wiener filter, whereas lung lobe segmentation is performed employing the Pyramid Scene Parsing Network (PSP-Net). Afterwards, feature extraction is carried out wherein features are extracted for the classification phase. In the first level of classification, DQNN is utilized, tuned by RNBO. Furthermore, RNBO is designed by merging the Remora Optimization Algorithm (ROA) and Namib Beetle Optimization (NBO). If a classified output is COVID-19, then the second-level classification is executed using DNFN for further classification. Additionally, DNFN is also trained by employing the newly proposed RNBO. Furthermore, the devised RNBO_DNFN achieved maximum testing accuracy, with TNR and TPR obtaining values of 89.4%, 89.5% and 87.5%.
Collapse
Affiliation(s)
- Amgothu Shanthi
- School of Information Technology and Engineering, Vellore Institute of Technology, Vellore 632014, India
| | - Srinivas Koppu
- School of Information Technology and Engineering, Vellore Institute of Technology, Vellore 632014, India
| |
Collapse
|
4
|
Deepapriya BS, Kumar P, Nandakumar G, Gnanavel S, Padmanaban R, Anbarasan AK, Meena K. Performance evaluation of deep learning techniques for lung cancer prediction. Soft comput 2023; 27:9191-9198. [PMID: 37255920 PMCID: PMC10170436 DOI: 10.1007/s00500-023-08313-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/23/2023] [Indexed: 06/01/2023]
Abstract
Due to the increase in pollution, the number of deaths caused by lung disease is rising rapidly. It is essential to predict the disease in earlier stages by means of high-level knowledge and acquaintance. Deep learning-based lung cancer prediction plays a vital role in assisting the medical practioners for diagnosing lung cancer in earlier stage. Computer-Aided diagnosis is considered to bring a boost to the field of medicine by tying it to automated systems. In this research paper, several models are experimented by using chest X-ray image or CT scan as an input to detect a particular disease. This research work is carried out to identify the best performing deep learning techniques for lung disease prediction. The performance of the method is evaluated using various performance metrics, such as precision, recall, accuracy and Jaccard index.
Collapse
Affiliation(s)
- B. S. Deepapriya
- Department of Computer Science and Engineering, Erode Sengunthar Engineering College, Erode, Tamilnadu India
| | - Parasuraman Kumar
- Department of Information Technology and Engineering, Manonmaniam Sundaranar University, Tirunelveli, 627 012 India
| | - G. Nandakumar
- Department of Information Technology, Manakulavinayagar Institute of Technology, Kalitheerthalkuppam, Puducherry 605 107 India
| | - S. Gnanavel
- Department of Computing Technologies, School of Computing, SRM Institute of Science and Technology, Kattankulathur, 603203 India
| | - R. Padmanaban
- Department of Computer Science and Engineering, Vel Tech Rangarajan Dr.Sagunthala R&D Institute of Science and Technology, Chennai, 600062 India
| | - Anbarasa Kumar Anbarasan
- School of Information Technology and Engineering, Vellore Institute of Technology, Vellore, Tamilnadu India
| | - K. Meena
- Department of Computer Science and Engineering, GITAM School of Technology, GITAM University, Bengaluru, India
| |
Collapse
|
5
|
Dubey AK, Mohbey KK. Combined Cloud-Based Inference System for the Classification of COVID-19 in CT-Scan and X-Ray Images. NEW GENERATION COMPUTING 2022; 41:61-84. [PMID: 36439302 PMCID: PMC9676871 DOI: 10.1007/s00354-022-00195-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/29/2022] [Accepted: 11/09/2022] [Indexed: 06/16/2023]
Abstract
In the past few years, most of the work has been done around the classification of covid-19 using different images like CT-scan, X-ray, and ultrasound. But none of that is capable enough to deal with each of these image types on a single common platform and can identify the possibility that a person is suffering from COVID or not. Thus, we realized there should be a platform to identify COVID-19 in CT-scan and X-ray images on the fly. So, to fulfill this need, we proposed an AI model to identify CT-scan and X-ray images from each other and then use this inference to classify them of COVID positive or negative. The proposed model uses the inception architecture under the hood and trains on the open-source extended covid-19 dataset. The dataset consists of plenty of images for both image types and is of size 4 GB. We achieved an accuracy of 100%, average macro-Precision of 100%, average macro-Recall of 100%, average macro f1-score of 100%, and AUC score of 99.6%. Furthermore, in this work, cloud-based architecture is proposed to massively scale and load balance as the Number of user requests rises. As a result, it will deliver a service with minimal latency to all users.
Collapse
Affiliation(s)
- Ankit Kumar Dubey
- Department of Computer Science, Central University of Rajasthan, Ajmer, India
| | | |
Collapse
|
6
|
Chi J, Zhang S, Han X, Wang H, Wu C, Yu X. MID-UNet: Multi-input directional UNet for COVID-19 lung infection segmentation from CT images. SIGNAL PROCESSING. IMAGE COMMUNICATION 2022; 108:116835. [PMID: 35935468 PMCID: PMC9344813 DOI: 10.1016/j.image.2022.116835] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Revised: 05/30/2022] [Accepted: 07/23/2022] [Indexed: 05/05/2023]
Abstract
Coronavirus Disease 2019 (COVID-19) has spread globally since the first case was reported in December 2019, becoming a world-wide existential health crisis with over 90 million total confirmed cases. Segmentation of lung infection from computed tomography (CT) scans via deep learning method has a great potential in assisting the diagnosis and healthcare for COVID-19. However, current deep learning methods for segmenting infection regions from lung CT images suffer from three problems: (1) Low differentiation of semantic features between the COVID-19 infection regions, other pneumonia regions and normal lung tissues; (2) High variation of visual characteristics between different COVID-19 cases or stages; (3) High difficulty in constraining the irregular boundaries of the COVID-19 infection regions. To solve these problems, a multi-input directional UNet (MID-UNet) is proposed to segment COVID-19 infections in lung CT images. For the input part of the network, we firstly propose an image blurry descriptor to reflect the texture characteristic of the infections. Then the original CT image, the image enhanced by the adaptive histogram equalization, the image filtered by the non-local means filter and the blurry feature map are adopted together as the input of the proposed network. For the structure of the network, we propose the directional convolution block (DCB) which consist of 4 directional convolution kernels. DCBs are applied on the short-cut connections to refine the extracted features before they are transferred to the de-convolution parts. Furthermore, we propose a contour loss based on local curvature histogram then combine it with the binary cross entropy (BCE) loss and the intersection over union (IOU) loss for better segmentation boundary constraint. Experimental results on the COVID-19-CT-Seg dataset demonstrate that our proposed MID-UNet provides superior performance over the state-of-the-art methods on segmenting COVID-19 infections from CT images.
Collapse
Affiliation(s)
- Jianning Chi
- Northeastern University, NO. 195, Chuangxin Road, Hunnan District, Shenyang, China
| | - Shuang Zhang
- Northeastern University, NO. 195, Chuangxin Road, Hunnan District, Shenyang, China
| | - Xiaoying Han
- Northeastern University, NO. 195, Chuangxin Road, Hunnan District, Shenyang, China
| | - Huan Wang
- Northeastern University, NO. 195, Chuangxin Road, Hunnan District, Shenyang, China
| | - Chengdong Wu
- Northeastern University, NO. 195, Chuangxin Road, Hunnan District, Shenyang, China
| | - Xiaosheng Yu
- Northeastern University, NO. 195, Chuangxin Road, Hunnan District, Shenyang, China
| |
Collapse
|
7
|
Owais M, Baek NR, Park KR. DMDF-Net: Dual multiscale dilated fusion network for accurate segmentation of lesions related to COVID-19 in lung radiographic scans. EXPERT SYSTEMS WITH APPLICATIONS 2022; 202:117360. [PMID: 35529253 PMCID: PMC9057951 DOI: 10.1016/j.eswa.2022.117360] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/13/2021] [Revised: 01/24/2022] [Accepted: 04/25/2022] [Indexed: 05/14/2023]
Abstract
The recent disaster of COVID-19 has brought the whole world to the verge of devastation because of its highly transmissible nature. In this pandemic, radiographic imaging modalities, particularly, computed tomography (CT), have shown remarkable performance for the effective diagnosis of this virus. However, the diagnostic assessment of CT data is a human-dependent process that requires sufficient time by expert radiologists. Recent developments in artificial intelligence have substituted several personal diagnostic procedures with computer-aided diagnosis (CAD) methods that can make an effective diagnosis, even in real time. In response to COVID-19, various CAD methods have been developed in the literature, which can detect and localize infectious regions in chest CT images. However, most existing methods do not provide cross-data analysis, which is an essential measure for assessing the generality of a CAD method. A few studies have performed cross-data analysis in their methods. Nevertheless, these methods show limited results in real-world scenarios without addressing generality issues. Therefore, in this study, we attempt to address generality issues and propose a deep learning-based CAD solution for the diagnosis of COVID-19 lesions from chest CT images. We propose a dual multiscale dilated fusion network (DMDF-Net) for the robust segmentation of small lesions in a given CT image. The proposed network mainly utilizes the strength of multiscale deep features fusion inside the encoder and decoder modules in a mutually beneficial manner to achieve superior segmentation performance. Additional pre- and post-processing steps are introduced in the proposed method to address the generality issues and further improve the diagnostic performance. Mainly, the concept of post-region of interest (ROI) fusion is introduced in the post-processing step, which reduces the number of false-positives and provides a way to accurately quantify the infected area of lung. Consequently, the proposed framework outperforms various state-of-the-art methods by accomplishing superior infection segmentation results with an average Dice similarity coefficient of 75.7%, Intersection over Union of 67.22%, Average Precision of 69.92%, Sensitivity of 72.78%, Specificity of 99.79%, Enhance-Alignment Measure of 91.11%, and Mean Absolute Error of 0.026.
Collapse
Affiliation(s)
- Muhammad Owais
- Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 04620, South Korea
| | - Na Rae Baek
- Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 04620, South Korea
| | - Kang Ryoung Park
- Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 04620, South Korea
| |
Collapse
|
8
|
Aiadi O, Khaldi B. A fast lightweight network for the discrimination of COVID-19 and pulmonary diseases. Biomed Signal Process Control 2022; 78:103925. [PMID: 35755317 PMCID: PMC9212881 DOI: 10.1016/j.bspc.2022.103925] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Revised: 05/17/2022] [Accepted: 06/18/2022] [Indexed: 11/23/2022]
Abstract
With the outbreak of COVID-19 and the increasing number of infections worldwide, there has been a noticeable deficiency in healthcare provided by medical professionals. To cope with this situation, computational methods can be used in different steps of COVID-19 handling. The first step is to accurately and rapidly diagnose infected persons, because the time taken for the diagnosis is among the crucial factors to save human lives. This paper proposes a computationally fast network for the diagnosis of COVID-19 and pulmonary diseases, which can be used in telemedicine. The proposed network is called DLNet because it jointly encodes local binary patterns along with filter outputs of discrete cosine transform (DCT). The first layer in DLNet is the convolution layer in which the input image is convolved using DCT filters. Then, to avoid over-fitting, a binary hashing procedure is performed by fusing responses of different filters into a unique feature map. This map is used to generate block-wise histograms by binding local binary codes of the input image and the map values. We normalize these histograms to improve the robustness of the network against illumination changes. Experiments conducted on a public dataset demonstrate the rapidity and effectiveness of DLNet, where an average accuracy, sensitivity, and specificity of 98.86%, 98.06, and 99.24% have been achieved, respectively. Moreover, the proposed network has shown high tolerance to the missing parts in the medical image, which makes it suitable for the telemedicine scenario.
Collapse
Affiliation(s)
- Oussama Aiadi
- Artifcial Intelligence and Information Technology Laboratory (LINATI), Department of Computer Science and Information Technology, Faculty of Sciences and Technology, University of Kasdi Merbah, Ouargla 3000, Algeria
| | - Belal Khaldi
- Artifcial Intelligence and Information Technology Laboratory (LINATI), Department of Computer Science and Information Technology, Faculty of Sciences and Technology, University of Kasdi Merbah, Ouargla 3000, Algeria
| |
Collapse
|
9
|
Bakkouri I, Afdel K. MLCA2F: Multi-Level Context Attentional Feature Fusion for COVID-19 lesion segmentation from CT scans. SIGNAL, IMAGE AND VIDEO PROCESSING 2022; 17:1181-1188. [PMID: 35935538 PMCID: PMC9346062 DOI: 10.1007/s11760-022-02325-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Revised: 05/13/2022] [Accepted: 07/16/2022] [Indexed: 06/15/2023]
Abstract
In the field of diagnosis and treatment planning of Coronavirus disease 2019 (COVID-19), accurate infected area segmentation is challenging due to the significant variations in the COVID-19 lesion size, shape, and position, boundary ambiguity, as well as complex structure. To bridge these gaps, this study presents a robust deep learning model based on a novel multi-scale contextual information fusion strategy, called Multi-Level Context Attentional Feature Fusion (MLCA2F), which consists of the Multi-Scale Context-Attention Network (MSCA-Net) blocks for segmenting COVID-19 lesions from Computed Tomography (CT) images. Unlike the previous classical deep learning models, the MSCA-Net integrates Multi-Scale Contextual Feature Fusion (MC2F) and Multi-Context Attentional Feature (MCAF) to learn more lesion details and guide the model to estimate the position of the boundary of infected regions, respectively. Practically, extensive experiments are performed on the Kaggle CT dataset to explore the optimal structure of MLCA2F. In comparison with the current state-of-the-art methods, the experiments show that the proposed methodology provides efficient results. Therefore, we can conclude that the MLCA2F framework has the potential to dramatically improve the conventional segmentation methods for assisting clinical decision-making.
Collapse
Affiliation(s)
- Ibtissam Bakkouri
- Laboratory of Computer Systems and Vision (LabSIV), Department of Computer Science, Faculty of Science, Ibn Zohr University, BP 8106, 80000 Agadir, Morocco
| | - Karim Afdel
- Laboratory of Computer Systems and Vision (LabSIV), Department of Computer Science, Faculty of Science, Ibn Zohr University, BP 8106, 80000 Agadir, Morocco
| |
Collapse
|
10
|
Sunoqrot MRS, Saha A, Hosseinzadeh M, Elschot M, Huisman H. Artificial intelligence for prostate MRI: open datasets, available applications, and grand challenges. Eur Radiol Exp 2022; 6:35. [PMID: 35909214 PMCID: PMC9339427 DOI: 10.1186/s41747-022-00288-8] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2022] [Accepted: 05/09/2022] [Indexed: 11/29/2022] Open
Abstract
Artificial intelligence (AI) for prostate magnetic resonance imaging (MRI) is starting to play a clinical role for prostate cancer (PCa) patients. AI-assisted reading is feasible, allowing workflow reduction. A total of 3,369 multi-vendor prostate MRI cases are available in open datasets, acquired from 2003 to 2021 in Europe or USA at 3 T (n = 3,018; 89.6%) or 1.5 T (n = 296; 8.8%), 346 cases scanned with endorectal coil (10.3%), 3,023 (89.7%) with phased-array surface coils; 412 collected for anatomical segmentation tasks, 3,096 for PCa detection/classification; for 2,240 cases lesions delineation is available and 56 cases have matching histopathologic images; for 2,620 cases the PSA level is provided; the total size of all open datasets amounts to approximately 253 GB. Of note, quality of annotations provided per dataset highly differ and attention must be paid when using these datasets (e.g., data overlap). Seven grand challenges and commercial applications from eleven vendors are here considered. Few small studies provided prospective validation. More work is needed, in particular validation on large-scale multi-institutional, well-curated public datasets to test general applicability. Moreover, AI needs to be explored for clinical stages other than detection/characterization (e.g., follow-up, prognosis, interventions, and focal treatment).
Collapse
Affiliation(s)
- Mohammed R S Sunoqrot
- Department of Circulation and Medical Imaging, NTNU-Norwegian University of Science and Technology, 7030, Trondheim, Norway.
- Department of Radiology and Nuclear Medicine, St. Olavs Hospital, Trondheim University Hospital, 7030, Trondheim, Norway.
| | - Anindo Saha
- Diagnostic Image Analysis Group, Department of Medical Imaging, Radboud University Medical Center, Nijmegen, 6525 GA, The Netherlands
| | - Matin Hosseinzadeh
- Diagnostic Image Analysis Group, Department of Medical Imaging, Radboud University Medical Center, Nijmegen, 6525 GA, The Netherlands
| | - Mattijs Elschot
- Department of Circulation and Medical Imaging, NTNU-Norwegian University of Science and Technology, 7030, Trondheim, Norway
- Department of Radiology and Nuclear Medicine, St. Olavs Hospital, Trondheim University Hospital, 7030, Trondheim, Norway
| | - Henkjan Huisman
- Department of Circulation and Medical Imaging, NTNU-Norwegian University of Science and Technology, 7030, Trondheim, Norway
- Diagnostic Image Analysis Group, Department of Medical Imaging, Radboud University Medical Center, Nijmegen, 6525 GA, The Netherlands
| |
Collapse
|
11
|
Band SS, Ardabili S, Yarahmadi A, Pahlevanzadeh B, Kiani AK, Beheshti A, Alinejad-Rokny H, Dehzangi I, Chang A, Mosavi A, Moslehpour M. A Survey on Machine Learning and Internet of Medical Things-Based Approaches for Handling COVID-19: Meta-Analysis. Front Public Health 2022; 10:869238. [PMID: 35812486 PMCID: PMC9260273 DOI: 10.3389/fpubh.2022.869238] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Accepted: 04/20/2022] [Indexed: 11/13/2022] Open
Abstract
Early diagnosis, prioritization, screening, clustering, and tracking of patients with COVID-19, and production of drugs and vaccines are some of the applications that have made it necessary to use a new style of technology to involve, manage, and deal with this epidemic. Strategies backed by artificial intelligence (A.I.) and the Internet of Things (IoT) have been undeniably effective to understand how the virus works and prevent it from spreading. Accordingly, the main aim of this survey is to critically review the ML, IoT, and the integration of IoT and ML-based techniques in the applications related to COVID-19, from the diagnosis of the disease to the prediction of its outbreak. According to the main findings, IoT provided a prompt and efficient approach to tracking the disease spread. On the other hand, most of the studies developed by ML-based techniques aimed at the detection and handling of challenges associated with the COVID-19 pandemic. Among different approaches, Convolutional Neural Network (CNN), Support Vector Machine, Genetic CNN, and pre-trained CNN, followed by ResNet have demonstrated the best performances compared to other methods.
Collapse
Affiliation(s)
- Shahab S. Band
- Future Technology Research Center, College of Future, National Yunlin University of Science and Technology, Douliou, Taiwan
| | - Sina Ardabili
- Department of Informatics, J. Selye University, Komárom, Slovakia
| | - Atefeh Yarahmadi
- Future Technology Research Center, College of Future, National Yunlin University of Science and Technology, Douliou, Taiwan
| | - Bahareh Pahlevanzadeh
- Department of Design and System Operations, Regional Information Center for Science and Technology (R.I.C.E.S.T.), Shiraz, Iran
| | - Adiqa Kausar Kiani
- Future Technology Research Center, College of Future, National Yunlin University of Science and Technology, Douliou, Taiwan
| | - Amin Beheshti
- Department of Computing, Macquarie University, Sydney, NSW, Australia
| | - Hamid Alinejad-Rokny
- BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, U.N.S.W. Sydney, Sydney, NSW, Australia
- U.N.S.W. Data Science Hub, The University of New South Wales (U.N.S.W. Sydney), Sydney, NSW, Australia
- Health Data Analytics Program, AI-enabled Processes (A.I.P.) Research Centre, Macquarie University, Sydney, NSW, Australia
| | - Iman Dehzangi
- Department of Computer Science, Rutgers University, Camden, NJ, United States
- Center for Computational and Integrative Biology, Rutgers University, Camden, NJ, United States
| | - Arthur Chang
- Bachelor Program in Interdisciplinary Studies, National Yunlin University of Science and Technology, Douliu, Taiwan
| | - Amir Mosavi
- John von Neumann Faculty of Informatics, Obuda University, Budapest, Hungary
- Institute of Information Engineering, Automation and Mathematics, Slovak University of Technology in Bratislava, Bratislava, Slovakia
| | - Massoud Moslehpour
- Department of Business Administration, College of Management, Asia University, Taichung, Taiwan
- Department of Management, California State University, San Bernardino, CA, United States
| |
Collapse
|
12
|
AI-driven quantification of ground glass opacities in lungs of COVID-19 patients using 3D computed tomography imaging. PLoS One 2022; 17:e0263916. [PMID: 35286309 PMCID: PMC8920286 DOI: 10.1371/journal.pone.0263916] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2021] [Accepted: 01/29/2022] [Indexed: 01/19/2023] Open
Abstract
Objectives Ground-glass opacity (GGO)—a hazy, gray appearing density on computed tomography (CT) of lungs—is one of the hallmark features of SARS-CoV-2 in COVID-19 patients. This AI-driven study is focused on segmentation, morphology, and distribution patterns of GGOs. Method We use an AI-driven unsupervised machine learning approach called PointNet++ to detect and quantify GGOs in CT scans of COVID-19 patients and to assess the severity of the disease. We have conducted our study on the “MosMedData”, which contains CT lung scans of 1110 patients with or without COVID-19 infections. We quantify the morphologies of GGOs using Minkowski tensors and compute the abnormality score of individual regions of segmented lung and GGOs. Results PointNet++ detects GGOs with the highest evaluation accuracy (98%), average class accuracy (95%), and intersection over union (92%) using only a fraction of 3D data. On average, the shapes of GGOs in the COVID-19 datasets deviate from sphericity by 15% and anisotropies in GGOs are dominated by dipole and hexapole components. These anisotropies may help to quantitatively delineate GGOs of COVID-19 from other lung diseases. Conclusion The PointNet++ and the Minkowski tensor based morphological approach together with abnormality analysis will provide radiologists and clinicians with a valuable set of tools when interpreting CT lung scans of COVID-19 patients. Implementation would be particularly useful in countries severely devastated by COVID-19 such as India, where the number of cases has outstripped available resources creating delays or even breakdowns in patient care. This AI-driven approach synthesizes both the unique GGO distribution pattern and severity of the disease to allow for more efficient diagnosis, triaging and conservation of limited resources.
Collapse
|
13
|
Enshaei N, Oikonomou A, Rafiee MJ, Afshar P, Heidarian S, Mohammadi A, Plataniotis KN, Naderkhani F. COVID-rate: an automated framework for segmentation of COVID-19 lesions from chest CT images. Sci Rep 2022; 12:3212. [PMID: 35217712 PMCID: PMC8881477 DOI: 10.1038/s41598-022-06854-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2021] [Accepted: 01/21/2022] [Indexed: 11/09/2022] Open
Abstract
Novel Coronavirus disease (COVID-19) is a highly contagious respiratory infection that has had devastating effects on the world. Recently, new COVID-19 variants are emerging making the situation more challenging and threatening. Evaluation and quantification of COVID-19 lung abnormalities based on chest Computed Tomography (CT) images can help determining the disease stage, efficiently allocating limited healthcare resources, and making informed treatment decisions. During pandemic era, however, visual assessment and quantification of COVID-19 lung lesions by expert radiologists become expensive and prone to error, which raises an urgent quest to develop practical autonomous solutions. In this context, first, the paper introduces an open-access COVID-19 CT segmentation dataset containing 433 CT images from 82 patients that have been annotated by an expert radiologist. Second, a Deep Neural Network (DNN)-based framework is proposed, referred to as the [Formula: see text], that autonomously segments lung abnormalities associated with COVID-19 from chest CT images. Performance of the proposed [Formula: see text] framework is evaluated through several experiments based on the introduced and external datasets. Third, an unsupervised enhancement approach is introduced that can reduce the gap between the training set and test set and improve the model generalization. The enhanced results show a dice score of 0.8069 and specificity and sensitivity of 0.9969 and 0.8354, respectively. Furthermore, the results indicate that the [Formula: see text] model can efficiently segment COVID-19 lesions in both 2D CT images and whole lung volumes. Results on the external dataset illustrate generalization capabilities of the [Formula: see text] model to CT images obtained from a different scanner.
Collapse
Affiliation(s)
- Nastaran Enshaei
- Concordia Institute for Information Systems Engineering, Concordia University, Montreal, QC, Canada
| | - Anastasia Oikonomou
- Department of Medical Imaging, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada.
| | - Moezedin Javad Rafiee
- Department of Medicine and Diagnostic Radiology, McGill University, Montreal, QC, Canada
| | - Parnian Afshar
- Concordia Institute for Information Systems Engineering, Concordia University, Montreal, QC, Canada
| | - Shahin Heidarian
- Department of Electrical and Computer Engineering, Concordia University, Montreal, QC, Canada
| | - Arash Mohammadi
- Concordia Institute for Information Systems Engineering, Concordia University, Montreal, QC, Canada
| | | | - Farnoosh Naderkhani
- Concordia Institute for Information Systems Engineering, Concordia University, Montreal, QC, Canada
| |
Collapse
|
14
|
Qayyum A, Mazhar M, Razzak I, Bouadjenek MR. Multilevel depth-wise context attention network with atrous mechanism for segmentation of COVID19 affected regions. Neural Comput Appl 2021; 35:1-13. [PMID: 34720443 PMCID: PMC8546198 DOI: 10.1007/s00521-021-06636-w] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2021] [Accepted: 10/13/2021] [Indexed: 12/02/2022]
Abstract
Severe acute respiratory syndrome coronavirus (SARS-CoV-2) also named COVID-19, aggressively spread all over the world in just a few months. Since then, it has multiple variants that are far more contagious than its parent. Rapid and accurate diagnosis of COVID-19 and its variants are crucial for its treatment, analysis of lungs damage and quarantine management. Deep learning-based solution for efficient and accurate diagnosis to COVID-19 and its variants using Chest X-rays, and computed tomography images could help to counter its outbreak. This work presents a novel depth-wise residual network with an atrous mechanism for accurate segmentation and lesion location of COVID-19 affected areas using volumetric CT images. The proposed framework consists of 3D depth-wise and 3D residual squeeze and excitation block in cascaded and parallel to capture uniformly multi-scale context (low-level detailed, mid-level comprehensive and high-level rich semantic features). The squeeze and excitation block adaptively recalibrates channel-wise feature responses by explicitly modeling inter-dependencies between various channels. We further have introduced an atrous mechanism with a different atrous rate as the bottom layer. Extensive experiments on benchmark CT datasets showed considerable gain (5%) for accurate segmentation and lesion location of COVID-19 affected areas.
Collapse
Affiliation(s)
- Abdul Qayyum
- Computer Science Department, University of Burgundy, Dijon, France
| | - Mona Mazhar
- Department of Computer Engineering and Mathematics, University Rovira i Virgili, Tarragona, Spain
| | - Imran Razzak
- School of Information Technology, Deakin University, Geelong, Australia
| | | |
Collapse
|
15
|
Owais M, Baek NR, Park KR. Domain-Adaptive Artificial Intelligence-Based Model for Personalized Diagnosis of Trivial Lesions Related to COVID-19 in Chest Computed Tomography Scans. J Pers Med 2021; 11:1008. [PMID: 34683149 PMCID: PMC8537687 DOI: 10.3390/jpm11101008] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2021] [Revised: 10/01/2021] [Accepted: 10/02/2021] [Indexed: 01/12/2023] Open
Abstract
BACKGROUND Early and accurate detection of COVID-19-related findings (such as well-aerated regions, ground-glass opacity, crazy paving and linear opacities, and consolidation in lung computed tomography (CT) scan) is crucial for preventive measures and treatment. However, the visual assessment of lung CT scans is a time-consuming process particularly in case of trivial lesions and requires medical specialists. METHOD A recent breakthrough in deep learning methods has boosted the diagnostic capability of computer-aided diagnosis (CAD) systems and further aided health professionals in making effective diagnostic decisions. In this study, we propose a domain-adaptive CAD framework, namely the dilated aggregation-based lightweight network (DAL-Net), for effective recognition of trivial COVID-19 lesions in CT scans. Our network design achieves a fast execution speed (inference time is 43 ms on a single image) with optimal memory consumption (almost 9 MB). To evaluate the performances of the proposed and state-of-the-art models, we considered two publicly accessible datasets, namely COVID-19-CT-Seg (comprising a total of 3520 images of 20 different patients) and MosMed (including a total of 2049 images of 50 different patients). RESULTS Our method exhibits average area under the curve (AUC) up to 98.84%, 98.47%, and 95.51% for COVID-19-CT-Seg, MosMed, and cross-dataset, respectively, and outperforms various state-of-the-art methods. CONCLUSIONS These results demonstrate that deep learning-based models are an effective tool for building a robust CAD solution based on CT data in response to present disaster of COVID-19.
Collapse
Affiliation(s)
| | | | - Kang Ryoung Park
- Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 04620, Korea; (M.O.); (N.R.B.)
| |
Collapse
|
16
|
Ma X, Zheng B, Zhu Y, Yu F, Zhang R, Chen B. COVID-19 lesion discrimination and localization network based on multi-receptive field attention module on CT images. OPTIK 2021; 241:167100. [PMID: 33976457 PMCID: PMC8103744 DOI: 10.1016/j.ijleo.2021.167100] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/23/2021] [Accepted: 04/29/2021] [Indexed: 05/05/2023]
Abstract
Since discovered in Hubei, China in December 2019, Corona Virus Disease 2019 named COVID-19 has lasted more than one year, and the number of new confirmed cases and confirmed deaths is still at a high level. COVID-19 is an infectious disease caused by SARS-CoV-2. Although RT-PCR is considered the gold standard for detection of COVID-19, CT plays an important role in the diagnosis and evaluation of the therapeutic effect of COVID-19. Diagnosis and localization of COVID-19 on CT images using deep learning can provide quantitative auxiliary information for doctors. This article proposes a novel network with multi-receptive field attention module to diagnose COVID-19 on CT images. This attention module includes three parts, a pyramid convolution module (PCM), a multi-receptive field spatial attention block (SAB), and a multi-receptive field channel attention block (CAB). The PCM can improve the diagnostic ability of the network for lesions of different sizes and shapes. The role of SAB and CAB is to focus the features extracted from the network on the lesion area to improve the ability of COVID-19 discrimination and localization. We verify the effectiveness of the proposed method on two datasets. The accuracy rate of 97.12%, specificity of 96.89%, and sensitivity of 97.21% are achieved by the proposed network on DTDB dataset provided by the Beijing Ditan Hospital Capital Medical University. Compared with other state-of-the-art attention modules, the proposed method achieves better result. As for the public COVID-19 SARS-CoV-2 dataset, 95.16% for accuracy, 95.6% for F1-score and 99.01% for AUC are obtained. The proposed network can effectively assist doctors in the diagnosis of COVID-19 CT images.
Collapse
Affiliation(s)
- Xia Ma
- Department of Pulmonary and Critical Care Medicine, The Third Hospital of Shanxi Medical University, Taiyuan 030032, China
- Department of Pulmonary and Critical Care Medicine, The First Hospital of Shanxi Medical University, Taiyuan 030001, China
| | - Bingbing Zheng
- School of Information Science and Engineering, East China University of Science and Technology, Shanghai 200237, China
| | - Yu Zhu
- School of Information Science and Engineering, East China University of Science and Technology, Shanghai 200237, China
| | - Fuli Yu
- School of Information Science and Engineering, East China University of Science and Technology, Shanghai 200237, China
| | - Rixin Zhang
- Department of Pulmonary and Critical Care Medicine, The First Hospital of Shanxi Medical University, Taiyuan 030001, China
| | - Budong Chen
- Beijing Ditan Hospital Capital Medical University, Beijing 100015, China
| |
Collapse
|
17
|
Li Z, Zhao S, Chen Y, Luo F, Kang Z, Cai S, Zhao W, Liu J, Zhao D, Li Y. A deep-learning-based framework for severity assessment of COVID-19 with CT images. EXPERT SYSTEMS WITH APPLICATIONS 2021; 185:115616. [PMID: 34334965 PMCID: PMC8314790 DOI: 10.1016/j.eswa.2021.115616] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/06/2021] [Revised: 06/03/2021] [Accepted: 07/12/2021] [Indexed: 02/05/2023]
Abstract
Millions of positive COVID-19 patients are suffering from the pandemic around the world, a critical step in the management and treatment is severity assessment, which is quite challenging with the limited medical resources. Currently, several artificial intelligence systems have been developed for the severity assessment. However, imprecise severity assessment and insufficient data are still obstacles. To address these issues, we proposed a novel deep-learning-based framework for the fine-grained severity assessment using 3D CT scans, by jointly performing lung segmentation and lesion segmentation. The main innovations in the proposed framework include: 1) decomposing 3D CT scan into multi-view slices for reducing the complexity of 3D model, 2) integrating prior knowledge (dual-Siamese channels and clinical metadata) into our model for improving the model performance. We evaluated the proposed method on 1301 CT scans of 449 COVID-19 cases collected by us, our method achieved an accuracy of 86.7% for four-way classification, with the sensitivities of 92%, 78%, 95%, 89% for four stages. Moreover, ablation study demonstrated the effectiveness of the major components in our model. This indicates that our method may contribute a potential solution to severity assessment of COVID-19 patients using CT images and clinical metadata.
Collapse
Affiliation(s)
- Zhidan Li
- MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China
| | - Shixuan Zhao
- MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China
| | - Yang Chen
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
| | - Fuya Luo
- MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China
| | - Zhiqing Kang
- MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China
| | - Shengping Cai
- Department of Radiology, Wuhan Red Cross Hospital, Wuhan, China
| | - Wei Zhao
- Department of Radiology, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Jun Liu
- Department of Radiology, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Di Zhao
- Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China
| | - Yongjie Li
- MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China
| |
Collapse
|
18
|
Müller D, Soto-Rey I, Kramer F. Robust chest CT image segmentation of COVID-19 lung infection based on limited data. INFORMATICS IN MEDICINE UNLOCKED 2021; 25:100681. [PMID: 34337140 PMCID: PMC8313817 DOI: 10.1016/j.imu.2021.100681] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Revised: 07/12/2021] [Accepted: 07/25/2021] [Indexed: 12/17/2022] Open
Abstract
BACKGROUND The coronavirus disease 2019 (COVID-19) affects billions of lives around the world and has a significant impact on public healthcare. For quantitative assessment and disease monitoring medical imaging like computed tomography offers great potential as alternative to RT-PCR methods. For this reason, automated image segmentation is highly desired as clinical decision support. However, publicly available COVID-19 imaging data is limited which leads to overfitting of traditional approaches. METHODS To address this problem, we propose an innovative automated segmentation pipeline for COVID-19 infected regions, which is able to handle small datasets by utilization as variant databases. Our method focuses on on-the-fly generation of unique and random image patches for training by performing several preprocessing methods and exploiting extensive data augmentation. For further reduction of the overfitting risk, we implemented a standard 3D U-Net architecture instead of new or computational complex neural network architectures. RESULTS Through a k-fold cross-validation on 20 CT scans as training and validation of COVID-19, we were able to develop a highly accurate as well as robust segmentation model for lungs and COVID-19 infected regions without overfitting on limited data. We performed an in-detail analysis and discussion on the robustness of our pipeline through a sensitivity analysis based on the cross-validation and impact on model generalizability of applied preprocessing techniques. Our method achieved Dice similarity coefficients for COVID-19 infection between predicted and annotated segmentation from radiologists of 0.804 on validation and 0.661 on a separate testing set consisting of 100 patients. CONCLUSIONS We demonstrated that the proposed method outperforms related approaches, advances the state-of-the-art for COVID-19 segmentation and improves robust medical image analysis based on limited data.
Collapse
Affiliation(s)
- Dominik Müller
- IT-Infrastructure for Translational Medical Research, Faculty of Applied Computer Science, Faculty of Medicine, University of Augsburg, Germany
| | - Iñaki Soto-Rey
- IT-Infrastructure for Translational Medical Research, Faculty of Applied Computer Science, Faculty of Medicine, University of Augsburg, Germany
| | - Frank Kramer
- IT-Infrastructure for Translational Medical Research, Faculty of Applied Computer Science, Faculty of Medicine, University of Augsburg, Germany
| |
Collapse
|
19
|
Qayyum A, Razzak I, Tanveer M, Kumar A. Depth-wise dense neural network for automatic COVID19 infection detection and diagnosis. ANNALS OF OPERATIONS RESEARCH 2021:1-21. [PMID: 34248242 PMCID: PMC8254442 DOI: 10.1007/s10479-021-04154-5] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 06/08/2021] [Indexed: 05/09/2023]
Abstract
Coronavirus (COVID-19) and its new strain resulted in massive damage to society and brought panic worldwide. Automated medical image analysis such as X-rays, CT, and MRI offers excellent early diagnosis potential to augment the traditional healthcare strategy to fight against COVID-19. However, the identification of COVID infected lungs X-rays is challenging due to the high variation in infection characteristics and low-intensity contrast between normal tissues and infections. To identify the infected area, in this work, we present a novel depth-wise dense network that uniformly scales all dimensions and performs multilevel feature embedding, resulting in increased feature representations. The inclusion of depth wise component and squeeze-and-excitation results in better performance by capturing a more receptive field than the traditional convolutional layer; however, the parameters are almost the same. To improve the performance and training set, we have combined three large scale datasets. The extensive experiments on the benchmark X-rays datasets demonstrate the effectiveness of the proposed framework by achieving 96.17% in comparison to cutting-edge methods primarily based on transfer learning.
Collapse
|
20
|
Munusamy H, Karthikeyan JM, Shriram G, Thanga Revathi S, Aravindkumar S. FractalCovNet architecture for COVID-19 Chest X-ray image Classification and CT-scan image Segmentation. Biocybern Biomed Eng 2021; 41:1025-1038. [PMID: 34257471 PMCID: PMC8264565 DOI: 10.1016/j.bbe.2021.06.011] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Revised: 06/26/2021] [Accepted: 06/30/2021] [Indexed: 12/14/2022]
Abstract
Precise and fast diagnosis of COVID-19 cases play a vital role in early stage of medical treatment and prevention. Automatic detection of COVID-19 cases using the chest X-ray images and chest CT-scan images will be helpful to reduce the impact of this pandemic on the human society. We have developed a novel FractalCovNet architecture using Fractal blocks and U-Net for segmentation of chest CT-scan images to localize the lesion region. The same FractalCovNet architecture is also used for classification of chest X-ray images using transfer learning. We have compared the segmentation results using various model such as U-Net, DenseUNet, Segnet, ResnetUNet, and FCN. We have also compared the classification results with various models like ResNet5-, Xception, InceptionResNetV2, VGG-16 and DenseNet architectures. The proposed FractalCovNet model is able to predict the COVID-19 lesion with high F-measure and precision values compared to the other state-of-the-art methods. Thus the proposed model can accurately predict the COVID-19 cases and discover lesion regions in chest CT without the manual annotations of lesions for every suspected individual. An easily-trained and high-performance deep learning model provides a fast way to identify COVID-19 patients, which is beneficial to control the outbreak of SARS-II-COV.
Collapse
Affiliation(s)
- Hemalatha Munusamy
- Department of Information Technology, Anna University, MIT Campus, Chennai, India
| | - J M Karthikeyan
- Department of Information Technology, Anna University, MIT Campus, Chennai, India
| | - G Shriram
- Department of Information Technology, Anna University, MIT Campus, Chennai, India
| | - S Thanga Revathi
- Department of Computer Science and Engineering, SRM Institute of Science and Technology, Chennai, India
| | - S Aravindkumar
- Department of Information Technology, Rajalakshmi Engineering College, Chennai, India
| |
Collapse
|
21
|
Pei HY, Yang D, Liu GR, Lu T. MPS-Net: Multi-Point Supervised Network for CT Image Segmentation of COVID-19. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2021; 9:47144-47153. [PMID: 34812388 PMCID: PMC8545216 DOI: 10.1109/access.2021.3067047] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/23/2021] [Accepted: 03/08/2021] [Indexed: 05/27/2023]
Abstract
The new coronavirus, which has become a global pandemic, has confirmed more than 88 million cases worldwide since the first case was recorded in December 2019, causing over 1.9 million deaths. Since COIVD-19 lesions have clear imaging features on CT images, it is suitable for the auxiliary diagnosis and treatment of COVID-19. Deep learning can be used to segment the lesions areas of COVID-19 in CT images to help monitor the epidemic situation. In this paper, we propose a multi-point supervision network (MPS-Net) for segmentation of COVID-19 lung infection CT image lesions to solve the problem of a variety of lesion shapes and areas. A multi-scale feature extraction structure, a sieve connection structure (SC), a multi-scale input structure and a multi-point supervised training structure were implemented into MPS-Net. In order to increase the ability to segment various lesion areas of different sizes, the multi-scale feature extraction structure and the sieve connection structure will use different sizes of receptive fields to extract feature maps of various scales. The multi-scale input structure is used to minimize the edge loss caused by the convolution process. In order to improve the accuracy of segmentation, we propose a multi-point supervision training structure to extract supervision signals from different up-sampling points on the network. Experimental results showed that the dice similarity coefficient (DSC), sensitivity, specificity and IOU of the segmentation results of our model are 0.8325, 0.8406, 09988 and 0.742, respectively. The experimental results demonstrated that the network proposed in this paper can effectively segment COVID-19 infection on CT images. It can be used to assist the diagnosis and treatment of new coronary pneumonia.
Collapse
Affiliation(s)
- Hong-Yang Pei
- Key Laboratory of Infrared Optoelectric Materials and Micro-Nano DevicesNortheastern UniversityShenyang110819China
- College of Information Science and EngineeringNortheastern UniversityShenyang110819China
| | - Dan Yang
- Key Laboratory of Infrared Optoelectric Materials and Micro-Nano DevicesNortheastern UniversityShenyang110819China
- Key Laboratory of Data Analytics and Optimization for Smart Industry, Ministry of EducationNortheastern UniversityShenyang110819China
| | - Guo-Ru Liu
- Key Laboratory of Data Analytics and Optimization for Smart Industry, Ministry of EducationNortheastern UniversityShenyang110819China
- College of Information Science and EngineeringNortheastern UniversityShenyang110819China
| | - Tian Lu
- College of Information Science and EngineeringNortheastern UniversityShenyang110819China
| |
Collapse
|