1
|
Ma X, Song H, Jia X, Wang Z. An improved V-Net lung nodule segmentation model based on pixel threshold separation and attention mechanism. Sci Rep 2024; 14:4743. [PMID: 38413699 PMCID: PMC10899216 DOI: 10.1038/s41598-024-55178-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Accepted: 02/21/2024] [Indexed: 02/29/2024] Open
Abstract
Accurate labeling of lung nodules in computed tomography (CT) images is crucial in early lung cancer diagnosis and before nodule resection surgery. However, the irregular shape of lung nodules in CT images and the complex lung environment make it much more challenging to segment lung nodules accurately. On this basis, we propose an improved V-Net segmentation method based on pixel threshold separation and attention mechanism for lung nodules. This method first offers a data augment strategy to solve the problem of insufficient samples in 3D medical datasets. In addition, we integrate the feature extraction module based on pixel threshold separation into the model to enhance the feature extraction ability under different thresholds on the one hand. On the other hand, the model introduces channel and spatial attention modules to make the model pay more attention to important semantic information and improve its generalization ability and accuracy. Experiments show that the Dice similarity coefficients of the improved model on the public datasets LUNA16 and LNDb are 94.9% and 81.1% respectively, and the sensitivities reach 92.7% and 76.9% respectively. which is superior to most existing UNet architecture models and comparable to the manual level segmentation results by medical technologists.
Collapse
Affiliation(s)
- Xiaopu Ma
- School of Computer Science and Technology, Nanyang Normal University, Nanyang, 473061, China.
| | - Handing Song
- School of Life Sciences and Agricultural Engineering, Nanyang Normal University, Nanyang, 473061, China
| | - Xiao Jia
- School of Computer Science and Technology, Nanyang Normal University, Nanyang, 473061, China
| | - Zhan Wang
- School of Life Sciences and Agricultural Engineering, Nanyang Normal University, Nanyang, 473061, China
| |
Collapse
|
2
|
Mao K, Jing X, Wang G, Chang Y, Liu J, Zhao Y, Yu S, Liu J. A novel open-source CADs platform for 3D CT pulmonary analysis. Comput Biol Med 2024; 169:107878. [PMID: 38141446 DOI: 10.1016/j.compbiomed.2023.107878] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Revised: 11/10/2023] [Accepted: 12/18/2023] [Indexed: 12/25/2023]
Abstract
Computer-aided diagnosis (CAD) systems play vital roles in the early detection of pulmonary nodules for reducing lung cancer mortality rates. To provide better services for professional doctors, this paper proposes an efficient open-source CAD platform with flexible equipments, user-friendly interfaces, and completed functions for 3D CT pulmonary nodule analysis. For the platform's design and implementation, we fully consider application scenarios and system requirements. The platform supplies core functions for (1) Basic Image Processing, (2) Intelligent Image Analysis, (3) Multi-View Image Visualization, (4) Report Editing and Generation, (5) User Information Management, and (6) Inference Service Monitoring. Specifically, other state-of-the-art or user-defined algorithms can be integrated as plugin modules with no interference for system architecture. System evaluation with use-case testing demonstrates the effectiveness and universality of the proposed platform.
Collapse
Affiliation(s)
- Keming Mao
- Software College, Northeastern University, Shenyang, China
| | - Xin Jing
- Software College, Northeastern University, Shenyang, China
| | - Gao Wang
- Software College, Northeastern University, Shenyang, China
| | - Yachen Chang
- School of Software Technology, Zhejiang University, Ningbo, China
| | - Jiale Liu
- Software College, Northeastern University, Shenyang, China.
| | - Yuhai Zhao
- College of Computer Science and Engineering, Northeastern University, Shenyang, China
| | - Shiyu Yu
- China Mobile Group Liaoning Company Limited, Shenyang, China
| | - Jingyu Liu
- China Mobile Group Liaoning Company Limited, Shenyang, China
| |
Collapse
|
3
|
Zhi L, Jiang W, Zhang S, Zhou T. Deep neural network pulmonary nodule segmentation methods for CT images: Literature review and experimental comparisons. Comput Biol Med 2023; 164:107321. [PMID: 37595518 DOI: 10.1016/j.compbiomed.2023.107321] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Revised: 05/08/2023] [Accepted: 08/07/2023] [Indexed: 08/20/2023]
Abstract
Automatic and accurate segmentation of pulmonary nodules in CT images can help physicians perform more accurate quantitative analysis, diagnose diseases, and improve patient survival. In recent years, with the development of deep learning technology, pulmonary nodule segmentation methods based on deep neural networks have gradually replaced traditional segmentation methods. This paper reviews the recent pulmonary nodule segmentation algorithms based on deep neural networks. First, the heterogeneity of pulmonary nodules, the interpretability of segmentation results, and external environmental factors are discussed, and then the open-source 2D and 3D models in medical segmentation tasks in recent years are applied to the Lung Image Database Consortium and Image Database Resource Initiative (LIDC) and Lung Nodule Analysis 16 (Luna16) datasets for comparison, and the visual diagnostic features marked by radiologists are evaluated one by one. According to the analysis of the experimental data, the following conclusions are drawn: (1) In the pulmonary nodule segmentation task, the performance of the 2D segmentation models DSC is generally better than that of the 3D segmentation models. (2) 'Subtlety', 'Sphericity', 'Margin', 'Texture', and 'Size' have more influence on pulmonary nodule segmentation, while 'Lobulation', 'Spiculation', and 'Benign and Malignant' features have less influence on pulmonary nodule segmentation. (3) Higher accuracy in pulmonary nodule segmentation can be achieved based on better-quality CT images. (4) Good contextual information acquisition and attention mechanism design positively affect pulmonary nodule segmentation.
Collapse
Affiliation(s)
- Lijia Zhi
- School of Computer Science and Engineering, North Minzu University, Yinchuan, 750021, China; Medical Imaging Center, Ningxia Hui Autonomous Region People's Hospital, Yinchuan, 750000, China; The Key Laboratory of Images & Graphics Intelligent Processing of State Ethnic Affairs Commission, Yinchuan, 750021, China.
| | - Wujun Jiang
- School of Computer Science and Engineering, North Minzu University, Yinchuan, 750021, China.
| | - Shaomin Zhang
- School of Computer Science and Engineering, North Minzu University, Yinchuan, 750021, China; Medical Imaging Center, Ningxia Hui Autonomous Region People's Hospital, Yinchuan, 750000, China; The Key Laboratory of Images & Graphics Intelligent Processing of State Ethnic Affairs Commission, Yinchuan, 750021, China.
| | - Tao Zhou
- School of Computer Science and Engineering, North Minzu University, Yinchuan, 750021, China; The Key Laboratory of Images & Graphics Intelligent Processing of State Ethnic Affairs Commission, Yinchuan, 750021, China.
| |
Collapse
|
4
|
M DL, M DP. An Improved Convolution Neural Network and Modified Regularized K-Means-Based Automatic Lung Nodule Detection and Classification. J Digit Imaging 2023; 36:1431-1446. [PMID: 37106212 PMCID: PMC10406790 DOI: 10.1007/s10278-023-00809-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2022] [Revised: 03/03/2023] [Accepted: 03/08/2023] [Indexed: 04/29/2023] Open
Abstract
If lung cancer is not detected in its initial phases, it can be fatal. However, because of the quantity and structure of its nodules, lung cancer is difficult to detect early. For accurate detections, radiologists require assistance from automated tools. Numerous expert methods have been created over time to assist radiologists in the diagnosis of lung cancer. However, this requires accurate research. Therefore, in this article, we propose a framework to precisely detect lung cancer by categorizing it between benign and malignant nodules. To achieve this objective, an efficient deep-learning algorithm is presented. The presented technique consists of four stages, namely pre-processing, segmentation, classification, and severity stage analysis. Initially, the collected image is given to the pre-processing stage to eliminate the distortion present in the image. Then, the noise-free image is given to the segmentation stage. For segmentation, in this paper, modified regularized K-means (MRKM) clustering algorithm is presented. After the segmentation process, the segmented nodule image is fed to the classification stage to categorize the nodule as benign or malignant (risk nodule). For classification, an improved convolution neural network (ICNN) is presented. The proposed ICNN is designed by modifying CNN with the integration of the adaptive tree seed optimization (ATSO) algorithm. Finally, the stage identification is carried out based on the size of the nodule and we classify the malignant nodule as S1-S4. The presented technique attained the maximum accuracy of 96.5% and performance compared with existing state-of-art methods.
Collapse
Affiliation(s)
- Dhasny Lydia M
- Department of Data Science and Business Systems, School of Computing, SRM Institute of Science and Technology, Kattankulathur, Tamil Nadu India
| | - Dr. Prakash M
- Department of Data Science and Business Systems, School of Computing, SRM Institute of Science and Technology, Kattankulathur, Tamil Nadu India
| |
Collapse
|
5
|
Usman M, Shin YG. DEHA-Net: A Dual-Encoder-Based Hard Attention Network with an Adaptive ROI Mechanism for Lung Nodule Segmentation. Sensors (Basel) 2023; 23:1989. [PMID: 36850583 PMCID: PMC9960760 DOI: 10.3390/s23041989] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Revised: 01/31/2023] [Accepted: 02/07/2023] [Indexed: 06/18/2023]
Abstract
Measuring pulmonary nodules accurately can help the early diagnosis of lung cancer, which can increase the survival rate among patients. Numerous techniques for lung nodule segmentation have been developed; however, most of them either rely on the 3D volumetric region of interest (VOI) input by radiologists or use the 2D fixed region of interest (ROI) for all the slices of computed tomography (CT) scan. These methods only consider the presence of nodules within the given VOI, which limits the networks' ability to detect nodules outside the VOI and can also encompass unnecessary structures in the VOI, leading to potentially inaccurate segmentation. In this work, we propose a novel approach for 3D lung nodule segmentation that utilizes the 2D region of interest (ROI) inputted from a radiologist or computer-aided detection (CADe) system. Concretely, we developed a two-stage lung nodule segmentation technique. Firstly, we designed a dual-encoder-based hard attention network (DEHA-Net) in which the full axial slice of thoracic computed tomography (CT) scan, along with an ROI mask, were considered as input to segment the lung nodule in the given slice. The output of DEHA-Net, the segmentation mask of the lung nodule, was inputted to the adaptive region of interest (A-ROI) algorithm to automatically generate the ROI masks for the surrounding slices, which eliminated the need for any further inputs from radiologists. After extracting the segmentation along the axial axis, at the second stage, we further investigated the lung nodule along sagittal and coronal views by employing DEHA-Net. All the estimated masks were inputted into the consensus module to obtain the final volumetric segmentation of the nodule. The proposed scheme was rigorously evaluated on the lung image database consortium and image database resource initiative (LIDC/IDRI) dataset, and an extensive analysis of the results was performed. The quantitative analysis showed that the proposed method not only improved the existing state-of-the-art methods in terms of dice score but also showed significant robustness against different types, shapes, and dimensions of the lung nodules. The proposed framework achieved the average dice score, sensitivity, and positive predictive value of 87.91%, 90.84%, and 89.56%, respectively.
Collapse
|
6
|
Yue G, Han W, Li S, Zhou T, Lv J, Wang T. Automated polyp segmentation in colonoscopy images via deep network with lesion-aware feature selection and refinement. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103846] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|