1
|
Nie X, Zhou X, Tong T, Lin X, Wang L, Zheng H, Li J, Xue E, Chen S, Zheng M, Chen C, Du M. N-Net: A novel dense fully convolutional neural network for thyroid nodule segmentation. Front Neurosci 2022; 16:872601. [PMID: 36117632 PMCID: PMC9475170 DOI: 10.3389/fnins.2022.872601] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2022] [Accepted: 08/11/2022] [Indexed: 11/13/2022] Open
Abstract
Medical image segmentation is an essential component of computer-aided diagnosis (CAD) systems. Thyroid nodule segmentation using ultrasound images is a necessary step for the early diagnosis of thyroid diseases. An encoder-decoder based deep convolutional neural network (DCNN), like U-Net architecture and its variants, has been extensively used to deal with medical image segmentation tasks. In this article, we propose a novel N-shape dense fully convolutional neural network for medical image segmentation, referred to as N-Net. The proposed framework is composed of three major components: a multi-scale input layer, an attention guidance module, and an innovative stackable dilated convolution (SDC) block. First, we apply the multi-scale input layer to construct an image pyramid, which achieves multi-level receiver field sizes and obtains rich feature representation. After that, the U-shape convolutional network is employed as the backbone structure. Moreover, we use the attention guidance module to filter the features before several skip connections, which can transfer structural information from previous feature maps to the following layers. This module can also remove noise and reduce the negative impact of the background. Finally, we propose a stackable dilated convolution (SDC) block, which is able to capture deep semantic features that may be lost in bilinear upsampling. We have evaluated the proposed N-Net framework on a thyroid nodule ultrasound image dataset (called the TNUI-2021 dataset) and the DDTI publicly available dataset. The experimental results show that our N-Net model outperforms several state-of-the-art methods in the thyroid nodule segmentation tasks.
Collapse
Affiliation(s)
- Xingqing Nie
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, China
- Fujian Key Lab of Medical Instrumentation and Pharmaceutical Technology, Fuzhou University, Fuzhou, China
| | - Xiaogen Zhou
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, China
- Fujian Key Lab of Medical Instrumentation and Pharmaceutical Technology, Fuzhou University, Fuzhou, China
| | - Tong Tong
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, China
- Fujian Key Lab of Medical Instrumentation and Pharmaceutical Technology, Fuzhou University, Fuzhou, China
- Imperial Vision Technology, Fuzhou, China
| | - Xingtao Lin
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, China
- Fujian Key Lab of Medical Instrumentation and Pharmaceutical Technology, Fuzhou University, Fuzhou, China
| | - Luoyan Wang
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, China
- Fujian Key Lab of Medical Instrumentation and Pharmaceutical Technology, Fuzhou University, Fuzhou, China
| | - Haonan Zheng
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, China
- Fujian Key Lab of Medical Instrumentation and Pharmaceutical Technology, Fuzhou University, Fuzhou, China
| | - Jing Li
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, China
- Fujian Key Lab of Medical Instrumentation and Pharmaceutical Technology, Fuzhou University, Fuzhou, China
| | - Ensheng Xue
- Fujian Medical Ultrasound Research Institute, Fuzhou, China
- Department of Ultrasound, Fujian Medical University Union Hospital, Fuzhou, China
| | - Shun Chen
- Fujian Medical Ultrasound Research Institute, Fuzhou, China
- Department of Ultrasound, Fujian Medical University Union Hospital, Fuzhou, China
| | - Meijuan Zheng
- Fujian Medical Ultrasound Research Institute, Fuzhou, China
- Department of Ultrasound, Fujian Medical University Union Hospital, Fuzhou, China
| | - Cong Chen
- Fujian Medical Ultrasound Research Institute, Fuzhou, China
- Department of Ultrasound, Fujian Medical University Union Hospital, Fuzhou, China
| | - Min Du
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, China
- Fujian Key Lab of Medical Instrumentation and Pharmaceutical Technology, Fuzhou University, Fuzhou, China
| |
Collapse
|
2
|
Huang K, Xu L, Zhu Y, Meng P. A U-snake based deep learning network for right ventricle segmentation. Med Phys 2022; 49:3900-3913. [PMID: 35302251 DOI: 10.1002/mp.15613] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2021] [Revised: 02/11/2022] [Accepted: 03/04/2022] [Indexed: 11/09/2022] Open
Abstract
PURPOSE Ventricular segmentation is of great importance for the heart condition monitoring. However, manual segmentation is time-consuming, cumbersome and subjective. Many segmentation methods perform poorly due to the complex structure and uncertain shape of the right ventricle, so we combine deep learning to achieve automatic segmentation. METHOD This paper proposed a method named U-Snake network which is based on the improvement of deep snake5 together with level set8 to segment the right ventricular in the MR images. U-snake aggregates the information of each receptive field which is learned by circular convolution of multiple different dilation rates. At the same time, we also added dice loss functions and transferred the result of U-Snake to the level set so as to further enhance the effect of small object segmentation. our method is tested on the test1 and test2 datasets in the Right Ventricular Segmentation Challenge, which shows the effectiveness. RESULTS The experiment showed that we have obtained good result in the right ventricle segmentation challenge(RVSC). The highest segmentation accuracy on the right ventricular test set 2 reached a dice coefficient of 0.911, and the segmentation speed reached 5fps. CONCLUSIONS Our method, a new deep learning network named U-snake, has surpassed the previous excellent ventricular segmentation method based on mathematical theory and other classical deep learning methods, such as Residual U-net27 , Inception cnn33 , Dilated cnn29 , etc. However, it can only be used as an auxiliary tool instead of replacing the work of human beings. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Kaiwen Huang
- The School of Optical-Electrical & Computer Engineering, University of Shanghai for Science & Technology, Shanghai, 200093, China
| | - Lei Xu
- The School of Optical-Electrical & Computer Engineering, University of Shanghai for Science & Technology, Shanghai, 200093, China
| | - Yingliang Zhu
- The School of Optical-Electrical & Computer Engineering, University of Shanghai for Science & Technology, Shanghai, 200093, China
| | - Penghui Meng
- The School of Optical-Electrical & Computer Engineering, University of Shanghai for Science & Technology, Shanghai, 200093, China
| |
Collapse
|
3
|
Soomro S, Akram F, Munir A, Lee CH, Choi KN. Segmentation of Left and Right Ventricles in Cardiac MRI Using Active Contours. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2017; 2017:8350680. [PMID: 28928796 PMCID: PMC5591936 DOI: 10.1155/2017/8350680] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/08/2017] [Accepted: 07/09/2017] [Indexed: 11/17/2022]
Abstract
Segmentation of left and right ventricles plays a crucial role in quantitatively analyzing the global and regional information in the cardiac magnetic resonance imaging (MRI). In MRI, the intensity inhomogeneity and weak or blurred object boundaries are the problems, which makes it difficult for the intensity-based segmentation methods to properly delineate the regions of interests (ROI). In this paper, a hybrid signed pressure force function (SPF) is proposed, which yields both local and global image fitted differences in an additive fashion. A characteristic term is also introduced in the SPF function to restrict the contour within the ROI. The overlapping dice index and Hausdorff-Distance metrics have been used over cardiac datasets for quantitative validation. Using 2009 LV MICCAI validation dataset, the proposed method yields DSC values of 0.95 and 0.97 for endocardial and epicardial contours, respectively. Using 2012 RV MICCAI dataset, for the endocardial region, the proposed method yields DSC values of 0.97 and 0.90 and HD values of 8.51 and 7.67 for ED and ES, respectively. For the epicardial region, it yields DSC values of 0.92 and 0.91 and HD values of 6.47 and 9.34 for ED and ES, respectively. Results show its robustness in the segmentation application of the cardiac MRI.
Collapse
Affiliation(s)
- Shafiullah Soomro
- Department of Computer Science and Engineering, Chung-Ang University, Seoul 156-756, Republic of Korea
| | - Farhan Akram
- Department of Computer Engineering and Mathematics, Rovira i Virgili University, 43007 Tarragona, Spain
| | - Asad Munir
- Department of Computer Science and Engineering, Chung-Ang University, Seoul 156-756, Republic of Korea
| | - Chang Ha Lee
- Department of Computer Science and Engineering, Chung-Ang University, Seoul 156-756, Republic of Korea
| | - Kwang Nam Choi
- Department of Computer Science and Engineering, Chung-Ang University, Seoul 156-756, Republic of Korea
| |
Collapse
|
4
|
Feng C, Zhang S, Zhao D, Li C. Simultaneous extraction of endocardial and epicardial contours of the left ventricle by distance regularized level sets. Med Phys 2016; 43:2741-2755. [DOI: 10.1118/1.4947126] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|
5
|
Wang L, Pei M, Codella NCF, Kochar M, Weinsaft JW, Li J, Prince MR, Wang Y. Left ventricle: fully automated segmentation based on spatiotemporal continuity and myocardium information in cine cardiac magnetic resonance imaging (LV-FAST). BIOMED RESEARCH INTERNATIONAL 2015; 2015:367583. [PMID: 25738153 PMCID: PMC4337041 DOI: 10.1155/2015/367583] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/22/2014] [Revised: 01/04/2015] [Accepted: 01/12/2015] [Indexed: 12/29/2022]
Abstract
CMR quantification of LV chamber volumes typically and manually defines the basal-most LV, which adds processing time and user-dependence. This study developed an LV segmentation method that is fully automated based on the spatiotemporal continuity of the LV (LV-FAST). An iteratively decreasing threshold region growing approach was used first from the midventricle to the apex, until the LV area and shape discontinued, and then from midventricle to the base, until less than 50% of the myocardium circumference was observable. Region growth was constrained by LV spatiotemporal continuity to improve robustness of apical and basal segmentations. The LV-FAST method was compared with manual tracing on cardiac cine MRI data of 45 consecutive patients. Of the 45 patients, LV-FAST and manual selection identified the same apical slices at both ED and ES and the same basal slices at both ED and ES in 38, 38, 38, and 41 cases, respectively, and their measurements agreed within -1.6 ± 8.7 mL, -1.4 ± 7.8 mL, and 1.0 ± 5.8% for EDV, ESV, and EF, respectively. LV-FAST allowed LV volume-time course quantitatively measured within 3 seconds on a standard desktop computer, which is fast and accurate for processing the cine volumetric cardiac MRI data, and enables LV filling course quantification over the cardiac cycle.
Collapse
Affiliation(s)
- Lijia Wang
- Shanghai Key Laboratory of Magnetic Resonance and Department of Physics, East China Normal University, Shanghai, China
- Department of Radiology, Weill Cornell Medical College, New York, NY 10022, USA
| | - Mengchao Pei
- Shanghai Key Laboratory of Magnetic Resonance and Department of Physics, East China Normal University, Shanghai, China
| | - Noel C. F. Codella
- Multimedia Research, IBM T. J. Watson Research Center, 1101 Kitchawan Road, Yorktown Heights, NY 10598, USA
| | - Minisha Kochar
- Department of Medicine-Cardiology, Weill Cornell Medical College, New York, NY 10021, USA
| | - Jonathan W. Weinsaft
- Department of Radiology, Weill Cornell Medical College, New York, NY 10022, USA
- Department of Medicine-Cardiology, Weill Cornell Medical College, New York, NY 10021, USA
| | - Jianqi Li
- Shanghai Key Laboratory of Magnetic Resonance and Department of Physics, East China Normal University, Shanghai, China
| | - Martin R. Prince
- Department of Radiology, Weill Cornell Medical College, New York, NY 10022, USA
| | - Yi Wang
- Shanghai Key Laboratory of Magnetic Resonance and Department of Physics, East China Normal University, Shanghai, China
- Department of Radiology, Weill Cornell Medical College, New York, NY 10022, USA
- Department of Medicine-Cardiology, Weill Cornell Medical College, New York, NY 10021, USA
- Department of Biomedical Engineering, Cornell University, Ithaca, NY 14853, USA
- Department of Biomedical Engineering, Kyung Hee University, 1 Seocheon-dong, Giheung-gu, Yongin-si, Gyeonggi-do 446701, Republic of Korea
| |
Collapse
|