1
|
Li B, Zhang L, Liu J, Peng H, Wang Q, Liu J. Multi-focus image fusion with parameter adaptive dual channel dynamic threshold neural P systems. Neural Netw 2024; 179:106603. [PMID: 39146717 DOI: 10.1016/j.neunet.2024.106603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2024] [Revised: 07/06/2024] [Accepted: 08/05/2024] [Indexed: 08/17/2024]
Abstract
Multi-focus image fusion (MFIF) is an important technique that aims to combine the focused regions of multiple source images into a fully clear image. Decision-map methods are widely used in MFIF to maximize the preservation of information from the source images. While many decision-map methods have been proposed, they often struggle with difficulties in determining focus and non-focus boundaries, further affecting the quality of the fused images. Dynamic threshold neural P (DTNP) systems are computational models inspired by biological spiking neurons, featuring dynamic threshold and spiking mechanisms to better distinguish focused and unfocused regions for decision map generation. However, original DTNP systems require manual parameter configuration and have only one stimulus. Therefore, they are not suitable to be used directly for generating high-precision decision maps. To overcome these limitations, we propose a variant called parameter adaptive dual channel DTNP (PADCDTNP) systems. Inspired by the spiking mechanisms of PADCDTNP systems, we further develop a new MFIF method. As a new neural model, PADCDTNP systems adaptively estimate parameters according to multiple external inputs to produce decision maps with robust boundaries, resulting in high-quality fusion results. Comprehensive experiments on the Lytro/MFFW/MFI-WHU dataset show that our method achieves advanced performance and yields comparable results to the fourteen representative MFIF methods. In addition, compared to the standard DTNP systems, PADCDTNP systems improve the fusion performance and fusion efficiency on the three datasets by 5.69% and 86.03%, respectively. The codes for both the proposed method and the comparison methods are released at https://github.com/MorvanLi/MFIF-PADCDTNP.
Collapse
Affiliation(s)
- Bo Li
- School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China; Ministry of Education Key Laboratory of Intelligent Networks and Network Security, Xi'an Jiaotong University, Xi'an, 710049, China
| | - Lingling Zhang
- School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China; Ministry of Education Key Laboratory of Intelligent Networks and Network Security, Xi'an Jiaotong University, Xi'an, 710049, China.
| | - Jun Liu
- School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China; Shaanxi Province Key Laboratory of Big Data Knowledge Engineering, Xi'an Jiaotong University, Xi'an, 710049, China
| | - Hong Peng
- School of Computer and Software Engineering, Xihua University, Chengdu, Sichuan, 610039, China
| | | | - Jiaqi Liu
- Henan University of Chinese Medicine, Henan, 450046, China
| |
Collapse
|
2
|
Wu D, Jiang J, Wang J, Zhou S, Qian K. Accuracy evaluation of dental CBCT and scanned model registration method based on pulp horn mapping surface: an in vitro proof-of-concept. BMC Oral Health 2024; 24:827. [PMID: 39034391 PMCID: PMC11637213 DOI: 10.1186/s12903-024-04565-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Accepted: 07/03/2024] [Indexed: 07/23/2024] Open
Abstract
BACKGROUND AND AIM 3D fusion model of cone-beam computed tomography (CBCT) and oral scanned data can be used for the accurate design of root canal access and guide plates in root canal therapy (RCT). However, the pose accuracy of the dental pulp and crown in data registration has not been investigated, which affects the precise implementation of clinical planning goals. We aimed to establish a novel registration method based on pulp horn mapping surface (PHMSR), to evaluate the accuracy of PHMSR versus traditional methods for crown-pulp registration of CBCT and oral scan data. MATERIALS AND METHODS This vitro study collected 8 groups of oral scanned and CBCT data in which the left mandibular teeth were not missing, No. 35 and No. 36 teeth were selected as the target teeth. The CBCT and scanned model were processed to generate equivalent point clouds. For the PHMSR method, the similarity between the feature directions of the pulp horn and the surface normal vectors of the crown were used to determine the mapping points in the CBCT point cloud that have a great influence on the pulp pose. The small surface with adjustable parameters is reconstructed near the mapping point of the crown, and the new matching point pairs between the point and the mapping surface are searched. The sparse iterative closest point (ICP) algorithm is used to solve the new matching point pairs. Then, in the C + + programming environment with a point cloud library (PCL), the PHMSR, the traditional sparse ICP, ICP, and coherent point drift (CPD) algorithms are used to register the point clouds under two different initial deviations. The root square mean error (RSME) of the crown, crown-pulp orientation deviation (CPOD), and position deviation (CPPD) were calculated to evaluate the registration accuracy. The significance between the groups was tested by a two-tailed paired t-test (p < 0.05). RESULTS The crown RSME values of the sparse ICP method (0.257), the ICP method (0.217), and the CPD method (0.209) were not significantly different from the PHMSR method (0.250). The CPOD and CPPD values of the sparse ICP method (4.089 and 0.133), the ICP method (1.787 and 0.700), and the CPD method (1.665 and 0.718) than for the PHMSR method, which suggests that the accuracy of crown-pulp registration is higher with the PHMSR method. CONCLUSION Compared with the traditional method, the PHMSR method has a smaller crown-pulp registration accuracy and a clinically acceptable deviation range, these results support the use of PHMSR method instead of the traditional method for clinical planning of root canal therapy.
Collapse
Affiliation(s)
- Dianhao Wu
- The Key Laboratory of Advanced Manufacturing and Intelligent Technology, Ministry of Education, Harbin University of Science and Technology, NO. 52, Xuefu Road, Nangang Dist, Harbin, Heilongjiang Province, 150080, People's Republic of China
| | - Jingang Jiang
- The Key Laboratory of Advanced Manufacturing and Intelligent Technology, Ministry of Education, Harbin University of Science and Technology, NO. 52, Xuefu Road, Nangang Dist, Harbin, Heilongjiang Province, 150080, People's Republic of China.
| | - Jinke Wang
- The Robotics and its Engineering Research Center, Harbin University of Science and Technology, Harbin, Heilongjiang Province, 150080, China
| | - Shan Zhou
- The 2nd Affiliated Hospital of Harbin Medical University, No.246 Xuefu Road, Nangang District, Harbin, Heilongjiang Province, 150001, People's Republic of China
| | - Kun Qian
- The Peking University School of Stomatology, No.22 Zhongguancun South Street, Haidian District, Beijing, 100081, People's Republic of China
| |
Collapse
|
3
|
Zheng J, Xiao J, Wang Y, Zhang X. CIRF: Coupled Image Reconstruction and Fusion Strategy for Deep Learning Based Multi-Modal Image Fusion. SENSORS (BASEL, SWITZERLAND) 2024; 24:3545. [PMID: 38894335 PMCID: PMC11175309 DOI: 10.3390/s24113545] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/31/2024] [Revised: 05/26/2024] [Accepted: 05/27/2024] [Indexed: 06/21/2024]
Abstract
Multi-modal medical image fusion (MMIF) is crucial for disease diagnosis and treatment because the images reconstructed from signals collected by different sensors can provide complementary information. In recent years, deep learning (DL) based methods have been widely used in MMIF. However, these methods often adopt a serial fusion strategy without feature decomposition, causing error accumulation and confusion of characteristics across different scales. To address these issues, we have proposed the Coupled Image Reconstruction and Fusion (CIRF) strategy. Our method parallels the image fusion and reconstruction branches which are linked by a common encoder. Firstly, CIRF uses the lightweight encoder to extract base and detail features, respectively, through the Vision Transformer (ViT) and the Convolutional Neural Network (CNN) branches, where the two branches interact to supplement information. Then, two types of features are fused separately via different blocks and finally decoded into fusion results. In the loss function, both the supervised loss from the reconstruction branch and the unsupervised loss from the fusion branch are included. As a whole, CIRF increases its expressivity by adding multi-task learning and feature decomposition. Additionally, we have also explored the impact of image masking on the network's feature extraction ability and validated the generalization capability of the model. Through experiments on three datasets, it has been demonstrated both subjectively and objectively, that the images fused by CIRF exhibit appropriate brightness and smooth edge transition with more competitive evaluation metrics than those fused by several other traditional and DL-based methods.
Collapse
Affiliation(s)
| | | | | | - Xuming Zhang
- Department of Biomedical Engineering, College of Life Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China
| |
Collapse
|
4
|
Yang Z, Lian J, Liu J. Infrared UAV Target Detection Based on Continuous-Coupled Neural Network. MICROMACHINES 2023; 14:2113. [PMID: 38004970 PMCID: PMC10673491 DOI: 10.3390/mi14112113] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Revised: 11/13/2023] [Accepted: 11/14/2023] [Indexed: 11/26/2023]
Abstract
The task of the detection of unmanned aerial vehicles (UAVs) is of great significance to social communication security. Infrared detection technology has the advantage of not being interfered with by environmental and other factors and can detect UAVs in complex environments. Since infrared detection equipment is expensive and data collection is difficult, there are few existing UAV-based infrared images, making it difficult to train deep neural networks; in addition, there are background clutter and noise in infrared images, such as heavy clouds, buildings, etc. The signal-to-clutter ratio is low, and the signal-to-noise ratio is low. Therefore, it is difficult to achieve the UAV detection task using traditional methods. The above challenges make infrared UAV detection a difficult task. In order to solve the above problems, this work drew upon the visual processing mechanism of the human brain to propose an effective framework for UAV detection in infrared images. The framework first determines the relevant parameters of the continuous-coupled neural network (CCNN) through the image's standard deviation, mean, etc. Then, it inputs the image into the CCNN, groups the pixels through iteration, then obtains the segmentation result through expansion and erosion, and finally, obtains the final result through the minimum circumscribed rectangle. The experimental results showed that, compared with the existing most-advanced brain-inspired image-understanding methods, this framework has the best intersection over union (IoU) (the intersection over union is the overlapping area between the predicted segmentation and the label divided by the joint area between the predicted segmentation and the label) in UAV infrared images, with an average of 74.79% (up to 97.01%), and can effectively realize the task of UAV detection.
Collapse
Affiliation(s)
- Zhuoran Yang
- School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China;
| | - Jing Lian
- School of Electronics and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China;
| | - Jizhao Liu
- School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China;
| |
Collapse
|
5
|
Zhu F, Liu W. A novel medical image fusion method based on multi-scale shearing rolling weighted guided image filter. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2023; 20:15374-15406. [PMID: 37679184 DOI: 10.3934/mbe.2023687] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/09/2023]
Abstract
Medical image fusion is a crucial technology for biomedical diagnoses. However, current fusion methods struggle to balance algorithm design, visual effects, and computational efficiency. To address these challenges, we introduce a novel medical image fusion method based on the multi-scale shearing rolling weighted guided image filter (MSRWGIF). Inspired by the rolling guided filter, we construct the rolling weighted guided image filter (RWGIF) based on the weighted guided image filter. This filter offers progressive smoothing filtering of the image, generating smooth and detailed images. Then, we construct a novel image decomposition tool, MSRWGIF, by replacing non-subsampled shearlet transform's non-sampling pyramid filter with RWGIF to extract richer detailed information. In the first step of our method, we decompose the original images under MSRWGIF to obtain low-frequency subbands (LFS) and high-frequency subbands (HFS). Since LFS contain a large amount of energy-based information, we propose an improved local energy maximum (ILGM) fusion strategy. Meanwhile, HFS employ a fast and efficient parametric adaptive pulse coupled-neural network (AP-PCNN) model to combine more detailed information. Finally, the inverse MSRWGIF is utilized to generate the final fused image from fused LFS and HFS. To test the proposed method, we select multiple medical image sets for experimental simulation and confirm its advantages by combining seven high-quality representative metrics. The simplicity and efficiency of the method are compared with 11 classical fusion methods, illustrating significant improvements in the subjective and objective performance, especially for color medical image fusion.
Collapse
Affiliation(s)
- Fang Zhu
- Department of Mathematics, Ministry of General Education, Anhui Xinhua University, Hefei 230088, China
| | - Wei Liu
- College of Mathematics and Computer Science, Tongling University, Tongling 244061, China
| |
Collapse
|
6
|
Panigrahy C, Seal A, Gonzalo-Martín C, Pathak P, Jalal AS. Parameter adaptive unit-linking pulse coupled neural network based MRI–PET/SPECT image fusion. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104659] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
|
7
|
Parameter adaptive unit-linking dual-channel PCNN based infrared and visible image fusion. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.09.157] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
8
|
Jin X, Zhou D, Jiang Q, Chu X, Yao S, Li K, Zhou W. How to Analyze the Neurodynamic Characteristics of Pulse-Coupled Neural Networks? A Theoretical Analysis and Case Study of Intersecting Cortical Model. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:6354-6368. [PMID: 33449895 DOI: 10.1109/tcyb.2020.3043233] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
The intersecting cortical model (ICM), initially designed for image processing, is a special case of the biologically inspired pulse-coupled neural-network (PCNN) models. Although the ICM has been widely used, few studies concern the internal activities and firing conditions of the neuron, which may lead to an invalid model in the application. Furthermore, the lack of theoretical analysis has led to inappropriate parameter settings and consequent limitations on ICM applications. To address this deficiency, we first study the continuous firing condition of ICM neurons to determine the restrictions that exist between network parameters and the input signal. Second, we investigate the neuron pulse period to understand the neural firing mechanism. Third, we derive the relationship between the continuous firing condition and the neural pulse period, and the relationship can prove the validity of the continuous firing condition and the neural pulse period as well. A solid understanding of the neural firing mechanism is helpful in setting appropriate parameters and in providing a theoretical basis for widespread applications to use the ICM model effectively. Extensive experiments of numerical tests with a common image reveal the rationality of our theoretical results.
Collapse
|
9
|
Multi-Scale Mixed Attention Network for CT and MRI Image Fusion. ENTROPY 2022; 24:e24060843. [PMID: 35741563 PMCID: PMC9222659 DOI: 10.3390/e24060843] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/11/2022] [Revised: 06/12/2022] [Accepted: 06/16/2022] [Indexed: 01/27/2023]
Abstract
Recently, the rapid development of the Internet of Things has contributed to the generation of telemedicine. However, online diagnoses by doctors require the analyses of multiple multi-modal medical images, which are inconvenient and inefficient. Multi-modal medical image fusion is proposed to solve this problem. Due to its outstanding feature extraction and representation capabilities, convolutional neural networks (CNNs) have been widely used in medical image fusion. However, most existing CNN-based medical image fusion methods calculate their weight maps by a simple weighted average strategy, which weakens the quality of fused images due to the effect of inessential information. In this paper, we propose a CNN-based CT and MRI image fusion method (MMAN), which adopts a visual saliency-based strategy to preserve more useful information. Firstly, a multi-scale mixed attention block is designed to extract features. This block can gather more helpful information and refine the extracted features both in the channel and spatial levels. Then, a visual saliency-based fusion strategy is used to fuse the feature maps. Finally, the fused image can be obtained via reconstruction blocks. The experimental results of our method preserve more textual details, clearer edge information and higher contrast when compared to other state-of-the-art methods.
Collapse
|
10
|
Ullah H, Zhao Y, Abdalla FYO, Wu L. Fast local Laplacian filtering based enhanced medical image fusion using parameter-adaptive PCNN and local features-based fuzzy weighted matrices. APPL INTELL 2022. [DOI: 10.1007/s10489-021-02834-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
11
|
An Efficient Defocus Blur Segmentation Scheme Based on Hybrid LTP and PCNN. SENSORS 2022; 22:s22072724. [PMID: 35408338 PMCID: PMC9003284 DOI: 10.3390/s22072724] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Revised: 03/25/2022] [Accepted: 03/25/2022] [Indexed: 11/21/2022]
Abstract
The defocus or motion effect in images is one of the main reasons for the blurry regions in digital images. It can affect the image artifacts up to some extent. However, there is a need for automatic defocus segmentation to separate blurred and sharp regions to extract the information about defocus-blur objects in some specific areas, for example, scene enhancement and object detection or recognition in defocus-blur images. The existence of defocus-blur segmentation algorithms is less prominent in noise and also costly for designing metric maps of local clarity. In this research, the authors propose a novel and robust defocus-blur segmentation scheme consisting of a Local Ternary Pattern (LTP) measured alongside Pulse Coupled Neural Network (PCNN) technique. The proposed scheme segments the blur region from blurred fragments in the image scene to resolve the limitations mentioned above of the existing defocus segmentation methods. It is noticed that the extracted fusion of upper and lower patterns of proposed sharpness-measure yields more noticeable results in terms of regions and edges compared to referenced algorithms. Besides, the suggested parameters in the proposed descriptor can be flexible to modify for performing numerous settings. To test the proposed scheme’s effectiveness, it is experimentally compared with eight referenced techniques along with a defocus-blur dataset of 1000 semi blurred images of numerous categories. The model adopted various evaluation metrics comprised of Precision, recall, and F1-Score, which improved the efficiency and accuracy of the proposed scheme. Moreover, the proposed scheme used some other flavors of evaluation parameters, e.g., Accuracy, Matthews Correlation-Coefficient (MCC), Dice-Similarity-Coefficient (DSC), and Specificity for ensuring provable evaluation results. Furthermore, the fuzzy-logic-based ranking approach of Evaluation Based on Distance from Average Solution (EDAS) module is also observed in the promising integrity analysis of the defocus blur segmentation and also in minimizing the time complexity.
Collapse
|
12
|
Wan H, Tang X, Zhu Z, Li W. Multi-Focus Image Fusion Method Based on Multi-Scale Decomposition of Information Complementary. ENTROPY 2021; 23:e23101362. [PMID: 34682086 PMCID: PMC8534655 DOI: 10.3390/e23101362] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Revised: 10/12/2021] [Accepted: 10/14/2021] [Indexed: 11/19/2022]
Abstract
Multi-focus image fusion is an important method used to combine the focused parts from source multi-focus images into a single full-focus image. Currently, to address the problem of multi-focus image fusion, the key is on how to accurately detect the focus regions, especially when the source images captured by cameras produce anisotropic blur and unregistration. This paper proposes a new multi-focus image fusion method based on the multi-scale decomposition of complementary information. Firstly, this method uses two groups of large-scale and small-scale decomposition schemes that are structurally complementary, to perform two-scale double-layer singular value decomposition of the image separately and obtain low-frequency and high-frequency components. Then, the low-frequency components are fused by a rule that integrates image local energy with edge energy. The high-frequency components are fused by the parameter-adaptive pulse-coupled neural network model (PA-PCNN), and according to the feature information contained in each decomposition layer of the high-frequency components, different detailed features are selected as the external stimulus input of the PA-PCNN. Finally, according to the two-scale decomposition of the source image that is structure complementary, and the fusion of high and low frequency components, two initial decision maps with complementary information are obtained. By refining the initial decision graph, the final fusion decision map is obtained to complete the image fusion. In addition, the proposed method is compared with 10 state-of-the-art approaches to verify its effectiveness. The experimental results show that the proposed method can more accurately distinguish the focused and non-focused areas in the case of image pre-registration and unregistration, and the subjective and objective evaluation indicators are slightly better than those of the existing methods.
Collapse
Affiliation(s)
- Hui Wan
- College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; (H.W.); (W.L.)
- College of Computer and Information Science, Chongqing Normal University, Chongqing 401331, China
| | - Xianlun Tang
- College of Automation, Chongqing University of Posts and Telecommunications, Chongqing 400065, China;
- Correspondence: ; Tel.: +86-23-62460553
| | - Zhiqin Zhu
- College of Automation, Chongqing University of Posts and Telecommunications, Chongqing 400065, China;
| | - Weisheng Li
- College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; (H.W.); (W.L.)
| |
Collapse
|
13
|
Vanitha K, Satyanarayana D, Prasad MNG. Multi-modal Medical Image Fusion Algorithm Based on Spatial Frequency Motivated PA-PCNN in the NSST Domain. Curr Med Imaging 2021; 17:634-643. [PMID: 33213329 DOI: 10.2174/1573405616666201118123220] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2020] [Revised: 08/09/2020] [Accepted: 10/13/2020] [Indexed: 11/22/2022]
Abstract
BACKGROUND Image fusion has been grown as an effectual method in diseases related diagnosis schemes. METHODS In this paper, a new method for combining multimodal medical images using spatial frequency motivated parameter-adaptive PCNN (SF-PAPCNN) is suggested. The multi- modal images are disintegrated into frequency bands by using decomposition NSST. The coefficients of low frequency bands are selected using maximum rule. The coefficients of high frequency bands are combined by SF-PAPCNN. METHODS In this paper, a new method for combining multimodal medical images using spatial frequency motivated parameter-adaptive PCNN (SF-PAPCNN) is suggested. The multi-modal images are disintegrated into frequency bands by using decomposition NSST. The coefficients of low frequency bands are selected using maximum rule. The coefficients of high frequency bands are combined by SF-PAPCNN. RESULTS The fused medical images is obtained by applying INSST to above coefficients. CONCLUSION The quality metrics such as entropy ENT, fusion symmetry FS, deviation STD, mutual information QMI and edge strength QAB/F are used to validate the efficacy of suggested scheme.
Collapse
Affiliation(s)
- K Vanitha
- Department of ECE, Jawaharlal Nehru Technological University, Anantapur, India
| | - D Satyanarayana
- Department of ECE, Rajeev Gandhi Memorial College of Engineering and Technology, Nandyal, India
| | - M N G Prasad
- Department of ECE, Jawaharlal Nehru Technological University, Anantapur, India
| |
Collapse
|
14
|
Qi H, Zhang G, Jia H, Xing Z. A hybrid equilibrium optimizer algorithm for multi-level image segmentation. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2021; 18:4648-4678. [PMID: 34198458 DOI: 10.3934/mbe.2021236] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Threshlod image segmentation is a classic method of color image segmentation. In this paper, we propose a hybrid equilibrium optimizer algorithm for multi-level image segmentation. When multi-level threshold method calculates the neighborhood mean and median of color image, it takes huge challenge to find the optimal threshold. We use the proposed method to optimize the multi-level threshold method and get the optimal threshold from the color image. In order to test the performance of the proposed method, we select the CEC2015 dataset as the benchmark function. The result shows that the proposed method improves the optimization ability of the original algorithm. And then, the classic images and wood fiber images are taken as experimental objects to analyze the segmentation result. The experimental results show that the proposed method has a good performance in Uniformity measure, Peak Signal-to-Noise Ratio and Feature Similarity Index and CPU time.
Collapse
Affiliation(s)
- Hong Qi
- School of Information and Computer Engineering, Northeast Forestry University, China
| | - Guanglei Zhang
- School of Information and Computer Engineering, Northeast Forestry University, China
| | - Heming Jia
- School of Information Engineering, Sanming Universiy, China
| | - Zhikai Xing
- School of Electrical Engineering and Automation, Wuhan University, China
| |
Collapse
|
15
|
Yousif AS, Omar Z, Sheikh UU, Khalid SA. A New Scheme of Medical Image Fusion Using Deep Convolutional Neural Network and Local Energy Pixel Domain. 2020 IEEE-EMBS CONFERENCE ON BIOMEDICAL ENGINEERING AND SCIENCES (IECBES) 2021. [DOI: 10.1109/iecbes48179.2021.9398840] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
|
16
|
|
17
|
Visual-Based Defect Detection and Classification Approaches for Industrial Applications-A SURVEY. SENSORS 2020; 20:s20051459. [PMID: 32155900 PMCID: PMC7085592 DOI: 10.3390/s20051459] [Citation(s) in RCA: 47] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/09/2020] [Revised: 03/02/2020] [Accepted: 03/02/2020] [Indexed: 11/25/2022]
Abstract
This paper reviews automated visual-based defect detection approaches applicable to various materials, such as metals, ceramics and textiles. In the first part of the paper, we present a general taxonomy of the different defects that fall in two classes: visible (e.g., scratches, shape error, etc.) and palpable (e.g., crack, bump, etc.) defects. Then, we describe artificial visual processing techniques that are aimed at understanding of the captured scenery in a mathematical/logical way. We continue with a survey of textural defect detection based on statistical, structural and other approaches. Finally, we report the state of the art for approaching the detection and classification of defects through supervised and non-supervised classifiers and deep learning.
Collapse
|
18
|
Deng X, Yan C, Ma Y. PCNN Mechanism and its Parameter Settings. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2020; 31:488-501. [PMID: 30990197 DOI: 10.1109/tnnls.2019.2905113] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
The pulse-coupled neural network (PCNN) model is a third-generation artificial neural network without training that uses the synchronous pulse bursts of neurons to process digital images, but the lack of in-depth theoretical research limits its extensive application. By analyzing the working mechanism of the PCNN, we present an expression for the fire-extinguishing time of neurons that fire in the second iteration and an expression for the firing time of neurons that extinguish in the second iteration. In addition, we find a phenomenon of the PCNN and name it mathematically coupled fire extinguishing. Based on the above analysis, we propose a new working mode for the PCNN, where the refiring of fire-extinguishing neurons is only allowed when all firing neurons are extinguished. We also work out the constraint conditions of the parameter settings under this mode. Furthermore, we analyze the relationship between the network parameters and mathematically coupled fire extinguishing, the coupling of neighboring neurons, and the convergence rate of the PCNN, respectively. In addition, we demonstrate the essential regularity of extinguished neuron in the PCNN and then propose an optimal parameter setting to achieve the best comprehensive performance of the PCNN.
Collapse
|
19
|
Research of Multimodal Medical Image Fusion Based on Parameter-Adaptive Pulse-Coupled Neural Network and Convolutional Sparse Representation. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2020; 2020:3290136. [PMID: 32411280 PMCID: PMC7204371 DOI: 10.1155/2020/3290136] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/12/2019] [Revised: 12/07/2019] [Accepted: 01/02/2020] [Indexed: 11/17/2022]
Abstract
Visual effects of medical image have a great impact on clinical assistant diagnosis. At present, medical image fusion has become a powerful means of clinical application. The traditional medical image fusion methods have the problem of poor fusion results due to the loss of detailed feature information during fusion. To deal with it, this paper proposes a new multimodal medical image fusion method based on the imaging characteristics of medical images. In the proposed method, the non-subsampled shearlet transform (NSST) decomposition is first performed on the source images to obtain high-frequency and low-frequency coefficients. The high-frequency coefficients are fused by a parameter‐adaptive pulse-coupled neural network (PAPCNN) model. The method is based on parameter adaptive and optimized connection strength β adopted to promote the performance. The low-frequency coefficients are merged by the convolutional sparse representation (CSR) model. The experimental results show that the proposed method solves the problems of difficult parameter setting and poor detail preservation of sparse representation during image fusion in traditional PCNN algorithms, and it has significant advantages in visual effect and objective indices compared with the existing mainstream fusion algorithms.
Collapse
|
20
|
|
21
|
Xing Z, Jia H, Song W. 3DPCNN based on whale optimization algorithm for color image segmentation. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2019. [DOI: 10.3233/jifs-182893] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- Zhikai Xing
- Northeast Forestry University, Harbin, China
| | - Heming Jia
- Northeast Forestry University, Harbin, China
| | | |
Collapse
|
22
|
Pulse-coupled neural network and its optimization for segmentation of electrical faults with infrared thermography. Appl Soft Comput 2019. [DOI: 10.1016/j.asoc.2018.10.056] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
23
|
Lian J, Yang Z, Sun W, Guo Y, Zheng L, Li J, Shi B, Ma Y. An image segmentation method of a modified SPCNN based on human visual system in medical images. Neurocomputing 2019. [DOI: 10.1016/j.neucom.2018.12.007] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
24
|
Zhang L, Shao H, Yao K, Li Q, Wang H. Underwater multi-focus image fusion based on sparse matrix. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2018. [DOI: 10.3233/jifs-169705] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- Lili Zhang
- College of Computer and Information Engineering, Hohai University, Nanjing, China
| | - Heshuai Shao
- College of Computer and Information Engineering, Hohai University, Nanjing, China
| | - Kai Yao
- College of Computer and Information Engineering, Hohai University, Nanjing, China
| | - Qi Li
- College of Computer and Information Engineering, Hohai University, Nanjing, China
| | - Huibin Wang
- College of Computer and Information Engineering, Hohai University, Nanjing, China
| |
Collapse
|
25
|
Yang Z, Lian J, Li S, Guo Y, Qi Y, Ma Y. Heterogeneous SPCNN and its application in image segmentation. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2018.01.044] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
26
|
Guo Y, Yang Z, Ma Y, Lian J, Zhu L. Saliency motivated improved simplified PCNN model for object segmentation. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2017.10.057] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
27
|
Chacon-Murguia MI, Ramirez-Quintana JA. Bio-inspired architecture for static object segmentation in time varying background models from video sequences. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2017.10.015] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
28
|
|
29
|
Lian J, Shi B, Li M, Nan Z, Ma Y. An automatic segmentation method of a parameter-adaptive PCNN for medical images. Int J Comput Assist Radiol Surg 2017; 12:1511-1519. [PMID: 28477278 DOI: 10.1007/s11548-017-1597-2] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2017] [Accepted: 04/24/2017] [Indexed: 11/27/2022]
Abstract
PURPOSE Since pre-processing and initial segmentation steps in medical images directly affect the final segmentation results of the regions of interesting, an automatic segmentation method of a parameter-adaptive pulse-coupled neural network is proposed to integrate the above-mentioned two segmentation steps into one. This method has a low computational complexity for different kinds of medical images and has a high segmentation precision. METHODS The method comprises four steps. Firstly, an optimal histogram threshold is used to determine the parameter [Formula: see text] for different kinds of images. Secondly, we acquire the parameter [Formula: see text] according to a simplified pulse-coupled neural network (SPCNN). Thirdly, we redefine the parameter V of the SPCNN model by sub-intensity distribution range of firing pixels. Fourthly, we add an offset [Formula: see text] to improve initial segmentation precision. RESULTS Compared with the state-of-the-art algorithms, the new method achieves a comparable performance by the experimental results from ultrasound images of the gallbladder and gallstones, magnetic resonance images of the left ventricle, and mammogram images of the left and the right breast, presenting the overall metric UM of 0.9845, CM of 0.8142, TM of 0.0726. CONCLUSION The algorithm has a great potential to achieve the pre-processing and initial segmentation steps in various medical images. This is a premise for assisting physicians to detect and diagnose clinical cases.
Collapse
Affiliation(s)
- Jing Lian
- School of Information Science and Engineering, Lanzhou University, Lanzhou, 730000, Gansu, China
| | - Bin Shi
- Equipment Management Department, Gansu Provincial Hospital, Lanzhou, 730000, Gansu, China
| | - Mingcong Li
- Biology Department, Lanhua No.1 High School, Lanzhou, 730060, Gansu, China
| | - Ziwei Nan
- School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou, 730070, Gansu, China
| | - Yide Ma
- School of Information Science and Engineering, Lanzhou University, Lanzhou, 730000, Gansu, China.
| |
Collapse
|
30
|
Huang W, Yan C, Wang J, Wang W. A time-delay neural network for solving time-dependent shortest path problem. Neural Netw 2017; 90:21-28. [PMID: 28364676 DOI: 10.1016/j.neunet.2017.03.002] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2016] [Revised: 02/27/2017] [Accepted: 03/03/2017] [Indexed: 11/28/2022]
Abstract
This paper concerns the time-dependent shortest path problem, which is difficult to come up with global optimal solution by means of classical shortest path approaches such as Dijkstra, and pulse-coupled neural network (PCNN). In this study, we propose a time-delay neural network (TDNN) framework that comes with the globally optimal solution when solving the time-dependent shortest path problem. The underlying idea of TDNN comes from the following mechanism: the shortest path depends on the earliest auto-wave (from start node) that arrives at the destination node. In the design of TDNN, each node on a network is considered as a neuron, which comes in the form of two units: time-window unit and auto-wave unit. Time-window unit is used to generate auto-wave in each time window, while auto-wave unit is exploited here to update the state of auto-wave. Whether or not an auto-wave leaves a node (neuron) depends on the state of auto-wave. The evaluation of the performance of the proposed approach was carried out based on online public Cordeau instances and New York Road instances. The proposed TDNN was also compared with the quality of classical approaches such as Dijkstra and PCNN.
Collapse
Affiliation(s)
- Wei Huang
- School of Computer and Communication Engineering, Tianjin University of Technology, Tianjin, China; State Key Laboratory of Digital Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Wuhan, China.
| | - Chunwang Yan
- School of Computer and Communication Engineering, Tianjin University of Technology, Tianjin, China
| | - Jinsong Wang
- School of Computer and Communication Engineering, Tianjin University of Technology, Tianjin, China
| | - Wei Wang
- School of Computer and Information Technology, Beijing Jiaotong University, Beijing, China
| |
Collapse
|
31
|
Kundu MK, Chowdhury M, Das S. Interactive radiographic image retrieval system. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2017; 139:209-220. [PMID: 28187892 DOI: 10.1016/j.cmpb.2016.10.023] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/26/2016] [Revised: 09/11/2016] [Accepted: 10/24/2016] [Indexed: 06/06/2023]
Abstract
BACKGROUND AND OBJECTIVE Content based medical image retrieval (CBMIR) systems enable fast diagnosis through quantitative assessment of the visual information and is an active research topic over the past few decades. Most of the state-of-the-art CBMIR systems suffer from various problems: computationally expensive due to the usage of high dimensional feature vectors and complex classifier/clustering schemes. Inability to properly handle the "semantic gap" and the high intra-class versus inter-class variability problem of the medical image database (like radiographic image database). This yields an exigent demand for developing highly effective and computationally efficient retrieval system. METHODS We propose a novel interactive two-stage CBMIR system for diverse collection of medical radiographic images. Initially, Pulse Coupled Neural Network based shape features are used to find out the most probable (similar) image classes using a novel "similarity positional score" mechanism. This is followed by retrieval using Non-subsampled Contourlet Transform based texture features considering only the images of the pre-identified classes. Maximal information compression index is used for unsupervised feature selection to achieve better results. To reduce the semantic gap problem, the proposed system uses a novel fuzzy index based relevance feedback mechanism by incorporating subjectivity of human perception in an analytic manner. RESULTS Extensive experiments were carried out to evaluate the effectiveness of the proposed CBMIR system on a subset of Image Retrieval in Medical Applications (IRMA)-2009 database consisting of 10,902 labeled radiographic images of 57 different modalities. We obtained overall average precision of around 98% after only 2-3 iterations of relevance feedback mechanism. We assessed the results by comparisons with some of the state-of-the-art CBMIR systems for radiographic images. CONCLUSIONS Unlike most of the existing CBMIR systems, in the proposed two-stage hierarchical framework, main importance is given on constructing efficient and compact feature vector representation, search-space reduction and handling the "semantic gap" problem effectively, without compromising the retrieval performance. Experimental results and comparisons show that the proposed system performs efficiently in the radiographic medical image retrieval field.
Collapse
Affiliation(s)
- Malay Kumar Kundu
- Machine Intelligence Unit, Indian Statistical Institute, Kolkata 700108, India
| | - Manish Chowdhury
- KTH, School of Technology and Health, Hälsovägen 11c, SE-14157 Huddinge, Sweden.
| | - Sudeb Das
- Machine Intelligence Unit, Indian Statistical Institute, Kolkata 700108, India
| |
Collapse
|
32
|
Lian J, Ma Y, Ma Y, Shi B, Liu J, Yang Z, Guo Y. Automatic gallbladder and gallstone regions segmentation in ultrasound image. Int J Comput Assist Radiol Surg 2017; 12:553-568. [PMID: 28063077 DOI: 10.1007/s11548-016-1515-z] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2016] [Accepted: 12/15/2016] [Indexed: 11/28/2022]
Abstract
PURPOSE As gallbladder diseases including gallstone and cholecystitis are mainly diagnosed by using ultra-sonographic examinations, we propose a novel method to segment the gallbladder and gallstones in ultrasound images. METHODS The method is divided into five steps. Firstly, a modified Otsu algorithm is combined with the anisotropic diffusion to reduce speckle noise and enhance image contrast. The Otsu algorithm separates distinctly the weak edge regions from the central region of the gallbladder. Secondly, a global morphology filtering algorithm is adopted for acquiring the fine gallbladder region. Thirdly, a parameter-adaptive pulse-coupled neural network (PA-PCNN) is employed to obtain the high-intensity regions including gallstones. Fourthly, a modified region-growing algorithm is used to eliminate physicians' labeled regions and avoid over-segmentation of gallstones. It also has good self-adaptability within the growth cycle in light of the specified growing and terminating conditions. Fifthly, the smoothing contours of the detected gallbladder and gallstones are obtained by the locally weighted regression smoothing (LOESS). RESULTS We test the proposed method on the clinical data from Gansu Provincial Hospital of China and obtain encouraging results. For the gallbladder and gallstones, average similarity percent of contours (EVA) containing metrics dice's similarity , overlap fraction and overlap value is 86.01 and 79.81%, respectively; position error is 1.7675 and 0.5414 mm, respectively; runtime is 4.2211 and 0.6603 s, respectively. Our method then achieves competitive performance compared with the state-of-the-art methods. CONCLUSIONS The proposed method is potential to assist physicians for diagnosing the gallbladder disease rapidly and effectively.
Collapse
Affiliation(s)
- Jing Lian
- School of Information Science and Engineering, Lanzhou University, Lanzhou, 730000, Gansu, China
| | - Yide Ma
- School of Information Science and Engineering, Lanzhou University, Lanzhou, 730000, Gansu, China.
| | - Yurun Ma
- School of Information Science and Engineering, Lanzhou University, Lanzhou, 730000, Gansu, China
| | - Bin Shi
- Equipment Management Department, Gansu Provincial Hospital, Lanzhou, 730000, Gansu, China
| | - Jizhao Liu
- School of Information Science and Engineering, Lanzhou University, Lanzhou, 730000, Gansu, China
| | - Zhen Yang
- School of Information Science and Engineering, Lanzhou University, Lanzhou, 730000, Gansu, China
| | - Yanan Guo
- School of Information Science and Engineering, Lanzhou University, Lanzhou, 730000, Gansu, China
| |
Collapse
|
33
|
Yang Z, Dong M, Guo Y, Gao X, Wang K, Shi B, Ma Y. A new method of micro-calcifications detection in digitized mammograms based on improved simplified PCNN. Neurocomputing 2016. [DOI: 10.1016/j.neucom.2016.08.068] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
34
|
Automated Sperm Head Detection Using Intersecting Cortical Model Optimised by Particle Swarm Optimization. PLoS One 2016; 11:e0162985. [PMID: 27632581 PMCID: PMC5025108 DOI: 10.1371/journal.pone.0162985] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2016] [Accepted: 08/31/2016] [Indexed: 11/26/2022] Open
Abstract
In human sperm motility analysis, sperm segmentation plays an important role to determine the location of multiple sperms. To ensure an improved segmentation result, the Laplacian of Gaussian filter is implemented as a kernel in a pre-processing step before applying the image segmentation process to automatically segment and detect human spermatozoa. This study proposes an intersecting cortical model (ICM), which was derived from several visual cortex models, to segment the sperm head region. However, the proposed method suffered from parameter selection; thus, the ICM network is optimised using particle swarm optimization where feature mutual information is introduced as the new fitness function. The final results showed that the proposed method is more accurate and robust than four state-of-the-art segmentation methods. The proposed method resulted in rates of 98.14%, 98.82%, 86.46% and 99.81% in accuracy, sensitivity, specificity and precision, respectively, after testing with 1200 sperms. The proposed algorithm is expected to be implemented in analysing sperm motility because of the robustness and capability of this algorithm.
Collapse
|
35
|
Li Y, Zhang C. Automated vision system for fabric defect inspection using Gabor filters and PCNN. SPRINGERPLUS 2016; 5:765. [PMID: 27386251 PMCID: PMC4912527 DOI: 10.1186/s40064-016-2452-6] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/12/2016] [Accepted: 05/27/2016] [Indexed: 11/10/2022]
Abstract
In this study, an embedded machine vision system using Gabor filters and Pulse Coupled Neural Network (PCNN) is developed to identify defects of warp-knitted fabrics automatically. The system consists of smart cameras and a Human Machine Interface (HMI) controller. A hybrid detection algorithm combing Gabor filters and PCNN is running on the SOC processor of the smart camera. First, Gabor filters are employed to enhance the contrast of images captured by a CMOS sensor. Second, defect areas are segmented by PCNN with adaptive parameter setting. Third, smart cameras will notice the controller to stop the warp-knitting machine once defects are found out. Experimental results demonstrate that the hybrid method is superior to Gabor and wavelet methods on detection accuracy. Actual operations in a textile factory verify the effectiveness of the inspection system.
Collapse
Affiliation(s)
- Yundong Li
- College of Electronics and Information Engineering, North China University of Technology, Beijing, 100041 China
| | - Cheng Zhang
- College of Electronics and Information Engineering, North China University of Technology, Beijing, 100041 China
| |
Collapse
|
36
|
Guo Y, Dong M, Yang Z, Gao X, Wang K, Luo C, Ma Y, Zhang J. A new method of detecting micro-calcification clusters in mammograms using contourlet transform and non-linking simplified PCNN. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2016; 130:31-45. [PMID: 27208519 DOI: 10.1016/j.cmpb.2016.02.019] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/11/2015] [Revised: 02/25/2016] [Accepted: 02/26/2016] [Indexed: 06/05/2023]
Abstract
BACKGROUND AND OBJECTIVES Mammography analysis is an effective technology for early detection of breast cancer. Micro-calcification clusters (MCs) are a vital indicator of breast cancer, so detection of MCs plays an important role in computer aided detection (CAD) system, this paper proposes a new hybrid method to improve MCs detection rate in mammograms. METHODS The proposed method comprises three main steps: firstly, remove label and pectoral muscle adopting the largest connected region marking and region growing method, and enhance MCs using the combination of double top-hat transform and grayscale-adjustment function; secondly, remove noise and other interference information, and retain the significant information by modifying the contourlet coefficients using nonlinear function; thirdly, we use the non-linking simplified pulse-coupled neural network to detect MCs. RESULTS In our work, we choose 118 mammograms including 38 mammograms with micro-calcification clusters and 80 mammograms without micro-calcification to demonstrate our algorithm separately from two open and common database including the MIAS and JSMIT; and we achieve the higher specificity of 94.7%, sensitivity of 96.3%, AUC of 97.0%, accuracy of 95.8%, MCC of 90.4%, MCC-PS of 61.3% and CEI of 53.5%, these promising results clearly demonstrate that the proposed approach outperforms the current state-of-the-art algorithms. In addition, this method is verified on the 20 mammograms from the People's Hospital of Gansu Province, the detection results reveal that our method can accurately detect the calcifications in clinical application. CONCLUSIONS This proposed method is simple and fast, furthermore it can achieve high detection rate, it could be considered used in CAD systems to assist the physicians for breast cancer diagnosis in the future.
Collapse
Affiliation(s)
- Ya'nan Guo
- School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China.
| | - Min Dong
- School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China
| | - Zhen Yang
- School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China
| | - Xiaoli Gao
- School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China
| | - Keju Wang
- School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China
| | - Chongfan Luo
- School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China
| | - Yide Ma
- School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China
| | - Jiuwen Zhang
- School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China
| |
Collapse
|
37
|
Ma Y, Wang L, Ma Y, Dong M, Du S, Sun X. An SPCNN-GVF-based approach for the automatic segmentation of left ventricle in cardiac cine MR images. Int J Comput Assist Radiol Surg 2016; 11:1951-1964. [PMID: 27295053 DOI: 10.1007/s11548-016-1429-9] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2015] [Accepted: 05/27/2016] [Indexed: 10/21/2022]
Abstract
PURPOSE Accurate segmentation of left ventricle (LV) is essential for the cardiac function analysis. However, it is labor intensive and time consuming for radiologists to delineate LV boundary manually. In this paper, we present a novel self-correcting framework for the fully automatic LV segmentation. METHODS Firstly, a time-domain method is designed to extract a rectangular region of interest around the heart. Then, the simplified pulse-coupled neural network (SPCNN) is employed to locate the LV cavity. Different from the existing approaches, SPCNN can realize the self-correcting segmentation due to its parameter controllability. Subsequently, the post-processing based on the maximum gradient searching is proposed to obtain the accurate endocardium. Finally, a new external force based on the shape similarity is defined and integrated into the gradient vector flow (GVF) snake with the balloon force to segment the epicardium. RESULTS We obtain encouraging segmentation results tested on the database provided by MICCAI 2009. The average percentage of good contours is 92.26 %, the average perpendicular distance is 2.38 mm, and the overlapping dice metric is 0.89. Besides, the experiment results show good correlations between the automatic segmentation and the manual delineation (for the LV ejection fraction and the LV myocardial mass, the correlation coefficients R are 0.9683 and 0.9278, respectively). CONCLUSION We propose an effective and fast method combing the SPCNN and the improved GVF for the automatic segmentation of LV.
Collapse
Affiliation(s)
- Yurun Ma
- School of Information Science and Engineering, Lanzhou University, Lanzhou, Gansu, 730000, China
| | - Li Wang
- School of Information Science and Engineering, Lanzhou University, Lanzhou, Gansu, 730000, China
| | - Yide Ma
- School of Information Science and Engineering, Lanzhou University, Lanzhou, Gansu, 730000, China.
| | - Min Dong
- School of Information Science and Engineering, Lanzhou University, Lanzhou, Gansu, 730000, China
| | - Shiqiang Du
- School of Information Science and Engineering, Lanzhou University, Lanzhou, Gansu, 730000, China
| | - Xiaoguang Sun
- School of Information Science and Engineering, Lanzhou University, Lanzhou, Gansu, 730000, China
| |
Collapse
|
38
|
|
39
|
Chen Y, Ma Y, Kim DH, Park SK. Region-Based Object Recognition by Color Segmentation Using a Simplified PCNN. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2015; 26:1682-1697. [PMID: 25494514 DOI: 10.1109/tnnls.2014.2351418] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
In this paper, we propose a region-based object recognition (RBOR) method to identify objects from complex real-world scenes. First, the proposed method performs color image segmentation by a simplified pulse-coupled neural network (SPCNN) for the object model image and test image, and then conducts a region-based matching between them. Hence, we name it as RBOR with SPCNN (SPCNN-RBOR). Hereinto, the values of SPCNN parameters are automatically set by our previously proposed method in terms of each object model. In order to reduce various light intensity effects and take advantage of SPCNN high resolution on low intensities for achieving optimized color segmentation, a transformation integrating normalized Red Green Blue (RGB) with opponent color spaces is introduced. A novel image segmentation strategy is suggested to group the pixels firing synchronously throughout all the transformed channels of an image. Based on the segmentation results, a series of adaptive thresholds, which is adjustable according to the specific object model is employed to remove outlier region blobs, form potential clusters, and refine the clusters in test images. The proposed SPCNN-RBOR method overcomes the drawback of feature-based methods that inevitably includes background information into local invariant feature descriptors when keypoints locate near object boundaries. A large number of experiments have proved that the proposed SPCNN-RBOR method is robust for diverse complex variations, even under partial occlusion and highly cluttered environments. In addition, the SPCNN-RBOR method works well in not only identifying textured objects, but also in less-textured ones, which significantly outperforms the current feature-based methods.
Collapse
|
40
|
Zhou D, Zhou H, Gao C, Guo Y. Simplified parameters model of PCNN and its application to image segmentation. Pattern Anal Appl 2015. [DOI: 10.1007/s10044-015-0462-6] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
41
|
A pulse coupled neural network segmentation algorithm for reflectance confocal images of epithelial tissue. PLoS One 2015; 10:e0122368. [PMID: 25816131 PMCID: PMC4376773 DOI: 10.1371/journal.pone.0122368] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2014] [Accepted: 02/13/2015] [Indexed: 12/16/2022] Open
Abstract
Automatic segmentation of nuclei in reflectance confocal microscopy images is critical for visualization and rapid quantification of nuclear-to-cytoplasmic ratio, a useful indicator of epithelial precancer. Reflectance confocal microscopy can provide three-dimensional imaging of epithelial tissue in vivo with sub-cellular resolution. Changes in nuclear density or nuclear-to-cytoplasmic ratio as a function of depth obtained from confocal images can be used to determine the presence or stage of epithelial cancers. However, low nuclear to background contrast, low resolution at greater imaging depths, and significant variation in reflectance signal of nuclei complicate segmentation required for quantification of nuclear-to-cytoplasmic ratio. Here, we present an automated segmentation method to segment nuclei in reflectance confocal images using a pulse coupled neural network algorithm, specifically a spiking cortical model, and an artificial neural network classifier. The segmentation algorithm was applied to an image model of nuclei with varying nuclear to background contrast. Greater than 90% of simulated nuclei were detected for contrast of 2.0 or greater. Confocal images of porcine and human oral mucosa were used to evaluate application to epithelial tissue. Segmentation accuracy was assessed using manual segmentation of nuclei as the gold standard.
Collapse
|
42
|
Automatic iterative algorithm for image segmentation using a modified pulse-coupled neural network. Neurocomputing 2013. [DOI: 10.1016/j.neucom.2013.03.025] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
43
|
|
44
|
Li J, Zou B, Ding L, Gao X. Image Segmentation with PCNN Model and Immune Algorithm. ACTA ACUST UNITED AC 2013. [DOI: 10.4304/jcp.8.9.2429-2436] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
45
|
A coarse-to-fine strategy for iterative segmentation using simplified pulse-coupled neural network. Soft comput 2013. [DOI: 10.1007/s00500-013-1077-8] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
46
|
Qu H, Yi Z, Yang SX. Efficient shortest-path-tree computation in network routing based on pulse-coupled neural networks. IEEE TRANSACTIONS ON CYBERNETICS 2013; 43:995-1010. [PMID: 23144039 DOI: 10.1109/tsmcb.2012.2221695] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
Shortest path tree (SPT) computation is a critical issue for routers using link-state routing protocols, such as the most commonly used open shortest path first and intermediate system to intermediate system. Each router needs to recompute a new SPT rooted from itself whenever a change happens in the link state. Most commercial routers do this computation by deleting the current SPT and building a new one using static algorithms such as the Dijkstra algorithm at the beginning. Such recomputation of an entire SPT is inefficient, which may consume a considerable amount of CPU time and result in a time delay in the network. Some dynamic updating methods using the information in the updated SPT have been proposed in recent years. However, there are still many limitations in those dynamic algorithms. In this paper, a new modified model of pulse-coupled neural networks (M-PCNNs) is proposed for the SPT computation. It is rigorously proved that the proposed model is capable of solving some optimization problems, such as the SPT. A static algorithm is proposed based on the M-PCNNs to compute the SPT efficiently for large-scale problems. In addition, a dynamic algorithm that makes use of the structure of the previously computed SPT is proposed, which significantly improves the efficiency of the algorithm. Simulation results demonstrate the effective and efficient performance of the proposed approach.
Collapse
Affiliation(s)
- Hong Qu
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China.
| | | | | |
Collapse
|
47
|
Gao C, Zhou D, Guo Y. An Iterative Thresholding Segmentation Model Using a Modified Pulse Coupled Neural Network. Neural Process Lett 2013. [DOI: 10.1007/s11063-013-9291-z] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
48
|
Xia Y, Sun C, Zheng WX. Discrete-time neural network for fast solving large linear L1 estimation problems and its application to image restoration. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2012; 23:812-820. [PMID: 24806129 DOI: 10.1109/tnnls.2012.2184800] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
There is growing interest in solving linear L1 estimation problems for sparsity of the solution and robustness against non-Gaussian noise. This paper proposes a discrete-time neural network which can calculate large linear L1 estimation problems fast. The proposed neural network has a fixed computational step length and is proved to be globally convergent to an optimal solution. Then, the proposed neural network is efficiently applied to image restoration. Numerical results show that the proposed neural network is not only efficient in solving degenerate problems resulting from the nonunique solutions of the linear L1 estimation problems but also needs much less computational time than the related algorithms in solving both linear L1 estimation and image restoration problems.
Collapse
|
49
|
YANG N, CHEN H, LI Y, HAO X. Coupled Parameter Optimization of PCNN Model and Vehicle Image Segmentation. ACTA ACUST UNITED AC 2012. [DOI: 10.1016/s1570-6672(11)60184-0] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|