1
|
Das PK, Meher S, Rath A, Panda G. An efficient deep learning system for automatic detection of Acute Lymphoblastic Leukemia. ISA TRANSACTIONS 2025; 158:488-496. [PMID: 39799077 DOI: 10.1016/j.isatra.2024.12.043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Revised: 12/22/2024] [Accepted: 12/27/2024] [Indexed: 01/15/2025]
Abstract
Early and highly accurate detection of rapidly damaging deadly disease like Acute Lymphoblastic Leukemia (ALL) is essential for providing appropriate treatment to save valuable lives. Recent development in deep learning, particularly transfer learning, is gaining a preferred trend of research in medical image processing because of their admirable performance, even with small datasets. It inspires us to develop a novel deep learning-based leukemia detection system in which an efficient and lightweight MobileNetV2 is used in conjunction with ShuffleNet to boost discrimination ability and enhance the receptive field via convolution layer succession. More importantly, the suggested weight factor and an optimal threshold value (which is experimentally selected) is responsible for maintaining a healthy balance between computational efficiency and classification performance. Hence, the benefits of inverted residual bottleneck structure, depthwise separable convolution, tunable hyperparameters, pointwise group convolution, and channel shuffling are integrated to improve the feature discrimination ability and make the proposed system faster and more accurate. The experimental results convey that the proposed framework outperforms others with the best detection performances. It achieves superior performance to its competitors with the best accuracy (99.07%), precision(98.00%), sensitivity (100%), specificity (98.31%), and F1 score (0.9899) in ALLIDB1 dataset. Similarly, it outperforms others with 98.46% accuracy, 98.46% precision, 98.46% specificity, 98.46% sensitivity, and 0.9846 F1 Score in ALLIDB2 dataset.
Collapse
Affiliation(s)
- Pradeep Kumar Das
- Department of Electronics and Communication Engineering, National Institute of Technology Warangal, Warangal 506004, Telangana, India; School of Electronics Engineering (SENSE), VIT Vellore, Tamil Nadu 632014, India.
| | - Sukadev Meher
- Department of Electronics and Communication Engineering, National Institute of Technology Rourkela, Odisha 769008, India.
| | - Adyasha Rath
- Department of Computer Science and Engineering, C. V. Raman Global University, Bhubaneswar 752054, Odisha, India.
| | - Ganapati Panda
- Department of Electronics and Telecommunication, C. V. Raman Global University, Bhubaneswar 752054, Odisha, India.
| |
Collapse
|
2
|
Li Y, Wang Y, Tan X. Highly valued subgoal generation for efficient goal-conditioned reinforcement learning. Neural Netw 2025; 181:106825. [PMID: 39488112 DOI: 10.1016/j.neunet.2024.106825] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2023] [Revised: 08/08/2024] [Accepted: 10/14/2024] [Indexed: 11/04/2024]
Abstract
Goal-conditioned reinforcement learning is widely used in robot control, manipulating the robot to accomplish specific tasks by maximizing accumulated rewards. However, the useful reward signal is only received when the desired goal is reached, leading to the issue of sparse rewards and affecting the efficiency of policy learning. In this paper, we propose a method to generate highly valued subgoals for efficient goal-conditioned policy learning, enabling the development of smart home robots or automatic pilots in our daily life. The highly valued subgoals are conditioned on the context of the specific tasks and characterized by suitable complexity for efficient goal-conditioned action value learning. The context variable captures the latent representation of the particular tasks, allowing for efficient subgoal generation. Additionally, the goal-conditioned action values regularized by the self-adaptive ranges generate subgoals with suitable complexity. Compared to Hindsight Experience Replay that uniformly samples subgoals from visited trajectories, our method generates the subgoals based on the context of tasks with suitable difficulty for efficient policy training. Experimental results show that our method achieves stable performance in robotic environments compared to baseline methods.
Collapse
Affiliation(s)
- Yao Li
- School of Computer and Information Technology, Shanxi University, China.
| | - YuHui Wang
- Center of Excellence in GenAI, King Abdullah University of Science and Technology, Saudi Arabia.
| | - XiaoYang Tan
- College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, China.
| |
Collapse
|
3
|
Sun Y, Li P, Xu H, Wang R. Structural prior-driven feature extraction with gradient-momentum combined optimization for convolutional neural network image classification. Neural Netw 2024; 179:106511. [PMID: 39146718 DOI: 10.1016/j.neunet.2024.106511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2024] [Revised: 06/12/2024] [Accepted: 07/03/2024] [Indexed: 08/17/2024]
Abstract
Recent image classification efforts have achieved certain success by incorporating prior information such as labels and logical rules to learn discriminative features. However, these methods overlook the variability of features, resulting in feature inconsistency and fluctuations in model parameter updates, which further contribute to decreased image classification accuracy and model instability. To address this issue, this paper proposes a novel method combining structural prior-driven feature extraction with gradient-momentum (SPGM), from the perspectives of consistent feature learning and precise parameter updates, to enhance the accuracy and stability of image classification. Specifically, SPGM leverages a structural prior-driven feature extraction (SPFE) approach to calculate gradients of multi-level features and original images to construct structural information, which is then transformed into prior knowledge to drive the network to learn features consistent with the original images. Additionally, an optimization strategy integrating gradients and momentum (GMO) is introduced, dynamically adjusting the direction and step size of parameter updates based on the angle and norm of the sum of gradients and momentum, enabling precise model parameter updates. Extensive experiments on CIFAR10 and CIFAR100 datasets demonstrate that the SPGM method significantly reduces the top-1 error rate in image classification, enhances the classification performance, and outperforms state-of-the-art methods.
Collapse
Affiliation(s)
- Yunyun Sun
- School of Internet of Things, Nanjing University of Posts and Telecommunications, Nanjing, 210023, Jiangsu, China.
| | - Peng Li
- School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing, 210023, Jiangsu, China; Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, Nanjing, 210023, Jiangsu, China.
| | - He Xu
- School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing, 210023, Jiangsu, China; Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, Nanjing, 210023, Jiangsu, China.
| | - Ruchuan Wang
- School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing, 210023, Jiangsu, China; Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, Nanjing, 210023, Jiangsu, China.
| |
Collapse
|
4
|
Elaraby A, Saad A, Elmannai H, Alabdulhafith M, Hadjouni M, Hamdi M. An approach for classification of breast cancer using lightweight deep convolution neural network. Heliyon 2024; 10:e38524. [PMID: 39640611 PMCID: PMC11619963 DOI: 10.1016/j.heliyon.2024.e38524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 09/09/2024] [Accepted: 09/25/2024] [Indexed: 12/07/2024] Open
Abstract
The rapid advancement of deep learning has generated considerable enthusiasm regarding its utilization in addressing medical imaging issues. Machine learning (ML) methods can help radiologists to diagnose breast cancer (BCs) barring invasive measures. Informative hand-crafted features are essential prerequisites for traditional machine learning classifiers to achieve accurate results, which are time-consuming to extract. In this paper, our deep learning algorithm is created to precisely identify breast cancers on screening mammograms, employing a training method that effectively utilizes training datasets with either full clinical annotation or solely the cancer status of the entire image. The proposed approach utilizes Lightweight Convolutional Neural Network (LWCNN) that allows automatic extraction features in an end-to-end manner. We have tested LWCNN model in two experiments. In the first experiment, the model was tested with two cases' original and enhancement datasets 1. It achieved 95 %, 93 %, 99 % and 98 % for training and testing accuracy respectively. In the second experiment, the model has been tested with two cases' original and enhancement datasets 2. It achieved 95 %, 91 %, 99 % and 92 % for training and testing accuracy respectively. Our proposed method, which uses various convolutional network to classify screening mammograms achieved exceptional performance when compared to other methods. The findings from these experiments clearly indicate that automatic deep learning techniques can be trained effectively to attain remarkable accuracy across a wide range of mammography datasets. This holds significant promise for improving clinical tools and reducing both false positive and false negative outcomes in screening mammography.
Collapse
Affiliation(s)
- Ahmed Elaraby
- Department of Computer Science, Faculty of Computers and Information, South Valley University, Qena, 83523, Egypt
| | - Aymen Saad
- Department of Information Technology, Management Technical College, Al-Furat Al-Awsat Technical University, Kufa, Iraq
| | - Hela Elmannai
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O.BOX 84428, Riyadh, 11671, Saudi Arabia
| | - Maali Alabdulhafith
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O.BOX 84428, Riyadh, 11671, Saudi Arabia
| | - Myriam Hadjouni
- Department of Computer Sciences, College of Computer and Information Science, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh, 11671, Saudi Arabia
| | - Monia Hamdi
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O.BOX 84428, Riyadh, 11671, Saudi Arabia
| |
Collapse
|
5
|
Sharma Y, Singh BK, Dhurandhar S. Vocal tasks-based EEG and speech signal analysis in children with neurodevelopmental disorders: a multimodal investigation. Cogn Neurodyn 2024; 18:2387-2403. [PMID: 39555290 PMCID: PMC11564584 DOI: 10.1007/s11571-024-10096-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Revised: 02/06/2024] [Accepted: 02/24/2024] [Indexed: 11/19/2024] Open
Abstract
Neurodevelopmental disorders (NDs) often hamper multiple functional prints of a child brain. Despite several studies on their neural and speech responses, multimodal researches on NDs are extremely rare. The present work examined the electroencephalography (EEG) and speech signals of the ND and control children, who performed "Hindi language" vocal tasks (V) of seven different categories, viz. 'vowel', 'consonant', 'one syllable', 'multi-syllable', 'compound', 'complex', and 'sentence' (V1-V7). Statistical testing of EEG parameters showed substantially high beta and gamma band energies in frontal, central, and temporal head sites of NDs for tasks V1-V5 and in parietal too for V6. For the 'sentence' task (V7), the NDs yielded significantly high theta and low alpha energies in the parietal area. These findings imply that even performing a general context-based task exerts a heavy cognitive loading in neurodevelopmental subjects. They also exhibited poor auditory comprehension while executing a long phrasing. Further, the speech signal analysis manifested significantly high amplitude (for V1-V7) and frequency (for V3-V7) perturbations in the voices of ND children. Moreover, the classification of subjects as ND or control was done via EEG and speech features. We attained 100% accuracy, precision, and F-measure using EEG features of all tasks, and using speech features of the 'complex' task. Jointly, the 'complex' task transpired as the best vocal stimuli among V1-V7 for characterizing ND brains. Meanwhile, we also inspected inter-relations between EEG energies and speech attributes of the ND group. Our work, thus, represents a unique multimodal layout to explore the distinctiveness of neuro-impaired children.
Collapse
Affiliation(s)
- Yogesh Sharma
- Department of Biomedical Engineering, National Institute of Technology Raipur, Raipur, Chhattisgarh 492010 India
| | - Bikesh Kumar Singh
- Department of Biomedical Engineering, National Institute of Technology Raipur, Raipur, Chhattisgarh 492010 India
| | | |
Collapse
|
6
|
Said A, Göker H. Spectral analysis and Bi-LSTM deep network-based approach in detection of mild cognitive impairment from electroencephalography signals. Cogn Neurodyn 2024; 18:597-614. [PMID: 38699612 PMCID: PMC11061085 DOI: 10.1007/s11571-023-10010-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Revised: 09/05/2023] [Accepted: 09/12/2023] [Indexed: 05/05/2024] Open
Abstract
Mild cognitive impairment (MCI) is a neuropsychological syndrome that is characterized by cognitive impairments. It typically affects adults 60 years of age and older. It is a noticeable decline in the cognitive function of the patient, and if left untreated it gets converted to Alzheimer's disease (AD). For that reason, early diagnosis of MCI is important as it slows down the conversion of the disease to AD. Early and accurate diagnosis of MCI requires recognition of the clinical characteristics of the disease, extensive testing, and long-term observations. These observations and tests can be subjective, expensive, incomplete, or inaccurate. Electroencephalography (EEG) is a powerful choice for the diagnosis of diseases with its advantages such as being non-invasive, based on findings, less costly, and getting results in a short time. In this study, a new EEG-based model is developed which can effectively detect MCI patients with higher accuracy. For this purpose, a dataset consisting of EEG signals recorded from a total of 34 subjects, 18 of whom were MCI and 16 control groups was used, and their ages ranged from 40 to 77. To conduct the experiment, the EEG signals were denoised using Multiscale Principal Component Analysis (MSPCA), and to increase the size of the dataset Data Augmentation (DA) method was performed. The tenfold cross-validation method was used to validate the model, moreover, the power spectral density (PSD) of the EEG signals was extracted from the EEG signals using three spectral analysis methods, the periodogram, welch, and multitaper. The PSD graphs of the EEG signals showed signal differences between the subjects of control and the MCI group, indicating that the signal power of MCI patients is lower compared to control groups. To classify the subjects, one of the best classifiers of deep learning algorithms called the Bi-directional long-short-term-memory (Bi-LSTM) was used, and several machine learning algorithms, such as decision tree (DT), support vector machine (SVM), and k-nearest neighbor (KNN). These algorithms were trained and tested using the extracted feature vectors from the control and the MCI groups. Additionally, the values of the coefficient matrix of those algorithms were compared and evaluated with the performance evaluation matrix to determine which one performed the best overall. According to the experimental results, the proposed deep learning model of multitaper spectral analysis approach with Bi-LSTM deep learning algorithm attained the highest number of correctly classified samples for diagnosing MCI patients and achieved a remarkable accuracy compared to the other proposed models. The achieved classification results of the deep learning model are reported to be 98.97% accuracy, 98.34% sensitivity, 99.67% specificity, 99.70% precision, 99.02% f1 score, and 97.94% Matthews correlation coefficient (MCC).
Collapse
Affiliation(s)
- Afrah Said
- Department of Electrical Electronics Engineering, Faculty of Simav Technology, Dumlupınar University, 43500 Kütahya, Turkey
| | - Hanife Göker
- Health Services Vocational College, Gazi University, 06830 Ankara, Turkey
| |
Collapse
|
7
|
Bai X, Wei X, Wang Z, Zhang M. CONet: Crowd and occlusion-aware network for occluded human pose estimation. Neural Netw 2024; 172:106109. [PMID: 38232431 DOI: 10.1016/j.neunet.2024.106109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2023] [Revised: 11/30/2023] [Accepted: 01/05/2024] [Indexed: 01/19/2024]
Abstract
Human pose estimation has numerous applications in motion recognition, virtual reality, human-computer interaction, and other related fields. However, multi-person pose estimation in crowded and occluded scenes is challenging. One major issue about the current top-down human pose estimation approaches is that they are limited to predicting the pose of a single person, even when the bounding box contains multiple individuals. To address this problem, we propose a novel Crowd and Occlusion-aware Network (CONet) using a divide-and-conquer strategy. Our approach includes a Crowd and Occlusion-aware Head (COHead) which estimates the pose of both the occluder and the occluded person using two separate branches. We also use the attention mechanism to guide the branches for differentiated learning, aiming to improve feature representation. Additionally, we propose a novel interference point loss to enhance the model's anti-interference ability. Our CONet is simple yet effective, and it outperforms the state-of-the-art model by +1.6 AP, achieving 71.6 AP on CrowdPose. Our proposed model has achieved state-of-the-art results on the CrowdPose dataset, demonstrating its effectiveness in improving the accuracy of human pose estimation in crowded and occluded scenes. This achievement highlights the potential of our model in many real-world applications where accurate human pose estimation is crucial, such as surveillance, sports analysis, and human-computer interaction.
Collapse
Affiliation(s)
- Xiuxiu Bai
- School of Software Engineering, Xi'an Jiaotong University, Xi'an 710049, China.
| | - Xing Wei
- School of Software Engineering, Xi'an Jiaotong University, Xi'an 710049, China
| | - Zengying Wang
- School of Software Engineering, Xi'an Jiaotong University, Xi'an 710049, China
| | - Miao Zhang
- School of Software Engineering, Xi'an Jiaotong University, Xi'an 710049, China
| |
Collapse
|
8
|
Kim JB, Choi HB, Han YH. Strangeness-driven exploration in multi-agent reinforcement learning. Neural Netw 2024; 172:106149. [PMID: 38306786 DOI: 10.1016/j.neunet.2024.106149] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Revised: 12/17/2023] [Accepted: 01/23/2024] [Indexed: 02/04/2024]
Abstract
In this study, a novel exploration method for centralized training and decentralized execution (CTDE)-based multi-agent reinforcement learning (MARL) is introduced. The method uses the concept of strangeness, which is determined by evaluating (1) the level of the unfamiliarity of the observations an agent encounters and (2) the level of the unfamiliarity of the entire state the agents visit. An exploration bonus, which is derived from the concept of strangeness, is combined with the extrinsic reward obtained from the environment to form a mixed reward, which is then used for training CTDE-based MARL algorithms. Additionally, a separate action-value function is also proposed to prevent the high exploration bonus from overwhelming the sensitivity to extrinsic rewards during MARL training. This separate function is used to design the behavioral policy for generating transitions. The proposed method is not much affected by stochastic transitions commonly observed in MARL tasks and improves the stability of CTDE-based MARL algorithms when used with an exploration method. By providing didactic examples and demonstrating the substantial performance improvement of our proposed exploration method in CTDE-based MARL algorithms, we illustrate the advantages of our approach. These evaluations highlight how our method outperforms state-of-the-art MARL baselines on challenging tasks within the StarCraft II micromanagement benchmark, underscoring its effectiveness in improving MARL.
Collapse
Affiliation(s)
- Ju-Bong Kim
- Future Convergence Engineering, Department of Computer Science and Engineering, Korea University of Technology and Education, Cheonan, 31253, Republic of Korea.
| | - Ho-Bin Choi
- Future Convergence Engineering, Department of Computer Science and Engineering, Korea University of Technology and Education, Cheonan, 31253, Republic of Korea.
| | - Youn-Hee Han
- Future Convergence Engineering, Department of Computer Science and Engineering, Korea University of Technology and Education, Cheonan, 31253, Republic of Korea.
| |
Collapse
|
9
|
Lyu L, Pang C, Wang J. Understanding the role of pathways in a deep neural network. Neural Netw 2024; 172:106095. [PMID: 38199152 DOI: 10.1016/j.neunet.2024.106095] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Revised: 11/30/2023] [Accepted: 12/31/2023] [Indexed: 01/12/2024]
Abstract
Deep neural networks have demonstrated superior performance in artificial intelligence applications, but the opaqueness of their inner working mechanism is one major drawback in their application. The prevailing unit-based interpretation is a statistical observation of stimulus-response data, which fails to show a detailed internal process of inherent mechanisms of neural networks. In this work, we analyze a convolutional neural network (CNN) trained in the classification task and present an algorithm to extract the diffusion pathways of individual pixels to identify the locations of pixels in an input image associated with object classes. The pathways allow us to test the causal components which are important for classification and the pathway-based representations are clearly distinguishable between categories. We find that the few largest pathways of an individual pixel from an image tend to cross the feature maps in each layer that is important for classification. And the large pathways of images of the same category are more consistent in their trends than those of different categories. We also apply the pathways to understanding adversarial attacks, object completion, and movement perception. Further, the total number of pathways on feature maps in all layers can clearly discriminate the original, deformed, and target samples.
Collapse
Affiliation(s)
- Lei Lyu
- School of Information Science and Engineering, Shandong Normal University, Jinan, China.
| | - Chen Pang
- School of Information Science and Engineering, Shandong Normal University, Jinan, China.
| | - Jihua Wang
- School of Information Science and Engineering, Shandong Normal University, Jinan, China.
| |
Collapse
|
10
|
Karami A, Niaki STA. An Online Support Vector Machine Algorithm for Dynamic Social Network Monitoring. Neural Netw 2024; 171:497-511. [PMID: 38159531 DOI: 10.1016/j.neunet.2023.12.024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2023] [Revised: 11/20/2023] [Accepted: 12/13/2023] [Indexed: 01/03/2024]
Abstract
Online monitoring of social networks offers exciting features for platforms, enabling both technical and behavioral analysis. Numerous studies have explored the adaptation of traditional quality control methods for detecting change points within social networks. However, the current research studies face limitations such as an overreliance on case-based attributes, high computational costs, poor scalability with large networks, and low sensitivity in fast change point detection. This paper proposes a novel algorithm for social network monitoring using One-Class Support Vector Machines (OC-SVMs) to address these limitations. Additionally, using both nodal and network-level attributes makes it versatile for diverse social network applications and effectively detecting network disturbances. The algorithm utilizes a well-defined training data dictionary with an updating procedure for evolutionary networks, enhancing memory and time efficiency by reducing the processing of input data. Extensive numerical experiments are conducted using an EpiCNet model to simulate interactions in an online social network, covering six change scenarios to evaluate the proposed methodology. The results show lower Average Run Length (ARL) and Expected Delay Detection (EDD), demonstrating the superior accuracy and effectiveness of the OC-SVM algorithm compared to alternative methods. Applying OC-SVM to the Enron Email network indicates its capability to identify change points, reflecting the tumultuous timeline that led to Enron's downfall. This further validates the substantial advancement of OC-SVM in social network monitoring and opens doors to broader real-world applications.
Collapse
Affiliation(s)
- Arya Karami
- Department of Industrial Engineering, Sharif University of Technology, Tehran, Iran; School of Mathematics and Statistics, University of New South Wales, Sydney, Australia
| | | |
Collapse
|
11
|
Gowda VB, Gopalakrishna MT, Megha J, Mohankumar S. Foreground segmentation network using transposed convolutional neural networks and up sampling for multiscale feature encoding. Neural Netw 2024; 170:167-175. [PMID: 37984043 DOI: 10.1016/j.neunet.2023.11.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Revised: 10/02/2023] [Accepted: 11/06/2023] [Indexed: 11/22/2023]
Abstract
Foreground segmentation algorithm aims to precisely separate moving objects from the background in various environments. However, the interference from darkness, dynamic background information, and camera jitter makes it still challenging to build a decent detection network. To solve these issues, a triplet CNN and Transposed Convolutional Neural Network (TCNN) are created by attaching a Features Pooling Module (FPM). TCNN process reduces the amount of multi-scale inputs to the network by fusing features into the Foreground Segmentation Network (FgSegNet) based FPM, which extracts multi-scale features from images and builds a strong feature pooling. Additionally, the up-sampling network is added to the proposed technique, which is used to up-sample the abstract image representation, so that its spatial dimensions match with the input image. The large context and long-range dependencies among pixels are acquired by TCNN and segmentation mask, in multiple scales using triplet CNN, to enhance the foreground segmentation of FgSegNet. The results, clearly show that FgSegNet surpasses other state-of-the-art algorithms on the CDnet2014 datasets, with an average F-Measure of 0.9804, precision of 0.9801, PWC as (0.0461), and recall as (0.9896). Moreover, the FgSegNet with up-sampling achieves the F-measure of 0.9804 which is higher when compared to the FgSegNet without up-sampling.
Collapse
Affiliation(s)
- Vishruth B Gowda
- Department of Computer Science and Engineering, SJB Institute of Technology, Bengaluru, Karnataka 560060, India; Visvesavaraya Technological University, Belgavi, Karnataka 590018, India.
| | - M T Gopalakrishna
- Visvesavaraya Technological University, Belgavi, Karnataka 590018, India; Department of Artificial Intelligence and Machine Learning, SJB Institute of Technology, Bengaluru, Karnataka 560060, India
| | - J Megha
- Department of Artificial Intelligence and Machine Learning, Ramaiah Institute of Technology, Bangalore 560054, India
| | - Shilpa Mohankumar
- Department of Information Science and Engineering, Bangalore Institute of Technology, Bengaluru, Karnataka 560060, India
| |
Collapse
|
12
|
Zhang W, Zhao W, Li J, Zhuang P, Sun H, Xu Y, Li C. CVANet: Cascaded visual attention network for single image super-resolution. Neural Netw 2024; 170:622-634. [PMID: 38056409 DOI: 10.1016/j.neunet.2023.11.049] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 09/27/2023] [Accepted: 11/22/2023] [Indexed: 12/08/2023]
Abstract
Deep convolutional neural networks (DCNNs) have exhibited excellent feature extraction and detail reconstruction capabilities for single image super-resolution (SISR). Nevertheless, most previous DCNN-based methods do not fully utilize the complementary strengths between feature maps, channels, and pixels. Therefore, it hinders the ability of DCNNs to represent abundant features. To tackle the aforementioned issues, we present a Cascaded Visual Attention Network for SISR called CVANet, which simulates the visual attention mechanism of the human eyes to focus on the reconstruction process of details. Specifically, we first designed a trainable feature attention module (FAM) for feature-level attention learning. Afterward, we introduce a channel attention module (CAM) to reinforce feature maps under channel-level attention learning. Meanwhile, we propose a pixel attention module (PAM) that adaptively selects representative features from the previous layers, which are utilized to generate a high-resolution image. Satisfactory, our CVANet can effectively improve the resolution of images by exploring the feature representation capabilities of different modules and the visual perception properties of the human eyes. Extensive experiments with different methods on four benchmarks demonstrate that our CVANet outperforms the state-of-the-art (SOTA) methods in subjective visual perception, PSNR, and SSIM.The code will be made available https://github.com/WilyZhao8/CVANet.
Collapse
Affiliation(s)
- Weidong Zhang
- School of Information Engineering, Henan Institute of Science and Technology, Xinxiang, 453003, China
| | - Wenyi Zhao
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, 100876, China.
| | - Jia Li
- School of Information Engineering, Henan Institute of Science and Technology, Xinxiang, 453003, China
| | - Peixian Zhuang
- School of Automation and Electrical Engineering, University of Science and Technology Beijing, 100084, China
| | - Haihan Sun
- School of Engineering, University of Tasmania, Tasmania, 7005, Australia
| | - Yibo Xu
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, 100876, China
| | - Chongyi Li
- School of Computer Science, Nankai University, Tianjing, 300073, China
| |
Collapse
|
13
|
Zhang J, Wang Q, Wang X, Qiao L, Liu M. Preserving specificity in federated graph learning for fMRI-based neurological disorder identification. Neural Netw 2024; 169:584-596. [PMID: 37956575 DOI: 10.1016/j.neunet.2023.11.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Revised: 10/22/2023] [Accepted: 11/03/2023] [Indexed: 11/15/2023]
Abstract
Resting-state functional magnetic resonance imaging (rs-fMRI) offers a non-invasive approach to examining abnormal brain connectivity associated with brain disorders. Graph neural network (GNN) gains popularity in fMRI representation learning and brain disorder analysis with powerful graph representation capabilities. Training a general GNN often necessitates a large-scale dataset from multiple imaging centers/sites, but centralizing multi-site data generally faces inherent challenges related to data privacy, security, and storage burden. Federated Learning (FL) enables collaborative model training without centralized multi-site fMRI data. Unfortunately, previous FL approaches for fMRI analysis often ignore site-specificity, including demographic factors such as age, gender, and education level. To this end, we propose a specificity-aware federated graph learning (SFGL) framework for rs-fMRI analysis and automated brain disorder identification, with a server and multiple clients/sites for federated model aggregation and prediction. At each client, our model consists of a shared and a personalized branch, where parameters of the shared branch are sent to the server while those of the personalized branch remain local. This can facilitate knowledge sharing among sites and also helps preserve site specificity. In the shared branch, we employ a spatio-temporal attention graph isomorphism network to learn dynamic fMRI representations. In the personalized branch, we integrate vectorized demographic information (i.e., age, gender, and education years) and functional connectivity networks to preserve site-specific characteristics. Representations generated by the two branches are then fused for classification. Experimental results on two fMRI datasets with a total of 1218 subjects suggest that SFGL outperforms several state-of-the-art approaches.
Collapse
Affiliation(s)
- Junhao Zhang
- School of Mathematics Science, Liaocheng University, Liaocheng, Shandong, 252000, China
| | - Qianqian Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA
| | - Xiaochuan Wang
- School of Mathematics Science, Liaocheng University, Liaocheng, Shandong, 252000, China
| | - Lishan Qiao
- School of Mathematics Science, Liaocheng University, Liaocheng, Shandong, 252000, China; School of Computer Science and Technology, Shandong Jianzhu University, Jinan, Shandong, 250101, China.
| | - Mingxia Liu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA.
| |
Collapse
|
14
|
Zhu S, Gao Y, Hou Y, Yang C. Reachable Set Estimation for Memristive Complex-Valued Neural Networks With Disturbances. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:11029-11034. [PMID: 35446773 DOI: 10.1109/tnnls.2022.3167117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
This brief focuses on reachable set estimation for memristive complex-valued neural networks (MCVNNs) with disturbances. Based on algebraic calculation and Gronwall-Bellman inequality, the states of MCVNNs with bounded input disturbances converge within a sphere. From this, the convergence speed is also obtained. In addition, an observer for MCVNNs is designed. Two illustrative simulations are also given to show the effectiveness of the obtained conclusions.
Collapse
|
15
|
Liu C, Zhan Y, Yu B, Liu L, Du B, Hu W, Liu T. On exploring node-feature and graph-structure diversities for node drop graph pooling. Neural Netw 2023; 167:559-571. [PMID: 37696073 DOI: 10.1016/j.neunet.2023.08.046] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Revised: 08/15/2023] [Accepted: 08/28/2023] [Indexed: 09/13/2023]
Abstract
Graph Neural Networks (GNNs) have been successfully applied to graph-level tasks in various fields such as biology, social networks, computer vision, and natural language processing. For the graph-level representations learning of GNNs, graph pooling plays an essential role. Among many pooling techniques, node drop pooling has garnered significant attention and is considered as a leading approach. However, existing node drop pooling methods, which typically retain the top-k nodes based on their significance scores, often overlook the diversity inherent in node features and graph structures. This limitation leads to suboptimal graph-level representations. To overcome this, we introduce a groundbreaking plug-and-play score scheme, termed MID. MID comprises a Multidimensional score space and two key operations: flIpscore and Dropscore. The multidimensional score space depicts the significance of nodes by multiple criteria; the flipscore process promotes the preservation of distinct node features; the dropscore compels the model to take into account a range of graph structures rather than focusing on local structures. To evaluate the effectiveness of our proposed MID, we have conducted extensive experiments by integrating it with a broad range of recent node drop pooling methods, such as TopKPool, SAGPool, GSAPool, and ASAP. In particular, MID has proven to bring a significant average improvement of approximately 2.8% over the four aforementioned methods when tested on 17 real-world graph classification datasets. Code is available at https://github.com/whuchuang/mid.
Collapse
Affiliation(s)
- Chuang Liu
- School of Computer Science, Wuhan University, Wuhan, China.
| | | | - Baosheng Yu
- School of Computer Science, University of Sydney, Sydney, Australia.
| | - Liu Liu
- School of Computer Science, University of Sydney, Sydney, Australia.
| | - Bo Du
- School of Computer Science, Wuhan University, Wuhan, China.
| | - Wenbin Hu
- School of Computer Science, Wuhan University, Wuhan, China.
| | - Tongliang Liu
- School of Computer Science, University of Sydney, Sydney, Australia.
| |
Collapse
|
16
|
Deng K, Zhu S, Bao G, Fu J, Zeng Z. Multistability of Dynamic Memristor Delayed Cellular Neural Networks With Application to Associative Memories. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:690-702. [PMID: 34347606 DOI: 10.1109/tnnls.2021.3099814] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Recently, dynamic memristor (DM)-cellular neural networks (CNNs) have received widespread attention due to their advantage of low power consumption. The previous works showed that DM-CNNs have at most 318 equilibrium points (EPs) with n=16 cells. Since time delay is unavoidable during the process of information transmission, the goal of this article is to research the multistability of DM-CNNs with time delay, and, meanwhile, to increase the storage capacity of DM-delay (D)CNNs. Depending on the different constitutive relations of memristors, two cases of the multistability for DM-DCNNs are discussed. After determining the constitutive relations, the number of EPs of DM-DCNNs is increased to 3n with n cells by means of the appropriate state-space decomposition and the Brouwer's fixed point theorem. Furthermore, the enlarged attraction domains of EPs can be obtained, and 2n of these EPs are locally exponentially stable in two cases. Compared with standard CNNs, the dynamic behavior of DM-DCNNs shows an outstanding merit. That is, the value of voltage and current approach to zero when the system becomes stable, and the memristor provides a nonvolatile memory to store the computation results. Finally, two numerical simulations are presented to illustrate the effectiveness of the theoretical results, and the applications of associative memories are shown at the end of this article.
Collapse
|
17
|
Göksel S, Başaran M, Gündoğdu H, Karaçin C. A Rare Hernia Mimicking Implant in a Patient with Rectal Adenocarcinoma: Internal Herniation. Mol Imaging Radionucl Ther 2023; 32:87-89. [PMID: 36820708 PMCID: PMC9950681 DOI: 10.4274/mirt.galenos.2022.53824] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/24/2023] Open
Abstract
Internal herniation may be seen more frequently in patients with intra-abdominal surgery and malignancy history. We presented a 58-year-old male patient diagnosed with rectal adenocarcinoma seven years ago with a history of surgery and pelvic radiotherapy. When the abdominal computed tomography (CT) image was taken during routine oncology follow-up, a lesion mimicking a serosal implant on the anterior abdominal wall was detected. 18F-fluorodeoxyglucose (FDG) positron emission tomography (PET)/CT imaging was performed the suspicion of recurrence. It was concluded that the lesion, which was evaluated as an implant in abdominal CT with 18F-FDG PET/CT imaging, was a spontaneously reducing internal herniation. 18F-FDG PET/CT imaging in cancer patients is crucial in illuminating the suspicion of recurrent lesions in these patients and sheds light on the course of the patients in oncology practice.
Collapse
Affiliation(s)
- Sibel Göksel
- Recep Tayyip Erdoğan University Faculty of Medicine, Department of Nuclear Medicine, Rize, Turkey,* Address for Correspondence: Recep Tayyip Erdoğan University Faculty of Medicine, Department of Nuclear Medicine, Rize, Turkey Phone: +90 543 389 77 14 E-mail:
| | - Mustafa Başaran
- Recep Tayyip Erdoğan University Faculty of Medicine, Department of Radiology, Rize, Turkey
| | - Hasan Gündoğdu
- Recep Tayyip Erdoğan University Faculty of Medicine, Department of Radiology, Rize, Turkey
| | - Cengiz Karaçin
- Dr. Abdurrahman Yurtaslan Training and Research Hospital, Clinic of Medical Oncology, Ankara, Turkey
| |
Collapse
|
18
|
Zhang X, Wang D, Ota K, Dong M, Li H. Delay-Dependent Switching Approaches for Stability Analysis of Two Additive Time-Varying Delay Neural Networks. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; 33:7545-7558. [PMID: 34255633 DOI: 10.1109/tnnls.2021.3085555] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
This article analyzes the exponentially stable problem of neural networks (NNs) with two additive time-varying delay components. Disparate from the previous solutions on this similar model, switching ideas, that divide the time-varying delay intervals and treat the small intervals as switching signals, are introduced to transfer the studied problem into a switching problem. Besides, delay-dependent switching adjustment indicators are proposed to construct a novel set of augmented multiple Lyapunov-Krasovskii functionals (LKFs) that not only satisfy the switching condition but also make the suitable delay-dependent integral items be in the each corresponding LKF based on each switching mode. Combined with some switching techniques, some less conservativeness stability criteria with different numbers of switching modes are obtained. In the end, two simulation examples are performed to demonstrate the effectiveness and efficiency of the presented methods comparing other available ones.
Collapse
|
19
|
|
20
|
Cao Y, Wang S, Guo Z, Huang T, Wen S. Event-based passification of delayed memristive neural networks. Inf Sci (N Y) 2021. [DOI: 10.1016/j.ins.2021.03.045] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
21
|
Sheng Y, Huang T, Zeng Z, Miao X. Global Exponential Stability of Memristive Neural Networks With Mixed Time-Varying Delays. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2021; 32:3690-3699. [PMID: 32857700 DOI: 10.1109/tnnls.2020.3015944] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
This article investigates the Lagrange exponential stability and the Lyapunov exponential stability of memristive neural networks with discrete and distributed time-varying delays (DMNNs). By means of inequality techniques, theories of the M-matrix, and the comparison strategy, the Lagrange exponential stability of the underlying DMNNs is considered in the sense of Filippov, and the globally exponentially attractive set is estimated through employing the M-matrix and external input. Especially, when the external input is not concerned, the Lyapunov exponential stability of the corresponding DMNNs is developed immediately in the form of an M-matrix, which contains some published outcomes as special cases. Furthermore, by constructing an M-matrix-based differential system, the Lyapunov exponential stability of the DMNNs is studied, which is less conservative than some existing ones. Finally, three simulation examples are carried out to examine the validness of the theories.
Collapse
|
22
|
Li L, Sun Y, Wang M, Huang W. Synchronization of Coupled Memristor Neural Networks with Time Delay: Positive Effects of Stochastic Delayed Impulses. Neural Process Lett 2021. [DOI: 10.1007/s11063-021-10600-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
23
|
Sheng Y, Huang T, Zeng Z, Li P. Exponential Stabilization of Inertial Memristive Neural Networks With Multiple Time Delays. IEEE TRANSACTIONS ON CYBERNETICS 2021; 51:579-588. [PMID: 31689230 DOI: 10.1109/tcyb.2019.2947859] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
This article investigates the global exponential stabilization (GES) of inertial memristive neural networks with discrete and distributed time-varying delays (DIMNNs). By introducing the inertial term into memristive neural networks (MNNs), DIMNNs are formulated as the second-order differential equations with discontinuous right-hand sides. Via a variable transformation, the initial DIMNNs are rewritten as the first-order differential equations. By exploiting the theories of differential inclusion, inequality techniques, and the comparison strategy, the p th moment GES ( p ≥ 1 ) of the addressed DIMNNs is presented in terms of algebraic inequalities within the sense of Filippov, which enriches and extends some published results. In addition, the global exponential stability of MNNs is also performed in the form of an M-matrix, which contains some existing ones as special cases. Finally, two simulations are carried out to validate the correctness of the theories, and an application is developed in pseudorandom number generation.
Collapse
|
24
|
State bounding for fuzzy memristive neural networks with bounded input disturbances. Neural Netw 2020; 134:163-172. [PMID: 33316722 DOI: 10.1016/j.neunet.2020.11.016] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2020] [Revised: 10/30/2020] [Accepted: 11/27/2020] [Indexed: 11/22/2022]
Abstract
This paper investigates the state bounding problem of fuzzy memristive neural networks (FMNNs) with bounded input disturbances. By using the characters of Metzler, Hurwitz and nonnegative matrices, this paper obtains the exact delay-independent and delay-dependent boundary ranges of the solution, which have less conservatism than the results in existing literatures. The validity of the results is verified by two numerical examples.
Collapse
|
25
|
Global exponential anti-synchronization for delayed memristive neural networks via event-triggering method. Neural Comput Appl 2020. [DOI: 10.1007/s00521-020-04762-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
26
|
Sheng Y, Lewis FL, Zeng Z, Huang T. Lagrange Stability and Finite-Time Stabilization of Fuzzy Memristive Neural Networks With Hybrid Time-Varying Delays. IEEE TRANSACTIONS ON CYBERNETICS 2020; 50:2959-2970. [PMID: 31059467 DOI: 10.1109/tcyb.2019.2912890] [Citation(s) in RCA: 37] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
This paper focuses on Lagrange exponential stability and finite-time stabilization of Takagi-Sugeno (T-S) fuzzy memristive neural networks with discrete and distributed time-varying delays (DFMNNs). By resorting to theories of differential inclusions and the comparison strategy, an algebraic condition is developed to confirm Lagrange exponential stability of the underlying DFMNNs in Filippov's sense, and the exponentially attractive set is estimated. When external input is not considered, global exponential stability of DFMNNs is derived directly, which includes some existing ones as special cases. Furthermore, finite-time stabilization of the addressed DFMNNs is analyzed by exploiting inequality techniques and the comparison approach via designing a nonlinear state feedback controller. The boundedness assumption of activation functions is removed herein. Finally, two simulations are presented to demonstrate the validness of the outcomes, and an application is performed in pseudorandom number generation.
Collapse
|
27
|
Bounemeur A, Chemachema M. Adaptive fuzzy fault-tolerant control using Nussbaum-type function with state-dependent actuator failures. Neural Comput Appl 2020. [DOI: 10.1007/s00521-020-04977-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
28
|
Passivity Analysis of Non-autonomous Discrete-Time Inertial Neural Networks with Time-Varying Delays. Neural Process Lett 2020. [DOI: 10.1007/s11063-020-10235-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
29
|
Wang X, Park JH, Zhong S, Yang H. A Switched Operation Approach to Sampled-Data Control Stabilization of Fuzzy Memristive Neural Networks With Time-Varying Delay. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2020; 31:891-900. [PMID: 31059457 DOI: 10.1109/tnnls.2019.2910574] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
This paper investigates the issue of sampled-data stabilization for Takagi-Sugeno fuzzy memristive neural networks (FMNNs) with time-varying delay. First, the concerned FMNNs are transformed into the tractable fuzzy NNs based on the excitatory and inhibitory of memristive synaptic weights using a new convex combination technique. Meanwhile, a switched fuzzy sampled-data controller is employed for the first time to tackle stability problems related to FMNNs. Then, the novel stabilization criteria of the FMNNs are established using the fuzzy membership functions (FMFs)-dependent Lyapunov-Krasovskii functional. This sufficiently utilizes information from not only the delayed state and the actual sampling pattern but also the FMFs. Two simulation examples are presented to demonstrate the feasibility and validity of the proposed method.
Collapse
|
30
|
|
31
|
Pershin YV, Di Ventra M. On the validity of memristor modeling in the neural network literature. Neural Netw 2019; 121:52-56. [PMID: 31536899 DOI: 10.1016/j.neunet.2019.08.026] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2019] [Revised: 08/13/2019] [Accepted: 08/22/2019] [Indexed: 10/26/2022]
Abstract
An analysis of the literature shows that there are two types of non-memristive models that have been widely used in the modeling of so-called "memristive" neural networks. Here, we demonstrate that such models have nothing in common with the concept of memristive elements: they describe either non-linear resistors or certain bi-state systems, which all are devices without memory. Therefore, the results presented in a significant number of publications are at least questionable, if not completely irrelevant to the actual field of memristive neural networks.
Collapse
Affiliation(s)
- Yuriy V Pershin
- Department of Physics and Astronomy, University of South Carolina, Columbia, SC 29208, USA.
| | | |
Collapse
|
32
|
Sheng Y, Lewis FL, Zeng Z. Exponential Stabilization of Fuzzy Memristive Neural Networks With Hybrid Unbounded Time-Varying Delays. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2019; 30:739-750. [PMID: 30047913 DOI: 10.1109/tnnls.2018.2852497] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
This paper is concerned with exponential stabilization for a class of Takagi-Sugeno fuzzy memristive neural networks (FMNNs) with unbounded discrete and distributed time-varying delays. Under the framework of Filippov solutions, algebraic criteria are established to guarantee exponential stabilization of the addressed FMNNs with hybrid unbounded time delays via designing a fuzzy state feedback controller by exploiting inequality techniques, calculus theorems, and theories of fuzzy sets. The obtained results in this paper enhance and generalize some existing ones. Meanwhile, a general theoretical framework is proposed to investigate the dynamical behaviors of various neural networks with mixed infinite time delays. Finally, two simulation examples are performed to illustrate the validity of the derived outcomes.
Collapse
|
33
|
Fu Q, Cai J, Zhong S, Yu Y, Shan Y. Input-to-state stability of discrete-time memristive neural networks with two delay components. Neurocomputing 2019. [DOI: 10.1016/j.neucom.2018.10.017] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
|
34
|
Passivity analysis of delayed reaction–diffusion memristor-based neural networks. Neural Netw 2019; 109:159-167. [DOI: 10.1016/j.neunet.2018.10.004] [Citation(s) in RCA: 77] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2018] [Revised: 09/25/2018] [Accepted: 10/09/2018] [Indexed: 11/21/2022]
|
35
|
Tang HA, Duan S, Hu X, Wang L. Passivity and synchronization of coupled reaction–diffusion neural networks with multiple time-varying delays via impulsive control. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2018.08.005] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
|
36
|
Zhou L. Delay-dependent and delay-independent passivity of a class of recurrent neural networks with impulse and multi-proportional delays. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2018.04.076] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/16/2022]
|
37
|
Zhang R, Zeng D, Liu X, Zhong S, Zhong Q. Improved results on state feedback stabilization for a networked control system with additive time-varying delay components' controller. ISA TRANSACTIONS 2018; 75:1-14. [PMID: 29471969 DOI: 10.1016/j.isatra.2018.02.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/24/2016] [Revised: 01/03/2018] [Accepted: 02/05/2018] [Indexed: 06/08/2023]
Abstract
This paper investigates the problems of stability and stabilization for a networked control system (NCS) with additive time-varying delay components' controller. Firstly, stability of a NCS with additive time-varying delays is investigated. A novel approach with free parameters is proposed. By constructing a new Lyapunov-Krasovskii functional (LKF) with two free parameters, stability criteria are obtained. The obtained stability criteria depend not only on upper bounds of delays but also free parameters. In addition, input-output method is extended to study the stability problem for the NCS. Compared with other approaches such as input-output method, the free-parameter approach is more flexible and effective in reducing the conservatism. Then, based on the stability results, a state feedback controller is designed to guarantee the asymptotically stable of the closed-loop systems. Finally, numerical examples are provided to show the effectiveness and less conservatism of the proposed results.
Collapse
Affiliation(s)
- Ruimei Zhang
- School of Mathematics Sciences, University of Electronic Science and Technology of China, Chengdu, Sichuan, 611731, China; Department of Applied Mathematics, University of Waterloo, Waterloo, Ontario N2L 3G1, Canada.
| | - Deqiang Zeng
- Data Recovery Key Laboratory of Sichuan Province, Neijiang Normal University, Neijiang, Sichuan, 641100, China; Numerical Simulation Key Laboratory of Sichuan Province, Neijiang Normal University, Neijiang, Sichuan, 641100, China
| | - Xinzhi Liu
- Department of Applied Mathematics, University of Waterloo, Waterloo, Ontario N2L 3G1, Canada
| | - Shouming Zhong
- School of Mathematics Sciences, University of Electronic Science and Technology of China, Chengdu, Sichuan, 611731, China
| | - Qishui Zhong
- School of Aeronautics and Astronautics, University of Electronic Science and Technology of China, Chengdu, 611731, China; Institute of Electronic and Information Engineering of UESTC, Guangdong, Dongguan, 523808, China
| |
Collapse
|
38
|
Liang Q, Wang L, Hao Q, She Z. Synchronization of heterogeneous linear networks with distinct inner coupling matrices. ISA TRANSACTIONS 2018; 75:127-136. [PMID: 29455892 DOI: 10.1016/j.isatra.2018.01.031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/09/2017] [Revised: 01/03/2018] [Accepted: 01/24/2018] [Indexed: 06/08/2023]
Abstract
In this paper, we study synchronization of heterogeneous linear networks with distinct inner coupling matrices. Firstly, for synchronous networks, we show that any synchronous trajectory will converge to a corresponding synchronous state. Then, we provide an invariant set, which can be exactly obtained by solving linear equations and then used for characterizing synchronous states. Afterwards, we use inner coupling matrices and node dynamics to successively decompose the original network into a new network, composed of the external part and the internal part. Moreover, this new network can be proved to synchronize to the above invariant set by constructing the corresponding desired Lyapunov-like functions for the internal part and the external part respectively. In particular, this result still holds if the coupling strength is disturbed slightly. Finally, examples with numerical simulations are given to illustrate the validity and applicability of our theoretical results.
Collapse
Affiliation(s)
- Quanyi Liang
- SKLSDE, LMIB and School of Mathematics and Systems Science, Beihang University, Beijing, China
| | - Lei Wang
- School of Automation Science & Electrical Engineering, Beihang University, Beijing, China
| | - Qiqi Hao
- SKLSDE, LMIB and School of Mathematics and Systems Science, Beihang University, Beijing, China
| | - Zhikun She
- SKLSDE, LMIB and School of Mathematics and Systems Science, Beihang University, Beijing, China.
| |
Collapse
|
39
|
Ding S, Wang Z, Zhang H. Dissipativity Analysis for Stochastic Memristive Neural Networks With Time-Varying Delays: A Discrete-Time Case. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2018; 29:618-630. [PMID: 28055917 DOI: 10.1109/tnnls.2016.2631624] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
In this paper, the dissipativity problem of discrete-time memristive neural networks (DMNNs) with time-varying delays and stochastic perturbation is investigated. A class of logical switched functions are put forward to reflect the memristor-based switched property of connection weights, and the DMNNs are then recast into a tractable model. Based on the tractable model, the robust analysis method and Refined Jensen-based inequalities are applied to establish some sufficient conditions that ensure the of DMNNs. Two numerical examples are presented to illustrate the effectiveness of the obtained results.
Collapse
|
40
|
Bao H, Cao J, Kurths J, Alsaedi A, Ahmad B. H∞ state estimation of stochastic memristor-based neural networks with time-varying delays. Neural Netw 2018; 99:79-91. [DOI: 10.1016/j.neunet.2017.12.014] [Citation(s) in RCA: 50] [Impact Index Per Article: 7.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2017] [Revised: 10/23/2017] [Accepted: 12/26/2017] [Indexed: 10/18/2022]
|
41
|
Wan P, Jian J. Passivity analysis of memristor-based impulsive inertial neural networks with time-varying delays. ISA TRANSACTIONS 2018; 74:88-98. [PMID: 29455890 DOI: 10.1016/j.isatra.2018.02.002] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2017] [Revised: 12/18/2017] [Accepted: 02/04/2018] [Indexed: 06/08/2023]
Abstract
This paper focuses on delay-dependent passivity analysis for a class of memristive impulsive inertial neural networks with time-varying delays. By choosing proper variable transformation, the memristive inertial neural networks can be rewritten as first-order differential equations. The memristive model presented here is regarded as a switching system rather than employing the theory of differential inclusion and set-value map. Based on matrix inequality and Lyapunov-Krasovskii functional method, several delay-dependent passivity conditions are obtained to ascertain the passivity of the addressed networks. In addition, the results obtained here contain those on the passivity for the addressed networks without impulse effects as special cases and can also be generalized to other neural networks with more complex pulse interference. Finally, one numerical example is presented to show the validity of the obtained results.
Collapse
Affiliation(s)
- Peng Wan
- College of Science, China Three Gorges University, Yichang, Hubei, 443002, China.
| | - Jigui Jian
- College of Science, China Three Gorges University, Yichang, Hubei, 443002, China.
| |
Collapse
|
42
|
Li C, Lian J, Wang Y. Stability of switched memristive neural networks with impulse and stochastic disturbance. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2017.11.031] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
43
|
Lakshmanan S, Prakash M, Lim CP, Rakkiyappan R, Balasubramaniam P, Nahavandi S. Synchronization of an Inertial Neural Network With Time-Varying Delays and Its Application to Secure Communication. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2018; 29:195-207. [PMID: 27834655 DOI: 10.1109/tnnls.2016.2619345] [Citation(s) in RCA: 117] [Impact Index Per Article: 16.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
In this paper, synchronization of an inertial neural network with time-varying delays is investigated. Based on the variable transformation method, we transform the second-order differential equations into the first-order differential equations. Then, using suitable Lyapunov-Krasovskii functionals and Jensen's inequality, the synchronization criteria are established in terms of linear matrix inequalities. Moreover, a feedback controller is designed to attain synchronization between the master and slave models, and to ensure that the error model is globally asymptotically stable. Numerical examples and simulations are presented to indicate the effectiveness of the proposed method. Besides that, an image encryption algorithm is proposed based on the piecewise linear chaotic map and the chaotic inertial neural network. The chaotic signals obtained from the inertial neural network are utilized for the encryption process. Statistical analyses are provided to evaluate the effectiveness of the proposed encryption algorithm. The results ascertain that the proposed encryption algorithm is efficient and reliable for secure communication applications.
Collapse
|
44
|
Fu Q, Cai J, Zhong S, Yu Y. Dissipativity and passivity analysis for memristor-based neural networks with leakage and two additive time-varying delays. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2017.09.014] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
45
|
Wei H, Chen C, Tu Z, Li N. New results on passivity analysis of memristive neural networks with time-varying delays and reaction–diffusion term. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2017.10.035] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
46
|
Nagamani G, Radhika T, Zhu Q. An Improved Result on Dissipativity and Passivity Analysis of Markovian Jump Stochastic Neural Networks With Two Delay Components. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2017; 28:3018-3031. [PMID: 27740500 DOI: 10.1109/tnnls.2016.2608360] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
In this paper, we investigate the dissipativity and passivity of Markovian jump stochastic neural networks involving two additive time-varying delays. Using a Lyapunov-Krasovskii functional with triple and quadruple integral terms, we obtain delay-dependent passivity and dissipativity criteria for the system. Using a generalized Finsler lemma (GFL), a set of slack variables with special structure are introduced to reduce design conservatism. The dissipativity and passivity criteria depend on the upper bounds of the discrete time-varying delay and its derivative are given in terms of linear matrix inequalities, which can be efficiently solved through the standard numerical software. Finally, our illustrative examples show that the proposed method performs well and is successful in problems where existing methods fail.
Collapse
|
47
|
Li R, Cao J. Finite-Time Stability Analysis for Markovian Jump Memristive Neural Networks With Partly Unknown Transition Probabilities. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2017; 28:2924-2935. [PMID: 28114080 DOI: 10.1109/tnnls.2016.2609148] [Citation(s) in RCA: 36] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
This paper is concerned with the finite-time stochastically stability (FTSS) analysis of Markovian jump memristive neural networks with partly unknown transition probabilities. In the neural networks, there exist a group of modes determined by Markov chain, and thus, the Markovian jump was taken into consideration and the concept of FTSS is first introduced for the memristive model. By introducing a Markov switching Lyapunov functional and stochastic analysis theory, an FTSS test procedure is proposed, from which we can conclude that the settling time function is a stochastic variable and its expectation is finite. The system under consideration is quite general since it contains completely known and completely unknown transition probabilities as two special cases. More importantly, a nonlinear measure method was introduced to verify the uniqueness of the equilibrium point; compared with the fixed point Theorem that has been widely used in the existing results, this method is more easy to implement. Besides, the delay interval was divided into four subintervals, which make full use of the information of the subsystems upper bounds of the time-varying delays. Finally, the effectiveness and superiority of the proposed method is demonstrated by two simulation examples.
Collapse
|
48
|
Wang J, Zhang H, Wang Z, Liu Z. Sampled-Data Synchronization of Markovian Coupled Neural Networks With Mode Delays Based on Mode-Dependent LKF. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2017; 28:2626-2637. [PMID: 28113649 DOI: 10.1109/tnnls.2016.2599263] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
This paper investigates sampled-data synchronization problem of Markovian coupled neural networks with mode-dependent interval time-varying delays and aperiodic sampling intervals based on an enhanced input delay approach. A mode-dependent augmented Lyapunov-Krasovskii functional (LKF) is utilized, which makes the LKF matrices mode-dependent as much as possible. By applying an extended Jensen's integral inequality and Wirtinger's inequality, new delay-dependent synchronization criteria are obtained, which fully utilizes the upper bound on variable sampling interval and the sawtooth structure information of varying input delay. In addition, the desired stochastic sampled-data controllers can be obtained by solving a set of linear matrix inequalities. Finally, two examples are provided to demonstrate the feasibility of the proposed method.This paper investigates sampled-data synchronization problem of Markovian coupled neural networks with mode-dependent interval time-varying delays and aperiodic sampling intervals based on an enhanced input delay approach. A mode-dependent augmented Lyapunov-Krasovskii functional (LKF) is utilized, which makes the LKF matrices mode-dependent as much as possible. By applying an extended Jensen's integral inequality and Wirtinger's inequality, new delay-dependent synchronization criteria are obtained, which fully utilizes the upper bound on variable sampling interval and the sawtooth structure information of varying input delay. In addition, the desired stochastic sampled-data controllers can be obtained by solving a set of linear matrix inequalities. Finally, two examples are provided to demonstrate the feasibility of the proposed method.
Collapse
Affiliation(s)
- Junyi Wang
- College of Information Science and Engineering, Northeastern University, Shenyang, China
| | - Huaguang Zhang
- College of Information Science and Engineering, Northeastern University, Shenyang, China
| | - Zhanshan Wang
- College of Information Science and Engineering, Northeastern University, Shenyang, China
| | - Zhenwei Liu
- College of Information Science and Engineering, Northeastern University, Shenyang, China
| |
Collapse
|
49
|
Su L, Zhou L. Passivity of memristor-based recurrent neural networks with multi-proportional delays. Neurocomputing 2017. [DOI: 10.1016/j.neucom.2017.05.064] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
50
|
Luo Y, Song B, Liang J, Dobaie AM. Finite-time state estimation for jumping recurrent neural networks with deficient transition probabilities and linear fractional uncertainties. Neurocomputing 2017. [DOI: 10.1016/j.neucom.2017.04.039] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|