1
|
Huo J, Yu J, Wang M, Yi Z, Leng J, Liao Y. Coexistence of Cyclic Sequential Pattern Recognition and Associative Memory in Neural Networks by Attractor Mechanisms. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:4959-4970. [PMID: 38442060 DOI: 10.1109/tnnls.2024.3368092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/07/2024]
Abstract
Neural networks are developed to model the behavior of the brain. One crucial question in this field pertains to when and how a neural network can memorize a given set of patterns. There are two mechanisms to store information: associative memory and sequential pattern recognition. In the case of associative memory, the neural network operates with dynamical attractors that are point attractors, each corresponding to one of the patterns to be stored within the network. In contrast, sequential pattern recognition involves the network memorizing a set of patterns and subsequently retrieving them in a specific order over time. From a dynamical perspective, this corresponds to the presence of a continuous attractor or a cyclic attractor composed of the sequence of patterns stored within the network in a given order. Evidence suggests that the brain is capable of simultaneously performing both associative memory and sequential pattern recognition. Therefore, these types of attractors coexist within the neural network, signifying that some patterns are stored as point attractors, while others are stored as continuous or cyclic attractors. This article investigates the coexistence of cyclic attractors and continuous or point attractors in certain nonlinear neural networks, enabling the simultaneous emergence of various memory mechanisms. By selectively grouping neurons, conditions are established for the existence of cyclic attractors, continuous attractors, and point attractors, respectively. Furthermore, each attractor is explicitly represented, and a competitive dynamic emerges among these coexisting attractors, primarily regulated by adjustments to external inputs.
Collapse
|
2
|
Gao K, Lu J, Zheng WX, Chen X. Synchronization in Coupled Neural Networks With Hybrid Delayed Impulses: Average Impulsive Delay-Gain Method. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:3608-3617. [PMID: 38366394 DOI: 10.1109/tnnls.2024.3357515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/18/2024]
Abstract
In this article, we propose a new concept called average impulsive delay-gain (AIDG) for studying the synchronization of coupled neural networks (CNNs). Based on the viewpoints of impulsive control and impulsive perturbation, we establish some globally exponential synchronization criteria for CNNs. Our methods are well-suited for addressing the synchronization problems of systems subject to hybrid delayed impulses with time-varying impulsive delay and gain. Moreover, we prove that the AIDG has both positive and negative effects on synchronization. Compared to existing research, our conclusions are more applicable and less conservative as the considered hybrid delayed impulses involve more flexible cases. Finally, we validate the effectiveness of our proposed results by applying them to small-world and scale-free network models.
Collapse
|
3
|
Wan P, Zhou Y, Zeng Z. Adaptive Drive-Response Synchronization of Timescale-Type Neural Networks With Unbounded Time-Varying Delays. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:1056-1068. [PMID: 37991913 DOI: 10.1109/tnnls.2023.3329138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/24/2023]
Abstract
In recent years, adaptive drive-response synchronization (DRS) of two continuous-time delayed neural networks (NNs) has been investigated extensively. For two timescale-type NNs (TNNs), how to develop adaptive synchronization control schemes and demonstrate rigorously is still an open problem. This article concentrates on adaptive control design for synchronization of TNNs with unbounded time-varying delays. First, timescale-type Barbalat lemma and novel timescale-type inequality techniques are first proposed, which provides us practical methods to investigate timescale-type nonlinear systems. Second, using timescale-type calculus, novel timescale-type inequality, and timescale-type Barbalat lemma, we demonstrate that global asymptotic synchronization can be achieved via adaptive control under algebraic and matrix inequality criteria even if the time-varying delays are unbounded and nondifferentiable. Adaptive DRS is discussed for TNNs, which implies our control schemes are suitable for continuous-time NNs, their discrete-time counterparts, and any combination of them. Finally, numerical examples on TNNs and timescale-type chaotic Ikeda-like oscillator with unbounded time-varying delays are carried out to verify the adaptive control schemes.
Collapse
|
4
|
Chen WH, Chen Y, Zheng WX. Variable Gain Impulsive Synchronization for Discrete-Time Delayed Neural Networks and Its Application in Digital Secure Communication. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:18674-18686. [PMID: 37815961 DOI: 10.1109/tnnls.2023.3319974] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/12/2023]
Abstract
This article revisits the problems of impulsive stabilization and impulsive synchronization of discrete-time delayed neural networks (DDNNs) in the presence of disturbance in the input channel. A new Lyapunov approach based on double Lyapunov functionals is introduced for analyzing exponential input-to-state stability (EISS) of discrete impulsive delayed systems. In the framework of double Lyapunov functionals, a pair of timer-dependent Lyapunov functionals are constructed for impulsive DDNNs. The pair of Lyapunov functionals can introduce more degrees of freedom that not only can be exploited to reduce the conservatism of the previous methods, but also make it possible to design variable gain impulsive controllers. New design criteria for impulsive stabilization and impulsive synchronization are derived in terms of linear matrix inequalities. Numerical results show that compared with the constant gain design technique, the proposed variable gain design technique can accept larger impulse intervals and equip the impulsive controllers with a stronger disturbance attenuation ability. Applications to digital signal encryption and image encryption are provided which validate the effectiveness of the theoretical results.
Collapse
|
5
|
Zhang L, Lu J, Liu F, Lou J. Synchronization of Time-Delay Coupled Neural Networks With Stabilizing Delayed Impulsive Control. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:18899-18906. [PMID: 37819822 DOI: 10.1109/tnnls.2023.3320651] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/13/2023]
Abstract
This brief studies the distributed synchronization of time-delay coupled neural networks (NNs) with impulsive pinning control involving stabilizing delays. A novel differential inequality is proposed, where the state's past information at impulsive time is effectively extracted and used to handle the synchronization of coupled NNs. Based on this inequality, the restriction that the size of impulsive delay is always limited by the system delay is removed, and the upper bound on the impulsive delay is relaxed, which is improved the existing related results. By using the methods of average impulsive interval (AII) and impulsive delay, some relaxed criteria for distributed synchronization of time-delay coupled NNs are obtained. The proposed synchronization conditions do not impose on the upper bound of two consecutive impulsive signals, and the lower bound is more flexible. Moreover, our results reveal that the impulsive delays may contribute to the synchronization of time-delay systems. Finally, typical networks are presented to illustrate the advantage of our delayed impulsive control method.
Collapse
|
6
|
Zhou X, Tan J, Li L, Yao Y, Zhang X. DoS attacks resilience of heterogeneous complex networks via dynamic event-triggered impulsive scheme for secure quasi-synchronization. ISA TRANSACTIONS 2024; 153:28-40. [PMID: 39179481 DOI: 10.1016/j.isatra.2024.07.017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/21/2024] [Revised: 07/12/2024] [Accepted: 07/12/2024] [Indexed: 08/26/2024]
Abstract
This paper addresses the secure quasi-synchronization issue of heterogeneous complex networks (HCNs) under aperiodic denial-of-service (DoS) attacks with dynamic event-triggered impulsive scheme (ETIS). The heterogeneity of networks and the aperiodic DoS attacks, which hinder communication channels and synchronization goals, present challenges to the analysis of secure quasi-synchronization. The ETIS leverages impulsive control and dynamic event-triggered scheme (ETS) to handle the network heterogeneity and the DoS attacks. We give specific bounds on the attack duration and frequency that the network can endure, and obtain synchronization criteria that relate to event parameters, attack duration, attack frequency, and impulsive gain by the variation of parameter formula and recursive methods. Moreover, we prove that the dynamic ETS significantly reduces the controller updates, saves energy without sacrificing the system decay rate, and prevents the Zeno phenomenon. Finally, we validate our control scheme with a numerical example.
Collapse
Affiliation(s)
- Xiaotao Zhou
- School of Mathematics, Hefei University of Technology, Hefei 230009, China
| | - Jieqing Tan
- School of Mathematics, Hefei University of Technology, Hefei 230009, China.
| | - Lulu Li
- School of Mathematics, Hefei University of Technology, Hefei 230009, China.
| | - Yangang Yao
- School of Information and Artificial Intelligence, Anhui Agricultural University, Hefei 230009, China.
| | - Xu Zhang
- School of Mathematics, Hefei University of Technology, Hefei 230009, China
| |
Collapse
|
7
|
Zhang X, Li C, Li H, Xu J. Synchronization of Neural Networks Involving Distributed-Delay Coupling: A Distributed-Delay Differential Inequalities Approach. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:8086-8096. [PMID: 37015367 DOI: 10.1109/tnnls.2022.3224393] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
In this article, we address the synchronization issue for coupled neural networks (CNNs) with mixed couplings by way of the delayed impulsive control, where the delay is distributed. Particularly, mixed couplings comprise the current-state coupling and the distributed-delay coupling, where influences on network connections caused by the past information of CNNs over a certain period are considered. First, we propose a novel array of delayed impulsive differential inequalities involving distributed-delay-dependent impulses, where distributed delays can be relatively larger. Second, we apply such delayed inequalities to analyze the problem of synchronization for CNNs with two different topologies. Sufficient criteria and distributed-delay-dependent impulsive controller are derived thereby. Furthermore, using techniques of matrix decomposition, several low-dimensional criteria are set out, which are appropriate for applications of large scale CNNs. Finally, a numerical example of CNNs with both the current-state coupling and the distributed-delay coupling involving three cases, are exhibited to exemplify the validity and the efficiency of the obtained theoretical results.
Collapse
|
8
|
Wang P, Li X, Zheng Q. Synchronization of inertial complex-valued memristor-based neural networks with time-varying delays. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2024; 21:3319-3334. [PMID: 38454730 DOI: 10.3934/mbe.2024147] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/09/2024]
Abstract
The synchronization of inertial complex-valued memristor-based neural networks (ICVMNNs) with time-varying delays was explored in the paper with the non-separation and non-reduced approach. Sufficient conditions required for the exponential synchronization of the ICVMNNs were identified with the construction of comprehensive Lyapunov functions and the design of a novel control scheme. The adaptive synchronization was also investigated based on the derived results, which is easier to implement in practice. What's more, a numerical example that verifies the obtained results was presented.
Collapse
Affiliation(s)
- Pan Wang
- School of Science, Xuchang University, Xuchang 461000, China
| | - Xuechen Li
- School of Science, Xuchang University, Xuchang 461000, China
| | - Qianqian Zheng
- School of Science, Xuchang University, Xuchang 461000, China
| |
Collapse
|
9
|
Ling S, Shi H, Wang H, Liu PX. Exponential synchronization of delayed coupled neural networks with delay-compensatory impulsive control. ISA TRANSACTIONS 2024; 144:133-144. [PMID: 37977885 DOI: 10.1016/j.isatra.2023.11.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/26/2022] [Revised: 10/13/2023] [Accepted: 11/10/2023] [Indexed: 11/19/2023]
Abstract
This paper studies the exponential synchronization problem for a class of delayed coupled neural networks with delay-compensatory impulsive control. A Razumikhin-type inequality involving some destabilizing delayed impulse gains and a new idea of delay-compensatory that shows two critical roles for system stability are presented, respectively. Based on the constructed inequality and the presented delay-compensatory idea, sufficient stability and synchronization criteria for globally exponential synchronization (GES) of coupled neural networks (CNNs) are presented. Compared with existing results, the uniqueness of the presented results lies in that impulse delays can be fetched and integrated to compensate for instantaneous unstable impulse dynamics caused by destabilizing gains. Moreover, constraints between system delay and impulsive delay are relaxed, and the interval of impulses no longer constrains the system delay. Comparisons and a practical application are given to demonstrate the superior performance of the presented novel control methods.
Collapse
Affiliation(s)
- Song Ling
- School of Mechanical, Electronic and Control Engineering, Beijing Jiaotong University, Beijing 100044, China
| | - Hongmei Shi
- School of Mechanical, Electronic and Control Engineering, Beijing Jiaotong University, Beijing 100044, China
| | - Huanqing Wang
- School of Mathematics Sciences, Bohai University, Jinzhou 121000, China
| | - Peter X Liu
- Department of Systems and Computer Engineering, Carleton University, Ottawa, ON K1S 5B6, Canada.
| |
Collapse
|
10
|
Xing M, Lu J, Lou J, Zhang L. Event-based fixed-time synchronization of neural networks under DoS attack and its applications. Neural Netw 2023; 166:622-633. [PMID: 37604073 DOI: 10.1016/j.neunet.2023.07.046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2022] [Revised: 06/29/2023] [Accepted: 07/27/2023] [Indexed: 08/23/2023]
Abstract
In this paper, the fixed-time synchronization control for neural networks with discontinuous data communication is investigated. Due to the transmission blocking caused by DoS attack, it is intractable to establish a monotonically decreasing Lyapunov function like the conventional analysis of fixed-time stability. Therefore, by virtue of recursive and reduction to absurdity approaches, novel fixed-time stability criteria where the estimated upper bound of settling-time is inherently different from existing results are presented. Then, based on the developed conditions, an event-triggered control scheme that can avoid Zeno behavior is designed to achieve synchronization of master-slave neural networks under DoS attack within a prescribed time. For comparison, the established control scheme is further discussed under the case without DoS attack, and the circumstance that there is no attack or event-triggered mechanism, respectively. Simulation results are finally provided to illustrate the significant and validity of our theoretical research. Especially, in terms of encryption and decryption keys generated from the synchronization behavior of chaotic networks, we specifically discuss the application of the proposed fixed-time synchronization scheme to image and audio encryption.
Collapse
Affiliation(s)
- Mengping Xing
- School of Cyber Science and Engineering, Southeast University, Nanjing, 210096, China.
| | - Jianquan Lu
- Department of Mathematics, Southeast University, Nanjing, 210096, China.
| | - Jungang Lou
- Yangtze Delta Region (Huzhou) Institute of Intelligent Transportation, Huzhou University, Huzhou, 313000, China.
| | - Lingzhong Zhang
- School of Electrical Engineering and Automation, Changshu Institute of Technology, Changshu 215500, China.
| |
Collapse
|
11
|
Design of Controllers for Finite-Time Robust Stabilization of Inertial Delayed Neural Networks with External Disturbances. Neural Process Lett 2023. [DOI: 10.1007/s11063-023-11206-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/18/2023]
|
12
|
A Unified Synchronization Criterion for Reaction-Diffusion Neural Networks with Time-Varying Impulsive Delays and System Delay. Neural Process Lett 2022. [DOI: 10.1007/s11063-022-10994-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
13
|
Li M, Yang X, Li X. Delayed Impulsive Control for Lag Synchronization of Delayed Neural Networks Involving Partial Unmeasurable States. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; PP:783-791. [PMID: 35648880 DOI: 10.1109/tnnls.2022.3177234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
In the framework of impulsive control, this article deals with the lag synchronization problem of neural networks involving partially unmeasurable states, where the time delay in impulses is fully addressed. Since the complexity of external environment and uncertainty of networks, which may lead to a result that the information of partial states is unmeasurable, the key problem for lag synchronization control is how to utilize the information of measurable states to design suitable impulsive control. By using linear matrix inequality (LMI) and transition matrix method coupled with dimension expansion technique, some sufficient conditions are derived to guarantee lag synchronization, where the requirement for information of all states is needless. Moreover, our proposed conditions not only allow the existence of unmeasurable states but also reduce the restrictions on the number of measurable states, which shows the generality of our results and wide-application in practice. Finally, two illustrative examples and their numerical simulations are presented to demonstrate the effectiveness of main results.
Collapse
|
14
|
Zhang L, Yang Y. Different Control Strategies for Fixed-Time Synchronization of Inertial Memristive Neural Networks. Neural Process Lett 2022. [DOI: 10.1007/s11063-022-10779-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|