1
|
Zhang T, Rao S, Zhou J. Heterogeneous boundary synchronization of time-delayed competitive neural networks with adaptive learning parameter in the space-time discretized frames. Neural Netw 2025; 186:107255. [PMID: 39955958 DOI: 10.1016/j.neunet.2025.107255] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2024] [Revised: 11/12/2024] [Accepted: 02/03/2025] [Indexed: 02/18/2025]
Abstract
This article presents the master-slave time-delayed competitive neural networks in space-time discretized frames(STD-CNNs) with the heterogeneous structure, induced by the design of an adaptive learning parameter in the slave STD-CNNs. This article addresses the issue of exponential synchronization for the time-delayed STD-CNNs with the heterogeneous structure via the controls at the boundaries, based on the learning law setting for the parameter in the slave STD-CNNs. In a corresponding manner, the exponential synchronization for time-delayed STD-CNNs with the homogeneous structure can be achieved via boundary controls. This study demonstrates that the problem of exponential synchronization for time-delayed heterogeneous STD-CNNs can be modeled by designating a time-varying learning parameter in the slave STD-CNNs, which can then be solved by means of calculative linear matrix inequalities(LMIs). To illustrate the feasibility of the current work, a numerical example is presented.
Collapse
Affiliation(s)
- Tianwei Zhang
- School of Mathematics and Statistics, Yunnan University, Yunnan, Kunming 650500, China
| | - Shaobin Rao
- Applied Technology College of Soochow University, Suzhou 215325, China
| | - Jianwen Zhou
- School of Mathematics and Statistics, Yunnan University, Yunnan, Kunming 650500, China.
| |
Collapse
|
2
|
Ping J, Zhu S, Luo W, Zhang Z. Hyper-Exponential Stabilization of Neural Networks by Event-Triggered Impulsive Control With Actuation Delay. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:7778-7781. [PMID: 38843063 DOI: 10.1109/tnnls.2024.3402311] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/27/2024]
Abstract
This brief studies the hyper-exponential stabilization of neural networks (NNs) by event-triggered impulsive control, where the impulse instants are determined by the event-triggered conditions. In the presence of actuation delay, an event-triggered impulsive control scheme is devised. For reducing the sampling task of continuous detection, a periodic-detection scheme is also introduced. Within these frameworks, the occurrence of Zeno behavior is rigorously precluded, and some criteria are formulated to achieve the stabilization of the system with a hyper-exponential convergence rate. Moreover, a numerical simulation is provided to elucidate the validity of the theoretical findings.
Collapse
|
3
|
Yan Z, Sun W, Guo W, Li B, Wen S, Cao J. Complete Stability of Delayed Recurrent Neural Networks With New Wave-Type Activation Functions. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:6584-6596. [PMID: 38709607 DOI: 10.1109/tnnls.2024.3394854] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2024]
Abstract
Activation functions have a significant effect on the dynamics of neural networks (NNs). This study proposes new nonmonotonic wave-type activation functions and examines the complete stability of delayed recurrent NNs (DRNNs) with these activation functions. Using the geometrical properties of the wave-type activation function and subsequent iteration scheme, sufficient conditions are provided to ensure that a DRNN with n neurons has exactly $(2m + 3)^{n}$ equilibria, where $(m + 2)^{n}$ equilibria are locally exponentially stable, the remainder $(2m + 3)^{n} - (m + 2)^{n}$ equilibria are unstable, and a positive integer m is related to wave-type activation functions. Furthermore, the DRNN with the proposed activation function is completely stable. Compared with the previous literature, the total number of equilibria and the stable equilibria significantly increase, thereby enhancing the memory storage capacity of DRNN. Finally, several examples are presented to demonstrate our proposed results.
Collapse
|
4
|
Huo J, Yu J, Wang M, Yi Z, Leng J, Liao Y. Coexistence of Cyclic Sequential Pattern Recognition and Associative Memory in Neural Networks by Attractor Mechanisms. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:4959-4970. [PMID: 38442060 DOI: 10.1109/tnnls.2024.3368092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/07/2024]
Abstract
Neural networks are developed to model the behavior of the brain. One crucial question in this field pertains to when and how a neural network can memorize a given set of patterns. There are two mechanisms to store information: associative memory and sequential pattern recognition. In the case of associative memory, the neural network operates with dynamical attractors that are point attractors, each corresponding to one of the patterns to be stored within the network. In contrast, sequential pattern recognition involves the network memorizing a set of patterns and subsequently retrieving them in a specific order over time. From a dynamical perspective, this corresponds to the presence of a continuous attractor or a cyclic attractor composed of the sequence of patterns stored within the network in a given order. Evidence suggests that the brain is capable of simultaneously performing both associative memory and sequential pattern recognition. Therefore, these types of attractors coexist within the neural network, signifying that some patterns are stored as point attractors, while others are stored as continuous or cyclic attractors. This article investigates the coexistence of cyclic attractors and continuous or point attractors in certain nonlinear neural networks, enabling the simultaneous emergence of various memory mechanisms. By selectively grouping neurons, conditions are established for the existence of cyclic attractors, continuous attractors, and point attractors, respectively. Furthermore, each attractor is explicitly represented, and a competitive dynamic emerges among these coexisting attractors, primarily regulated by adjustments to external inputs.
Collapse
|
5
|
Cao B, Nie X, Zheng WX, Cao J. Multistability of State-Dependent Switched Fractional-Order Hopfield Neural Networks With Mexican-Hat Activation Function and Its Application in Associative Memories. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:1213-1227. [PMID: 38048243 DOI: 10.1109/tnnls.2023.3334871] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/06/2023]
Abstract
The multistability and its application in associative memories are investigated in this article for state-dependent switched fractional-order Hopfield neural networks (FOHNNs) with Mexican-hat activation function (AF). Based on the Brouwer's fixed point theorem, the contraction mapping principle and the theory of fractional-order differential equations, some sufficient conditions are established to ensure the existence, exact existence and local stability of multiple equilibrium points (EPs) in the sense of Filippov, in which the positively invariant sets are also estimated. In particular, the analysis concerning the existence and stability of EPs is quite different from those in the literature because the considered system involves both fractional-order derivative and state-dependent switching. It should be pointed out that, compared with the results in the literature, the total number of EPs and stable EPs increases from and to and , respectively, where with being the system dimension. Besides, a new method is designed to realize associative memories for grayscale and color images by introducing a deviation vector, which, in comparison with the existing works, not only improves the utilization efficiency of EPs, but also reduces the system dimension and computational burden. Finally, the effectiveness of the theoretical results is illustrated by four numerical simulations.
Collapse
|
6
|
Song C, Qin S, Zeng Z. Multiple Mittag-Leffler Stability of Almost Periodic Solutions for Fractional-Order Delayed Neural Networks: Distributed Optimization Approach. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:569-581. [PMID: 37948148 DOI: 10.1109/tnnls.2023.3328307] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/12/2023]
Abstract
This article proposes new theoretical results on the multiple Mittag-Leffler stability of almost periodic solutions (APOs) for fractional-order delayed neural networks (FDNNs) with nonlinear and nonmonotonic activation functions. Profited from the superior geometrical construction of activation function, the considered FDNNs have multiple APOs with local Mittag-Leffler stability under given algebraic inequality conditions. To solve the algebraic inequality conditions, especially in high-dimensional cases, a distributed optimization (DOP) model and a corresponding neurodynamic solving approach are employed. The conclusions in this article generalize the multiple stability of integer- or fractional-order NNs. Besides, the consideration of the DOP approach can ameliorate the excessive consumption of computational resources when utilizing the LMI toolbox to deal with high-dimensional complex NNs. Finally, a simulation example is presented to confirm the accuracy of the theoretical conclusions obtained, and an experimental example of associative memories is shown.
Collapse
|
7
|
Zhu S, Zhang J, Liu X, Shen M, Wen S, Mu C. Multistability and Robustness of Competitive Neural Networks With Time-Varying Delays. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:18746-18757. [PMID: 37819823 DOI: 10.1109/tnnls.2023.3321434] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/13/2023]
Abstract
This article is devoted to analyzing the multistability and robustness of competitive neural networks (NNs) with time-varying delays. Based on the geometrical structure of activation functions, some sufficient conditions are proposed to ascertain the coexistence of equilibrium points, of them are locally exponentially stable, where represents a dimension of system and is the parameter related to activation functions. The derived stability results not only involve exponential stability but also include power stability and logarithmical stability. In addition, the robustness of stable equilibrium points is discussed in the presence of perturbations. Compared with previous papers, the conclusions proposed in this article are easy to verify and enrich the existing stability theories of competitive NNs. Finally, numerical examples are provided to support theoretical results.
Collapse
|
8
|
Zhang F, Huang T, Wu A, Zeng Z. Mittag-Leffler stability and application of delayed fractional-order competitive neural networks. Neural Netw 2024; 179:106501. [PMID: 38986190 DOI: 10.1016/j.neunet.2024.106501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2024] [Revised: 06/04/2024] [Accepted: 06/28/2024] [Indexed: 07/12/2024]
Abstract
In the article, the Mittag-Leffler stability and application of delayed fractional-order competitive neural networks (FOCNNs) are developed. By virtue of the operator pair, the conditions of the coexistence of equilibrium points (EPs) are discussed and analyzed for delayed FOCNNs, in which the derived conditions of coexistence improve the existing results. In particular, these conditions are simplified in FOCNNs with stepped activations. Furthermore, the Mittag-Leffler stability of delayed FOCNNs is established by using the principle of comparison, which enriches the methodologies of fractional-order neural networks. The results on the obtained stability can be used to design the horizontal line detection of images, which improves the practicability of image detection results. Two simulations are displayed to validate the superiority of the obtained results.
Collapse
Affiliation(s)
- Fanghai Zhang
- School of Electrical Engineering and Automation, Hefei University of Technology, Hefei 230009, China.
| | - Tingwen Huang
- Department of Science Program, Texas A&M University at Qatar, Doha, Qatar.
| | - Ailong Wu
- College of Mathematics and Statistics, Hubei Normal University, Huangshi 435002, China.
| | - Zhigang Zeng
- School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China.
| |
Collapse
|
9
|
Zheng C, Hu C, Yu J, Wen S. Saturation function-based continuous control on fixed-time synchronization of competitive neural networks. Neural Netw 2024; 169:32-43. [PMID: 37857171 DOI: 10.1016/j.neunet.2023.10.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Revised: 09/17/2023] [Accepted: 10/06/2023] [Indexed: 10/21/2023]
Abstract
Currently, through proposing discontinuous control strategies with the signum function and discussing separately short-term memory (STM) and long-term memory (LTM) of competitive artificial neural networks (ANNs), the fixed-time (FXT) synchronization of competitive ANNs has been explored. Note that the method of separate analysis usually leads to complicated theoretical derivation and synchronization conditions, and the signum function inevitably causes the chattering to reduce the performance of the control schemes. To try to solve these challenging problems, the FXT synchronization issue is concerned in this paper for competitive ANNs by establishing a theorem of FXT stability with switching type and developing continuous control schemes based on a kind of saturation functions. Firstly, different from the traditional method of studying separately STM and LTM of competitive ANNs, the models of STM and LTM are compressed into a high-dimensional system so as to reduce the complexity of theoretical analysis. Additionally, as an important theoretical preliminary, a FXT stability theorem with switching differential conditions is established and some high-precision estimates for the convergence time are explicitly presented by means of several special functions. To achieve FXT synchronization of the addressed competitive ANNs, a type of continuous pure power-law control scheme is developed via introducing the saturation function instead of the signum function, and some synchronization criteria are further derived by the established FXT stability theorem. These theoretical results are further illustrated lastly via a numerical example and are applied to image encryption.
Collapse
Affiliation(s)
- Caicai Zheng
- College of Mathematics and System Science, Xinjiang University, Urumqi, 830017, China.
| | - Cheng Hu
- College of Mathematics and System Science, Xinjiang University, Urumqi, 830017, China; Xinjiang Key Laboratory of Applied Mathematics, Urumqi, 830017, China.
| | - Juan Yu
- College of Mathematics and System Science, Xinjiang University, Urumqi, 830017, China; Xinjiang Key Laboratory of Applied Mathematics, Urumqi, 830017, China.
| | - Shiping Wen
- Centre for Artificial Intelligence, University of Technology Sydney, Ultimate 2007, Australia.
| |
Collapse
|
10
|
Li R, Cao J, Li N. Stabilization of reaction-diffusion fractional-order memristive neural networks. Neural Netw 2023; 165:290-297. [PMID: 37307670 DOI: 10.1016/j.neunet.2023.05.042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Revised: 04/14/2023] [Accepted: 05/21/2023] [Indexed: 06/14/2023]
Abstract
This paper investigates the stabilization control of fractional-order memristive neural networks with reaction-diffusion terms. With regard to the reaction-diffusion model, a novel processing method based on Hardy-Poincarè inequality is introduced, as a result, the diffusion terms are estimated associated with the information of the reaction-diffusion coefficients and the regional feature, which may be beneficial to obtain conditions with less conservatism. Then, based on Kakutani's fixed point theorem of set-valued maps, new testable algebraic conclusion for ensuring the existence of the system's equilibrium point is obtained. Subsequently, by means of Lyapunov stability theory, it is concluded that the resulting stabilization error system is global asymptotic/Mittag-Leffler stable with a prescribed controller. Finally, an illustrative example about is provided to show the effectiveness of the established results.
Collapse
Affiliation(s)
- Ruoxia Li
- School of Mathematics and Statistics, Shaanxi Normal University, Xi'an, 710062, China.
| | - Jinde Cao
- School of Mathematics, Southeast University, Nanjing 210096, China; Yonsei Frontier Lab, Yonsei University, Seoul 03722, South Korea
| | - Ning Li
- College of Mathematics and Information Science, Henan University of Economics and Law, Zhengzhou, Henan, 450046, China
| |
Collapse
|
11
|
Yang Y, Zhang T. Anti-periodic motion and mean-square exponential convergence of nonlocal discrete-time stochastic competitive lattice neural networks with fuzzy logic. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2023. [DOI: 10.3233/jifs-223495] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/09/2023]
Abstract
This paper firstly establishes the discrete-time lattice networks for nonlocal stochastic competitive neural networks with reaction diffusions and fuzzy logic by employing a mix techniques of finite difference to space variables and Mittag-Leffler time Euler difference to time variable. The proposed networks consider both the effects of spatial diffusion and fuzzy logic, whereas most of the existing literatures focus only on discrete-time networks without spatial diffusion. Firstly, the existence of a unique ω-anti-periodic in distribution to the networks is addressed by employing Banach contractive mapping principle and the theory of stochastic calculus. Secondly, global exponential convergence in mean-square sense to the networks is discussed on the basis of constant variation formulas for sequences. Finally, an illustrative example is used to show the feasible of the works in the current paper with the help of MATLAB Toolbox. The work in this paper is pioneering in this regard and it has created a certain research foundations for future studies in this area.
Collapse
Affiliation(s)
- Yali Yang
- Oxbridge College,Kunming University of Science and Technology, Kunming,China
| | - Tianwei Zhang
- Department of Mathematics,Yunnan University, Kunming,China
| |
Collapse
|
12
|
Local Lagrange Exponential Stability Analysis of Quaternion-Valued Neural Networks with Time Delays. MATHEMATICS 2022. [DOI: 10.3390/math10132157] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
This study on the local stability of quaternion-valued neural networks is of great significance to the application of associative memory and pattern recognition. In the research, we study local Lagrange exponential stability of quaternion-valued neural networks with time delays. By separating the quaternion-valued neural networks into a real part and three imaginary parts, separating the quaternion field into 34n subregions, and using the intermediate value theorem, sufficient conditions are proposed to ensure quaternion-valued neural networks have 34n equilibrium points. According to the Halanay inequality, the conditions for the existence of 24n local Lagrange exponentially stable equilibria of quaternion-valued neural networks are established. The obtained stability results improve and extend the existing ones. Under the same conditions, quaternion-valued neural networks have more stable equilibrium points than complex-valued neural networks and real-valued neural networks. The validity of the theoretical results were verified by an example.
Collapse
|