1
|
Yan Z, Sun W, Guo W, Li B, Wen S, Cao J. Complete Stability of Delayed Recurrent Neural Networks With New Wave-Type Activation Functions. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:6584-6596. [PMID: 38709607 DOI: 10.1109/tnnls.2024.3394854] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2024]
Abstract
Activation functions have a significant effect on the dynamics of neural networks (NNs). This study proposes new nonmonotonic wave-type activation functions and examines the complete stability of delayed recurrent NNs (DRNNs) with these activation functions. Using the geometrical properties of the wave-type activation function and subsequent iteration scheme, sufficient conditions are provided to ensure that a DRNN with n neurons has exactly $(2m + 3)^{n}$ equilibria, where $(m + 2)^{n}$ equilibria are locally exponentially stable, the remainder $(2m + 3)^{n} - (m + 2)^{n}$ equilibria are unstable, and a positive integer m is related to wave-type activation functions. Furthermore, the DRNN with the proposed activation function is completely stable. Compared with the previous literature, the total number of equilibria and the stable equilibria significantly increase, thereby enhancing the memory storage capacity of DRNN. Finally, several examples are presented to demonstrate our proposed results.
Collapse
|
2
|
Wang J, Zhu S, Mu C, Liu X, Wen S. Unified analysis on multistablity of fraction-order multidimensional-valued memristive neural networks. Neural Netw 2024; 179:106498. [PMID: 38986183 DOI: 10.1016/j.neunet.2024.106498] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2024] [Revised: 04/29/2024] [Accepted: 06/26/2024] [Indexed: 07/12/2024]
Abstract
This article provides a unified analysis of the multistability of fraction-order multidimensional-valued memristive neural networks (FOMVMNNs) with unbounded time-varying delays. Firstly, based on the knowledge of fractional differentiation and memristors, a unified model is established. This model is a unified form of real-valued, complex-valued, and quaternion-valued systems. Then, based on a unified method, the number of equilibrium points for FOMVMNNs is discussed. The sufficient conditions for determining the number of equilibrium points have been obtained. By using 1-norm to construct Lyapunov functions, the unified criteria for multistability of FOMVMNNs are obtained, these criteria are less conservative and easier to verify. Moreover, the attraction basins of the stable equilibrium points are estimated. Finally, two numerical simulation examples are provided to verify the correctness of the results.
Collapse
Affiliation(s)
- Jiarui Wang
- School of Mathematics, China University of Mining and Technology, Xuzhou, 221116, China.
| | - Song Zhu
- School of Mathematics, China University of Mining and Technology, Xuzhou, 221116, China.
| | - Chaoxu Mu
- School of Electrical and Automation Engineering, Tianjin University, Tianjin, 300072, China.
| | - Xiaoyang Liu
- School of Computer Science and Technology, Jiangsu Normal University, Xuzhou, 221116, China.
| | - Shiping Wen
- Centre for Artificial Intelligence, University of Technology Sydney, Ultimo, NSW 2007, Australia.
| |
Collapse
|
3
|
Zhang F, Huang T, Wu A, Zeng Z. Mittag-Leffler stability and application of delayed fractional-order competitive neural networks. Neural Netw 2024; 179:106501. [PMID: 38986190 DOI: 10.1016/j.neunet.2024.106501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2024] [Revised: 06/04/2024] [Accepted: 06/28/2024] [Indexed: 07/12/2024]
Abstract
In the article, the Mittag-Leffler stability and application of delayed fractional-order competitive neural networks (FOCNNs) are developed. By virtue of the operator pair, the conditions of the coexistence of equilibrium points (EPs) are discussed and analyzed for delayed FOCNNs, in which the derived conditions of coexistence improve the existing results. In particular, these conditions are simplified in FOCNNs with stepped activations. Furthermore, the Mittag-Leffler stability of delayed FOCNNs is established by using the principle of comparison, which enriches the methodologies of fractional-order neural networks. The results on the obtained stability can be used to design the horizontal line detection of images, which improves the practicability of image detection results. Two simulations are displayed to validate the superiority of the obtained results.
Collapse
Affiliation(s)
- Fanghai Zhang
- School of Electrical Engineering and Automation, Hefei University of Technology, Hefei 230009, China.
| | - Tingwen Huang
- Department of Science Program, Texas A&M University at Qatar, Doha, Qatar.
| | - Ailong Wu
- College of Mathematics and Statistics, Hubei Normal University, Huangshi 435002, China.
| | - Zhigang Zeng
- School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China.
| |
Collapse
|
4
|
Liu P, Wang J, Zeng Z. An Overview of the Stability Analysis of Recurrent Neural Networks With Multiple Equilibria. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:1098-1111. [PMID: 34449396 DOI: 10.1109/tnnls.2021.3105519] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
The stability analysis of recurrent neural networks (RNNs) with multiple equilibria has received extensive interest since it is a prerequisite for successful applications of RNNs. With the increasing theoretical results on this topic, it is desirable to review the results for a systematical understanding of the state of the art. This article provides an overview of the stability results of RNNs with multiple equilibria including complete stability and multistability. First, preliminaries on the complete stability and multistability analysis of RNNs are introduced. Second, the complete stability results of RNNs are summarized. Third, the multistability results of various RNNs are reviewed in detail. Finally, future directions in these interesting topics are suggested.
Collapse
|
5
|
Deng K, Zhu S, Bao G, Fu J, Zeng Z. Multistability of Dynamic Memristor Delayed Cellular Neural Networks With Application to Associative Memories. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:690-702. [PMID: 34347606 DOI: 10.1109/tnnls.2021.3099814] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Recently, dynamic memristor (DM)-cellular neural networks (CNNs) have received widespread attention due to their advantage of low power consumption. The previous works showed that DM-CNNs have at most 318 equilibrium points (EPs) with n=16 cells. Since time delay is unavoidable during the process of information transmission, the goal of this article is to research the multistability of DM-CNNs with time delay, and, meanwhile, to increase the storage capacity of DM-delay (D)CNNs. Depending on the different constitutive relations of memristors, two cases of the multistability for DM-DCNNs are discussed. After determining the constitutive relations, the number of EPs of DM-DCNNs is increased to 3n with n cells by means of the appropriate state-space decomposition and the Brouwer's fixed point theorem. Furthermore, the enlarged attraction domains of EPs can be obtained, and 2n of these EPs are locally exponentially stable in two cases. Compared with standard CNNs, the dynamic behavior of DM-DCNNs shows an outstanding merit. That is, the value of voltage and current approach to zero when the system becomes stable, and the memristor provides a nonvolatile memory to store the computation results. Finally, two numerical simulations are presented to illustrate the effectiveness of the theoretical results, and the applications of associative memories are shown at the end of this article.
Collapse
|
6
|
Multistability of Quaternion-Valued Recurrent Neural Networks with Discontinuous Nonmonotonic Piecewise Nonlinear Activation Functions. Neural Process Lett 2022. [DOI: 10.1007/s11063-022-11116-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
|
7
|
Zhang J, Zhu S, Bao G, Liu X, Wen S. Analysis and Design of Multivalued High-Capacity Associative Memories Based on Delayed Recurrent Neural Networks. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:12989-13000. [PMID: 34347620 DOI: 10.1109/tcyb.2021.3095499] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
This article aims at analyzing and designing the multivalued high-capacity-associative memories based on recurrent neural networks with both asynchronous and distributed delays. In order to increase storage capacities, multivalued activation functions are introduced into associative memories. The stored patterns are retrieved by external input vectors instead of initial conditions, which can guarantee accurate associative memories by avoiding spurious equilibrium points. Some sufficient conditions are proposed to ensure the existence, uniqueness, and global exponential stability of the equilibrium point of neural networks with mixed delays. For neural networks with n neurons, m -dimensional input vectors, and 2k -valued activation functions, the autoassociative memories have (2k)n storage capacities and heteroassociative memories have min {(2k)n,(2k)m} storage capacities. That is, the storage capacities of designed associative memories in this article are obviously higher than the 2n and min {2n,2m} storage capacities of the conventional ones. Three examples are given to support the theoretical results.
Collapse
|
8
|
Wan L, Liu Z. Multiple exponential stability and instability for state-dependent switched neural networks with time-varying delays and piecewise-linear radial basis activation functions. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.12.040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
9
|
Wan L, Liu Z. Multimode function multistability for Cohen-Grossberg neural networks with mixed time delays. ISA TRANSACTIONS 2022; 129:179-192. [PMID: 34991879 DOI: 10.1016/j.isatra.2021.11.046] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/14/2021] [Revised: 11/18/2021] [Accepted: 11/18/2021] [Indexed: 06/14/2023]
Abstract
In this paper, we are concerned with the multimode function multistability for Cohen-Grossberg neural networks (CGNNs) with mixed time delays. It is introduced the multimode function multistability as well as its specific mathematical expression, which is a generalization of multiple exponential stability, multiple polynomial stability, multiple logarithmic stability, and asymptotic stability. Also, according to the neural network (NN) model and the maximum and minimum values of activation functions, n pairs of upper and lower boundary functions are obtained. Via the locations of the zeros of the n pairs of upper and lower boundary functions, the state space is divided into ∏i=1n(2Hi+1) parts correspondingly. By virtue of the reduction to absurdity, continuity of function, Brouwer's fixed point theorem and Lyapunov stability theorem, the criteria for multimode function multistability are acquired. Multiple types of multistability, including multiple exponential stability, multiple polynomial stability, multiple logarithmic stability, and multiple asymptotic stability, can be achieved by selecting different types of function P(t). Two numerical examples are offered to substantiate the generality of the obtained criteria over the existing results.
Collapse
Affiliation(s)
- Liguang Wan
- School of Electrical Engineering and Automation, Hubei Normal University, Huangshi 435002, China; School of information Science and Engineering, Wuhan University of Science and Technology, Wuhan 430081, China.
| | - Zhenxing Liu
- School of information Science and Engineering, Wuhan University of Science and Technology, Wuhan 430081, China.
| |
Collapse
|
10
|
Zhang F, Zeng Z. Multistability and Stabilization of Fractional-Order Competitive Neural Networks With Unbounded Time-Varying Delays. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; 33:4515-4526. [PMID: 33630741 DOI: 10.1109/tnnls.2021.3057861] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
This article investigates the multistability and stabilization of fractional-order competitive neural networks (FOCNNs) with unbounded time-varying delays. By utilizing the monotone operator, several sufficient conditions of the coexistence of equilibrium points (EPs) are obtained for FOCNNs with concave-convex activation functions. And then, the multiple μ -stability of delayed FOCNNs is derived by the analytical method. Meanwhile, several comparisons with existing work are shown, which implies that the derived results cover the inverse-power stability and Mittag-Leffler stability as special cases. Moreover, the criteria on the stabilization of FOCNNs with uncertainty are established by designing a controller. Compared with the results of fractional-order neural networks, the obtained results in this article enrich and improve the previous results. Finally, three numerical examples are provided to show the effectiveness of the presented results.
Collapse
|
11
|
Solís-Pérez J, Hernández J, Parrales A, Gómez-Aguilar J, Huicochea A. Artificial neural networks with conformable transfer function for improving the performance in thermal and environmental processes. Neural Netw 2022; 152:44-56. [DOI: 10.1016/j.neunet.2022.04.016] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Revised: 03/19/2022] [Accepted: 04/14/2022] [Indexed: 10/18/2022]
|
12
|
Zhang F, Zeng Z. Multiple Mittag-Leffler Stability of Delayed Fractional-Order Cohen-Grossberg Neural Networks via Mixed Monotone Operator Pair. IEEE TRANSACTIONS ON CYBERNETICS 2021; 51:6333-6344. [PMID: 31995512 DOI: 10.1109/tcyb.2019.2963034] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
This article mainly investigates the multiple Mittag-Leffler stability of delayed fractional-order Cohen-Grossberg neural networks with time-varying delays. By using mixed monotone operator pair, the conditions of the coexistence of multiple equilibrium points are obtained for fractional-order Cohen-Grossberg neural networks, and these conditions are eventually transformed into algebraic inequalities based on the vertex of the divided region. In particular, when the symbols of these inequalities are determined by the dominant term, several verifiable corollaries are given. And then, the sufficient conditions of the Mittag-Leffler stability are derived for fractional-order Cohen-Grossberg neural networks with time-varying delays. In addition, two numerical examples are provided to illustrate the effectiveness of the theoretical results.
Collapse
|
13
|
Wang S, Jin L, Du X, Stanimirovi PS. Accelerated convergent zeroing neurodynamics models for solving multi-linear systems with M-tensors. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2021.06.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
14
|
Multistability of Hopfield neural networks with a designed discontinuous sawtooth-type activation function. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2021.05.045] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
15
|
Zhang F, Huang T, Feng D, Zeng Z. Multistability and robustness of complex-valued neural networks with delays and input perturbation. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2021.03.045] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
16
|
Zhang F, Zeng Z. Robust Stability of Recurrent Neural Networks With Time-Varying Delays and Input Perturbation. IEEE TRANSACTIONS ON CYBERNETICS 2021; 51:3027-3038. [PMID: 31329152 DOI: 10.1109/tcyb.2019.2926537] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
This paper addresses the robust stability of recurrent neural networks (RNNs) with time-varying delays and input perturbation, where the time-varying delays include discrete and distributed delays. By employing the new ψ -type integral inequality, several sufficient conditions are derived for the robust stability of RNNs with discrete and distributed delays. Meanwhile, the robust boundedness of neural networks is explored by the bounded input perturbation and L1 -norm constraint. Moreover, RNNs have a strong anti-jamming ability to input perturbation, and the robustness of RNNs is suitable for associative memory. Specifically, when input perturbation belongs to the specified and well-characterized space, the results cover both monostability and multistability as special cases. It is revealed that there is a relationship between the stability of neural networks and input perturbation. Compared with the existing results, these conditions proposed in this paper improve and extend the existing stability in some literature. Finally, the numerical examples are given to substantiate the effectiveness of the theoretical results.
Collapse
|
17
|
Zhang J, Zhu S, Lu N, Wen S. Multistability of state-dependent switching neural networks with discontinuous nonmonotonic piecewise linear activation functions. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2021.01.046] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
18
|
Zhang F, Huang T, Wu Q, Zeng Z. Multistability of delayed fractional-order competitive neural networks. Neural Netw 2021; 140:325-335. [PMID: 33895556 DOI: 10.1016/j.neunet.2021.03.036] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2020] [Revised: 02/27/2021] [Accepted: 03/24/2021] [Indexed: 10/21/2022]
Abstract
This paper is concerned with the multistability of fractional-order competitive neural networks (FCNNs) with time-varying delays. Based on the division of state space, the equilibrium points (EPs) of FCNNs are given. Several sufficient conditions and criteria are proposed to ascertain the multiple O(t-α)-stability of delayed FCNNs. The O(t-α)-stability is the extension of Mittag-Leffler stability of fractional-order neural networks, which contains monostability and multistability. Moreover, the attraction basins of the stable EPs of FCNNs are estimated, which shows the attraction basins of the stable EPs can be larger than the divided subsets. These conditions and criteria supplement and improve the previous results. Finally, the results are illustrated by the simulation examples.
Collapse
Affiliation(s)
- Fanghai Zhang
- School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, China; Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China, Wuhan, China.
| | - Tingwen Huang
- Science Program, Texas A&M University at Qatar, Doha, Qatar.
| | - Qiujie Wu
- School of Internet, Anhui University, Hefei, China.
| | - Zhigang Zeng
- School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, China; Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China, Wuhan, China.
| |
Collapse
|
19
|
Multi-periodicity of switched neural networks with time delays and periodic external inputs under stochastic disturbances. Neural Netw 2021; 141:107-119. [PMID: 33887601 DOI: 10.1016/j.neunet.2021.03.039] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2020] [Revised: 03/11/2021] [Accepted: 03/29/2021] [Indexed: 11/21/2022]
Abstract
This paper presents new theoretical results on the multi-periodicity of recurrent neural networks with time delays evoked by periodic inputs under stochastic disturbances and state-dependent switching. Based on the geometric properties of activation function and switching threshold, the neuronal state space is partitioned into 5n regions in which 3n ones are shown to be positively invariant with probability one. Furthermore, by using Itô's formula, Lyapunov functional method, and the contraction mapping theorem, two criteria are proposed to ascertain the existence and mean-square exponential stability of a periodic orbit in every positive invariant set. As a result, the number of mean-square exponentially stable periodic orbits increases to 3n from 2n in a neural network without switching. Two illustrative examples are elaborated to substantiate the efficacy and characteristics of the theoretical results.
Collapse
|
20
|
Liu P, Wang J, Guo Z. Multiple and Complete Stability of Recurrent Neural Networks With Sinusoidal Activation Function. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2021; 32:229-240. [PMID: 32203032 DOI: 10.1109/tnnls.2020.2978267] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
This article presents new theoretical results on multistability and complete stability of recurrent neural networks with a sinusoidal activation function. Sufficient criteria are provided for ascertaining the stability of recurrent neural networks with various numbers of equilibria, such as a unique equilibrium, finite, and countably infinite numbers of equilibria. Multiple exponential stability criteria of equilibria are derived, and the attraction basins of equilibria are estimated. Furthermore, criteria for complete stability and instability of equilibria are derived for recurrent neural networks without time delay. In contrast to the existing stability results with a finite number of equilibria, the new criteria, herein, are applicable for both finite and countably infinite numbers of equilibria. Two illustrative examples with finite and countably infinite numbers of equilibria are elaborated to substantiate the results.
Collapse
|
21
|
Shen Y, Zhu S. Multistability of delayed neural networks with monotonically nondecreasing linear activation function. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2020.10.011] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
22
|
Wan P, Sun D, Zhao M, Zhao H. Monostability and Multistability for Almost-Periodic Solutions of Fractional-Order Neural Networks With Unsaturating Piecewise Linear Activation Functions. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2020; 31:5138-5152. [PMID: 32092015 DOI: 10.1109/tnnls.2020.2964030] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Since the unsaturating activation function is unbounded, more complex dynamics may exist in neural networks with this kind of activation function. In this article, monostability and multistability results of almost-periodic solutions are developed for fractional-order neural networks with unsaturating piecewise linear activation functions. Some globally Mittag-Leffler attractive sets are given, and the existence of globally Mittag-Leffler stable almost-periodic solution is demonstrated by using Ascoli-Arzela theorem. In particular, some sufficient conditions are provided to ascertain the multistability of almost-periodic solutions based on locally positively invariant set. It shows that there exists an almost-periodic solution in each positively invariant set, and all trajectories converge to this periodic trajectory in that rectangular area. Two illustrative examples are provided to demonstrate the effectiveness of the proposed sufficient criteria.
Collapse
|
23
|
Liu P, Zheng WX, Zeng Z. On Complete Stability of Recurrent Neural Networks With Time-Varying Delays and General Piecewise Linear Activation Functions. IEEE TRANSACTIONS ON CYBERNETICS 2020; 50:2249-2263. [PMID: 30575557 DOI: 10.1109/tcyb.2018.2884836] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
This paper addresses the problem of complete stability of delayed recurrent neural networks with a general class of piecewise linear activation functions. By applying an appropriate partition of the state space and iterating the defined bounding functions, some sufficient conditions are obtained to ensure that an n -neuron neural network is completely stable with exactly ∏i=1n(2Ki-1) equilibrium points, among which ∏i=1nKi equilibrium points are locally exponentially stable and the others are unstable, where Ki (i=1,…,n) are non-negative integers which depend jointly on activation functions and parameters of neural networks. The results of this paper include the existing works on the stability analysis of recurrent neural networks with piecewise linear functions as special cases and hence can be considered as the improvement and extension of the existing stability results in the literature. A numerical example is provided to illustrate the derived theoretical results.
Collapse
|
24
|
Chen C, Zhu S, Wei Y, Chen C. Finite-Time Stability of Delayed Memristor-Based Fractional-Order Neural Networks. IEEE TRANSACTIONS ON CYBERNETICS 2020; 50:1607-1616. [PMID: 30418930 DOI: 10.1109/tcyb.2018.2876901] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
This paper studies one type of delayed memristor-based fractional-order neural networks (MFNNs) on the finite-time stability problem. By using the method of iteration, contracting mapping principle, the theory of differential inclusion, and set-valued mapping, a new criterion for the existence and uniqueness of the equilibrium point which is stable in finite time of considered MFNNs is established when the order α satisfies . Then, when , on the basis of generalized Gronwall inequality and Laplace transform, a sufficient condition ensuring the considered MFNNs stable in finite time is given. Ultimately, simulation examples are proposed to demonstrate the validity of the results.
Collapse
|
25
|
Shen W, Zhang X, Wang Y. Stability analysis of high order neural networks with proportional delays. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2019.09.019] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
26
|
Wan P, Sun D, Zhao M, Wan L, Jin S. Multistability and attraction basins of discrete-time neural networks with nonmonotonic piecewise linear activation functions. Neural Netw 2019; 122:231-238. [PMID: 31698201 DOI: 10.1016/j.neunet.2019.10.005] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2019] [Revised: 08/20/2019] [Accepted: 10/08/2019] [Indexed: 11/26/2022]
Abstract
This paper is concerned with multistability and attraction basins of discrete-time neural networks with nonmonotonic piecewise linear activation functions. Under some reasonable conditions, the addressed networks have (2m+1)n equilibrium points. (m+1)n of which are locally asymptotically stable, and the others are unstable. The attraction basins of the locally asymptotically stable equilibrium points are given in the form of hyperspherical regions. These results here, which include existence, uniqueness, locally asymptotical stability, instability and attraction basins of the multiple equilibrium points, generalize and improve the earlier publications. Finally, an illustrative example with numerical simulation is given to show the feasibility and the effectiveness of the theoretical results. The theoretical results and illustrative example indicate that the activation functions improve the storage capacity of neural networks significantly.
Collapse
Affiliation(s)
- Peng Wan
- Key Laboratory of Dependable Service Computing in Cyber Physical Society of Ministry of Education, Chongqing University, Chongqing 400044, China; School of Automation, Chongqing University, Chongqing 400044, China
| | - Dihua Sun
- Key Laboratory of Dependable Service Computing in Cyber Physical Society of Ministry of Education, Chongqing University, Chongqing 400044, China; School of Automation, Chongqing University, Chongqing 400044, China.
| | - Min Zhao
- Key Laboratory of Dependable Service Computing in Cyber Physical Society of Ministry of Education, Chongqing University, Chongqing 400044, China; School of Automation, Chongqing University, Chongqing 400044, China
| | - Li Wan
- School of Software Engineering, Southeast University, Nanjing, 211189, China
| | - Shuang Jin
- Key Laboratory of Dependable Service Computing in Cyber Physical Society of Ministry of Education, Chongqing University, Chongqing 400044, China; School of Automation, Chongqing University, Chongqing 400044, China
| |
Collapse
|
27
|
Liu D, Zhu S, Sun K. Global Anti-Synchronization of Complex-Valued Memristive Neural Networks With Time Delays. IEEE TRANSACTIONS ON CYBERNETICS 2019; 49:1735-1747. [PMID: 29993825 DOI: 10.1109/tcyb.2018.2812708] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
This paper formulates a class of complex-valued memristive neural networks as well as investigates the problem of anti-synchronization for complex-valued memristive neural networks. Under the concept of drive-response, several sufficient conditions for guaranteeing the anti-synchronization are given by employing suitable Lyapunov functional and some inequality techniques. The proposed results of this paper are less conservative than existing literatures due to the characteristics of memristive complex-valued neural networks. Moreover, the proposed results are easy to be validated with the parameters of system itself. Finally, two examples with numerical simulations are showed to demonstrate the efficiency of our theoretical results.
Collapse
|
28
|
Zhang F, Zeng Z. Multiple ψ -Type Stability and Its Robustness for Recurrent Neural Networks With Time-Varying Delays. IEEE TRANSACTIONS ON CYBERNETICS 2019; 49:1803-1815. [PMID: 29993797 DOI: 10.1109/tcyb.2018.2813979] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
In this paper, the ψ -type stability and robustness of recurrent neural networks are investigated by using the differential inequality. By utilizing ψ -type functions combined with the inequality techniques, some sufficient conditions ensuring ψ -type stability and robustness are derived for linear neural networks with time-varying delays. Then, by choosing appropriate Lipschitz coefficient in subregion, some algebraic criteria of the multiple ψ -type stability and robust boundedness are established for the delayed neural networks with time-varying delays. For special cases, several criteria are also presented by selecting parameters with easy implementation. The derived results cover both ψ -type mono-stability and multiple ψ -type stability. In addition, these theoretical results contain exponential stability, polynomial stability, and μ -stability, and they also complement and extend some previous results. Finally, two numerical examples are provided to illustrate the effectiveness of the proposed criteria.
Collapse
|
29
|
Abstract
In this paper, an eco-economic model with harvesting on biological population is established, which takes the form of a differential-algebra system. The impact of the economic profit from harvesting upon the dynamics of the model is studied. By using a suitable parameterization for the differential-algebra system, we derive an equivalent parameterized system which gives the stability results for the positive equilibrium point of our model. Moreover, based on the parameterized system as well as the approaches of normal form and formal series, the conditions on the Hopf bifurcation and the stability of center are obtained. Several numerical simulations for demonstrating the theoretical results are also presented. Lastly, according to the dynamical analysis, we provide a threshold value for the economic profit, which can maintain the sustainable development of our eco-economic system.
Collapse
Affiliation(s)
- Wei Liu
- School of Mathematics and Statistics, Xi’an Jiaotong University, Xi’an 710049, P. R. China
- School of Mathematics and Computer Science, Xinyu University, Xinyu 338004, P. R. China
| | - Yaolin Jiang
- School of Mathematics and Statistics, Xi’an Jiaotong University, Xi’an 710049, P. R. China
| |
Collapse
|
30
|
Zhang F, Zeng Z. Multiple ψ -Type Stability of Cohen-Grossberg Neural Networks With Both Time-Varying Discrete Delays and Distributed Delays. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2019; 30:566-579. [PMID: 29994620 DOI: 10.1109/tnnls.2018.2846249] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
In this paper, multiple ψ -type stability of Cohen-Grossberg neural networks (CGNNs) with both time-varying discrete delays and distributed delays is investigated. By utilizing ψ -type functions combined with a new ψ -type integral inequality for treating distributed delay terms, some sufficient conditions are obtained to ensure that multiple equilibrium points are ψ -type stable for CGNNs with discrete and distributed delays, where the distributed delays include bounded and unbounded delays. These conditions of CGNNs with different output functions are less restrictive. More specifically, the algebraic criteria of the generalized model are applicable to several well-known neural network models by taking special parameters, and multiple different output functions are introduced to replace some of the same output functions, which improves the diversity of output results for the design of neural networks. In addition, the estimation of relative convergence rate of ψ -type stability is determined by the parameters of CGNNs and the selection of ψ -type functions. As a result, the existing results on multistability and monostability can be improved and extended. Finally, some numerical simulations are presented to illustrate the effectiveness of the obtained results.
Collapse
|
31
|
Song Q, Chen X. Multistability Analysis of Quaternion-Valued Neural Networks With Time Delays. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2018; 29:5430-5440. [PMID: 29994739 DOI: 10.1109/tnnls.2018.2801297] [Citation(s) in RCA: 69] [Impact Index Per Article: 9.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
This paper addresses the multistability issue for quaternion-valued neural networks (QVNNs) with time delays. By using the inequality technique, sufficient conditions are proposed for the boundedness and the global attractivity of delayed QVNNs. Based on the geometrical properties of the activation functions, several criteria are obtained to ensure the existence of equilibrium points, of which are locally stable. Two numerical examples are provided to illustrate the effectiveness of the obtained results.
Collapse
|
32
|
Wang L, Zeng Z, Ge MF, Hu J. Global stabilization analysis of inertial memristive recurrent neural networks with discrete and distributed delays. Neural Netw 2018; 105:65-74. [DOI: 10.1016/j.neunet.2018.04.014] [Citation(s) in RCA: 59] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2018] [Revised: 04/08/2018] [Accepted: 04/20/2018] [Indexed: 12/01/2022]
|
33
|
Liu L, Cao J, Qian C. th Moment Exponential Input-to-State Stability of Delayed Recurrent Neural Networks With Markovian Switching via Vector Lyapunov Function. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2018; 29:3152-3163. [PMID: 28692993 DOI: 10.1109/tnnls.2017.2713824] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
In this paper, the th moment input-to-state exponential stability for delayed recurrent neural networks (DRNNs) with Markovian switching is studied. By using stochastic analysis techniques and classical Razumikhin techniques, a generalized vector -operator differential inequality including cross item is obtained. Without additional restrictive conditions on the time-varying delay, the sufficient criteria on the th moment input-to-state exponential stability for DRNNs with Markovian switching are derived by means of the vector -operator differential inequality. When the input is zero, an improved criterion on exponential stability is obtained. Two numerical examples are provided to examine the correctness of the derived results.
Collapse
|
34
|
Song Q, Yu Q, Zhao Z, Liu Y, Alsaadi FE. Boundedness and global robust stability analysis of delayed complex-valued neural networks with interval parameter uncertainties. Neural Netw 2018; 103:55-62. [DOI: 10.1016/j.neunet.2018.03.008] [Citation(s) in RCA: 73] [Impact Index Per Article: 10.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2017] [Revised: 01/26/2018] [Accepted: 03/14/2018] [Indexed: 10/17/2022]
|
35
|
Liu P, Zeng Z, Wang J. Multistability of Recurrent Neural Networks With Nonmonotonic Activation Functions and Unbounded Time-Varying Delays. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2018; 29:3000-3010. [PMID: 28678718 DOI: 10.1109/tnnls.2017.2710299] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
This paper is concerned with the coexistence of multiple equilibrium points and dynamical behaviors of recurrent neural networks with nonmonotonic activation functions and unbounded time-varying delays. Based on a state space partition by using the geometrical properties of the activation functions, it is revealed that an -neuron neural network can exhibit equilibrium points with . In particular, several sufficient criteria are proposed to ascertain the asymptotical stability of equilibrium points for recurrent neural networks. These theoretical results cover both monostability and multistability. Furthermore, the attraction basins of asymptotically stable equilibrium points are estimated. It is shown that the attraction basins of the stable equilibrium points can be larger than their originally partitioned subsets. Finally, the results are illustrated by using the simulation results of four examples.
Collapse
|
36
|
Sheng Y, Zeng Z. Impulsive synchronization of stochastic reaction–diffusion neural networks with mixed time delays. Neural Netw 2018; 103:83-93. [DOI: 10.1016/j.neunet.2018.03.010] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2017] [Revised: 01/16/2018] [Accepted: 03/14/2018] [Indexed: 11/12/2022]
|
37
|
Marco MD, Forti M, Grazzini M, Pancioni L. Multistability of delayed neural networks with hard-limiter saturation nonlinearities. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2018.03.006] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
38
|
Di Marco M, Forti M, Pancioni L. New Conditions for Global Asymptotic Stability of Memristor Neural Networks. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2018; 29:1822-1834. [PMID: 28422696 DOI: 10.1109/tnnls.2017.2688404] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Recent papers in the literature introduced a class of neural networks (NNs) with memristors, named dynamic-memristor (DM) NNs, such that the analog processing takes place in the charge-flux domain, instead of the typical current-voltage domain as it happens for Hopfield NNs and standard cellular NNs. One key advantage is that, when a steady state is reached, all currents, voltages, and power of a DM-NN drop off, whereas the memristors act as nonvolatile memories that store the processing result. Previous work in the literature addressed multistability of DM-NNs, i.e., convergence of solutions in the presence of multiple asymptotically stable equilibrium points (EPs). The goal of this paper is to study a basically different dynamical property of DM-NNs, namely, to thoroughly investigate the fundamental issue of global asymptotic stability (GAS) of the unique EP of a DM-NN in the general case of nonsymmetric neuron interconnections. A basic result on GAS of DM-NNs is established using Lyapunov method and the concept of Lyapunov diagonally stable matrices. On this basis, some relevant classes of nonsymmetric DM-NNs enjoying the property of GAS are highlighted.
Collapse
|
39
|
Wan L, Wu A. Multistability in Mittag-Leffler sense of fractional-order neural networks with piecewise constant arguments. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2018.01.049] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|
40
|
Jin L, Li S, Wang H, Zhang Z. Nonconvex projection activated zeroing neurodynamic models for time-varying matrix pseudoinversion with accelerated finite-time convergence. Appl Soft Comput 2018. [DOI: 10.1016/j.asoc.2017.09.016] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
41
|
Sheng Y, Shen Y, Zhu M. Delay-Dependent Global Exponential Stability for Delayed Recurrent Neural Networks. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2017; 28:2974-2984. [PMID: 27705864 DOI: 10.1109/tnnls.2016.2608879] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
This paper deals with the global exponential stability for delayed recurrent neural networks (DRNNs). By constructing an augmented Lyapunov-Krasovskii functional and adopting the reciprocally convex combination approach and Wirtinger-based integral inequality, delay-dependent global exponential stability criteria are derived in terms of linear matrix inequalities. Meanwhile, a general and effective method on global exponential stability analysis for DRNNs is given through a lemma, where the exponential convergence rate can be estimated. With this lemma, some global asymptotic stability criteria of DRNNs acquired in previous studies can be generalized to global exponential stability ones. Finally, a frequently utilized numerical example is carried out to illustrate the effectiveness and merits of the proposed theoretical results.
Collapse
|
42
|
Zhang F, Zeng Z. Multistability and instability analysis of recurrent neural networks with time-varying delays. Neural Netw 2017; 97:116-126. [PMID: 29096200 DOI: 10.1016/j.neunet.2017.09.013] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2017] [Revised: 08/07/2017] [Accepted: 09/26/2017] [Indexed: 11/25/2022]
Abstract
This paper provides new theoretical results on the multistability and instability analysis of recurrent neural networks with time-varying delays. It is shown that such n-neuronal recurrent neural networks have exactly [Formula: see text] equilibria, [Formula: see text] of which are locally exponentially stable and the others are unstable, where k0 is a nonnegative integer such that k0≤n. By using the combination method of two different divisions, recurrent neural networks can possess more dynamic properties. This method improves and extends the existing results in the literature. Finally, one numerical example is provided to show the superiority and effectiveness of the presented results.
Collapse
Affiliation(s)
- Fanghai Zhang
- School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China; Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China, Wuhan 430074, China.
| | - Zhigang Zeng
- School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China; Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China, Wuhan 430074, China.
| |
Collapse
|
43
|
Wang L, Shen Y, Zhang G. Finite-Time Stabilization and Adaptive Control of Memristor-Based Delayed Neural Networks. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2017; 28:2648-2659. [PMID: 28113640 DOI: 10.1109/tnnls.2016.2598598] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Finite-time stability problem has been a hot topic in control and system engineering. This paper deals with the finite-time stabilization issue of memristor-based delayed neural networks (MDNNs) via two control approaches. First, in order to realize the stabilization of MDNNs in finite time, a delayed state feedback controller is proposed. Then, a novel adaptive strategy is applied to the delayed controller, and finite-time stabilization of MDNNs can also be achieved by using the adaptive control law. Some easily verified algebraic criteria are derived to ensure the stabilization of MDNNs in finite time, and the estimation of the settling time functional is given. Moreover, several finite-time stability results as our special cases for both memristor-based neural networks (MNNs) without delays and neural networks are given. Finally, three examples are provided for the illustration of the theoretical results.Finite-time stability problem has been a hot topic in control and system engineering. This paper deals with the finite-time stabilization issue of memristor-based delayed neural networks (MDNNs) via two control approaches. First, in order to realize the stabilization of MDNNs in finite time, a delayed state feedback controller is proposed. Then, a novel adaptive strategy is applied to the delayed controller, and finite-time stabilization of MDNNs can also be achieved by using the adaptive control law. Some easily verified algebraic criteria are derived to ensure the stabilization of MDNNs in finite time, and the estimation of the settling time functional is given. Moreover, several finite-time stability results as our special cases for both memristor-based neural networks (MNNs) without delays and neural networks are given. Finally, three examples are provided for the illustration of the theoretical results.
Collapse
Affiliation(s)
- Leimin Wang
- School of Automation, China University of Geosciences, Wuhan, China
| | - Yi Shen
- School of Automation, Huazhong University of Science and Technology, Wuhan, China
| | - Guodong Zhang
- College of Mathematics and Statistics, South-Central University for Nationalities, Wuhan, China
| |
Collapse
|
44
|
Sheng Y, Zhang H, Zeng Z. Synchronization of Reaction-Diffusion Neural Networks With Dirichlet Boundary Conditions and Infinite Delays. IEEE TRANSACTIONS ON CYBERNETICS 2017; 47:3005-3017. [PMID: 28436913 DOI: 10.1109/tcyb.2017.2691733] [Citation(s) in RCA: 52] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
This paper is concerned with synchronization for a class of reaction-diffusion neural networks with Dirichlet boundary conditions and infinite discrete time-varying delays. By utilizing theories of partial differential equations, Green's formula, inequality techniques, and the concept of comparison, algebraic criteria are presented to guarantee master-slave synchronization of the underlying reaction-diffusion neural networks via a designed controller. Additionally, sufficient conditions on exponential synchronization of reaction-diffusion neural networks with finite time-varying delays are established. The proposed criteria herein enhance and generalize some published ones. Three numerical examples are presented to substantiate the validity and merits of the obtained theoretical results.
Collapse
|
45
|
Shi P, Li F, Wu L, Lim CC. Neural Network-Based Passive Filtering for Delayed Neutral-Type Semi-Markovian Jump Systems. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2017; 28:2101-2114. [PMID: 27323377 DOI: 10.1109/tnnls.2016.2573853] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
This paper investigates the problem of exponential passive filtering for a class of stochastic neutral-type neural networks with both semi-Markovian jump parameters and mixed time delays. Our aim is to estimate the states by designing a Luenberger-type observer, such that the filter error dynamics are mean-square exponentially stable with an expected decay rate and an attenuation level. Sufficient conditions for the existence of passive filters are obtained, and a convex optimization algorithm for the filter design is given. In addition, a cone complementarity linearization procedure is employed to cast the nonconvex feasibility problem into a sequential minimization problem, which can be readily solved by the existing optimization techniques. Numerical examples are given to demonstrate the effectiveness of the proposed techniques.
Collapse
|
46
|
Bao G, Zeng Z. Region stability analysis for switched discrete-time recurrent neural network with multiple equilibria. Neurocomputing 2017. [DOI: 10.1016/j.neucom.2017.03.065] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
47
|
Wang YW, Yang W, Xiao JW, Zeng ZG. Impulsive Multisynchronization of Coupled Multistable Neural Networks With Time-Varying Delay. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2017; 28:1560-1571. [PMID: 27071198 DOI: 10.1109/tnnls.2016.2544788] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
This paper studies the synchronization problem of coupled delayed multistable neural networks (NNs) with directed topology. To begin with, several sufficient conditions are developed in terms of algebraic inequalities such that every subnetwork has multiple locally exponentially stable periodic orbits or equilibrium points. Then two new concepts named dynamical multisynchronization (DMS) and static multisynchronization (SMS) are introduced to describe the two novel kinds of synchronization manifolds. Using the impulsive control strategy and the Razumikhin-type technique, some sufficient conditions for both the DMS and the SMS of the controlled coupled delayed multistable NNs with fixed and switching topologies are derived, respectively. Simulation examples are presented to illustrate the effectiveness of the proposed results.
Collapse
|
48
|
Liu P, Zeng Z, Wang J. Multistability of Delayed Recurrent Neural Networks with Mexican Hat Activation Functions. Neural Comput 2017; 29:423-457. [DOI: 10.1162/neco_a_00922] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
This letter studies the multistability analysis of delayed recurrent neural networks with Mexican hat activation function. Some sufficient conditions are obtained to ensure that an [Formula: see text]-dimensional recurrent neural network can have [Formula: see text] equilibrium points with [Formula: see text], and [Formula: see text] of them are locally exponentially stable. Furthermore, the attraction basins of these stable equilibrium points are estimated. We show that the attraction basins of these stable equilibrium points can be larger than their originally partitioned subsets. The results of this letter improve and extend the existing stability results in the literature. Finally, a numerical example containing different cases is given to illustrate the theoretical results.
Collapse
Affiliation(s)
- Peng Liu
- School of Automation, Huazhong University of Science and Technology, China, and the Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China, Wuhan 430074, P.R.C
| | - Zhigang Zeng
- School of Automation, Huazhong University of Science and Technology, China, and the Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China, Wuhan 430074, P.R.C
| | - Jun Wang
- Department of Computer Science, City University of Hong Kong, Kowloon, Hong Kong
| |
Collapse
|
49
|
Zhang F, Zeng Z. Multistability of recurrent neural networks with time-varying delays and nonincreasing activation function. Neurocomputing 2016. [DOI: 10.1016/j.neucom.2016.07.032] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
50
|
Liu P, Zeng Z, Wang J. Complete stability of delayed recurrent neural networks with Gaussian activation functions. Neural Netw 2016; 85:21-32. [PMID: 27814464 DOI: 10.1016/j.neunet.2016.09.006] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2016] [Revised: 08/13/2016] [Accepted: 09/20/2016] [Indexed: 11/25/2022]
Abstract
This paper addresses the complete stability of delayed recurrent neural networks with Gaussian activation functions. By means of the geometrical properties of Gaussian function and algebraic properties of nonsingular M-matrix, some sufficient conditions are obtained to ensure that for an n-neuron neural network, there are exactly 3k equilibrium points with 0≤k≤n, among which 2k and 3k-2k equilibrium points are locally exponentially stable and unstable, respectively. Moreover, it concludes that all the states converge to one of the equilibrium points; i.e., the neural networks are completely stable. The derived conditions herein can be easily tested. Finally, a numerical example is given to illustrate the theoretical results.
Collapse
Affiliation(s)
- Peng Liu
- School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China; Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China, Wuhan 430074, China.
| | - Zhigang Zeng
- School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China; Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China, Wuhan 430074, China.
| | - Jun Wang
- Department of Computer Science, City University of Hong Kong, Kowloon Tong, Hong Kong.
| |
Collapse
|