An Overview of the Stability Analysis of Recurrent Neural Networks With Multiple Equilibria

The stability analysis of recurrent neural networks (RNNs) with multiple equilibria has received extensive interest since it is a prerequisite for successful applications of RNNs. With the increasing theoretical results on this topic, it is desirable to review the results for a systematical understanding of the state of the art. This article provides an overview of the stability results of RNNs with multiple equilibria including complete stability and multistability. First, preliminaries on the complete stability and multistability analysis of RNNs are introduced. Second, the complete stability results of RNNs are summarized. Third, the multistability results of various RNNs are reviewed in detail. Finally, future directions in these interesting topics are suggested.

Existence and global asymptotic stability criteria for nonlinear neutral-type neural networks involving multiple time delays using a quadratic-integral Lyapunov functional

In this paper we consider a standard class of the neural networks and propose an investigation of the global asymptotic stability of these neural systems. The main aim of this investigation is to define a novel Lyapunov functional having quadratic-integral form and use it to reach a stability criterion for the under study neural networks. Since some fundamental characteristics, such as nonlinearity, including time-delays and neutrality, help us design a more realistic and applicable model of neural systems, we will use all of these factors in our neural dynamical systems. At the end, some numerical simulations are presented to illustrate the obtained stability criterion and show the essential role of the time-delays in appearance of the oscillations and stability in the neural networks.

th Moment Exponential Input-to-State Stability of Delayed Recurrent Neural Networks With Markovian Switching via Vector Lyapunov Function

In this paper, the th moment input-to-state exponential stability for delayed recurrent neural networks (DRNNs) with Markovian switching is studied. By using stochastic analysis techniques and classical Razumikhin techniques, a generalized vector -operator differential inequality including cross item is obtained. Without additional restrictive conditions on the time-varying delay, the sufficient criteria on the th moment input-to-state exponential stability for DRNNs with Markovian switching are derived by means of the vector -operator differential inequality. When the input is zero, an improved criterion on exponential stability is obtained. Two numerical examples are provided to examine the correctness of the derived results.

Existence and stability of periodic solution of impulsive neural systems with complex deviating arguments

This paper discusses a class of impulsive neural networks with the variable delay and complex deviating arguments. By using Mawhin's continuation theorem of coincidence degree and the Halanay-type inequalities, several sufficient conditions for impulsive neural networks are established for the existence and globally exponential stability of periodic solutions, respectively. Furthermore, the obtained results are applied to some typical impulsive neural network systems as special cases, with a real-life example to show feasibility of our results.

Impulsive control for existence, uniqueness, and global stability of periodic solutions of recurrent neural networks with discrete and continuously distributed delays

In this paper, a class of recurrent neural networks with discrete and continuously distributed delays is considered. Sufficient conditions for the existence, uniqueness, and global exponential stability of a periodic solution are obtained by using contraction mapping theorem and stability theory on impulsive functional differential equations. The proposed method, which differs from the existing results in the literature, shows that network models may admit a periodic solution which is globally exponentially stable via proper impulsive control strategies even if it is originally unstable or divergent. Two numerical examples and their computer simulations are offered to show the effectiveness of our new results.

PERIODICITY AND STABILITY IN RECURRENT CELLULAR NEURAL NETWORKS WITH IMPULSIVE EFFECTS

In this paper, the exponential stability analysis problem is considered for a class of impulsive recurrent cellular neural networks (IRCNNs) with time-varying delays. Without assuming the boundedness on the activation functions, some sufficient conditions are derived for checking the existence and exponential stability of periodic solution for this system by using Mawhin's continuation theorem of coincidence degree theory and constructing suitable Lyapunov functional. It is believed that these results are significant and useful for the design and applications of IRCNNs. Finally, an example with numerical simulation is given to show the effectiveness of the proposed method and results.

EXISTENCE AND GLOBAL EXPONENTIAL STABILITY OF PERIODIC SOLUTION OF A CLASS OF IMPULSIVE NETWORKS WITH INFINITE DELAYS

Sufficient conditions are obtained for the existence and global exponential stability of a unique periodic solution of a class of impulsive tow-neuron networks with variable and unbounded delays. The approaches are based on Mawhin's continuation theorem of coincidence degree theory and Lyapunov functions.

NOVEL STABILITY CRITERIA FOR DELAYED CELLULAR NEURAL NETWORKS

In this paper, a new sufficient condition is given for the global asymptotic stability and global exponential output stability of a unique equilibrium points of delayed cellular neural networks (DCNNs) by using Lyapunov method. This condition imposes constraints on the feedback matrices and delayed feedback matrices of DCNNs and is independent of the delay. The obtained results extend and improve upon those in the earlier literature, and this condition is also less restrictive than those given in the earlier references. Two examples compared with the previous results in the literatures are presented and a simulation result is also given.

GLOBAL EXPONENTIAL STABILITY OF REACTION-DIFFUSION TIME-VARYING DELAYED CELLULAR NEURAL NETWORKS WITH DIRICHLET BOUNDARY CONDITIONS

This paper is devoted to global exponential stability of reaction-diffusion time-varying delayed cellular neural networks with Dirichlet boundary conditions. Without assuming the monotonicity and differentiability of activation functions, nor symmetry of synaptic interconnection weights, the authors present some delay independent and easily verifiable sufficient conditions to ensure the global exponential stability of the equilibrium solution by using the method of variational parameter and inequality technique. These conditions obtained have important leading significance in the designs and applications of global exponential stability for reaction-diffusion neural circuit systems with delays. Lastly, one example is given to illustrate the theoretical analysis.

Complete Stability in Multistable Delayed Neural Networks

We investigate the complete stability for multistable delayed neural networks. A new formulation modified from the previous studies on multistable networks is developed to derive componentwise dynamical property. An iteration argument is then constructed to conclude that every solution of the network converges to a single equilibrium as time tends to infinity. The existence of 3n equilibria and 2n positively invariant sets for the n-neuron system remains valid under the new formulation. The theory is demonstrated by a numerical illustration.

Global exponential stability of bidirectional associative memory neural networks with time delays

In this paper, we consider delayed bidirectional associative memory (BAM) neural networks (NNs) with Lipschitz continuous activation functions. By applying Young's inequality and Hoelder's inequality techniques together with the properties of monotonic continuous functions, global exponential stability criteria are established for BAM NNs with time delays. This is done through the use of a new Lyapunov functional and an M-matrix. The results obtained in this paper extend and improve previous results.

Stability Analysis of Takagi–Sugeno Fuzzy Cellular Neural Networks With Time-Varying Delays

This correspondence investigates the global exponential stability problem of Takagi-Sugeno fuzzy cellular neural networks with time-varying delays (TSFDCNNs). Based on the Lyapunov-Krasovskii functional theory and linear matrix inequality technique, a less conservative delay-dependent stability criterion is derived to guarantee the exponential stability of TSFDCNNs. By constructing a Lyapunov-Krasovskii functional, the supplementary requirement that the time derivative of time-varying delays must be smaller than one is released in the proposed delay-dependent stability criterion. Two illustrative examples are provided to verify the effectiveness of the proposed results.

Deriving Sufficient Conditions for Global Asymptotic Stability of Delayed Neural Networks via Nonsmooth Analysis—II

Following our recent approach of nonsmooth analysis, we report a new set of sufficient conditions and its implications for the global asymptotic stability of delayed cellular neural networks (DCNN). The new conditions not only unify a string of previous stability results, but also yield strict improvement over them by allowing the symmetric part of the feedback matrix positive definite, hence enlarging the application domain of DCNNs. Advantages of the new results over existing ones are illustrated with examples. We also compare our results with those related results obtained via LMI approach.

Global Asymptotic Stability Analysis of Bidirectional Associative Memory Neural Networks With Time Delays

This paper presents a sufficient condition for the existence, uniqueness and global asymptotic stability of the equilibrium point for bidirectional associative memory (BAM) neural networks with distributed time delays. The results impose constraint conditions on the network parameters of neural system independently of the delay parameter, and they are applicable to all continuous nonmonotonic neuron activation functions. It is shown that in some special cases of the results, the stability criteria can be easily checked. Some examples are also given to compare the results with the previous results derived in the literature.

Analysis of global exponential stability and periodic solutions of neural networks with time-varying delays

In this paper, a general class of recurrent neural networks with time-varying delays is studied. Some novel and sufficient conditions are given to guarantee the global exponential stability of the equilibrium point and the existence of periodic solutions for such delayed neural networks. Comparing with some previous literature, in which the time-varying delays were assumed to be differentiable and their derivatives were simultaneously required to be not greater than 1, the restrictions on the time-varying delays are removed. Therefore, our results obtained here improve and extend some previously related results. Finally, two numerical examples are provided to illustrate our theorems.

Global robust stability for shunting inhibitory CNNs with delays

In this paper, the problem of global robust stability for shunting inhibitory cellular neural networks (SICNNs) is studied. A sufficient condition guaranteeing the network's global robust stability is established. The result can easily be used to verify globally robust stable networks. An example is given to illustrate that the conditions of our results are feasible.

Some sufficient conditions for global exponential stability of delayed Hopfield neural networks

In this paper, we have derived some sufficient conditions for existence and uniqueness of equilibrium and global exponential stability in delayed Hopfield neural networks by using a different approach from the usually used one where the existence, uniqueness of equilibrium and stability are proved in two separate steps, rather we first prove global exponential convergence to 0 of the difference between any two solutions of the original neural networks, the existence and uniqueness of equilibrium is the direct results of this procedure. We obtain the conditions by suitable construction of Lyapunov functionals and estimation of derivates of the Lyapunov functionals by the well-known Young's inequality and Holder's inequality. The proposed conditions are related to p-norms of vector or matrix, p in [1, infinity] and thus unify and generalize some results in the literature.

Absolute exponential stability of recurrent neural networks with Lipschitz-continuous activation functions and time delays

This paper investigates the absolute exponential stability of a general class of delayed neural networks, which require the activation functions to be partially Lipschitz continuous and monotone nondecreasing only, but not necessarily differentiable or bounded. Three new sufficient conditions are derived to ascertain whether or not the equilibrium points of the delayed neural networks with additively diagonally stable interconnection matrices are absolutely exponentially stable by using delay Halanay-type inequality and Lyapunov function. The stability criteria are also suitable for delayed optimization neural networks and delayed cellular neural networks whose activation functions are often nondifferentiable or unbounded. The results herein answer a question: if a neural network without any delay is absolutely exponentially stable, then under what additional conditions, the neural networks with delay is also absolutely exponentially stable.

Robust Stability of Interval Bidirectional Associative Memory Neural Network With Time Delays

In this paper, the conventional bidirectional associative memory (BAM) neural network with signal transmission delay is intervalized in order to study the bounded effect of deviations in network parameters and external perturbations. The resultant model is referred to as a novel interval dynamic BAM (IDBAM) model. By combining a number of different Lyapunov functionals with the Razumikhin technique, some sufficient conditions for the existence of unique equilibrium and robust stability are derived. These results are fairly general and can be verified easily. To go further, we extend our investigation to the time-varying delay case. Some robust stability criteria for BAM with perturbations of time-varying delays are derived. Besides, our approach for the analysis allows us to consider several different types of activation functions, including piecewise linear sigmoids with bounded activations as well as the usual C1-smooth sigmoids. We believe that the results obtained have leading significance in the design and application of BAM neural networks.

Absolutely exponential stability of a class of neural networks with unbounded delay

In this paper, the existence and uniqueness of the equilibrium point and absolute stability of a class of neural networks with partially Lipschitz continuous activation functions are investigated. The neural networks contain both variable and unbounded delays. Using the matrix property, a necessary and sufficient condition for the existence and uniqueness of the equilibrium point of the neural networks is obtained. By constructing proper vector Liapunov functions and nonlinear integro-differential inequalities involving both variable delays and unbounded delay, using M-matrix theory, sufficient conditions for absolutely exponential stability are obtained.

A Generalized LMI-Based Approach to the Global Asymptotic Stability of Delayed Cellular Neural Networks

A novel linear matrix inequality (LMI)-based criterion for the global asymptotic stability and uniqueness of the equilibrium point of a class of delayed cellular neural networks (CNNs) is presented. The criterion turns out to be a generalization and improvement over some previous criteria.

Deriving Sufficient Conditions for Global Asymptotic Stability of Delayed Neural Networks via Nonsmooth Analysis

In this paper, we obtain new sufficient conditions ensuring existence, uniqueness, and global asymptotic stability (GAS) of the equilibrium point for a general class of delayed neural networks (DNNs) via nonsmooth analysis, which makes full use of the Lipschitz property of functions defining DNNs. Based on this new tool of nonsmooth analysis, we first obtain a couple of general results concerning the existence and uniqueness of the equilibrium point. Then those results are applied to show that existence assumptions on the equilibrium point in some existing sufficient conditions ensuring GAS are actually unnecessary; and some strong assumptions such as the boundedness of activation functions in some other existing sufficient conditions can be actually dropped. Finally, we derive some new sufficient conditions which are easy to check. Comparison with some related existing results is conducted and advantages are illustrated with examples. Throughout our paper, spectral properties of the matrix (A + Atau) play an important role, which is a distinguished feature from previous studies. Here, A and Atau are, respectively, the feedback and the delayed feedback matrix defining the neural network under consideration.

Dynamics of periodic delayed neural networks

This paper formulates and studies a model of periodic delayed neural networks. This model can well describe many practical architectures of delayed neural networks, which is generalization of some additive delayed neural networks such as delayed Hopfield neural networks and delayed cellular neural networks, under a time-varying environment, particularly when the network parameters and input stimuli are varied periodically with time. Without assuming the smoothness, monotonicity and boundedness of the activation functions, the two functional issues on neuronal dynamics of this periodic networks, i.e. the existence and global exponential stability of its periodic solutions, are investigated. Some explicit and conclusive results are established, which are natural extension and generalization of the corresponding results existing in the literature. Furthermore, some examples and simulations are presented to illustrate the practical nature of the new results.