Unified analysis on multistablity of fraction-order multidimensional-valued memristive neural networks

This article provides a unified analysis of the multistability of fraction-order multidimensional-valued memristive neural networks (FOMVMNNs) with unbounded time-varying delays. Firstly, based on the knowledge of fractional differentiation and memristors, a unified model is established. This model is a unified form of real-valued, complex-valued, and quaternion-valued systems. Then, based on a unified method, the number of equilibrium points for FOMVMNNs is discussed. The sufficient conditions for determining the number of equilibrium points have been obtained. By using 1-norm to construct Lyapunov functions, the unified criteria for multistability of FOMVMNNs are obtained, these criteria are less conservative and easier to verify. Moreover, the attraction basins of the stable equilibrium points are estimated. Finally, two numerical simulation examples are provided to verify the correctness of the results.

An Overview of the Stability Analysis of Recurrent Neural Networks With Multiple Equilibria

The stability analysis of recurrent neural networks (RNNs) with multiple equilibria has received extensive interest since it is a prerequisite for successful applications of RNNs. With the increasing theoretical results on this topic, it is desirable to review the results for a systematical understanding of the state of the art. This article provides an overview of the stability results of RNNs with multiple equilibria including complete stability and multistability. First, preliminaries on the complete stability and multistability analysis of RNNs are introduced. Second, the complete stability results of RNNs are summarized. Third, the multistability results of various RNNs are reviewed in detail. Finally, future directions in these interesting topics are suggested.

Multistability of Dynamic Memristor Delayed Cellular Neural Networks With Application to Associative Memories

Recently, dynamic memristor (DM)-cellular neural networks (CNNs) have received widespread attention due to their advantage of low power consumption. The previous works showed that DM-CNNs have at most 318 equilibrium points (EPs) with n=16 cells. Since time delay is unavoidable during the process of information transmission, the goal of this article is to research the multistability of DM-CNNs with time delay, and, meanwhile, to increase the storage capacity of DM-delay (D)CNNs. Depending on the different constitutive relations of memristors, two cases of the multistability for DM-DCNNs are discussed. After determining the constitutive relations, the number of EPs of DM-DCNNs is increased to 3ⁿ with n cells by means of the appropriate state-space decomposition and the Brouwer's fixed point theorem. Furthermore, the enlarged attraction domains of EPs can be obtained, and 2ⁿ of these EPs are locally exponentially stable in two cases. Compared with standard CNNs, the dynamic behavior of DM-DCNNs shows an outstanding merit. That is, the value of voltage and current approach to zero when the system becomes stable, and the memristor provides a nonvolatile memory to store the computation results. Finally, two numerical simulations are presented to illustrate the effectiveness of the theoretical results, and the applications of associative memories are shown at the end of this article.

Basic theorem and global exponential stability of differential-algebraic neural networks with delay

A differential-algebraic neural network (DANN) with delay (DDANN) is proposed. Firstly, the global existence and uniqueness theorems are established for a DDANN, respectively. Next, a new differential-algebraic inequality is established. Then, a theorem on global exponential stability of DDANN is shown by using this inequality. As an application of DDANN, a very concise criterion on global exponential stability for a neutral-type neural network is given by using DDANNs. Finally, two examples are given to illustrate the theoretical results.

Multistability of Switched Neural Networks With Piecewise Linear Activation Functions Under State-Dependent Switching

This paper is concerned with the multistability of switched neural networks with piecewise linear activation functions under state-dependent switching. Under some reasonable assumptions on the switching threshold and activation functions, by using the state-space decomposition method, contraction mapping theorem, and strictly diagonally dominant matrix theory, we can characterize the number of equilibria as well as analyze the stability/instability of the equilibria. More interesting, we can find that the switching threshold plays an important role for stable equilibria in the unsaturation regions of activation functions, and the number of stable equilibria of an n -neuron switched neural network with state-dependent parameters increases to 3ⁿ from 2ⁿ in the conventional one. Furthermore, for two-neuron switched neural networks, the precise attraction basin of each stable equilibrium point can be figured out, and its boundary is composed of the stable manifolds of unstable equilibrium points and the switching lines. Two simulation examples are discussed in detail to substantiate the effectiveness of the theoretical analysis.

Multistability of Delayed Hybrid Impulsive Neural Networks With Application to Associative Memories

The important topic of multistability of continuous-and discrete-time neural network (NN) models has been investigated rather extensively. Concerning the design of associative memories, multistability of delayed hybrid NNs is studied in this paper with an emphasis on the impulse effects. Arising from the spiking phenomenon in biological networks, impulsive NNs provide an efficient model for synaptic interconnections among neurons. Using state-space decomposition, the coexistence of multiple equilibria of hybrid impulsive NNs is analyzed. Multistability criteria are then established regrading delayed hybrid impulsive neurodynamics, for which both the impulse effects on the convergence rate and the basins of attraction of the equilibria are discussed. Illustrative examples are given to verify the theoretical results and demonstrate an application to the design of associative memories. It is shown by an experimental example that delayed hybrid impulsive NNs have the advantages of high storage capacity and high fault tolerance when used for associative memories.

Multistability and instability analysis of recurrent neural networks with time-varying delays

This paper provides new theoretical results on the multistability and instability analysis of recurrent neural networks with time-varying delays. It is shown that such n-neuronal recurrent neural networks have exactly [Formula: see text] equilibria, [Formula: see text] of which are locally exponentially stable and the others are unstable, where k₀ is a nonnegative integer such that k₀≤n. By using the combination method of two different divisions, recurrent neural networks can possess more dynamic properties. This method improves and extends the existing results in the literature. Finally, one numerical example is provided to show the superiority and effectiveness of the presented results.

Convergence and Multistability of Nonsymmetric Cellular Neural Networks With Memristors

Recent work has considered a class of cellular neural networks (CNNs) where each cell contains an ideal capacitor and an ideal flux-controlled memristor. One main feature is that during the analog computation the memristor is assumed to be a dynamic element, hence each cell is second-order with state variables given by the capacitor voltage and the memristor flux. Such CNNs, named dynamic memristor (DM)-CNNs, were proved to be convergent when a symmetry condition for the cell interconnections is satisfied. The goal of this paper is to investigate convergence and multistability of DM-CNNs in the general case of nonsymmetric interconnections. The main result is that convergence holds when there are (possibly) nonsymmetric, non-negative interconnections between cells and an irreducibility assumption is satisfied. This result appears to be similar to the classic convergence result for standard (S)-CNNs with positive cell-linking templates. Yet, due to the presence of DMs, a DM-CNN displays some basically different and peculiar dynamical properties with respect to S-CNNs. One key difference is that the DM-CNN processing is based on the time evolution of memristor fluxes instead of capacitor voltages as it happens for S-CNNs. Moreover, when a steady state is reached, all voltages and currents, and hence power consumption of a DM-CNN vanish. This notwithstanding the memristors are able to store in a nonvolatile way the result of the processing. Voltages, currents and power instead do not vanish when an S-CNN reaches a steady state.

Optimal Communication Network-Based H∞ Quantized Control With Packet Dropouts for a Class of Discrete-Time Neural Networks With Distributed Time Delay

This paper is concerned with optimal communication network-based H∞ quantized control for a discrete-time neural network with distributed time delay. Control of the neural network (plant) is implemented via a communication network. Both quantization and communication network-induced data packet dropouts are considered simultaneously. It is assumed that the plant state signal is quantized by a logarithmic quantizer before transmission, and communication network-induced packet dropouts can be described by a Bernoulli distributed white sequence. A new approach is developed such that controller design can be reduced to the feasibility of linear matrix inequalities, and a desired optimal control gain can be derived in an explicit expression. It is worth pointing out that some new techniques based on a new sector-like expression of quantization errors, and the singular value decomposition of a matrix are developed and employed in the derivation of main results. An illustrative example is presented to show the effectiveness of the obtained results.

Multistability for Delayed Neural Networks via Sequential Contracting

In this paper, we explore a variety of new multistability scenarios in the general delayed neural network system. Geometric structure embedded in equations is exploited and incorporated into the analysis to elucidate the underlying dynamics. Criteria derived from different geometric configurations lead to disparate numbers of equilibria. A new approach named sequential contracting is applied to conclude the global convergence to multiple equilibrium points of the system. The formulation accommodates both smooth sigmoidal and piecewise-linear activation functions. Several numerical examples illustrate the present analytic theory.

Multistability and Instability of Neural Networks With Discontinuous Nonmonotonic Piecewise Linear Activation Functions

In this paper, we discuss the coexistence and dynamical behaviors of multiple equilibrium points for recurrent neural networks with a class of discontinuous nonmonotonic piecewise linear activation functions. It is proved that under some conditions, such n -neuron neural networks can have at least 5(n) equilibrium points, 3(n) of which are locally stable and the others are unstable, based on the contraction mapping theorem and the theory of strict diagonal dominance matrix. The investigation shows that the neural networks with the discontinuous activation functions introduced in this paper can have both more total equilibrium points and more locally stable equilibrium points than the ones with continuous Mexican-hat-type activation function or discontinuous two-level activation functions. An illustrative example with computer simulations is presented to verify the theoretical analysis.

Convergence and attractivity of memristor-based cellular neural networks with time delays

This paper presents theoretical results on the convergence and attractivity of memristor-based cellular neural networks (MCNNs) with time delays. Based on a realistic memristor model, an MCNN is modeled using a differential inclusion. The essential boundedness of its global solutions is proven. The state of MCNNs is further proven to be convergent to a critical-point set located in saturated region of the activation function, when the initial state locates in a saturated region. It is shown that the state convergence time period is finite and can be quantitatively estimated using given parameters. Furthermore, the positive invariance and attractivity of state in non-saturated regions are also proven. The simulation results of several numerical examples are provided to substantiate the results.

Synchronization of Coupled Neutral-Type Neural Networks With Jumping-Mode-Dependent Discrete and Unbounded Distributed Delays

In this paper, the synchronization problem is studied for an array of N identical delayed neutral-type neural networks with Markovian jumping parameters. The coupled networks involve both the mode-dependent discrete-time delays and the mode-dependent unbounded distributed time delays. All the network parameters including the coupling matrix are also dependent on the Markovian jumping mode. By introducing novel Lyapunov-Krasovskii functionals and using some analytical techniques, sufficient conditions are derived to guarantee that the coupled networks are asymptotically synchronized in mean square. The derived sufficient conditions are closely related with the discrete-time delays, the distributed time delays, the mode transition probability, and the coupling structure of the networks. The obtained criteria are given in terms of matrix inequalities that can be efficiently solved by employing the semidefinite program method. Numerical simulations are presented to further demonstrate the effectiveness of the proposed approach.

Multistability of neural networks with Mexican-hat-type activation functions

In this paper, we are concerned with a class of neural networks with Mexican-hat-type activation functions. Due to the different structure from neural networks with saturated activation functions, a set of new sufficient conditions are presented to study the multistability, including the total number of equilibrium points, their locations, and stability. Furthermore, the attraction basins of stable equilibrium points are investigated for two-neuron neural networks. The investigation shows that the stable manifolds of unstable equilibrium points constitute the boundaries of attraction basins of stable equilibrium points. Several illustrative examples are given to verify the effectiveness of our results.

Limit set dichotomy and multistability for a class of cooperative neural networks with delays

Recent papers have pointed out the interest to study convergence in the presence of multiple equilibrium points (EPs) (multistability) for neural networks (NNs) with nonsymmetric cooperative (nonnegative) interconnections and neuron activations modeled by piecewise linear (PL) functions. One basic difficulty is that the semiflows generated by such NNs are monotone but, due to the horizontal segments in the PL functions, are not eventually strongly monotone (ESM). This notwithstanding, it has been shown that there are subclasses of irreducible interconnection matrices for which the semiflows, although they are not ESM, enjoy convergence properties similar to those of ESM semiflows. The results obtained so far concern the case of cooperative NNs without delays. The goal of this paper is to extend some of the existing results to the relevant case of NNs with delays. More specifically, this paper considers a class of NNs with PL neuron activations, concentrated delays, and a nonsymmetric cooperative interconnection matrix A and delay interconnection matrix A(τ). The main result is that when A+A(τ) satisfies a full interconnection condition, then the generated semiflows, which are monotone but not ESM, satisfy a limit set dichotomy analogous to that valid for ESM semiflows. It follows that there is an open and dense set of initial conditions, in the state space of continuous functions on a compact interval, for which the solutions converge toward an EP. The result holds in the general case where the NNs possess multiple EPs, i.e., is a result on multistability, and is valid for any constant value of the delays.