Global Exponential Stability of Impulsive Fuzzy High-Order BAM Neural Networks With Continuously Distributed Delays

Convergence Analysis of Online Gradient Method for High-Order Neural Networks and Their Sparse Optimization

In this article, we investigate the boundedness and convergence of the online gradient method with the smoothing group regularization for the sigma-pi-sigma neural network (SPSNN). This enhances the sparseness of the network and improves its generalization ability. For the original group regularization, the error function is nonconvex and nonsmooth, which can cause oscillation of the error function. To ameliorate this drawback, we propose a simple and effective smoothing technique, which can effectively eliminate the deficiency of the original group regularization. The group regularization effectively optimizes the network structure from two aspects redundant hidden nodes tending to zero and redundant weights of surviving hidden nodes in the network tending to zero. This article shows the strong and weak convergence results for the proposed method and proves the boundedness of weights. Experiment results clearly demonstrate the capability of the proposed method and the effectiveness of redundancy control. The simulation results are observed to support the theoretical results.

Multistability and Robustness of Competitive Neural Networks With Time-Varying Delays

This article is devoted to analyzing the multistability and robustness of competitive neural networks (NNs) with time-varying delays. Based on the geometrical structure of activation functions, some sufficient conditions are proposed to ascertain the coexistence of equilibrium points, of them are locally exponentially stable, where represents a dimension of system and is the parameter related to activation functions. The derived stability results not only involve exponential stability but also include power stability and logarithmical stability. In addition, the robustness of stable equilibrium points is discussed in the presence of perturbations. Compared with previous papers, the conclusions proposed in this article are easy to verify and enrich the existing stability theories of competitive NNs. Finally, numerical examples are provided to support theoretical results.

Bounded Antisynchronization of Multiple Neural Networks via Multilevel Hybrid Control

The bounded antisynchronization (AS) problem of multiple discrete-time neural networks (NNs) based on the fuzzy model is studied, in consideration of the differences in quantity and communication among different NN groups, the variabilities of dynamics, and communication topological affected by environments. To reduce the energy consumption of communication, a cluster pinning communication mechanism is proposed, and an impulsive observer is designed to estimate the state of target NN. Then, a multilevel hybrid controller based on the impulsive observer is built including the AS controller and the bounded synchronization (BS) controller. Sufficient conditions for bounded AS are obtained by analyzing the stability of the BS augmented error (BSAE) and the AS augmented error (ASAE) based on the fuzzy-based Lyapunov functional (FBLF). Finally, a numerical example and an application example are given to verify the validity of the obtained results.

Pattern Formation in a Reaction-Diffusion BAM Neural Network With Time Delay: (k1, k2) Mode Hopf-Zero Bifurcation Case

This article investigates the joint effects of connection weight and time delay on pattern formation for a delayed reaction-diffusion BAM neural network (RDBAMNN) with Neumann boundary conditions by using the (k₁,k₂) mode Hopf-zero bifurcation. First, the conditions for k₁ mode zero bifurcation are obtained by choosing connection weight as the bifurcation parameter. It is found that the connection weight has a great impact on the properties of steady state. With connection weight increasing, the homogeneous steady state becomes inhomogeneous, which means that the connection weight can affect the spatial stability of steady state. Then, the specified conditions for the k₂ mode Hopf bifurcation and the (k₁,k₂) mode Hopf-zero bifurcation are established. By using the center manifold, the third-order normal form of the Hopf-zero bifurcation is obtained. Through the analysis of the normal form, the bifurcation diagrams on two parameters' planes (connection weight and time delay) are obtained, which contains six areas. Some interesting spatial patterns are found in these areas: a homogeneous periodic solution, a homogeneous steady state, two inhomogeneous steady state, and two inhomogeneous periodic solutions.

Multimode function multistability for Cohen-Grossberg neural networks with mixed time delays

In this paper, we are concerned with the multimode function multistability for Cohen-Grossberg neural networks (CGNNs) with mixed time delays. It is introduced the multimode function multistability as well as its specific mathematical expression, which is a generalization of multiple exponential stability, multiple polynomial stability, multiple logarithmic stability, and asymptotic stability. Also, according to the neural network (NN) model and the maximum and minimum values of activation functions, n pairs of upper and lower boundary functions are obtained. Via the locations of the zeros of the n pairs of upper and lower boundary functions, the state space is divided into ∏_i=1ⁿ(2H_i+1) parts correspondingly. By virtue of the reduction to absurdity, continuity of function, Brouwer's fixed point theorem and Lyapunov stability theorem, the criteria for multimode function multistability are acquired. Multiple types of multistability, including multiple exponential stability, multiple polynomial stability, multiple logarithmic stability, and multiple asymptotic stability, can be achieved by selecting different types of function P(t). Two numerical examples are offered to substantiate the generality of the obtained criteria over the existing results.

A new predefined-time stability theorem and its application in the synchronization of memristive complex-valued BAM neural networks

In this paper, two novel and general predefined-time stability lemmas are given and applied to the predefined-time synchronization problem of memristive complex-valued bidirectional associative memory neural networks (MCVBAMNNs). Firstly, different from the generally fixed-time stability lemma, the setting of an adjustable time parameter in the derived predefined-time stability lemma causes it to be more flexible and more general. Secondly, the model studied in the complex-valued BAM neural networks model, which is different from the previous discussion of the real part and imaginary part respectively. It is more practical to study the complex-valued nonseparation. Thirdly, two effective controllers are designed to realize the synchronization performance of BAM neural networks based on the predefined-time stability, and the analysis is given based on general predefined-time synchronization. Finally, the correctness of the theoretical derivation is verified by numerical simulation. A secure communication scheme based on predefined-time synchronization of MCVBAMNNs is proposed, and the effectiveness and superiority of the results are proved.

Global Stability of Bidirectional Associative Memory Neural Networks With Multiple Time-Varying Delays

This article investigates the global stability of bidirectional associative memory neural networks with discrete and distributed time-varying delays (DBAMNNs). By employing the comparison strategy and inequality techniques, global asymptotic stability (GAS) and global exponential stability (GES) of the underlying DBAMNNs are of concern in terms of p -norm ( p ≥ 2 ). Meanwhile, GES of the addressed DBAMNNs is also analyzed in terms of 1-norm. When distributed time delay is neglected, the GES of the corresponding bidirectional associative memory neural networks is presented as an M -matrix, which includes certain existing outcomes as special cases. Two examples are finally provided to substantiate the validity of theories.

Periodicity and multi-periodicity generated by impulses control in delayed Cohen-Grossberg-type neural networks with discontinuous activations

This paper discusses the periodicity and multi-periodicity in delayed Cohen-Grossberg-type neural networks (CGNNs) possessing impulsive effects, whose activation functions possess discontinuities and are allowed to be unbounded or nonmonotonic. Based on differential inclusion and cone expansion-compression fixed-point theory of set-valued mapping, several improved criteria are given to derive the positive solution with ω-periodicity and ω-multi-periodicity for delayed CGNNs under impulsive control. These ω-periodicity/ω-multi-periodicity orbits are produced by impulses control. The analytical method and theoretical results presented in this paper are of certain significance to the design of neural network models or circuits possessing discontinuous neuron activation and impulsive effects in periodic environment.

On μ-Pseudo Almost Periodic Solutions for Clifford-Valued Neutral Type Neural Networks With Delays in the Leakage Term

We propose a class of Clifford-valued neutral type neural networks with delays in the leakage term. Using a direct method, that is, without decomposing the Clifford-valued system under consideration into a real-valued system, we obtain sufficient conditions for the existence and global exponential stability of μ -pseudo almost periodic solutions of the Clifford-valued neural network under consideration. Finally, we give a numerical example to show the feasibility of our results.

Extended Robust Exponential Stability of Fuzzy Switched Memristive Inertial Neural Networks With Time-Varying Delays on Mode-Dependent Destabilizing Impulsive Control Protocol

This article investigates the problem of robust exponential stability of fuzzy switched memristive inertial neural networks (FSMINNs) with time-varying delays on mode-dependent destabilizing impulsive control protocol. The memristive model presented here is treated as a switched system rather than employing the theory of differential inclusion and set-value map. To optimize the robust exponentially stable process and reduce the cost of time, hybrid mode-dependent destabilizing impulsive and adaptive feedback controllers are simultaneously applied to stabilize FSMINNs. In the new model, the multiple impulsive effects exist between two switched modes, and the multiple switched effects may also occur between two impulsive instants. Based on switched analysis techniques, the Takagi-Sugeno (T-S) fuzzy method, and the average dwell time, extended robust exponential stability conditions are derived. Finally, simulation is provided to illustrate the effectiveness of the results.

Monostability and Multistability for Almost-Periodic Solutions of Fractional-Order Neural Networks With Unsaturating Piecewise Linear Activation Functions

Since the unsaturating activation function is unbounded, more complex dynamics may exist in neural networks with this kind of activation function. In this article, monostability and multistability results of almost-periodic solutions are developed for fractional-order neural networks with unsaturating piecewise linear activation functions. Some globally Mittag-Leffler attractive sets are given, and the existence of globally Mittag-Leffler stable almost-periodic solution is demonstrated by using Ascoli-Arzela theorem. In particular, some sufficient conditions are provided to ascertain the multistability of almost-periodic solutions based on locally positively invariant set. It shows that there exists an almost-periodic solution in each positively invariant set, and all trajectories converge to this periodic trajectory in that rectangular area. Two illustrative examples are provided to demonstrate the effectiveness of the proposed sufficient criteria.

Stubborn State Estimation for Delayed Neural Networks Using Saturating Output Errors

This paper is concerned with the stubborn state estimation of delayed neural networks that subject to a general class of disturbances in measurements, including outliers and impulsive disturbances as its special cases. This class of disturbances may be unbounded, irregular, and assorted; therefore, they can hardly be suppressed by existing identification-based estimation approaches. In this paper, a stubborn state estimator is constructed by intentionally devising a saturation scheme on the injection of output estimation error. The embedded saturation can effectively resist the influences from these measurement disturbances by saturating them. Moreover, the saturation threshold in the designed scheme is not constant but governed by a dynamic equation with parameters to be designed. Benefiting from this adaptiveness, the estimator obtains more freedom in dealing with various disturbances. By combining a novel Lyapunov functional, the generalized sector condition and two latest integral inequalities, a delay-dependent criterion is derived in a less conservative way to check whether the estimation error system with this dynamic saturation is globally stable. A sufficient condition with two tuning scalars is further provided to codesign the gain of the state estimator and the evolution law of the saturation threshold. Finally, two numerical examples are used to illustrate the stubbornness of this state estimator in the presence of measurement outliers or impulsive disturbances.

Robust delay-dependent stability of uncertain inertial neural networks with impulsive effects and distributed-delay

The robust stability problem of uncertain inertial neural networks with impulsive effects and distributed-delay is considered in the present paper. The average impulsive interval and differential inequality for delay differential equations are used to obtain the global exponential stability of the inertial neural networks. The robust distributed-delay-dependent stability criteria here are proposed in terms of both linear matrix inequalities and algebraic inequalities. Our results can not only be used to obtain the stability of the uncertain inertial neural network with impulsive disturbance, but also be utilized to design the impulsive control for the uncertain inertial neural networks. The novel criteria complement and extend the previous works on uncertain inertial neural network with/without impulsive effects. Typical numerical examples are used to test the validity of the developed stability criteria finally.