Synchronization of Complex Networks With Nondifferentiable Time-Varying Delay

In this article, we investigate the synchronization of complex networks with general time-varying delay, especially with nondifferentiable delay. In the literature, the time-varying delay is usually assumed to be differentiable. This assumption is strict and not easy to verify in engineering. Until now, the synchronization of networks with nondifferentiable delay through adaptive control remains a challenging problem. By analyzing the boundedness of the adaptive control gain and extending the well-known Halanay inequality, we solve this problem and establish several synchronization criteria for networks under the centralized adaptive control and networks under the decentralized adaptive control. Particularly, the boundedness of the centralized adaptive control gain is theoretically proved. Numerical simulations are provided to verify the theoretical results.

Self-Supervised Time Series Clustering With Model-Based Dynamics

Time series clustering is usually an essential unsupervised task in cases when category information is not available and has a wide range of applications. However, existing time series clustering methods usually either ignore temporal dynamics of time series or isolate the feature extraction from clustering tasks without considering the interaction between them. In this article, a time series clustering framework named self-supervised time series clustering network (STCN) is proposed to optimize the feature extraction and clustering simultaneously. In the feature extraction module, a recurrent neural network (RNN) conducts a one-step time series prediction that acts as the reconstruction of the input data, capturing the temporal dynamics and maintaining the local structures of the time series. The parameters of the output layer of the RNN are regarded as model-based dynamic features and then fed into a self-supervised clustering module to obtain the predicted labels. To bridge the gap between these two modules, we employ spectral analysis to constrain the similar features to have the same pseudoclass labels and align the predicted labels with pseudolabels as well. STCN is trained by iteratively updating the model parameters and the pseudoclass labels. Experiments conducted on extensive time series data sets show that STCN has state-of-the-art performance, and the visualization analysis also demonstrates the effectiveness of the proposed model.

Non-fragile sampled-data robust synchronization of uncertain delayed chaotic Lurie systems with randomly occurring controller gain fluctuation

This paper proposes a new non-fragile stochastic control method to investigate the robust sampled-data synchronization problem for uncertain chaotic Lurie systems (CLSs) with time-varying delays. The controller gain fluctuation and time-varying uncertain parameters are supposed to be random and satisfy certain Bernoulli distributed white noise sequences. Moreover, by choosing an appropriate Lyapunov-Krasovskii functional (LKF), which takes full advantage of the available information about the actual sampling pattern and the nonlinear condition, a novel synchronization criterion is developed for analyzing the corresponding synchronization error system. Furthermore, based on the most powerful free-matrix-based integral inequality (FMBII), the desired non-fragile sampled-data estimator controller is obtained in terms of the solution of linear matrix inequalities. Finally, three numerical simulation examples of Chua's circuit and neural network are provided to show the effectiveness and superiorities of the proposed theoretical results.

Adaptive Elastic Echo State Network for Multivariate Time Series Prediction

Echo state network (ESN) is a new kind of recurrent neural network with a randomly generated reservoir structure and an adaptable linear readout layer. It has been widely employed in the field of time series prediction. However, when high-dimensional reservoirs are utilized to predict multivariate time series, there may be a collinearity problem. In this paper, to overcome the collinearity problem and obtain a sparse solution, we propose a new model-adaptive elastic ESN, in which adaptive elastic net algorithm is used to calculate the unknown weights. It combines the strengths of the quadratic regularization and the adaptively weighted lasso shrinkage. Hence, the proposed model can deal with the collinearity problem and enjoy the oracle property with an unbiased estimation. We exhibit the merits of our model on two benchmark multivariate chaotic datasets and two real-world applications. Experimental results substantiate the effectiveness and characteristics of the proposed model.

A Complex-Valued Projection Neural Network for Constrained Optimization of Real Functions in Complex Variables

In this paper, we present a complex-valued projection neural network for solving constrained convex optimization problems of real functions with complex variables, as an extension of real-valued projection neural networks. Theoretically, by developing results on complex-valued optimization techniques, we prove that the complex-valued projection neural network is globally stable and convergent to the optimal solution. Obtained results are completely established in the complex domain and thus significantly generalize existing results of the real-valued projection neural networks. Numerical simulations are presented to confirm the obtained results and effectiveness of the proposed complex-valued projection neural network.

Passivity of switched recurrent neural networks with time-varying delays

This paper is concerned with the passivity analysis for switched neural networks subject to stochastic disturbances and time-varying delays. First, using the multiple Lyapunov functions method, a state-dependent switching law is designed to present a stochastic passivity condition. Second, a hysteresis switching law involving both the current state and the previous value of the switching signal are presented to avoid chattering resulted from the state-dependent switching. Third, based on the average dwell-time approach, a class of switching signals is determined to guarantee the switched neural network stochastically passive. Finally, three numerical examples are provided to illustrate the characteristics of three proposed switching laws.

Multistability of two kinds of recurrent neural networks with activation functions symmetrical about the origin on the phase plane

In this paper, we investigate multistability of two kinds of recurrent neural networks with time-varying delays and activation functions symmetrical about the origin on the phase plane. One kind of activation function is with zero slope at the origin on the phase plane, while the other is with nonzero slope at the origin on the phase plane. We derive sufficient conditions under which these two kinds of n-dimensional recurrent neural networks are guaranteed to have (2m+1)(n) equilibrium points, with (m+1)(n) of them being locally exponentially stable. These new conditions improve and extend the existing multistability results for recurrent neural networks. Finally, the validity and performance of the theoretical results are demonstrated through two numerical examples.

On stabilization of stochastic Cohen-Grossberg neural networks with mode-dependent mixed time-delays and Markovian switching

The globally exponential stabilization problem is investigated for a general class of stochastic Cohen-Grossberg neural networks with both Markovian jumping parameters and mixed mode-dependent time-delays. The mixed time-delays consist of both discrete and distributed delays. This paper aims to design a memoryless state feedback controller such that the closed-loop system is stochastically exponentially stable in the mean square sense. By introducing a new Lyapunov-Krasovskii functional that accounts for the mode-dependent mixed delays, stochastic analysis is conducted in order to derive delay-dependent criteria for the exponential stabilization problem. Three numerical examples are carried out to demonstrate the feasibility of our delay-dependent stabilization criteria.

Global stability of complex-valued recurrent neural networks with time-delays

Since the last decade, several complex-valued neural networks have been developed and applied in various research areas. As an extension of real-valued recurrent neural networks, complex-valued recurrent neural networks use complex-valued states, connection weights, or activation functions with much more complicated properties than real-valued ones. This paper presents several sufficient conditions derived to ascertain the existence of unique equilibrium, global asymptotic stability, and global exponential stability of delayed complex-valued recurrent neural networks with two classes of complex-valued activation functions. Simulation results of three numerical examples are also delineated to substantiate the effectiveness of the theoretical results.

Multistability of neural networks with time-varying delays and concave-convex characteristics

In this paper, stability of multiple equilibria of neural networks with time-varying delays and concave-convex characteristics is formulated and studied. Some sufficient conditions are obtained to ensure that an n-neuron neural network with concave-convex characteristics can have a fixed point located in the appointed region. By means of an appropriate partition of the n-dimensional state space, when nonlinear activation functions of an n-neuron neural network are concave or convex in 2k+2m-1 intervals, this neural network can have (2k+2m-1)n equilibrium points. This result can be applied to the multiobjective optimal control and associative memory. In particular, several succinct criteria are given to ascertain multistability of cellular neural networks. These stability conditions are the improvement and extension of the existing stability results in the literature. A numerical example is given to illustrate the theoretical findings via computer simulations.

Novel exponential stability criteria of high-order neural networks with time-varying delays

The global exponential stability is analyzed for a class of high-order Hopfield-type neural networks with time-varying delays. Based on the Lyapunov stability theory, together with the linear matrix inequality approach and free-weighting matrix method, some less conservative delay-independent and delay-dependent sufficient conditions are presented for the global exponential stability of the equilibrium point of the considered neural networks. Two numerical examples are provided to demonstrate the effectiveness of the proposed stability criteria.

On some necessary and sufficient conditions for a recurrent neural network model with time delays to generate oscillations

In this paper, the existence of oscillations for a class of recurrent neural networks with time delays between neural interconnections is investigated. By using the fixed point theory and Liapunov functional, we prove that a recurrent neural network might have a unique equilibrium point which is unstable. This particular type of instability, combined with the boundedness of the solutions of the system, will force the network to generate a permanent oscillation. Some necessary and sufficient conditions for these oscillations are obtained. Simple and practical criteria for fixing the range of parameters in this network are also derived. Typical simulation examples are presented.