1
|
Jin Y, Lee SM. Sampled-Data State Estimation for LSTM. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:2300-2313. [PMID: 38324431 DOI: 10.1109/tnnls.2024.3359211] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/09/2024]
Abstract
This article first introduces a sampled-data state estimator design method for continuous-time long short-term memory (LSTM) neural networks with irregularly sampled output. To this end, the structure of the LSTM is addressed to obtain its dynamic equation. As a result, the LSTM neural network is modeled as a continuous-time linear parameter-varying system that is dependent on the gate units. For this system, the sampled-data Luenberger- and Arcak-type state estimator design methods are presented in terms of linear matrix inequalities (LMIs) by using the properties of the gate units. Lastly, the proposed method not only provides a numerical example for analyzing absolute stability but also demonstrates it in practice by applying a pre-trained behavior generation model of a robot manipulator.
Collapse
|
2
|
Hu J, Wang Z, Liu GP. Delay Compensation-Based State Estimation for Time-Varying Complex Networks With Incomplete Observations and Dynamical Bias. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:12071-12083. [PMID: 33449896 DOI: 10.1109/tcyb.2020.3043283] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
In this article, a delay-compensation-based state estimation (DCBSE) method is given for a class of discrete time-varying complex networks (DTVCNs) subject to network-induced incomplete observations (NIIOs) and dynamical bias. The NIIOs include the communication delays and fading observations, where the fading observations are modeled by a set of mutually independent random variables. Moreover, the possible bias is taken into account, which is depicted by a dynamical equation. A predictive scheme is proposed to compensate for the influences induced by the communication delays, where the predictive-based estimation mechanism is adopted to replace the delayed estimation transmissions. This article focuses on the problems of estimation method design and performance discussions for addressed DTVCNs with NIIOs and dynamical bias. In particular, a new distributed state estimation approach is presented, where a locally minimized upper bound is obtained for the estimation error covariance matrix and a recursive way is designed to determine the estimator gain matrix. Furthermore, the performance evaluation criteria regarding the monotonicity are proposed from the analytic perspective. Finally, some experimental comparisons are proposed to show the validity and advantages of the new DCBSE approach.
Collapse
|
3
|
Cai S, Lau VKN. Remote State Estimation of Nonlinear Systems Over Fading Channels via Recurrent Neural Networks. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; 33:3908-3922. [PMID: 33566773 DOI: 10.1109/tnnls.2021.3054826] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
In this article, we consider the remote state estimation for nonlinear dynamic systems with known linear dynamics and unknown nonlinear perturbations. The nonlinear dynamic plant is monitored by multiple distributed sensors over a random access wireless network with shared common radio channel. We focus on the communication strategy and remote state estimation algorithm design so as to achieve a remote state estimation stability subject to unknown nonlinearities in plant and various wireless impairments, such as multisensor interference, wireless fading, and additive channel noise. By exploiting the additive properties of the physical wireless channels, we propose a novel information fusion over-the-air mechanism to address the signal collision and interference among the sensors. Utilizing the partial knowledge on the linear dynamics of the plant, we also propose a novel recurrent neural network (RNN)-based remote state estimator aided by a virtual state estimation mean-square-error (MSE) process. We further propose a novel online training algorithm such that the RNN at the remote estimator can effectively learn the unknown plant nonlinearities. Using the Lyapunov drift analysis approach, we establish closed-form sufficient requirements on the communication resources needed to achieve almost sure stability of both state estimation and RNN online training in high signal-to-noise ratio (SNR) regime. As a result, our proposed scheme is asymptomatic optimal for large SNR in the sense that both the plant state and the unknown plant nonlinearities can be perfectly recovered at the remote estimator. The proposed scheme is also compared with various baselines and we show that significant performance gains can be achieved.
Collapse
|
4
|
Liu Y, Fang F, Zhou J, Liu Y. H∞ state estimation for T-S fuzzy reaction-diffusion delayed neural networks with randomly occurring gain uncertainties and semi-Markov jump parameters. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.04.060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
5
|
Adaptive Asymptotic Regulation for Uncertain Nonlinear Stochastic Systems with Time-Varying Delays. Symmetry (Basel) 2021. [DOI: 10.3390/sym13122284] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
In this paper, for a class of uncertain stochastic nonlinear systems with input time-varying delays, an adaptive neural dynamic surface control (DSC) method is proposed. To approximate the unknown continuous functions online, the neural network approximation technique was applied, and based on the DSC scheme, the desired controller was constructed. A compensation system is presented to compensate for the effect of the input delay. The Lyapunov–Krasovskii functionals (LKFs) were employed to compensate for the effect of the state delay. Compared with the existing works, based on using the DSC scheme with the nonlinear filter and stochastic Barbalat’s lemma, the asymptotic regulation performance of this closed-loop system can be guaranteed under the developed controller. To certify the availability for the designed control method, some simulation results are presented.
Collapse
|
6
|
Suo J, Li N, Li Q. Event-triggered H∞ state estimation for discrete-time delayed switched stochastic neural networks with persistent dwell-time switching regularities and sensor saturations. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2021.01.131] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
7
|
Li J, Wang Z, Dong H, Ghinea G. Outlier-Resistant Remote State Estimation for Recurrent Neural Networks With Mixed Time-Delays. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2021; 32:2266-2273. [PMID: 32452774 DOI: 10.1109/tnnls.2020.2991151] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
In this brief, a new outlier-resistant state estimation (SE) problem is addressed for a class of recurrent neural networks (RNNs) with mixed time-delays. The mixed time delays comprise both discrete and distributed delays that occur frequently in signal transmissions among artificial neurons. Measurement outputs are sometimes subject to abnormal disturbances (resulting probably from sensor aging/outages/faults/failures and unpredictable environmental changes) leading to measurement outliers that would deteriorate the estimation performance if directly taken into the innovation in the estimator design. We propose to use a certain confidence-dependent saturation function to mitigate the side effects from the measurement outliers on the estimation error dynamics (EEDs). Through using a combination of Lyapunov-Krasovskii functional and inequality manipulations, a delay-dependent criterion is established for the existence of the outlier-resistant state estimator ensuring that the corresponding EED achieves the asymptotic stability with a prescribed H∞ performance index. Then, the explicit characterization of the estimator gain is obtained by solving a convex optimization problem. Finally, numerical simulation is carried out to demonstrate the usefulness of the derived theoretical results.
Collapse
|
8
|
H∞state estimation for multi-rate artificial neural networks with integral measurements: A switched system approach. Inf Sci (N Y) 2020. [DOI: 10.1016/j.ins.2020.06.021] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
9
|
Chen W, Ding D, Mao J, Liu H, Hou N. Dynamical performance analysis of communication-embedded neural networks: A survey. Neurocomputing 2019. [DOI: 10.1016/j.neucom.2018.08.088] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
10
|
Zhang XM, Han QL, Ge X. An overview of neuronal state estimation of neural networks with time-varying delays. Inf Sci (N Y) 2019. [DOI: 10.1016/j.ins.2018.11.001] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
11
|
Chen MZQ. Nonfragile State Estimation of Quantized Complex Networks With Switching Topologies. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2018; 29:5111-5121. [PMID: 29994424 DOI: 10.1109/tnnls.2018.2790982] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
This paper considers the nonfragile $H_\infty $ estimation problem for a class of complex networks with switching topologies and quantization effects. The network architecture is assumed to be dynamic and evolves with time according to a random process subject to a sojourn probability. The coupled signal is to be quantized before transmission due to power and bandwidth constraints, and the quantization errors are transformed into sector-bounded uncertainties. The concept of nonfragility is introduced by inserting randomly occurred uncertainties into the estimator parameters to cope with the unavoidable small gain variations emerging from the implementations of estimators. Both the quantizers and the estimators have several operation modes depending on the switching signal of the underlying network structure. A sufficient condition is provided via a linear matrix inequality approach to ensure the estimation error dynamic to be stochastically stable in the absence of external disturbances, and the $H_\infty $ performance with a prescribed index is also satisfied. Finally, a numerical example is presented to clarify the validity of the proposed method.
Collapse
|
12
|
Xu Y, Liu C, Lu R, Su CY. Remote Estimator Design for Time-Delay Neural Networks Using Communication State Information. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2018; 29:5149-5158. [PMID: 29994373 DOI: 10.1109/tnnls.2018.2793185] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
This paper investigates the estimator design for the neural networks, where distributed delays and imperfect measurements are included. A randomly occurred neuron-dependent nonlinearity is used to describe the uncertain measurements disturbed by neurons. The measurements are transmitted over multiple transmission channels, and Markov chains are introduced to model packet dropouts of these channels. A one-to-one map is constructed to transform $m$ independent Markov chains to an augmented one to facilitate system analysis. A new variable called channel state is defined based on the cases of packet dropouts, and the channel-state-dependent estimator is designed to trade off between the number and the performance of the estimator. Sufficient conditions are established to guarantee that the augmented system is stochastically stable and satisfies the strict $(Q, S, R)-\gamma -$ dissipativity. The estimator gains are derived using linear matrix methods. Finally, an example is applied to illustrate the effectiveness of the developed methods.
Collapse
|
13
|
Dong H, Hou N, Wang Z, Ren W. Variance-Constrained State Estimation for Complex Networks With Randomly Varying Topologies. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2018; 29:2757-2768. [PMID: 28541916 DOI: 10.1109/tnnls.2017.2700331] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
This paper investigates the variance-constrained state estimation problem for a class of nonlinear time-varying complex networks with randomly varying topologies, stochastic inner coupling, and measurement quantization. A Kronecker delta function and Markovian jumping parameters are utilized to describe the random changes of network topologies. A Gaussian random variable is introduced to model the stochastic disturbances in the inner coupling of complex networks. As a kind of incomplete measurements, measurement quantization is taken into consideration so as to account for the signal distortion phenomenon in the transmission process. Stochastic nonlinearities with known statistical characteristics are utilized to describe the stochastic evolution of the complex networks. We aim to design a finite-horizon estimator, such that in the simultaneous presence of quantized measurements and stochastic inner coupling, the prescribed variance constraints on the estimation error and the desired performance requirements are guaranteed over a finite horizon. Sufficient conditions are established by means of a series of recursive linear matrix inequalities, and subsequently, the estimator gain parameters are derived. A simulation example is presented to illustrate the effectiveness and applicability of the proposed estimator design algorithm.
Collapse
|
14
|
UFIR Filtering for GPS-Based Tracking over WSNs with Delayed and Missing Data. JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING 2018. [DOI: 10.1155/2018/7456010] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
In smart cities, vehicles tracking is organized to increase safety by localizing cars using the Global Positioning System (GPS). The GPS-based system provides accurate tracking but is also required to be reliable and robust. As a main estimator, we propose using the unbiased finite impulse response (UFIR) filter, which meets these needs as being more robust than the Kalman filter (KF). The UFIR filter is developed for vehicle tracking in discrete-time state-space over wireless sensor networks (WSNs) with time-stamped data discretely delayed on k-step-lags and missing data. The state-space model is represented in a way such that the UFIR filter, KF, and H∞ filter can be used universally. Applications are given for measurement data, which are cooperatively transferred from a vehicle to a central station through several nodes with k-step-lags. Better tracking performance of the UFIR filter is shown experimentally.
Collapse
|
15
|
Song Y, Hu J, Chen D, Liu Y, Alsaadi FE, Sun G. A resilience approach to state estimation for discrete neural networks subject to multiple missing measurements and mixed time-delays. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2017.06.065] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
16
|
State estimation for neural networks with jumping interval weight matrices and transmission delays. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2017.09.043] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
17
|
Zha L, Fang JA, Liu J, Tian E. Event-triggered non-fragile state estimation for delayed neural networks with randomly occurring sensor nonlinearity. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2017.08.011] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
18
|
State Estimation for General Complex Dynamical Networks with Incompletely Measured Information. ENTROPY 2017; 20:e20010005. [PMID: 33265096 PMCID: PMC7512260 DOI: 10.3390/e20010005] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/16/2017] [Revised: 12/17/2017] [Accepted: 12/20/2017] [Indexed: 11/16/2022]
Abstract
Estimating uncertain state variables of a general complex dynamical network with randomly incomplete measurements of transmitted output variables is investigated in this paper. The incomplete measurements, occurring randomly through the transmission of output variables, always cause the failure of the state estimation process. Different from the existing methods, we propose a novel method to handle the incomplete measurements, which can perform well to balance the excessively deviated estimators under the influence of incomplete measurements. In particular, the proposed method has no special limitation on the node dynamics compared with many existing methods. By employing the Lyapunov stability theory along with the stochastic analysis method, sufficient criteria are deduced rigorously to ensure obtaining the proper estimator gains with known model parameters. Illustrative simulation for the complex dynamical network composed of chaotic nodes are given to show the validity and efficiency of the proposed method.
Collapse
|
19
|
Choi HD, Ahn CK, Karimi HR, Lim MT. Filtering of Discrete-Time Switched Neural Networks Ensuring Exponential Dissipative and $l_{2}$ - $l_{\infty }$ Performances. IEEE TRANSACTIONS ON CYBERNETICS 2017; 47:3195-3207. [PMID: 28166518 DOI: 10.1109/tcyb.2017.2655725] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
This paper studies delay-dependent exponential dissipative and l2 - l∞ filtering problems for discrete-time switched neural networks (DSNNs) including time-delayed states. By introducing a novel discrete-time inequality, which is a discrete-time version of the continuous-time Wirtinger-type inequality, we establish new sets of linear matrix inequality (LMI) criteria such that discrete-time filtering error systems are exponentially stable with guaranteed performances in the exponential dissipative and l2 - l∞ senses. The design of the desired exponential dissipative and l2 - l∞ filters for DSNNs can be achieved by solving the proposed sets of LMI conditions. Via numerical simulation results, we show the validity of the desired discrete-time filter design approach.
Collapse
|
20
|
Design of state estimator for BAM fuzzy cellular neural networks with leakage and unbounded distributed delays. Inf Sci (N Y) 2017. [DOI: 10.1016/j.ins.2017.02.056] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
21
|
Non-fragile H∞ state estimation for nonlinear networked system with probabilistic diverging disturbance and multiple missing measurements. Neurocomputing 2017. [DOI: 10.1016/j.neucom.2016.12.018] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
22
|
State estimation for recurrent neural networks with unknown delays: A robust analysis approach. Neurocomputing 2017. [DOI: 10.1016/j.neucom.2016.07.061] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
23
|
Ding S, Wang Z, Wang J, Zhang H. H∞state estimation for memristive neural networks with time-varying delays: The discrete-time case. Neural Netw 2016; 84:47-56. [DOI: 10.1016/j.neunet.2016.08.002] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2016] [Revised: 07/28/2016] [Accepted: 08/08/2016] [Indexed: 10/21/2022]
|
24
|
Sheng L, Wang Z, Tian E, Alsaadi FE. Delay-distribution-dependent H ∞ state estimation for delayed neural networks with (x,v)-dependent noises and fading channels. Neural Netw 2016; 84:102-112. [PMID: 27718389 DOI: 10.1016/j.neunet.2016.08.013] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2016] [Revised: 07/12/2016] [Accepted: 08/30/2016] [Indexed: 10/21/2022]
Abstract
This paper deals with the H∞ state estimation problem for a class of discrete-time neural networks with stochastic delays subject to state- and disturbance-dependent noises (also called (x,v)-dependent noises) and fading channels. The time-varying stochastic delay takes values on certain intervals with known probability distributions. The system measurement is transmitted through fading channels described by the Rice fading model. The aim of the addressed problem is to design a state estimator such that the estimation performance is guaranteed in the mean-square sense against admissible stochastic time-delays, stochastic noises as well as stochastic fading signals. By employing the stochastic analysis approach combined with the Kronecker product, several delay-distribution-dependent conditions are derived to ensure that the error dynamics of the neuron states is stochastically stable with prescribed H∞ performance. Finally, a numerical example is provided to illustrate the effectiveness of the obtained results.
Collapse
Affiliation(s)
- Li Sheng
- College of Information and Control Engineering, China University of Petroleum (East China), Qingdao 266580, China
| | - Zidong Wang
- College of Electrical Engineering and Automation, Shandong University of Science and Technology, Qingdao 266590, China; Department of Computer Science, Brunel University London, Uxbridge, Middlesex, UB8 3PH, United Kingdom.
| | - Engang Tian
- School of Electrical and Automation Engineering, Nanjing Normal University, Nanjing 210023, China
| | - Fuad E Alsaadi
- Faculty of Engineering, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| |
Collapse
|