Observer-Based NN Control for Nonlinear Systems With Full-State Constraints and External Disturbances

Reinforcement Learning for Robust Dynamic Event-Driven Constrained Control

We consider a robust dynamic event-driven control (EDC) problem of nonlinear systems having both unmatched perturbations and unknown styles of constraints. Specifically, the constraints imposed on the nonlinear systems' input could be symmetric or asymmetric. Initially, to tackle such constraints, we construct a novel nonquadratic cost function for the constrained auxiliary system. Then, we propose a dynamic event-triggering mechanism relied on the time-based variable and the system states simultaneously for cutting down the computational load. Meanwhile, we show that the robust dynamic EDC of original nonlinear-constrained systems could be acquired by solving the event-driven optimal control problem of the constrained auxiliary system. After that, we develop the corresponding event-driven Hamilton-Jacobi-Bellman equation, and then solve it through a unique critic neural network (CNN) in the reinforcement learning framework. To relax the persistence of excitation condition in tuning CNN's weights, we incorporate experience replay into the gradient descent method. With the aid of Lyapunov's approach, we prove that the closed-loop auxiliary system and the weight estimation error are uniformly ultimately bounded stable. Finally, two examples, including a nonlinear plant and the pendulum system, are utilized to validate the theoretical claims.

Observer-Based Consensus Control for MASs With Prescribed Constraints via Reinforcement Learning Algorithm

In this article, an adaptive optimal consensus control problem is studied for multiagent systems (MASs) with external disturbances, unmeasurable states, and prescribed constraints. First, by using neural networks (NNs), a composite observer is constructed to estimate the unmeasurable states and disturbances simultaneously. Then, the consensus error is guaranteed within a prescribed boundary by presenting an improved prescribed performance control (PPC) technique, and the initial conditions for the error are eliminated. In addition, the updating laws of actor-critic NNs are established by using a simplified reinforcement learning (RL) algorithm based on the uniqueness of optimal solution, and the asymmetric input saturation is resolved by designing auxiliary system instead of using nonquadratic cost functions in other optimal control methods. Finally, the boundedness of all signals in the closed-loop system is proved by using Lyapunov stability theory. The effectiveness of the proposed control method is verified by a simulation example.

Event-Triggered-Based Distributed Consensus Tracking for Nonlinear Multiagent Systems With Quantization

In this article, an observer-based adaptive neural network (NN) event-triggered distributed consensus tracking problem is investigated for nonlinear multiagent systems with quantization. In the first place, the limited capacity of the communication channel between agents is considered. The event-trigger mechanism and dynamic uniform quantizers are set up to reduce information transmission. The next NN is utilized to handle the unknown nonlinear functions. Finally, in order to estimate the unmeasurable states, an NN-based state observer is designed for each agent by using a dynamic gain function. To settle the difficulty caused by the coupling effects of event-triggered conditions and the scaling function in dynamic uniform quantizers and observers, a distributed control protocol with estimated information of its neighbors is designed, which ensures distributed consensus tracking of the nonlinear multiagent systems without incurring the Zeno behavior. The effectiveness of the control protocol is illustrated by a simulation example.