1
|
Cai M, Yuan Y, Luo B, Li F, Xu X, Yang C, Gui W. Adaptive Neural Consensus Observer Networks Design for a Class of Semilinear Parabolic PDE Systems. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:5734-5746. [PMID: 38598392 DOI: 10.1109/tnnls.2024.3383030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/12/2024]
Abstract
This article concerns the investigation on the consensus problem for the joint state-uncertainty estimation of a class of parabolic partial differential equation (PDE) systems with parametric and nonparametric uncertainties. We propose a two-layer network consisting of informed and uninformed boundary observers where novel adaptation laws are developed for the identification of uncertainties. Particularly, all observer agents in the network transmit their information with each other across the entire network. The proposed adaptation laws include a penalty term of the mismatch between the parameter estimates generated by the other observer agents. Moreover, for the nonparametric uncertainties, radial basis function (RBF) neural networks are employed for the universal approximation of unknown nonlinear functions. Given the persistently exciting condition, it is shown that the proposed network of adaptive observers can achieve exponential joint state-uncertainty estimation in the presence of parametric uncertainties and ultimate bounded estimation in the presence of nonparametric uncertainties based on the Lyapunov stability theory. The effects of the proposed consensus method are demonstrated through a typical reaction-diffusion system example, which implies convincing numerical findings.
Collapse
|
2
|
Fang Y, Zhang J, Li Y. Neural networks adaptive predefined-time control for pure-feedback nonlinear systems: a case study on robotic exoskeleton systems. Sci Rep 2025; 15:6041. [PMID: 39972119 PMCID: PMC11839909 DOI: 10.1038/s41598-025-90002-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2024] [Accepted: 02/10/2025] [Indexed: 02/21/2025] Open
Abstract
A predefined-time (PT) tracking adaptive control method is studied for non-affine pure-feedback nonlinear systems, with an emphasis on its practical application in robotic exoskeleton technology. A novel PT neural networks control algorithm is implemented, by leveraging the approximation capabilities of neural networks, backstepping technique, barrier functions and Mean Value Theorem. The neural networks are used to approximate the unknown nonlinearities inherent in the system's control dynamics, while the adaptive law is meticulously designed based on the PT Lyapunov stability criterion. By Lyapunov PT theory, the developed methodology guarantees the system's convergence within a pre-established time, therefore offering enhanced performance over conventional fixed-time control methodologies. Simulation results validate the efficacy of this proposed control approach, demonstrating its practical implications for controlling robotic exoskeletons under state constraints, thus validating its potential for real-world applications.
Collapse
Affiliation(s)
- Yuehua Fang
- College of Mathematics and Computer Science, Hengshui University, Hebei, 053000, China
| | - Jianhua Zhang
- School of Information and Control Engineering, Qingdao University of Technology, Qingdao, 266520, China.
| | - Yinguang Li
- School of Information and Control Engineering, Qingdao University of Technology, Qingdao, 266520, China
| |
Collapse
|
3
|
Luo A, Zhou Q, Ma H, Li H. Observer-Based Consensus Control for MASs With Prescribed Constraints via Reinforcement Learning Algorithm. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:17281-17291. [PMID: 37603472 DOI: 10.1109/tnnls.2023.3301538] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/23/2023]
Abstract
In this article, an adaptive optimal consensus control problem is studied for multiagent systems (MASs) with external disturbances, unmeasurable states, and prescribed constraints. First, by using neural networks (NNs), a composite observer is constructed to estimate the unmeasurable states and disturbances simultaneously. Then, the consensus error is guaranteed within a prescribed boundary by presenting an improved prescribed performance control (PPC) technique, and the initial conditions for the error are eliminated. In addition, the updating laws of actor-critic NNs are established by using a simplified reinforcement learning (RL) algorithm based on the uniqueness of optimal solution, and the asymmetric input saturation is resolved by designing auxiliary system instead of using nonquadratic cost functions in other optimal control methods. Finally, the boundedness of all signals in the closed-loop system is proved by using Lyapunov stability theory. The effectiveness of the proposed control method is verified by a simulation example.
Collapse
|
4
|
Ma L, Zhu F, Zhao X. Human-in-the-Loop Consensus Control for Multiagent Systems With External Disturbances. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:11024-11034. [PMID: 37027750 DOI: 10.1109/tnnls.2023.3246567] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
In this article, the human-in-the-loop leader-follower consensus control problem is addressed for multiagent systems (MASs) with unknown external disturbances. A human operator is deployed to monitor the MASs' team by transmitting an execution signal to a nonautonomous leader in response to any hazard detected, with the control input of the leader unknown to all followers. For each follower, a full-order observer, in which the observer error dynamic system decouples the unknown disturbance input, is designed for asymptotic state estimation. Then, an interval observer is constructed for the consensus error dynamic system, where the unknown disturbances and control inputs of its neighbors and its disturbance are treated as unknown inputs (UIs). To process the UIs, a new asymptotic algebraic UI reconstruction (UIR) scheme is proposed based on the interval observer, and one of the significant features of the UIR is the capacity to decouple the control input of the follower. The subsequent human-in-the-loop asymptotic convergence consensus protocol is developed by applying an observer-based distributed control strategy. Finally, the proposed control scheme is validated through two simulation examples.
Collapse
|
5
|
Chen L, Dai SL, Dong C. Adaptive Optimal Tracking Control of an Underactuated Surface Vessel Using Actor-Critic Reinforcement Learning. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:7520-7533. [PMID: 36449582 DOI: 10.1109/tnnls.2022.3214681] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
In this article, we present an adaptive reinforcement learning optimal tracking control (RLOTC) algorithm for an underactuated surface vessel subject to modeling uncertainties and time-varying external disturbances. By integrating backstepping technique with the optimized control design, we show that the desired optimal tracking performance of vessel control is guaranteed due to the fact that the virtual and actual control inputs are designed as optimized solutions of every subsystem. To enhance the robustness of vessel control systems, we employ neural network (NN) approximators to approximate uncertain vessel dynamics and present adaptive control technique to estimate the upper boundedness of external disturbances. Under the reinforcement learning framework, we construct actor-critic networks to solve the Hamilton-Jacobi-Bellman equations corresponding to subsystems of surface vessel to achieve the optimized control. The optimized control algorithm can synchronously train the adaptive parameters not only for actor-critic networks but also for NN approximators and adaptive control. By Lyapunov stability theorem, we show that the RLOTC algorithm can ensure the semiglobal uniform ultimate boundedness of the closed-loop systems. Compared with the existing reinforcement learning control results, the presented RLOTC algorithm can compensate for uncertain vessel dynamics and unknown disturbances, and obtain the optimized control performance by considering optimization in every backstepping design. Simulation studies on an underactuated surface vessel are given to illustrate the effectiveness of the RLOTC algorithm.
Collapse
|
6
|
Guo Z, Li H, Ma H, Meng W. Distributed Optimal Attitude Synchronization Control of Multiple QUAVs via Adaptive Dynamic Programming. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:8053-8063. [PMID: 36446013 DOI: 10.1109/tnnls.2022.3224029] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
This article proposes a distributed optimal attitude synchronization control strategy for multiple quadrotor unmanned aerial vehicles (QUAVs) through the adaptive dynamic programming (ADP) algorithm. The attitude systems of QUAVs are modeled as affine nominal systems subject to parameter uncertainties and external disturbances. Considering attitude constraints in complex flying environments, a one-to-one mapping technique is utilized to transform the constrained systems into equivalent unconstrained systems. An improved nonquadratic cost function is constructed for each QUAV, which reflects the requirements of robustness and the constraints of control input simultaneously. To overcome the issue that the persistence of excitation (PE) condition is difficult to meet, a novel tuning rule of critic neural network (NN) weights is developed via the concurrent learning (CL) technique. In terms of the Lyapunov stability theorem, the stability of the closed-loop system and the convergence of critic NN weights are proved. Finally, simulation results on multiple QUAVs show the effectiveness of the proposed control strategy.
Collapse
|
7
|
Zhang JX, Yang T, Chai T. Neural Network Control of Underactuated Surface Vehicles With Prescribed Trajectory Tracking Performance. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:8026-8039. [PMID: 37015439 DOI: 10.1109/tnnls.2022.3223666] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
This article is concerned with the fast and accurate trajectory tracking control problem for a sort of underactuated surface vehicle under model uncertainties and environmental disturbances. A novel neural networks (NNs)-based prescribed performance control strategy is proposed to solve the problem. In the control design, a new type of performance function is constructed which provides a way to predefine the settling time and accuracy, straightforward. Then, a pair of barrier functions are employed to combat not only the position error but also the virtual control input. This evades the possible singularity or discontinuity of the control solution. Next, an initialization technique is exploited, removing the requirement for the initial condition of the control system. Finally, two NNs are employed to deal with the unknown ship nonlinearities. The performance analysis not only demonstrates the effectiveness of the proposed approach but also reveals its robustness against disturbances and unknown reference trajectory derivatives. There is, thus, no need to acquire such knowledge or employ specialized tools to handle disturbances. The theoretical findings are illustrated by a simulation study.
Collapse
|
8
|
Du X, Zhan X, Wu J, Yan H. Effects of Two-Channel Noise and Packet Loss on Performance of Information Time Delay Systems. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:8549-8556. [PMID: 37015669 DOI: 10.1109/tnnls.2022.3230648] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
The performance limitations of multiple-input multiple-output (MIMO) information time delay system (ITDS) with packet loss, codec and white Gaussian noise (WGN) are investigated in this article. By using the spectrum decomposition technique, inner-outer factorization, and partial factorization techniques, the expression of performance limitations is obtained under the two-degree-of-freedom (2DOF) compensator. The theoretical analysis results demonstrate that the system performance is related to the time delay, non-minimum phase (NMP) zeros, unstable zeros and their directions in a given device. In addition, WGN, packet loss and codec also impact the performance. Finally, the theoretical results are verified by simulation examples. Simulation results show that packet loss rate and encoding and decoding have a greater impact on system performance.
Collapse
|
9
|
Zhou H, Tong S. Adaptive Neural Network Event-Triggered Output-Feedback Containment Control for Nonlinear MASs With Input Quantization. IEEE TRANSACTIONS ON CYBERNETICS 2023; 53:7406-7416. [PMID: 37028360 DOI: 10.1109/tcyb.2023.3249154] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
This article investigates the adaptive neural network (NN) event-triggered containment control problem for a class of nonlinear multiagent systems (MASs). Since the considered nonlinear MASs contain unknown nonlinear dynamics, immeasurable states, and quantized input signals, the NNs are adopted to model unknown agents, and an NN state observer is established by using the intermittent output signal. Subsequently, a novel event-triggered mechanism consisting of both the sensor-to-controller and controller-to-actuator channels are established. By decomposing quantized input signals into the sum of two bounded nonlinear functions and based on the adaptive backstepping control and first-order filter design theories, an adaptive NN event-triggered output-feedback containment control scheme is formulated. It is proved that the controlled system is semi-globally uniformly ultimately bounded (SGUUB) and the followers are within a convex hull formed by the leaders. Finally, a simulation example is given to validate the effectiveness of the presented NN containment control scheme.
Collapse
|
10
|
Zhu Z, Zhu Q. Fixed-time adaptive neural self-triggered decentralized control for stochastic nonlinear systems with strong interconnections. Neurocomputing 2023. [DOI: 10.1016/j.neucom.2022.12.030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
11
|
Zheng X, Li XM, Yao D, Li H, Lu R. Observer-Based Finite-Time Consensus Control for Multiagent Systems with Nonlinear Faults. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.11.034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|