Output-Feedback Robust Control of Uncertain Systems via Online Data-Driven Learning

Adaptive neural identification and non-singular control of pure-feedback nonlinear systems

This paper proposes a new constructive identification and adaptive control method for nonlinear pure-feedback systems, which remedies the 'explosion of complexity' and potential control singularity encountered in the traditional adaptive backstepping controllers. First, to avoid using the backstepping recursive design, alternative state variables and the corresponding coordinate transformation are introduced to reformulate the pure-feedback system into an equivalent canonical model. Then, a high-order sliding mode (HOSM) observer is used to reconstruct the unknown states for this canonical model. To remedy the potential singularity in the control, the unknown system dynamics are lumped to derive an alternative identification structure and one-step control synthesis, where two radial basis function neural networks (RBFNN) are adopted to online estimate these lumped dynamics. In this framework, the online estimation of control gain is not in the denominator of controller, and thus the division by zero in the controllers is avoided. Finally, a new online learning algorithm is constructed to obtain the RBFNNs' weights, ensuring the convergence to the neighborhood of true values and allowing accurate identification of unknown dynamics. Theoretical analysis elaborates that the convergence of both the tracking error and the estimation error is obtained simultaneously. Simulations and practical experiments on a hydraulic servo test-rig verify the effectiveness and utility of the suggested methods.

Reinforcement learning based proportional-integral-derivative controllers design for consensus of multi-agent systems

This paper develops a novel Proportional-Integral-Derivative (PID) tuning method for multi-agent systems with a reinforced self-learning capability for achieving the optimal consensus of all agents. Unlike the traditional model-based and data-driven PID tuning methods, the developed PID self-learning method updates the controller parameters by actively interacting with unknown environment, with the outcomes of guaranteed consensus and performance optimization of agents. Firstly, the PID control-based consensus problem of multi-agent systems is formulated. Then, finding the PID gains is converted into solving a nonzero-sum game problem, thus an off-policy Q-learning algorithm with the critic-only structure is proposed to update the PID gains using only data, without the knowledge of dynamics of agents. Finally, simulations are given to verify the effectiveness of the proposed method.

Offline and Online Adaptive Critic Control Designs With Stability Guarantee Through Value Iteration

This article is concerned with the stability of the closed-loop system using various control policies generated by value iteration. Some stability properties involving admissibility criteria, the attraction domain, and so forth, are investigated. An offline integrated value iteration (VI) scheme with a stability guarantee is developed by combining the advantages of VI and policy iteration, which is convenient to obtain admissible control policies. Also, based on the concept of attraction domain, an online adaptive dynamic programming algorithm using immature control policies is developed. Remarkably, it is ensured that the state trajectory under the online algorithm converges to the origin. Particularly, for linear systems, the online ADP algorithm with a general scheme possesses more enhanced stability property. The theoretical results reveal that the stability of the linear system can be guaranteed even if the control policy sequence includes finite unstable elements. The numerical results verify the effectiveness of the present algorithms.

Data-Driven Robust Control Using Reinforcement Learning

This paper proposes a robust control design method using reinforcement learning for controlling partially-unknown dynamical systems under uncertain conditions. The method extends the optimal reinforcement learning algorithm with a new learning technique based on the robust control theory. By learning from the data, the algorithm proposes actions that guarantee the stability of the closed-loop system within the uncertainties estimated also from the data. Control policies are calculated by solving a set of linear matrix inequalities. The controller was evaluated using simulations on a blood glucose model for patients with Type 1 diabetes. Simulation results show that the proposed methodology is capable of safely regulating the blood glucose within a healthy level under the influence of measurement and process noises. The controller has also significantly reduced the post-meal fluctuation of the blood glucose. A comparison between the proposed algorithm and the existing optimal reinforcement learning algorithm shows the improved robustness of the closed-loop system using our method.

Method and Test Bench for Hydro-Mechanical Continuously Variable Transmission Based on Multi-Level Test and Verification

According to the structural characteristics of Hydro-mechanical continuously variable transmission (HMCVT), a multi-functional test bench was developed, and the basic structure, working principle, and test functions of the test bench were introduced. The test bench has the following characteristics: To analyze the impact of mechanical transmission and hydraulic transmission on the HMCVT transmission system, the performance can be tested separately by using a test bench; the coupling characteristics of the hydraulic transmission and mechanical transmission can also be tested; it can also test and verify the performance of the HMCVT transmission system and the control system; the test bench has a simple structure, diverse functions, and convenient operation. Using the multi-functional test bench, this paper proposes a method of multi-level test and verification. Through this method, the simulation models are revised and improved many times, and the accuracy of the models is improved, which are consistent with the physical model, and eventually, the accuracy of the simulation result is improved. This method is used to test and verify the hydraulic transmission system, analyze the characteristics of the hydraulic transmission system, and verify the feasibility and practicability of the multi-level verification method.

TSM-Based Adaptive Fuzzy Control of Robotic Manipulators with Output Constraints

This paper proposes an adaptive control scheme based on terminal sliding mode (TSM) for robotic manipulators with output constraints and unknown disturbances. The fuzzy logic system (FLS) is developed to approximate unknown dynamics of robotic manipulators. An error transformation technique is used in the process of controller design to ensure that the output constraints are not violated. The advantage of the error transformation compared to traditional barrier Lyapunov functions (BLFs) is that there is no need to design a virtual controller. Thus, the design complexity of the controller is reduced. Through Lyapunov stability analysis, the system state can be proved to converge to the neighborhood near the balanced point in finite time. Extensive simulation results illustrated the validity of the proposed controller.