Adaptive Learning and Sampled-Control for Nonlinear Game Systems Using Dynamic Event-Triggering Strategy

Event-Trigger Reinforcement Learning-Based Coordinate Control of Modular Unmanned System via Nonzero-Sum Game

Decreasing the position error and control torque is important for the coordinate control of a modular unmanned system with less communication burden between the sensor and the actuator. Therefore, this paper proposes event-trigger reinforcement learning (ETRL)-based coordinate control of a modular unmanned system (MUS) via the nonzero-sum game (NZSG) strategy. The dynamic model of the MUS is established via joint torque feedback (JTF) technology. Based on the NZSG strategy, the existing coordinate control problem is transformed into an RL issue. With the help of the ET mechanism, the periodic communication mechanism of the system is avoided. The ET-critic neural network (NN) is used to approximate the performance index function, thus obtaining the ETRL coordinate control policy. The stability of the closed-loop system is verified via Lyapunov's theorem. Experiment results demonstrate the validity of the proposed method. The experimental results show that the proposed method reduces the position error by 30% and control torque by 10% compared with the existing control methods.

Dynamic Event-Triggered Strategy-Based Optimal Control of Modular Robot Manipulator: A Multiplayer Nonzero-Sum Game Perspective

Due to the limited computing and processing ability of modular robot manipulator (MRM) components, such as sensors and controllers, event-triggered mechanisms are considered a crucial communication paradigm shift in resource constrained applications. Dynamic event-triggered mechanism is developing into a new technology by reason of its higher resource utilization efficiency and more flexible system design requirements than traditional event-triggered. Therefore, an optimal control scheme of multiplayer nonzero-sum game based on dynamic event-triggered is developed for MRM systems with uncertain disturbances. First, dynamic model of the MRM is established according to joint torque feedback technique and model uncertainty is estimated by data-driven-based neural network identifier. In the framework of differential game, the tracking control problem of MRM system is transformed into the optimal control problem for multiplayer nonzero-sum game with the control input of each joint module as the player. Then, the static event-triggered control problem of MRM system is studied based on adaptive dynamic programming algorithm. On this basis, the internal dynamic variable describing the previous state of the system is introduced, and the characteristics of dynamic trigger rule and its relationship with static rule are revealed theoretically. By designing an exponential attenuation signal, the minimum sampling interval of the system is always positive, so that Zeno behavior is excluded. Lyapunov theory proves that the system is asymptotically stable and the experimental results verify the validity of the proposed method.

Event-Triggered Adaptive Neural Impedance Control of Robotic Systems

This article presents an event-triggered adaptive neural impedance control (ETANIC) scheme for robotic systems, where the combination of impedance control (IC) and event-triggered mechanism can significantly reduce the computational burden and the communication cost under the premise of ensuring the stability and tracking performances of the robotic systems. The IC is used to achieve the compliant behavior of the robotic systems in response to the environment. The uncertainties of the robotic systems are estimated by the radial basis function neural network (RBFNN), and the update laws for RBFNN are derived from the designed Lyapunov function. The stability of the whole closed-loop control system is analyzed by the Lyapunov theory, and the event-triggered conditions are designed to avoid the Zeno behavior. The numerical simulation and experimental tests demonstrate that the proposed ETANIC scheme can achieve better efficiency for controlling the robotic systems to perform the interaction tasks with the environment in comparison to the adaptive neural IC (ANIC).

Sparse successive approximation for nonlinear H2 and H∞ optimal control problems under residual errors

Successive approximation techniques are effective approaches to solve the Hamilton-Jacobi-Bellman (HJB)/Hamilton-Jacobi-Isaacs (HJI) equations in nonlinear H2 and H∞ optimal control problems (OCPs), but residual errors in the solving process may destroy its convergence property, and related numerical methods also pose computational burden and difficulties. In this paper, the HJB/HJI partial differential equations (PDEs) for infinite-horizon nonlinear H2 and H∞ OCPs are handled in a unified formulation, and a sparse successive approximation method is proposed. Taking advantage of successive approximation techniques, the nonlinear HJB/HJI PDEs are transformed into sequences of easily solvable linear PDEs, to which the solutions can be computed point-wise by handling simple initial value problems. Extra constraints are also incorporated in the solving process to guarantee the convergence under residual errors. The sparse grid based collocation points and basis functions are then employed to enable efficient numerical implementation. The performance of the proposed method is also numerically demonstrated in simulations.

Event-triggered adaptive optimal tracking control for nonlinear stochastic systems with dynamic state constraints

This paper investigates the issue of event-triggered adaptive optimal tracking control for uncertain nonlinear systems with stochastic disturbances and dynamic state constraints. To handle the dynamic state constraints, a novel unified tangent-type nonlinear mapping function is proposed. A neural networks (NNs)-based identifier is designed to cope with the stochastic disturbances. By utilizing adaptive dynamic programming (ADP) of identifier-actor-critic architecture and event triggering mechanism, the adaptive optimized event-triggered control (ETC) approach for the nonlinear stochastic system is first proposed. It is proven that the designed optimized ETC approach guarantees the robustness of the stochastic systems and the semi-globally uniformly ultimately bounded in the mean square of the NNs adaptive estimation error, and the Zeno behavior can be avoided. Simulations are offered to illustrate the effectiveness of the proposed control approach.