Adaptive Neural Control of Underactuated Surface Vessels With Prescribed Performance Guarantees

Trajectory tracking control for ships with fixed-time prescribed performance considering input saturation and dead zone

To enable underactuated ships to achieve trajectory tracking under unknown external disturbances, model uncertainties, and actuator saturation and dead zone, a fixed-time prescribed performance trajectory tracking control method is designed. Firstly, the position tracking errors are constrained by designing the barrier Lyapunov function, and the prescribed performance function is set as the constraint boundary to address the issue of fixed constraint boundaries in traditional methods. Secondly, RBF neural networks are employed to estimate the model uncertainties, and adaptive laws are used to estimate the upper bound of the composite disturbances. Finally, the controller is designed by incorporating fixed-time convergence theory and further using fixed-time sliding mode surface in order to overcome the shortcomings of traditional control algorithms in terms of slow response and the use of finite-time convergence with respect to the initial state. Through Lyapunov stability analysis, it is proven that all signals in the closed-loop system are bounded, and the velocity tracking errors can achieve global fixed-time convergence. Simulation results demonstrate that the proposed control scheme enables underactuated ship to achieve trajectory tracking even in the presence of input saturation and dead zone. Statistical results show that the performance indicators of the proposed controller are significantly smaller than those of the first group in the comparative experiments, with a shorter settling time. Moreover, compared to traditional saturation handling methods, the input curves of the proposed controller are smoother and more aligned with practical engineering requirements.

Selective Memory Recursive Least Squares: Recast Forgetting Into Memory in RBF Neural Network-Based Real-Time Learning

In radial basis function neural network (RBFNN)-based real-time learning tasks, forgetting mechanisms are widely used such that the neural network can keep its sensitivity to new data. However, with forgetting mechanisms, some useful knowledge will get lost simply because they are learned a long time ago, which we refer to as the passive knowledge forgetting phenomenon. To address this problem, this article proposes a real-time training method named selective memory recursive least squares (SMRLS) in which the classical forgetting mechanisms are recast into a memory mechanism. Different from the forgetting mechanism, which mainly evaluates the importance of samples according to the time when samples are collected, the memory mechanism evaluates the importance of samples through both temporal and spatial distribution of samples. With SMRLS, the input space of the RBFNN is evenly divided into a finite number of partitions, and a synthesized objective function is developed using synthesized samples from each partition. In addition to the current approximation error, the neural network also updates its weights according to the recorded data from the partition being visited. Compared with classical training methods including the forgetting factor recursive least squares (FFRLS) and stochastic gradient descent (SGD) methods, SMRLS achieves improved learning speed and generalization capability, which are demonstrated by corresponding simulation results.

Adaptive Optimal Tracking Control of an Underactuated Surface Vessel Using Actor-Critic Reinforcement Learning

In this article, we present an adaptive reinforcement learning optimal tracking control (RLOTC) algorithm for an underactuated surface vessel subject to modeling uncertainties and time-varying external disturbances. By integrating backstepping technique with the optimized control design, we show that the desired optimal tracking performance of vessel control is guaranteed due to the fact that the virtual and actual control inputs are designed as optimized solutions of every subsystem. To enhance the robustness of vessel control systems, we employ neural network (NN) approximators to approximate uncertain vessel dynamics and present adaptive control technique to estimate the upper boundedness of external disturbances. Under the reinforcement learning framework, we construct actor-critic networks to solve the Hamilton-Jacobi-Bellman equations corresponding to subsystems of surface vessel to achieve the optimized control. The optimized control algorithm can synchronously train the adaptive parameters not only for actor-critic networks but also for NN approximators and adaptive control. By Lyapunov stability theorem, we show that the RLOTC algorithm can ensure the semiglobal uniform ultimate boundedness of the closed-loop systems. Compared with the existing reinforcement learning control results, the presented RLOTC algorithm can compensate for uncertain vessel dynamics and unknown disturbances, and obtain the optimized control performance by considering optimization in every backstepping design. Simulation studies on an underactuated surface vessel are given to illustrate the effectiveness of the RLOTC algorithm.

Neural Network Control of Underactuated Surface Vehicles With Prescribed Trajectory Tracking Performance

This article is concerned with the fast and accurate trajectory tracking control problem for a sort of underactuated surface vehicle under model uncertainties and environmental disturbances. A novel neural networks (NNs)-based prescribed performance control strategy is proposed to solve the problem. In the control design, a new type of performance function is constructed which provides a way to predefine the settling time and accuracy, straightforward. Then, a pair of barrier functions are employed to combat not only the position error but also the virtual control input. This evades the possible singularity or discontinuity of the control solution. Next, an initialization technique is exploited, removing the requirement for the initial condition of the control system. Finally, two NNs are employed to deal with the unknown ship nonlinearities. The performance analysis not only demonstrates the effectiveness of the proposed approach but also reveals its robustness against disturbances and unknown reference trajectory derivatives. There is, thus, no need to acquire such knowledge or employ specialized tools to handle disturbances. The theoretical findings are illustrated by a simulation study.

Event-Based Adaptive NN Fixed-Time Cooperative Formation for Multiagent Systems

This article focuses on the fixed-time formation control problem for nonlinear multiagent systems (MASs) with dynamic uncertainties and limited communication resources. Under the framework of the backstepping method, a time-varying formation function is introduced in the controller design. To attain the prescribed transient and steady-state performance of MASs, a fixed-time prescribed performance function (FTPPF) is designed and the further coordinate transformation addressing the zero equilibrium point problem is removed. To achieve better approximating performance, a neural network (NN)-based composite dynamic surface control (CDSC) strategy is proposed, where the CDSC scheme is consisted of prediction errors and serial-parallel estimation models. According to the signals generated by the estimation models, disturbance observers are established to overcome the difficulty from approximating errors and mismatched disturbances. Moreover, an improved dynamic event-triggered mechanism and varying threshold parameters are constructed to reduce the signal transmission frequency. Via the Lyapunov stability theory, all the signals in the closed-loop system are semi-globally uniformly ultimately bounded. Finally, the simulation results verify the effectiveness of the developed CDSC strategy.

Partial-Neurons-Based Proportional-Integral Observer Design for Artificial Neural Networks: A Multiple Description Encoding Scheme

This article is concerned with a new partial-neurons-based proportional-integral observer (PIO) design problem for a class of artificial neural networks (ANNs) subject to bounded disturbances. For the purpose of improving the reliability of the data transmission, the multiple description encoding mechanisms are exploited to encode the measurement data into two identically important descriptions, and the encoded data are then transmitted to the decoders via two individual communication channels susceptible to packet dropouts, where Bernoulli-distributed stochastic variables are utilized to characterize the random occurrence of the packet dropouts. An explicit relationship is discovered that quantifies the influences of the packet dropouts on the decoding accuracy, and a sufficient condition is provided to assess the boundedness of the estimation error dynamics. Furthermore, the desired PIO parameters are calculated by solving two optimization problems based on two metrics (i.e., the smallest ultimate bound and the fastest decay rate) characterizing the estimation performance. Finally, the applicability and advantage of the proposed PIO design strategy are verified by means of an illustrative example.

Collision-free automatic berthing of maritime autonomous surface ships via safety-certified active disturbance rejection control

This paper addresses the automatic berthing of a maritime autonomous surface ship operating in a confined water environment subject to static obstacles, dynamic obstacles, thruster constraints, and space constraints due to shorelines. A safety-certified active disturbance rejection control (ADRC) method is proposed for achieving the automatic berthing task of an MASS in the presence of model uncertainties and ocean disturbances. An extended state observer (ESO) based on a second-order robust exact differentiator (RED) is employed to estimate an extended state vector consisting of internal model uncertainties and external ocean disturbances. With the aid of the RED-based ESO, a nominal ADRC law is designed to achieve the position and heading stabilization. To avoid collisions with static obstacles, dynamic obstacles, and shorelines, input-to-state safe high-order control barrier functions are used to guarantee safety. Optimized control signals are obtained based on a constrained quadratic programming (QP) problem within safety constraints. In order to translate the control signals into the individual thruster command, a constrained QP problem is further used to search for optimized commands in real time. It is proven that the closed-loop automatic berthing system is input-to-state stable. By using the proposed method, the MASS is able to reach the desired position and heading with collision avoidance. Simulation results verify the effectiveness of the proposed safety-certified ADRC method for automatic berthing.

Reinforcement Learning-Based Fractional-Order Adaptive Fault-Tolerant Formation Control of Networked Fixed-Wing UAVs With Prescribed Performance

This article investigates the fault-tolerant formation control (FTFC) problem for networked fixed-wing unmanned aerial vehicles (UAVs) against faults. To constrain the distributed tracking errors of follower UAVs with respect to neighboring UAVs in the presence of faults, finite-time prescribed performance functions (PPFs) are developed to transform the distributed tracking errors into a new set of errors by incorporating user-specified transient and steady-state requirements. Then, the critic neural networks (NNs) are developed to learn the long-term performance indices, which are used to evaluate the distributed tracking performance. Based on the generated critic NNs, actor NNs are designed to learn the unknown nonlinear terms. Moreover, to compensate for the reinforcement learning errors of actor-critic NNs, nonlinear disturbance observers (DOs) with skillfully constructed auxiliary learning errors are developed to facilitate the FTFC design. Furthermore, by using the Lyapunov stability analysis, it is shown that all follower UAVs can track the leader UAV with predesigned offsets, and the distributed tracking errors are finite-time convergent. Finally, comparative simulation results are presented to show the effectiveness of the proposed control scheme.

LPVS guidance and adaptive event-triggered control for an underactuated surface vessel with the prevention of obstacle's vicious maneuvering

This paper investigates the adaptive neural event-triggered control for an underactuated surface vessel (USV), considering constraints of the obstacle's vicious maneuvering and the limited communication channel. In the algorithm, a novel logical phantom virtual ship (LPVS) guidance principle is developed to generate the global path following reference and the obstacle avoidance order in the simulation results, where the corresponding operation comply to the suggestion in international regulations for prevention collision at sea (COLREGs). The improved design of velocity obstacle (VO) method can guarantee its predictive capability to prevent the obstacle's vicious maneuvering. As for the control module, the adaptive event-triggered control algorithm is proposed by employing the robust neural damping technique and the input event-triggered mechanism. And the derived adaptive law can effectively solve perturbations from the gain uncertainty and the external disturbances. Through the theoretical analysis, all signals of the closed-loop control system are with the semi-globally uniform ultimate bounded (SGUUB) stability. The simulation experiments have been presented to verify the obstacle avoidance effectiveness and the burden-some superiority of the algorithm.

Time-varying encounter angle trajectory tracking control of unmanned surface vehicle based on wave modeling

In this note, a wave simulation method based on the wave spectrum is proposed, and the wave simulation is transformed into external interference to verify the necessity of using variable encounter angle real wave interference. Firstly, A wave simulation method based on wave spectrum and equidistant method is proposed and demonstrated. Secondly, wave modeling is transformed into interference force related to the encounter angle by fully considering the real marine environment. Furthermore, a trajectory tracking controller with variable encounter angles and the actual sea state is designed using the disturbance modeling method. Finally, the necessity and authenticity of considering varying encounter angles and real sea conditions in the motion control of unmanned surface vehicles (USVs) are proved by simulation.

Event-Triggered Finite-Time Formation Control of Underactuated Multiple ASVs with Prescribed Performance and Collision Avoidance

In this paper, an event-triggered finite-time controller is proposed for solving the formation control problems of underactuated multiple autonomous surface vessels (ASVs), including asymmetric mass matrix, collision avoidance, maintaining communication distances and prescribed performance. First, to not only avoid collisions between the follower and leader but also maintain an effective communication distance, a desired tracking distance is designed to be maintained. Second, an improved barrier Lyapunov function (BLF) is proposed to implement the tracking error constraint. In addition, the relative threshold event-triggering strategy effectively solves the communication pressure problem and greatly saves communication resources. Finally, based on coordinate transformation, line of sight (LOS) and dynamic surface control (DSC), a comprehensive finite-time formation control method is proposed to avoid collisions and maintain communication distance. All the signals of the proposed control system can be stabilized in finite time (PFS). The numerical simulation results verify the effectiveness of the proposed control system.

Flight and Vibration Control of Flexible Air-Breathing Hypersonic Vehicles Under Actuator Faults

The issue of modeling and fault-tolerant control (FTC) design for a class of flexible air-breathing hypersonic vehicles (FAHVs) with actuator faults is investigated in this article. Different from previous research, the shear deformation of the fuselage is considered, and an ordinary differential equations-partial differential equations (ODEs-PDEs) coupled model is established for the FAHVs. A feedback control is proposed to ensure flight stable and an adaptive FTC method is designed to deal with actuator faults while suppressing the system's vibrations. Besides, the stability analysis of the closed-loop system is given via the Lyapunov direct method and an algorithm that transfers the bilinear matrix inequalities (BMIs) feasibility problem to the linear matrix inequalities (LMIs) feasibility problem is provided for determining the control gains. Finally, the numerical simulation results show that the proposed controller can stabilize the flight states and suppresses the vibration of the fuselage efficiently.

Leader-Follower Formation Learning Control of Discrete-Time Nonlinear Multiagent Systems

This article investigates the leader-follower formation learning control (FLC) problem for discrete-time strict-feedback multiagent systems (MASs). The objective is to acquire the experience knowledge from the stable leader-follower adaptive formation control process and improve the control performance by reusing the experiential knowledge. First, a two-layer control scheme is proposed to solve the leader-follower formation control problem. In the first layer, by combining adaptive distributed observers and constructed i_n -step predictors, the leader's future state is predicted by the followers in a distributed manner. In the second layer, the adaptive neural network (NN) controllers are constructed for the followers to ensure that all the followers track the predicted output of the leader. In the stable formation control process, the NN weights are verified to exponentially converge to their optimal values by developing an extended stability corollary of linear time-varying (LTV) system. Second, by constructing some specific "learning rules," the NN weights with convergent sequences are synthetically acquired and stored in the followers as experience knowledge. Then, the stored knowledge is reused to construct the FLC. The proposed FLC method not only solves the leader-follower formation problem but also improves the transient control performance. Finally, the validity of the presented FLC scheme is illustrated by simulations.

Synchronized control of multiple electrohydraulic systems with terminal sliding mode observer under parametric uncertainty and external load

The leader-following synchronization control strategy is proposed for multiple electro-hydraulic systems (MEHS) to realize all the follower outputs of electrohydraulic systems synchronized to a virtual leader demand. Due to existed lumped uncertainties generated by some uncertain errors of hydraulic parameters and unascertainable external load disturbance, the synchronization control performance of MEHS will be degraded by using many common controllers. In this study, a terminal sliding mode observer (TSMO) is adopted in the MEHS to estimate the lumped uncertainties such that guarantees uncertainty estimated errors convergence to zero in a finite time. Then a synchronized controller of MEHS is designed by backstepping iteration and Lyapunov technique to guarantee the output cylinder position of every EHS tracking the virtual leader demand. Finally, the feasibility and effectiveness of the designed TSMO and the proposed synchronized control strategy are verified via simulation and experiment.

Adaptive Finite-Time Tracking Control of Nonholonomic Multirobot Formation Systems With Limited Field-of-View Sensors

This article studies the vision-based tracking control problem for a nonholonomic multirobot formation system with uncertain dynamic models and visibility constraints. A fixed onboard vision sensor that provides the relative distance and bearing angle is subject to limited range and angle of view due to limited sensing capability. The constraint resulting from collision avoidance is also taken into account for safe operations of the formation system. Furthermore, the preselected specifications on transient and steady-state performance are provided by considering the time-varying and asymmetric constraint requirements on formation tracking errors for each robot. To address the constraint problems, we incorporate a novel barrier Lyapunov function into controller design and analysis. Based on the recursive adaptive backstepping procedure and neural-network approximation, we develop a vision-based formation tracking control protocol such that formation tracking errors can converge into a small neighborhood of the origin in finite time while meeting the requirements of visibility and performance constraints. The proposed protocol is decentralized in the sense that the control action on each robot only depends on the local relative information, without the need for explicit network communication. Moreover, the control protocol could extend to an unconstrained multirobot system. Both simulation and experimental results show the effectiveness of the control protocol.

Learning and Near-Optimal Control of Underactuated Surface Vessels With Periodic Disturbances

In this article, we propose a novel learning and near-optimal control approach for underactuated surface (USV) vessels with unknown mismatched periodic external disturbances and unknown hydrodynamic parameters. Given a prior knowledge of the periods of the disturbances, an analytical near-optimal control law is derived through the approximation of the integral-type quadratic performance index with respect to the tracking error, where the equivalent unknown parameters are generated online by an auxiliary system that can learn the dynamics of the controlled system. It is proved that the state differences between the auxiliary system and the corresponding controlled USV vessel are globally asymptotically convergent to zero. Besides, the approach theoretically guarantees asymptotic optimality of the performance index. The efficacy of the method is demonstrated via simulations based on the real parameters of an USV vessel.

Dynamic Learning From Adaptive Neural Control for Discrete-Time Strict-Feedback Systems

This article first investigates the issue on dynamic learning from adaptive neural network (NN) control of discrete-time strict-feedback nonlinear systems. To verify the exponential convergence of estimated NN weights, an extended stability result is presented for a class of discrete-time linear time-varying systems with time delays. Subsequently, by combining the n -step-ahead predictor technology and backstepping, an adaptive NN controller is constructed, which integrates the novel weight updating laws with time delays and without the σ modification. After ensuring the convergence of system output to a recurrent reference signal, the radial basis function (RBF) NN is verified to satisfy the partial persistent excitation condition. By the combination of the extended stability result, the estimated NN weights can be verified to exponentially converge to their ideal values. The convergent weight sequences are comprehensively represented and stored by constructing some elegant learning rules with some novel sequences and the mod function. The stored knowledge is used again to develop a neural learning control scheme. Compared with the traditional adaptive NN control, the proposed scheme can not only accomplish the same or similar tracking tasks but also greatly improve the transient control performance and alleviate the online computation. Finally, the validity of the presented scheme is illustrated by numerical and practical examples.

Finite-Time Command-Filtered Composite Adaptive Neural Control of Uncertain Nonlinear Systems

This article presents a new command-filtered composite adaptive neural control scheme for uncertain nonlinear systems. Compared with existing works, this approach focuses on achieving finite-time convergent composite adaptive control for the higher-order nonlinear system with unknown nonlinearities, parameter uncertainties, and external disturbances. First, radial basis function neural networks (NNs) are utilized to approximate the unknown functions of the considered uncertain nonlinear system. By constructing the prediction errors from the serial-parallel nonsmooth estimation models, the prediction errors and the tracking errors are fused to update the weights of the NNs. Afterward, the composite adaptive neural backstepping control scheme is proposed via nonsmooth command filter and adaptive disturbance estimation techniques. The proposed control scheme ensures that high-precision tracking performances and NN approximation performances can be achieved simultaneously. Meanwhile, it can avoid the singularity problem in the finite-time backstepping framework. Moreover, it is proved that all signals in the closed-loop control system can be convergent in finite time. Finally, simulation results are given to illustrate the effectiveness of the proposed control scheme.

An Enhanced Artificial Electric Field Algorithm with Sine Cosine Mechanism for Logistics Distribution Vehicle Routing

Aiming at the scheduling problem of logistics distribution vehicles, an enhanced artificial electric field algorithm (SC-AEFA) based on the sine cosine mechanism is proposed. The development of the SC-AEFA was as follows. First, a map grid model for enterprise logistics distribution vehicle path planning was established. Then, an enhanced artificial electric field algorithm with the sine cosine mechanism was developed to simulate the logistics distribution vehicle scheduling, establish the logistics distribution vehicle movement law model, and plan the logistics distribution vehicle scheduling path. Finally, a distribution business named fresh enterprise A in the Fuzhou Strait Agricultural and Sideline Products Trading Market was selected to test the effectiveness of the method proposed. The theoretical proof and simulation test results show that the SC-AEFA has a good optimization ability and a strong path planning ability for enterprise logistics vehicle scheduling, which can improve the scheduling ability and efficiency of logistics distribution vehicles and save transportation costs.

Neural-Network Control of a Stand-Alone Tall Building-Like Structure With an Eccentric Load: An Experimental Investigation

This article develops a finite-dimensional dynamic model to describe a stand-alone tall building-like structure with an eccentric load by using the assumed mode method (AMM). To compensate for the dynamic uncertainties, a new neural-network (NN) control strategy is designed to suppress vibrations of the tall buildings. The output constraint on the angle of the pendulum is also considered, and such an angle can be ensured within the safety limit by incorporating a barrier Lyapunov function. The semiglobally uniform ultimate boundness (SGUUB) of the closed-loop system is proved via Lyapunov's stability. The simulation results reveal that the new NN strategy can effectively realize vibration suppression in the flexible beam and pendulum. The effectiveness of the new NN approach is further verified through the experiments on the Quanser smart structure.

Fractional-Order PIλDμ Controller Using Adaptive Neural Fuzzy Model for Course Control of Underactuated Ships

For the uncertainty caused by the time-varying modeling parameters with the sailing speed in the course control of underactuated ships, a novel identification method based on an adaptive neural fuzzy model (ANFM) is proposed to approximate the inverse dynamic characteristics of the ship in this paper. This model adjusts both its own structure and parameters as it learns, and is able to automatically partition the input space, determine the number of membership functions and the number of fuzzy rules. The trained ANFM is used as an inverse controller, in parallel with a fractional-order PIλDμ controller for the course control of underactuated ships. Meanwhile, the sine wave curve and the sawtooth wave curve are considered as the input learning samples of ANFM, respectively, and the inverse dynamics simulation experiments of the ship are carried out. Two different ANFM structures are obtained, which are connected in parallel with the fractional-order PIλDμ controller respectively to control the course of ship. The simulation results show that the proposed method can effectively overcome the influence of uncertainty of ship modeling parameters, track the desired course quickly and effectively, and has a good control effect. Finally, comparative experiments of four different controllers are carried out, and the results show that the FO PIλDμ controller using ANFM has the advantages of small overshoot, short adjustment time, and precise control.

Sideslip-Compensated Guidance-Based Adaptive Neural Control of Marine Surface Vessels

This article presents an improved guidance law for underactuated marine vessels that compensates cross-track error caused by external disturbances through its sideslip. The proposed guidance law demonstrates improved path-following performance regardless of disturbances, such as waves, winds, and ocean currents. This article also presents an adaptive neural-network (NN) control law for the partially known vessel dynamics with state constraints. For satisfying the state constraints, this control scheme adopts an integral barrier Lyapunov function (iBLF)-based backstepping control technique. It is shown that the closed-loop system remains bounded, and state constraints are always satisfied. Finally, the efficacy of the improved guidance law and iBLF-based adaptive control strategy was verified in simulation and experiments using an autonomous surface vessel.

System Transformation-Based Neural Control for Full-State-Constrained Pure-Feedback Systems via Disturbance Observer

In this article, a novel disturbance observer-based adaptive neural control (ANC) scheme is proposed for full-state-constrained pure-feedback nonlinear systems using a new system transformation method. A nonlinear transformation function in a uniformed design framework is constructed to convert the original states with constrained bounds into the ones without any constraints. By combining an auxiliary first-order filter, an augmented nonlinear system without any state constraint is derived to circumvent the difficulty of the controller design caused by the nonaffine input signal. Based on the augmented nonlinear system, a nonlinear disturbance observer (NDO) is designed to enhance the disturbance rejection ability. Subsequently, the NDO-based ANC scheme is presented by combining the second-order filters with backstepping. The proposed scheme confines all states within the predefined bounds, eliminates the condition on both the known sign and bounds of control gains, improves the robustness of the closed-loop system, and alleviates the computational burden. Two simulation examples are performed to show the validity of the presented scheme.

TD-Based Adaptive Output Feedback Control of Ship Heading with Stochastic Noise and Unknown Actuator Dead-Zone Input

To meet the demand of ship control, a new heading control tactic is explored using switching theory. Different from the previous results, the stochastic noise and switched control are considered in the Norrbin nonlinear mathematical model concurrently to discuss ship heading control. Then, for the resulting systems, the adaptive control issue is addressed, while the dead-zone input is embedded and unknown. By establishing switched state observers for the corresponding subsystems, the conservatism of the common state observer can be reduced greatly, and the analysis can be achieved under the switching signal satisfying the average dwell time (ADT). The “explosion of terms” problem occurring in the backstepping technique is well remedied via an innovative tracking differentiator (TD) technology, which is an innovation in itself. According to the theory proof, under the developed control tactic, the resulting signals are then to be bounded in probability, with the tracking goal being achieved well. The theoretical design result was analyzed, and the corresponding validity is given through simulation experiments.

Disturbance Observer-Based Fault-Tolerant Control for Robotic Systems With Guaranteed Prescribed Performance

The actuator failure compensation control problem of robotic systems possessing dynamic uncertainties has been investigated in this paper. Control design against partial loss of effectiveness (PLOE) and total loss of effectiveness (TLOE) of the actuator are considered and described, respectively, and a disturbance observer (DO) using neural networks is constructed to attenuate the influence of the unknown disturbance. Regarding the prescribed error bounds as time-varying constraints, the control design method based on barrier Lyapunov function (BLF) is used to strictly guarantee both the steady-state performance and the transient performance. A simulation study on a two-link planar manipulator verifies the effectiveness of the proposed controllers in dealing with the prescribed performance, the system uncertainties, and the unknown actuator failure simultaneously. Implementation on a Baxter robot gives an experimental verification of our controller.

Robust Adaptive Self-Structuring Neural Network Bounded Target Tracking Control of Underactuated Surface Vessels

This paper studies the target-tracking problem of underactuated surface vessels with model uncertainties and external unknown disturbances. A composite robust adaptive self-structuring neural-network-bounded controller is proposed to improve system performance and avoid input saturation. An extended state observer is proposed to estimate the uncertain nonlinear term, including the unknown velocity of the tracking target, when only the measurement values of the line-of-sight range and angle can be obtained. An adaptive self-structuring neural network is developed to approximate model uncertainties and external unknown disturbances, which can effectively optimize the structure of the neural network to reduce the computational burden by adjusting the number of neurons online. The input-to-state stability of the total closed-loop system is analyzed by the cascade stability theorem. The simulation results verify the effectiveness of the proposed method.

Data-Driven Performance-Prescribed Reinforcement Learning Control of an Unmanned Surface Vehicle

An unmanned surface vehicle (USV) under complicated marine environments can hardly be modeled well such that model-based optimal control approaches become infeasible. In this article, a self-learning-based model-free solution only using input-output signals of the USV is innovatively provided. To this end, a data-driven performance-prescribed reinforcement learning control (DPRLC) scheme is created to pursue control optimality and prescribed tracking accuracy simultaneously. By devising state transformation with prescribed performance, constrained tracking errors are substantially converted into constraint-free stabilization of tracking errors with unknown dynamics. Reinforcement learning paradigm using neural network-based actor-critic learning framework is further deployed to directly optimize controller synthesis deduced from the Bellman error formulation such that transformed tracking errors evolve a data-driven optimal controller. Theoretical analysis eventually ensures that the entire DPRLC scheme can guarantee prescribed tracking accuracy, subject to optimal cost. Both simulations and virtual-reality experiments demonstrate the remarkable effectiveness and superiority of the proposed DPRLC scheme.

Distributed Path Following of Multiple Under-Actuated Autonomous Surface Vehicles Based on Data-Driven Neural Predictors via Integral Concurrent Learning

This article addresses the problem of distributed path following of multiple under-actuated autonomous surface vehicles (ASVs) with completely unknown kinetic models. An integrated distributed guidance and learning control architecture is proposed for achieving a time-varying formation. Specifically, a robust distributed guidance law at the kinematic level is developed based on a consensus approach, a path-following mechanism, and an extended state observer. At the kinetic level, a model-free kinetic control law based on data-driven neural predictors via integral concurrent learning is designed such that the kinetic model can be learned by using recorded data. The advantage of the proposed method is two-folds. First, the proposed formation controllers are able to achieve various time-varying formations without using the velocities of neighboring vehicles. Second, the proposed control law is model-free without any parameter information on kinetic models. Simulation results substantiate the effectiveness of the proposed robust distributed guidance and model-free control laws for multiple under-actuated ASVs with fully unknown kinetic models.

Data-Driven Adaptive Disturbance Observers for Model-Free Trajectory Tracking Control of Maritime Autonomous Surface Ships

In this article, we address the disturbance/ uncertainty estimation of maritime autonomous surface ships (MASSs) with unknown internal dynamics, unknown external disturbances, and unknown input gains. In contrast to existing disturbance observers where some prior knowledge on kinetic model parameters such as the control input gains is available in advance, reduced- and full-order data-driven adaptive disturbance observers (DADOs) are proposed for estimating unknown input gains, as well as total disturbance composed of unknown internal dynamics and external disturbances. An advantage of the proposed DADOs is that the total disturbance and input gains can be simultaneously estimated with guaranteed convergence via data-driven adaption. We apply the proposed full-order DADO for the trajectory tracking control of an MASS without kinetic modeling and present a model-free trajectory tracking control law for the ship based on the DADO and a backstepping technique. We report the simulation results to substantiate the efficacy of the proposed DADO approach to model-free trajectory tracking control of an autonomous surface ship without knowing its dynamics.

Virtual Guidance-Based Coordinated Tracking Control of Multi-Autonomous Underwater Vehicles Using Composite Neural Learning

This article proposes a virtual leader-based coordinated controller for the nonlinear multiple autonomous underwater vehicles (multi-AUVs) with the system uncertainties. To achieve the coordinated formation, a virtual AUV is set as the leader, while the desired command is designed using the relative position between each AUV and the virtual leader. The controller is designed based on the back-stepping scheme, and the online data-based learning scheme is used for uncertainty approximation. The highlight is that compared with previous learning methods which mostly focus on stability, the learning performance index is constructed using the collected online data in this article. The index is further used in the composite update law of the neural weights. The closed-loop system stability is analyzed via the Lyapunov approach. The simulation test on the five AUVs under fixed formation shows that the proposed method can achieve higher tracking performance with improved approximation accuracy.

Trajectory Tracking Control for Underactuated USV with Prescribed Performance and Input Quantization

This paper is devoted to the problem of prescribed performance trajectory tracking control for symmetrical underactuated unmanned surface vessels (USVs) in the presence of model uncertainties and input quantization. By combining backstepping filter mechanisms and adaptive algorithms, two robust control architectures are investigated for surge motion and yaw motion. To guarantee the prespecified performance requirements for position tracking control, the constrained error dynamics are transformed to unconstrained ones by virtue of a tangent-type nonlinear mapping function. On the other hand, the inaccurate model can be identified through radial basis neural networks (RBFNNs), where the minimum learning parameter (MLP) algorithm is employed with a low computational complexity. Furthermore, quantization errors can be effectively reduced even when the parameters of the quantizer remain unavailable to designers. Finally, the effectiveness of the proposed controllers is verified via theoretical analyses and numerical simulations.

Reinforcement Learning-Based Optimal Tracking Control of an Unknown Unmanned Surface Vehicle

In this article, a novel reinforcement learning-based optimal tracking control (RLOTC) scheme is established for an unmanned surface vehicle (USV) in the presence of complex unknowns, including dead-zone input nonlinearities, system dynamics, and disturbances. To be specific, dead-zone nonlinearities are decoupled to be input-dependent sloped controls and unknown biases that are encapsulated into lumped unknowns within tracking error dynamics. Neural network (NN) approximators are further deployed to adaptively identify complex unknowns and facilitate a Hamilton-Jacobi-Bellman (HJB) equation that formulates optimal tracking. In order to derive a practically optimal solution, an actor-critic reinforcement learning framework is built by employing adaptive NN identifiers to recursively approximate the total optimal policy and cost function. Eventually, theoretical analysis shows that the entire RLOTC scheme can render tracking errors that converge to an arbitrarily small neighborhood of the origin, subject to optimal cost. Simulation results and comprehensive comparisons on a prototype USV demonstrate remarkable effectiveness and superiority.

Distributed Cooperative Learning Control of Uncertain Multiagent Systems With Prescribed Performance and Preserved Connectivity

For an uncertain multiagent system, distributed cooperative learning control exerting the learning capability of the control system in a cooperative way is one of the most important and challenging issues. This article aims to address this issue for an uncertain high-order nonlinear multiagent system with guaranteed transient performance and preserved initial connectivity under an undirected and static communication topology. The considered multiagent system has an identical structure and the uncertain agent dynamics are estimated by localized radial basis function (RBF) neural networks (NNs) in a cooperative way. The NN weight estimates are rigorously proven to converge to small neighborhoods of their common optimal values along the union of all agents' trajectories by a deterministic learning theory. Consequently, the associated uncertain dynamics can be locally accurately identified and can be stored and represented by constant RBF networks. Using the stored knowledge on identified system dynamics, an experience-based distributed controller is proposed to improve the control performance and reduce the computational burden. The theoretical results are demonstrated on an application to the formation control of a group of unmanned surface vehicles.

Adaptive Consensus Tracking Control of Uncertain Nonlinear Multiagent Systems With Predefined Accuracy

In this article, we consider the leader-follower consensus control problem of uncertain multiagent systems, aiming to achieve the improvement of system steady state and transient performance. To this end, a new adaptive neural control approach is proposed with a novel design of the Lyapunov function, which is generated with a class of positive functions. Guided by this idea, a series of smooth functions is incorporated into backstepping design and Lyapunov analysis to develop a performance-oriented controller. It is proved that the proposed controller achieves a perfect asymptotic consensus performance and a tunable L₂ transient performance of synchronization errors, whereas most existing results can only ensure the stability. Simulation demonstrates the obtained results.

Observer-Based Fuzzy Output-Feedback Control for Discrete-Time Strict-Feedback Nonlinear Systems With Stochastic Noises

This paper focuses on the observer-based output-feedback control (OBOFC) problem for a class of discrete-time strict-feedback nonlinear systems (DTSFNSs) with both multiplicative process noises and additive measurement noises. A state observer is first designed to estimate immeasurable system states, and then a novel observer-based backstepping control framework is proposed for DTSFNSs with known model information. To be specific, virtual control laws and the actual control law are derived using a variable substitution method that gets rid of the repeated accumulation of measurement noises in the recursive process. Furthermore, for technical derivation, the multiplicative noise is successively bounded by state estimation errors and controlled errors. Stability conditions are obtained to guarantee the exponential mean-square boundedness of the closed-loop system. Moreover, the nonlinear modeling uncertainties are taken into account to better reflect engineering practices. In virtue of the universal approximation property of fuzzy-logic systems, a fuzzy observer and the corresponding fuzzy output-feedback controller are simultaneously constructed to derive the stability criteria by using novel weight updated laws. Simulation studies are performed to test the validity of the proposed OBOFC scheme.

Adaptive Neural Event-Triggered Control for Discrete-Time Strict-Feedback Nonlinear Systems

This paper proposes a novel event-triggered (ET) adaptive neural control scheme for a class of discrete-time nonlinear systems in a strict-feedback form. In the proposed scheme, the ideal control input is derived in a recursive design process, which relies on system states only and is unrelated to virtual control laws. In this case, the high-order neural networks (NNs) are used to approximate the ideal control input (but not the virtual control laws), and then the corresponding adaptive neural controller is developed under the ET mechanism. A modified NN weight updating law, nonperiodically tuned at triggering instants, is designed to guarantee the uniformly ultimate boundedness (UUB) of NN weight estimates for all sampling times. In virtue of the bounded NN weight estimates and a dead-zone operator, the ET condition together with an adaptive ET threshold coefficient is constructed to guarantee the UUB of the closed-loop networked control system through the Lyapunov stability theory, thereby largely easing the network communication load. The proposed ET condition is easy to implement because of the avoidance of: 1) the use of the intermediate ET conditions in the backstepping procedure; 2) the computation of virtual control laws; and 3) the redundant triggering of events when the system states converge to a desired region. The validity of the presented scheme is demonstrated by simulation results.

Event-Based Adaptive Neural Tracking Control for Discrete-Time Stochastic Nonlinear Systems: A Triggering Threshold Compensation Strategy

This paper investigates the event-triggered (ET) tracking control problem for a class of discrete-time strict-feedback nonlinear systems subject to both stochastic noises and limited controller-to-actuator communication capacities. The ET mechanism with fixed triggering threshold is designed to decide whether the current control signal should be transmitted to the actuator. A systematic framework is developed to construct a novel adaptive neural controller by directly applying the backstepping procedure to the underlying system. The proposed framework overcomes the noncausality problem, avoids the possible controller-related singularity problem, and gets rid of the neural approximation of the virtual control laws. Under the ET mechanism, the corresponding ET-based actuator is put forward by introducing an ET threshold compensation operator. Such a compensation operator (with an adjustable design parameter) is subtly designed based on a hyperbolic tangent function and a sign function. The threshold compensation error is analytically characterized in terms of a time-varying parameter, and the error bound is shown to be relatively small that is dependent on the adjustable design parameter. Compared with the traditional ET-based actuator without the compensation operator, the proposed ET-based actuator exhibits several distinguished features including: 1) improvement of the tracking accuracy (especially at the triggering instants); 2) further mitigation of the communication load; and 3) enlargement of the allowable range of the ET threshold. These features are illustrated by numerical and practical examples.

Backstepping active disturbance rejection control for trajectory tracking of underactuated autonomous underwater vehicles with position error constraint

In this article, the three-dimensional trajectory tracking control of an autonomous underwater vehicle is addressed. The vehicle is assumed to be underactuated and the system parameters and the external disturbances are unknown. First, the five degrees of freedom kinematics and dynamics model of underactuated autonomous underwater vehicle are acquired. Following this, reduced-order linear extended state observers are designed to estimate and compensate for the uncertainties that exist in the model and the external disturbances. A backstepping active disturbance rejection control method is designed with the help of a time-varying barrier Lyapunov function to constrain the position tracking error. Furthermore, the controller system can be proved to be stable by employing the Lyapunov stability theory. Finally, the simulation and comparative analyses demonstrate the usefulness and robustness of the proposed controller in the presence of internal parameter uncertainties and external time-varying disturbances.

The Bilinear Model Predictive Method-Based Motion Control System of an Underactuated Ship with an Uncertain Model in the Disturbance

Ship transportation plays an increasingly important role in and accounts for a large proportion of cargo transport. Therefore, it is necessary to improve the quality of the trajectory control system of the ship for improving the transport efficiency and ensuring maritime safety. This paper deals with the advanced control system for the three-degrees-of-freedom model of the underactuated ship in the condition of uncertain disturbance. Based on the three-degrees-of-freedom model of the underactuated ship, the authors built a bilinear model of the ship by linearizing each nonlinear model section. Then, the authors used the state estimator to compensate for uncertain components and random disturbances in the model. Finally, the authors built the output-feedback predictive controller based on the channel-separation principle combined with direct observation of the continuous model for controlling the motion of the underactuated ship in the case of uncertain disturbance and the bound control signals. The result is that the movement quality of the underactuated ship is very good in the context of uncertain disturbance and bound control signals.