Neural-Dynamic-Method-Based Dual-Arm CMG Scheme With Time-Varying Constraints Applied to Humanoid Robots

Distributed Neurodynamic Models for Solving a Class of System of Nonlinear Equations

This article investigates a class of systems of nonlinear equations (SNEs). Three distributed neurodynamic models (DNMs), namely a two-layer model (DNM-I) and two single-layer models (DNM-II and DNM-III), are proposed to search for such a system's exact solution or a solution in the sense of least-squares. Combining a dynamic positive definite matrix with the primal-dual method, DNM-I is designed and it is proved to be globally convergent. To obtain a concise model, based on the dynamic positive definite matrix, time-varying gain, and activation function, DNM-II is developed and it enjoys global convergence. To inherit DNM-II's concise structure and improved convergence, DNM-III is proposed with the aid of time-varying gain and activation function, and this model possesses global fixed-time consensus and convergence. For the smooth case, DNM-III's globally exponential convergence is demonstrated under the Polyak-Łojasiewicz (PL) condition. Moreover, for the nonsmooth case, DNM-III's globally finite-time convergence is proved under the Kurdyka-Łojasiewicz (KL) condition. Finally, the proposed DNMs are applied to tackle quadratic programming (QP), and some numerical examples are provided to illustrate the effectiveness and advantages of the proposed models.

Hybrid Orientation and Position Collaborative Motion Generation Scheme for a Multiple Mobile Redundant Manipulator System Synthesized by a Recurrent Neural Network

To enable distributed multiple mobile manipulator systems to complete collaborative tasks safely and stably, this article investigates and presents a motion generation scheme that considers both orientation and position coordination based on a distributed recurrent neural network. Moreover, physical limits are also considered. Specifically, the orientation and position coordination constraints and physical limits are modeled separately as equality and inequality constraints with coupled variables. Subsequently, a motion generation scheme for multiple mobile manipulators based on quadratic programming is established. Finally, a distributed linear variational inequality-based primal-dual neural network is constructed to solve the motion generation scheme and obtain the motion trajectories of all the mobile manipulators. The simulation results demonstrate that the hybrid orientation and position collaboration motion generation scheme effectively addresses the position and orientation coordination problem for multiple mobile manipulator systems. Compared to other schemes, the proposed scheme based on a distributed computing structure greatly enhances the stability of the system. Additionally, the proposed approach introduces orientation coordination and physical limits, which increases the practicality of the system.

Zhang equivalency of inequation-to-inequation type for constraints of redundant manipulators

In solving specific problems, physical laws and mathematical theorems directly express the connections between variables with equations/inequations. At times, it could be extremely hard or not viable to solve these equations/inequations directly. The PE (principle of equivalence) is a commonly applied pragmatic method across multiple fields. PE transforms the initial equations/inequations into simplified equivalent equations/inequations that are more manageable to solve, allowing researchers to achieve their objectives. The problem-solving process in many fields benefits from the use of PE. Recently, the ZE (Zhang equivalency) framework has surfaced as a promising approach for addressing time-dependent optimization problems. This ZEF (ZE framework) consolidates constraints at different tiers, demonstrating its capacity for the solving of time-dependent optimization problems. To broaden the application of ZEF in time-dependent optimization problems, specifically in the domain of motion planning for redundant manipulators, the authors systematically investigate the ZEF-I2I (ZEF of the inequation-to-inequation) type. The study concentrates on transforming constraints (i.e., joint constraints and obstacles avoidance depicted in different tiers) into consolidated constraints backed by rigorous mathematical derivations. The effectiveness and applicability of the ZEF-I2I are verified through two optimization motion planning schemes, which consolidate constraints in the velocity-tier and acceleration-tier. Schemes are required to accomplish the goal of repetitive motion planning within constraints. The firstly presented optimization motion planning schemes are then reformulated as two time-dependent quadratic programming problems. Simulative experiments conducted on the basis of a six-joint redundant manipulator confirm the outstanding effectiveness of the firstly presented ZEF-I2I in achieving the goal of motion planning within constraints.

A Segmented Variable-Parameter ZNN for Dynamic Quadratic Minimization With Improved Convergence and Robustness

As a category of the recurrent neural network (RNN), zeroing neural network (ZNN) can effectively handle time-variant optimization issues. Compared with the fixed-parameter ZNN that needs to be adjusted frequently to achieve good performance, the conventional variable-parameter ZNN (VPZNN) does not require frequent adjustment, but its variable parameter will tend to infinity as time grows. Besides, the existing noise-tolerant ZNN model is not good enough to deal with time-varying noise. Therefore, a new-type segmented VPZNN (SVPZNN) for handling the dynamic quadratic minimization issue (DQMI) is presented in this work. Unlike the previous ZNNs, the SVPZNN includes an integral term and a nonlinear activation function, in addition to two specially constructed time-varying piecewise parameters. This structure keeps the time-varying parameters stable and makes the model have strong noise tolerance capability. Besides, theoretical analysis on SVPZNN is proposed to determine the upper bound of convergence time in the absence or presence of noise interference. Numerical simulations verify that SVPZNN has shorter convergence time and better robustness than existing ZNN models when handling DQMI.

Observer-based adaptive fuzzy output feedback control for functional constraint systems with dead-zone input

This paper develops an adaptive output feedback control for a class of functional constraint systems with unmeasurable states and unknown dead zone input. The constraint is a series of functions closely linked to state variables and time, which is not achieved in current research results and is more general in practical systems. Furthermore, a fuzzy approximator based adaptive backstepping algorithm is designed and an adaptive state observer with time-varying functional constraints (TFC) is constructed to estimate the unmeasurable states of the control system. Relying on the relevant knowledge of dead zone slopes, the issue of non-smooth dead-zone input is successfully solved. The time-varying integral barrier Lyapunov functions (iBLFs) are employed to guarantee that the states of the system remain within the constraint interval. By Lyapunov stability theory, the adopted control approach can ensure the stability of the system. Finally, the feasibility of the considered method is conformed via a simulation experiment.

Ensemble Support Vector Recurrent Neural Network for Brain Signal Detection

The brain-computer interface (BCI) P300 speller analyzes the P300 signals from the brain to achieve direct communication between humans and machines, which can assist patients with severe disabilities to control external machines or robots to complete expected tasks. Therefore, the classification method of P300 signals plays an important role in the development of BCI systems and technologies. In this article, a novel ensemble support vector recurrent neural network (E-SVRNN) framework is proposed and developed to acquire more accurate and efficient electroencephalogram (EEG) signal classification results. First, we construct a support vector machine (SVM) to formulate EEG signals recognizing model. Second, the SVM formulation is transformed into a standard convex quadratic programming (QP) problem. Third, the convex QP problem is solved by combining a varying parameter recurrent neural network (VPRNN) with a penalty function. Experimental results on BCI competition II and BCI competition III datasets demonstrate that the proposed E-SVRNN framework can achieve accuracy rates as high as 100% and 99%, respectively. In addition, the results of comparison experiments verify that the proposed E-SVRNN possesses the best recognition accuracy and information transfer rate (ITR) compared with most of the state-of-the-art algorithms.

Design and Analysis of Data-Driven Learning Control: An Optimization-Based Approach

Learning to perform perfect tracking tasks based on measurement data is desirable in the controller design of systems operating repetitively. This motivates this article to seek an optimization-based design and analysis approach for data-driven learning control systems by focusing on iterative learning control (ILC) of repetitive systems with unknown nonlinear time-varying dynamics. It is shown that perfect output tracking can be realized with updating inputs, where no explicit model knowledge but only measured input-output data are leveraged. In particular, adaptive updating strategies are proposed to obtain parameter estimations of nonlinearities. A double-dynamics analysis approach is applied to establish ILC convergence, together with boundedness of input, output, and estimated parameters, which benefits from employing properties of nonnegative matrices. Simulations are implemented to verify the validity of our optimization-based adaptive ILC.

Smooth-Switching Gain Based Adaptive Neural Network Control of n-Joint Manipulator with Multiple Constraints

Modeling errors, external loads and output constraints will affect the tracking control of the n-joint manipulator driven by the permanent magnet synchronous motor. To solve the above problems, the smooth-switching for backstepping gain control strategy based on the Barrier Lyapunov Function and adaptive neural network (BLF-ANBG) is proposed. First, the adaptive neural network method is established to approximate modeling errors, unknown loads and unenforced inputs. Then, the gain functions based on the error and error rate of change are designed, respectively. The two gain functions can respectively provide faster response speed and better tracking stability. The smooth-switching for backstepping gain strategy based on the Barrier Lyapunov Function is proposed to combine the advantages of both gain functions. According to the above strategy, the BLF-ANBG strategy is proposed, which not only solves the influence of multiple constraints, unknown loads and modeling errors, but also enables the manipulator system to have better dynamic and steady-state performances at the same time. Finally, the proposed controller is applied to a 2-DOF manipulator and compared with other commonly used methods. The simulation results show that the BLF-ANBG strategy has good tracking performance under multiple constraints and model errors.

RNN for Repetitive Motion Generation of Redundant Robot Manipulators: An Orthogonal Projection-Based Scheme

For the existing repetitive motion generation (RMG) schemes for kinematic control of redundant manipulators, the position error always exists and fluctuates. This article gives an answer to this phenomenon and presents the theoretical analyses to reveal that the existing RMG schemes exist a theoretical position error related to the joint angle error. To remedy this weakness of existing solutions, an orthogonal projection RMG (OPRMG) scheme is proposed in this article by introducing an orthogonal projection method with the position error eliminated theoretically, which decouples the joint space error and Cartesian space error with joint constraints considered. The corresponding new recurrent neural networks (NRNNs) are structured by exploiting the gradient descent method with the assistance of velocity compensation with theoretical analyses provided to embody the stability and feasibility. In addition, simulation results on a fixed-based redundant manipulator, a mobile manipulator, and a multirobot system synthesized by the existing RMG schemes and the proposed one are presented to verify the superiority and precise performance of the OPRMG scheme for kinematic control of redundant manipulators. Moreover, via adjusting the coefficient, simulations on the position error and joint drift of the redundant manipulator are conducted for comparison to prove the high performance of the OPRMG scheme. To bring out the crucial point, different controllers for the redundancy resolution of redundant manipulators are compared to highlight the superiority and advantage of the proposed NRNN. This work greatly improves the existing RMG solutions in theoretically eliminating the position error and joint drift, which is of significant contributions to increasing the accuracy and efficiency of high-precision instruments in manufacturing production.

Design and Analysis of a Novel Integral Recurrent Neural Network for Solving Time-Varying Sylvester Equation

To solve a general time-varying Sylvester equation, a novel integral recurrent neural network (IRNN) is designed and analyzed. This kind of recurrent neural networks is based on an error-integral design equation and does not need training in advance. The IRNN can achieve global convergence performance and strong robustness if odd-monotonically increasing activation functions [i.e., the linear, bipolar-sigmoid, power, or sigmoid-power activation functions (SP-AFs)] are applied. Specifically, if linear or bipolar-sigmoid activation functions are applied, the IRNN possess exponential convergence performance. The IRNN has finite-time convergence property by using power activation function. To obtain faster convergence performance and finite-time convergence property, an SP-AF is designed. Furthermore, by using the discretization method, the discrete IRNN model and its convergence analysis are also presented. Practical application to robot manipulator and computer simulation results with using different activation functions and design parameters have verified the effectiveness, stability, and reliability of the proposed IRNN.

A Penalty Strategy Combined Varying-Parameter Recurrent Neural Network for Solving Time-Varying Multi-Type Constrained Quadratic Programming Problems

To obtain the optimal solution to the time-varying quadratic programming (TVQP) problem with equality and multitype inequality constraints, a penalty strategy combined varying-parameter recurrent neural network (PS-VP-RNN) for solving TVQP problems is proposed and analyzed. By using a novel penalty function designed in this article, the inequality constraint of the TVQP can be transformed into a penalty term that is added into the objective function of TVQP problems. Then, based on the design method of VP-RNN, a PS-VP-RNN is designed and analyzed for solving the TVQP with penalty term. One of the greatest advantages of PS-VP-RNN is that it cannot only solve the TVQP with equality constraints but can also solve the TVQP with inequality and bounded constraints. The global convergence theorem of PS-VP-RNN is presented and proved. Finally, three numerical simulation experiments with different forms of inequality and bounded constraints verify the effectiveness and accuracy of PS-VP-RNN in solving the TVQP problems.

A Novel Supertwisting Zeroing Neural Network With Application to Mobile Robot Manipulators

Various zeroing neural network (ZNN) models have been investigated to address the tracking control of robot manipulators for the capacity of parallel processing and nonlinearity handling. However, two limitations occur in the existing ZNN models. The first one is the convergence time that tends to be infinitely large. The second one is the research of robustness that remains in the analyses of stability and asymptotic convergence. To simultaneously enhance the convergence performance and robustness, this article proposes a new ZNN model by using a supertwisting (ST) algorithm, termed STZNN model, for the tracking control of mobile robot manipulators. The proposed STZNN model inherently possesses the advantages of finite-time convergence and robustness making the control process fast and robust. The bridge from the sliding mode control to the ZNN is built, and the essential connection between the ST algorithm and ZNN is explored by constructing a unified design process. Theorems and proofs about global stability, finite-time convergence, and robustness are provided. Finally, path-tracking applications, comparisons, and tests substantiate the effectiveness and superiority of the STZNN model for the tracking control handling of mobile robot manipulators.

Mutual-Collision-Avoidance Scheme Synthesized by Neural Networks for Dual Redundant Robot Manipulators Executing Cooperative Tasks

Collision between dual robot manipulators during working process will lead to task failure and even robot damage. To avoid mutual collision of dual robot manipulators while doing collaboration tasks, a novel recurrent neural network (RNN)-based mutual-collision-avoidance (MCA) scheme for solving the motion planning problem of dual manipulators is proposed and exploited. Because of the high accuracy and low computation complexity, the linear variational inequality-based primal-dual neural network is used to solve the proposed scheme. The proposed scheme is applied to the collaboration trajectory tracking and cup-stacking tasks, and shows its effectiveness for avoiding collision between the dual robot manipulators. Through network iteration and online learning, the dual robot manipulators will learn the ability of MCA. Moreover, a line-segment-based distance measure algorithm is proposed to calculate the minimum distance between the dual manipulators. If the computed minimum distance is less than the first safe-related distance threshold, a speed brake operation is executed and guarantees that the robot cannot exceed the second safe-related distance threshold. Furthermore, the proposed MCA strategy is formulated as a standard quadratic programming problem, which is further solved by an RNN. Computer simulations and a real dual robot experiment further verify the effectiveness, accuracy, and physical realizability of the RNN-based MCA scheme when manipulators cooperatively execute the end-effector tasks.

General 7-Instant DCZNN Model Solving Future Different-Level System of Nonlinear Inequality and Linear Equation

In this article, a novel and challenging problem called future different-level system of nonlinear inequality and linear equation (FDLSNILE) is proposed and investigated. To solve FDLSNILE, the corresponding continuous different-level system of nonlinear inequality and linear equation (CDLSNILE) is first analyzed, and then, a continuous combined zeroing neural network (CCZNN) model for solving CDLSNILE is proposed. To obtain a discrete combined zeroing neural network (DCZNN) model for solving FDLSNILE, a high-precision general 7-instant Zhang et al. discretization (ZeaD) formula for the first-order time derivative approximation is proposed. Furthermore, by applying the general 7-instant ZeaD formula to discretize the CCZNN model, a general 7-instant DCZNN (7IDCZNN) model is thus proposed for solving FDLSNILE. For comparison, by using three conventional ZeaD formulas, three conventional DCZNN models are also developed. Meanwhile, theoretical analyses and results guarantee the efficacy and superiority of the general 7IDCZNN model compared with the other three conventional DCZNN models for solving FDLSNILE. Finally, several comparative numerical experiments, including the motion control of a 5-link redundant manipulator, are provided to substantiate the efficacy and superiority of the general 7-instant ZeaD formula and the corresponding 7IDCZNN model.

A robust zeroing neural network for solving dynamic nonlinear equations and its application to kinematic control of mobile manipulator

Nonlinear phenomena are often encountered in various practical systems, and most of the nonlinear problems in science and engineering can be simply described by nonlinear equation, effectively solving nonlinear equation (NE) has aroused great interests of the academic and industrial communities. In this paper, a robust zeroing neural network (RZNN) activated by a new power versatile activation function (PVAF) is proposed and analyzed for finding the solutions of dynamic nonlinear equations (DNE) within fixed time in noise polluted environment. As compared with the previous ZNN model activated by other commonly used activation functions (AF), the main improvement of the presented RZNN model is the fixed-time convergence even in the presence of noises. In addition, the convergence time of the proposed RZNN model is irrelevant to its initial states, and it can be computed directly. Both the rigorous mathematical analysis and numerical simulation results are provided for the verification of the effectiveness and robustness of the proposed RZNN model. Moreover, a successful robotic manipulator path tracking example in noise polluted environment further demonstrates the practical application prospects of the proposed RZNN models.

Exploiting upper-limb functional principal components for human-like motion generation of anthropomorphic robots

BACKGROUND

Human-likeliness of robot movements is a key component to enable a safe and effective human-robot interaction, since it contributes to increase acceptance and motion predictability of robots that have to closely interact with people, e.g. for assistance and rehabilitation purposes. Several parameters have been used to quantify how much a robot behaves like a human, which encompass aspects related to both the robot appearance and motion. The latter point is fundamental to allow the operator to interpret robotic actions, and plan a meaningful reactions. While different approaches have been presented in literature, which aim at devising bio-aware control guidelines, a direct implementation of human actions for robot planning is not straightforward, still representing an open issue in robotics.

METHODS

We propose to embed a synergistic representation of human movements for robot motion generation. To do this, we recorded human upper-limb motions during daily living activities. We used functional Principal Component Analysis (fPCA) to extract principal motion patterns. We then formulated the planning problem by optimizing the weights of a reduced set of these components. For free-motions, our planning method results into a closed form solution which uses only one principal component. In case of obstacles, a numerical routine is proposed, incrementally enrolling principal components until the problem is solved with a suitable precision.

RESULTS

Results of fPCA show that more than 80% of the observed variance can be explained by only three functional components. The application of our method to different meaningful movements, with and without obstacles, show that our approach is able to generate complex motions with a very reduced number of functional components. We show that the first synergy alone accounts for the 96% of cost reduction and that three components are able to achieve a satisfactory motion reconstruction in all the considered cases.

CONCLUSIONS

In this work we moved from the analysis of human movements via fPCA characterization to the design of a novel human-like motion generation algorithm able to generate, efficiently and with a reduced set of basis elements, several complex movements in free space, both in free motion and in case of obstacle avoidance tasks.

Extended State Observer Fuzzy-Approximation-Based Active Disturbances Rejection Control Method for Humanoid Robot with Trajectory Tracking

This study aimed to propose an extended state observer fuzzy-approximation-based active disturbances rejection control (FAADRC) method for a dual-arm humanoid robotic system. The purpose of this control system was to provide disturbance estimation and compensation to enable the humanoid robots to track any continuous desired trajectory, even in the presence of environmental disturbances and parametric uncertainties. The proposed active disturbances rejection controller was analyzed using mathematical modeling, and the robot dual-arm motion information of a number of cases when they simulated the trajectory was examined to verify the model. The extended state observer adaptive fuzzy-approximation control strategy was designed combining the synthesis of the robust design, active disturbances rejection control, and Lyapunov function method so that the proposed FAADRC did not need to know the arms model of the humanoid robot precisely. In the control system proposed in this study, once the desired trajectories of the robot’s dual-arm positions were given, the FAADRC system was closed to any unknown functions and to the derivative of the virtual control law of the humanoid robot system. In this case, a robust controller based on an extended state observer was designed to realize the disturbance estimation and compensation. Using the proposed trajectory tracking, not only were the coordinate motions of a humanoid robot’s two arms generated, but the arms could also be controlled to move to the desired positions. The proposed closed-loop system under the FAADRC design was effective, and the asymptotic stability was successfully achieved. The numerical simulation showed the tracking error comparison and the estimated errors of the extended state observer. Two experimental tests were carried out to prove the performance of the algorithm presented in this study. The experimental results showed that the proposed FAADRC exhibited a better performance than the regular proportional integral derivative controller.

Computing Time-Varying Quadratic Optimization With Finite-Time Convergence and Noise Tolerance: A Unified Framework for Zeroing Neural Network

Zeroing neural network (ZNN), as a powerful calculating tool, is extensively applied in various computation and optimization fields. Convergence and noise-tolerance performance are always pursued and investigated in the ZNN field. Up to now, there are no unified ZNN models that simultaneously achieve the finite-time convergence and inherent noise tolerance for computing time-varying quadratic optimization problems, although this superior property is highly demanded in practical applications. In this paper, for computing time-varying quadratic optimization within finite-time convergence in the presence of various additive noises, a new framework for ZNN is designed to fill this gap in a unified manner. Specifically, different from the previous design formulas either possessing finite-time convergence or possessing noise-tolerance performance, a new design formula with finite-time convergence and noise tolerance is proposed in a unified framework (and thus called unified design formula). Then, on the basis of the unified design formula, a unified ZNN (UZNN) is, thus, proposed and investigated in the unified framework of ZNN for computing time-varying quadratic optimization problems in the presence of various additive noises. In addition, theoretical analyses of the unified design formula and the UZNN model are given to guarantee the finite-time convergence and inherent noise tolerance. Computer simulation results verify the superior property of the UZNN model for computing time-varying quadratic optimization problems, as compared with the previously proposed ZNN models.

A new noise-tolerant and predefined-time ZNN model for time-dependent matrix inversion

In this work, a new zeroing neural network (ZNN) using a versatile activation function (VAF) is presented and introduced for solving time-dependent matrix inversion. Unlike existing ZNN models, the proposed ZNN model not only converges to zero within a predefined finite time but also tolerates several noises in solving the time-dependent matrix inversion, and thus called new noise-tolerant ZNN (NNTZNN) model. In addition, the convergence and robustness of this model are mathematically analyzed in detail. Two comparative numerical simulations with different dimensions are used to test the efficiency and superiority of the NNTZNN model to the previous ZNN models using other activation functions. In addition, two practical application examples (i.e., a mobile manipulator and a real Kinova JACO² robot manipulator) are presented to validate the applicability and physical feasibility of the NNTZNN model in a noisy environment. Both simulative and experimental results demonstrate the effectiveness and tolerant-noise ability of the NNTZNN model.

Based on fuzzy-approximation adaptive backstepping control method for dual-arm of humanoid robot with trajectory tracking

In this article, a fuzzy-approximation-based adaptive backstepping control method for dual-arm of a humanoid robot was proposed. The purpose of this control system is to provide coordinated movement assistance to enable the humanoid robot’s human-like forearm to grab objects coordinately (or track any continuous desired trajectory), even in the presence of environmental disturbances and parametric uncertainties. We analyze the proposed adaptive backstepping by mathematical modeling and actually measure the robot dual-arm motion information of a number of case when they simulate the trajectory to verify the model. We design the adaptive fuzzy-approximation control strategy and combining the synthesis of the robust design, backstepping control, and Lyapunov function method, the proposed adaptive fuzzy backstepping control does not need to know the humanoid robot’s arms model precisely. In the control system proposed here, once the desired trajectories of the robot’s dual-arm positions are given, the adaptive fuzzy system was closed to any unknown functions and to the derivative of the virtual control law of the humanoid robot system. In this case, a robust design scheme was utilized to compensate for any approximation errors. With the proposed trajectory tracking, not only able to generate the coordinate motions for a humanoid robot’s two arms, but it can also control the arms to move to the desired positions. The proposed closed-loop system under the adaptive fuzzy backstepping control design was effective and that asymptotic stability was successfully achieved. The adaptive fuzzy-approximation backstepping control strategy should be more complete and intelligent and more actual test should be conducted to further evaluate the effect of the proposed trajectory tracking. The instability of dual-arm of humanoid robot system is systematically analyzed and a backstepping control strategy based on the adaptive fuzzy-approximation to improve the continuity of trajectory tracking of the robot’s arms is proposed.

Dendritic Neuron Model With Effective Learning Algorithms for Classification, Approximation, and Prediction

An artificial neural network (ANN) that mimics the information processing mechanisms and procedures of neurons in human brains has achieved a great success in many fields, e.g., classification, prediction, and control. However, traditional ANNs suffer from many problems, such as the hard understanding problem, the slow and difficult training problems, and the difficulty to scale them up. These problems motivate us to develop a new dendritic neuron model (DNM) by considering the nonlinearity of synapses, not only for a better understanding of a biological neuronal system, but also for providing a more useful method for solving practical problems. To achieve its better performance for solving problems, six learning algorithms including biogeography-based optimization, particle swarm optimization, genetic algorithm, ant colony optimization, evolutionary strategy, and population-based incremental learning are for the first time used to train it. The best combination of its user-defined parameters has been systemically investigated by using the Taguchi's experimental design method. The experiments on 14 different problems involving classification, approximation, and prediction are conducted by using a multilayer perceptron and the proposed DNM. The results suggest that the proposed learning algorithms are effective and promising for training DNM and thus make DNM more powerful in solving classification, approximation, and prediction problems.

Neural-Dynamic Based Synchronous-Optimization Scheme of Dual Redundant Robot Manipulators

In order to track complex-path tasks in three dimensional space without joint-drifts, a neural-dynamic based synchronous-optimization (NDSO) scheme of dual redundant robot manipulators is proposed and developed. To do so, an acceleration-level repetitive motion planning optimization criterion is derived by the neural-dynamic method twice. Position and velocity feedbacks are taken into account to decrease the errors. Considering the joint-angle, joint-velocity, and joint-acceleration limits, the redundancy resolution problem of the left and right arms are formulated as two quadratic programming problems subject to equality constraints and three bound constraints. The two quadratic programming schemes of the left and right arms are then integrated into a standard quadratic programming problem constrained by an equality constraint and a bound constraint. As a real-time solver, a linear variational inequalities-based primal-dual neural network (LVI-PDNN) is used to solve the quadratic programming problem. Finally, the simulation section contains experiments of the execution of three complex tasks including a couple task, the comparison with pseudo-inverse method and robustness verification. Simulation results verify the efficacy and accuracy of the proposed NDSO scheme.

Human-In-The-Loop Control and Task Learning for Pneumatically Actuated Muscle Based Robots

Pneumatically actuated muscles (PAMs) provide a low cost, lightweight, and high power-to-weight ratio solution for many robotic applications. In addition, the antagonist pair configuration for robotic arms make it open to biologically inspired control approaches. In spite of these advantages, they have not been widely adopted in human-in-the-loop control and learning applications. In this study, we propose a biologically inspired multimodal human-in-the-loop control system for driving a one degree-of-freedom robot, and realize the task of hammering a nail into a wood block under human control. We analyze the human sensorimotor learning in this system through a set of experiments, and show that effective autonomous hammering skill can be readily obtained through the developed human-robot interface. The results indicate that a human-in-the-loop learning setup with anthropomorphically valid multi-modal human-robot interface leads to fast learning, thus can be used to effectively derive autonomous robot skills for ballistic motor tasks that require modulation of impedance.

A Neural Controller for Image-Based Visual Servoing of Manipulators With Physical Constraints

Main issues in visual servoing of manipulators mainly include rapid convergence of feature errors to zero and the safety of joints regarding joint physical limits. To address the two issues, in this paper, an image-based visual servoing scheme is proposed for manipulators with an eye-in-hand configuration. Compared with existing schemes, the proposed one does not require performing pseudoinversion for the image Jacobian matrix or inversion for the Jacobian matrix associated with the forward kinematics of the manipulators. Theoretical analysis shows that the proposed scheme not only guarantees the asymptotic convergence of feature errors to zero but also the compliance with joint angle and velocity limits of the manipulators. Besides, simulation results based on a PUMA560 manipulator with a camera mounted on the end effector verify the theoretical conclusions and the efficacy of the proposed scheme.

Modified Primal-Dual Neural Networks for Motion Control of Redundant Manipulators With Dynamic Rejection of Harmonic Noises

In recent decades, primal-dual neural networks, as a special type of recurrent neural networks, have received great success in real-time manipulator control. However, noises are usually ignored when neural controllers are designed based on them, and thus, they may fail to perform well in the presence of intensive noises. Harmonic noises widely exist in real applications and can severely affect the control accuracy. This work proposes a novel primal-dual neural network design that directly takes noise control into account. By taking advantage of the fact that the unknown amplitude and phase information of a harmonic signal can be eliminated from its dynamics, our deliberately designed neural controller is able to reach the accurate tracking of reference trajectories in a noisy environment. Theoretical analysis and extensive simulations show that the proposed controller stabilizes the control system polluted by harmonic noises and converges the position tracking error to zero. Comparisons show that our proposed solution consistently and significantly outperforms the existing primal-dual neural solutions as well as feedforward neural one and adaptive neural one for redundancy resolution of manipulators.

Robust Zeroing Neural-Dynamics and Its Time-Varying Disturbances Suppression Model Applied to Mobile Robot Manipulators

This paper proposes a novel robust zeroing neural-dynamics (RZND) approach as well as its associated model for solving the inverse kinematics problem of mobile robot manipulators. Unlike existing works based on the assumption that neural network models are free of external disturbances, four common forms of time-varying disturbances suppressed by the proposed RZND model are investigated in this paper. In addition, theoretical analyses on the antidisturbance performance are presented in detail to prove the effectiveness and robustness of the proposed RZND model with time-varying disturbances suppressed for solving the inverse kinematics problem of mobile robot manipulators. That is, the RZND model converges toward the exact solution of the inverse kinematics problem of mobile robot manipulators with bounded or zero-oriented steady-state position error. Moreover, simulation studies and comprehensive comparisons with existing neural network models, e.g., the conventional Zhang neural network model and the gradient-based recurrent neural network model, together with extensive tests with four common forms of time-varying disturbances substantiate the efficacy, robustness, and superiority of the proposed RZND approach as well as its time-varying disturbances suppression model for solving the inverse kinematics problem of mobile robot manipulators.

Human experience–inspired path planning for robots

In this article, we present a human experience–inspired path planning algorithm for service robots. In addition to considering the path distance and smoothness, we emphasize the safety of robot navigation. Specifically, we build a speed field in accordance with several human driving experiences, like slowing down or detouring at a narrow aisle, and keeping a safe distance to the obstacles. Based on this speed field, the path curvatures, path distance, and steering speed are all integrated to form an energy function, which can be efficiently solved by the A* algorithm to seek the optimal path by resorting to an admissible heuristic function estimated from the energy function. Moreover, a simple yet effective fast path smoothing algorithm is proposed so as to ease the robots steering. Several examples are presented, demonstrating the effectiveness of our human experience–inspired path planning method.

A Velocity-Level Bi-Criteria Optimization Scheme for Coordinated Path Tracking of Dual Robot Manipulators Using Recurrent Neural Network

A dual-robot system is a robotic device composed of two robot arms. To eliminate the joint-angle drift and prevent the occurrence of high joint velocity, a velocity-level bi-criteria optimization scheme, which includes two criteria (i.e., the minimum velocity norm and the repetitive motion), is proposed and investigated for coordinated path tracking of dual robot manipulators. Specifically, to realize the coordinated path tracking of dual robot manipulators, two subschemes are first presented for the left and right robot manipulators. After that, such two subschemes are reformulated as two general quadratic programs (QPs), which can be formulated as one unified QP. A recurrent neural network (RNN) is thus presented to solve effectively the unified QP problem. At last, computer simulation results based on a dual three-link planar manipulator further validate the feasibility and the efficacy of the velocity-level optimization scheme for coordinated path tracking using the recurrent neural network.

Smooth Neuroadaptive PI Tracking Control of Nonlinear Systems With Unknown and Nonsmooth Actuation Characteristics

This paper considers the tracking control problem for a class of multi-input multi-output nonlinear systems subject to unknown actuation characteristics and external disturbances. Neuroadaptive proportional-integral (PI) control with self-tuning gains is proposed, which is structurally simple and computationally inexpensive. Different from traditional PI control, the proposed one is able to online adjust its PI gains using stability-guaranteed analytic algorithms without involving manual tuning or trial and error process. It is shown that the proposed neuroadaptive PI control is continuous and smooth everywhere and ensures the uniformly ultimately boundedness of all the signals of the closed-loop system. Furthermore, the crucial compact set precondition for a neural network (NN) to function properly is guaranteed with the barrier Lyapunov function, allowing the NN unit to play its learning/approximating role during the entire system operation. The salient feature also lies in its low complexity in computation and effectiveness in dealing with modeling uncertainties and nonlinearities. Both square and nonsquare nonlinear systems are addressed. The benefits and the feasibility of the developed control are also confirmed by simulations.