State of the Art and Development Trend of Laparoscopic Surgical Robot and Master Manipulator

BACKGROUND

In recent years, laparoscopic surgical robots have rapidly developed. However, most focus on the overall robotic systems, with few summaries on the laparoscopic surgical robots and the master manipulators.

METHODS

This paper provides a summary and analysis of typical laparoscopic surgical robots, including the strengths and limitations of existing laparoscopic surgical robots. Additionally, the master manipulators are analysed and summarised from four aspects: structural design and optimization, time-varying delays, tremor suppression and force feedback. Further classification and summary are made based on the different methods used in each study.

RESULTS

Laparoscopic surgical robots and the master manipulators still have some limitations. Therefore, the development trends of the laparoscopic surgical robots and the master manipulators are discussed from four aspects: structural materials, remote surgery, intelligence and human-machine interaction.

CONCLUSION

With the continuous advancement of technology, laparoscopic surgical robots will play an increasingly important role in the field of surgery.

Stable Bilateral Teleoperation Control Method for Biped Robots with Time-Varying Delays

This document proposes a control scheme applied to delayed bilateral teleoperation of the forward and turn speed of a biped robot against asymmetric and time-varying delays. This biped robot is modeled as a hybrid dynamic system because it behaves as a continuous system when the leg moves forward and discrete when the foot touches the ground generating an impulsive response. It is proposed to vary online the damping according to the time delay present in the communication channel, and the walking cycle time using an optimization criterion, to decrease the teleoperation system errors. To accomplish this, a three-phase cascade calibration process is used, and their benefits are evidenced in a comparative simulation study. The first phase is an offline calibration of the inverse dynamic compensation and also the parameters of the bilateral controller. The second phase guarantees the bilateral coordination of the delayed teleoperation system, using the Lyapunov–Krasovskii stability theory, by changing the leader damping and the equivalent follower damping together. The third phase assures a stable walk of the hybrid dynamics by controlling the walking cycle time and the real damping to move the eigenvalues of the Poincaré map, numerically computed, to stable limit cycles and link this result with an equivalent continuous system to join both phases. Additionally, a fictitious force was implemented to detect and avoid possible collisions with obstacles. Finally, an intercontinental teleoperation experiment of an NAO robot via the Internet including force and visual feedback is shown.

Composite Adaptive Guaranteed Performances Synchronization Control for Bilateral Teleoperation System With Asymmetrical Time-Varying Delays

This article studies the guaranteed performance synchronization control problem for networked bilateral teleoperation systems with system uncertainties. The communication channel connecting the master and the slave is subject to asymmetrical varying time delays with unknown upper bounds. The first result on prescribed performance synchronization control for the bilateral teleoperation system under such a weak assumption on the communication time delays is provided. Moreover, a novel composite adaptive control algorithm is proposed under a much weaker interval-excitation (IE) condition. More specifically, parameter adaptive estimation accuracy and speed are quantificationally ensured by employing a composite technique. Therefore, both steady-state performance and transient-state performance are achieved for the position synchronization and parameter estimation with the proposed control strategy. The Lyapunov function and the multidimensional small-gain framework are utilized to derive system stability criteria. It demonstrates that the allowable maximal derivatives of the transmission delays can be easily computed with the given parameters of the control algorithm and the nonlinear performance functions. Finally, both simulation and experimental results are provided to demonstrate the feasibility and superiority of the proposed composite adaptive strategy.

Bilateral motion prediction and control for teleoperation under long time-varying delays

Bilateral controller design for the teleoperation system is studied in this paper based on a motion prediction approach. To compensate the known long time-varying delays, novel predictors are presented to reconstruct the positions and velocities of robots on both sides through using the delayed measurements. The proposed predictors consist of several sub-predictors in a cascade structure, each of which is to predict the states of the previous one. The estimations of the actual states can be obtained from the last sub-predictor. New prediction horizons of each sub-observers are designed to cope with the time-varying fractions of the time delay. Then through applying the predicted results, bilateral predictive controller is designed for the teleoperation. The errors of both position tracking and prediction can converge into the bounded regions under several sufficient conditions of the control gains, which are obtained by using the Lyapunov-Krasovskii approach. The effective capacity of the presented method can be verified through comparative simulations.

Delayed Bilateral Teleoperation of the Speed and Turn Angle of a Bipedal Robot

This paper proposes a shared control scheme which aims to achieve a stable control of the speed and turn of a bipedal robot during a delayed bilateral teleoperation. The strategy allows to get a delay-dependent damping value that must be injected to assure a bounded response of the hybrid system, while simultaneously, the human operator receives a force feedback that help him to decrease the synchronism error. Furthermore, a test where a human operator handles the walking of a simulated bipedal robot, to follow a curve path in front of varying time delay, is performed and analyzed.

Human-inspired stable bilateral teleoperation of mobile manipulators

This paper presents a novel strategy for delayed bilateral teleoperation of mobile manipulator robots. The strategy is based on the hypothesis that if the slave robot behaves similarly as the operator would do to the same task, the operator's perception of the system states improves, and therefore the performance of the task is better. The proposed scheme allows controlling in simultaneously the mobile platform and the manipulator robot employing a single master device and maintaining the stability of the system against variable and asymmetric communication time delays. Stability guidelines based on Lyapunov-Krasovskii method are provided for the adjustment of the delayed system. Besides, a new control allocation strategy is proposed founded on the study of human movement in a task of navigation-pick and place. Finally, the performance of the proposal is compared with the standard switched control using a real robotic platform. As a result in practice, the proposed scheme is easier and more intuitive for the operator, besides it allows to reduce significantly the time necessary to complete the task.

Force and Position–Velocity Coordination for Delayed Bilateral Teleoperation of a Mobile Robot

This document proposes a control scheme for delayed bilateral teleoperation of a mobile robot, which it is sought to achieve a coordination of the master device position with the slave mobile robot velocity, and at the same time synchronize the force exerted by the operator with force applied by the environment over the mobile robot. This approach allows the operator to improve the sensitive perception of the remote environment in which the robot navigates while he generates commands to control the mobile robot motion. In this paper, variable and asymmetrical communication time delays are taken into account, as well as a non-passive model of the human operator, for which a novel model is proposed that has a more general structure than the typical ones used to date in the teleoperation field. Furthermore, based on the theoretical analysis presented, the state of convergence in the stationary response is obtained. In addition, an experimental performance evaluation is carried out, where the position–velocity error, force error and the time to complete the task are evaluated. In the tests, a human operator commands a remote mobile robot to push objects of different weight while he perceives the weight of each object through the force feedback system. As an outcome, the theoretical and practical results obtained allow concluding that a satisfactory trade-off between stability and transparency is reached.

A modular bilateral haptic control framework for teleoperation of robots

This paper presents a novel approach to implement bilateral control loops between local haptic devices and remote industrial manipulators using a layer of simulation and virtual reality. The remote scene of manipulation has been visualized in an open-source software environment, where forward and inverse kinematics of the manipulators can be computed. Therefore, the explicit knowledge of mathematical models of the robots is not required for the implementation of the proposed bilateral control schemes. A haptic coupling has been designed between the human operator and the task in the remote environment. Virtually introduced force feedback has contributed to the performance of the proposed bilateral loop by facilitating the adaptation of unexperienced human operators. Teleoperation of one remote manipulator has been experimentally demonstrated with the proposed controllers. Structural modularity of the bilateral haptic control schemes makes them directly extendable for the teleoperation of multiple collaborative robots. Stability and transparency of the proposed bilateral haptic controllers have been theoretically and experimentally investigated.

Multilateral Telecoordinated Control of Multiple Robots With Uncertain Kinematics

This paper addresses the telecoordinated control of multiple robots in the simultaneous presence of asymmetric time-varying delays, nonpassive external forces, and uncertain kinematics/dynamics. To achieve the control objective, a neuroadaptive controller with utilizing prescribed performance control and switching control technique is developed, where the basic idea is to employ the concept of motion synchronization in each pair of master-slave robots and among all slave robots. By using the multiple Lyapunov-Krasovskii functionals method, the state-independent input-to-output practical stability of the closed-loop system is established. Compared with the previous approaches, the new design is straightforward and easier to implement and is applicable to a wider area. Simulation results on three pairs of three degrees-of-freedom robots confirm the theoretical findings.

A Novel Switching-Based Control Framework for Improved Task Performance in Teleoperation System With Asymmetric Time-Varying Delays

This paper addresses the adaptive control for task-space teleoperation systems with constrained predefined synchronization error, where a novel switched control framework is investigated. Based on multiple Lyapunov-Krasovskii functionals method, the stability of the resulting closed-loop system is established in the sense of state-independent input-to-output stability. Compared with previous work, the developed method can simultaneously handle the unknown kinematics/dynamics, asymmetric varying time delays, and prescribed performance control in a unified framework. It is shown that the developed controller can guarantee the prescribed transient-state and steady-state synchronization performances between the master and slave robots, which is demonstrated by the simulation study.

Robust H∞ cost guaranteed integral sliding mode control for the synchronization problem of nonlinear tele-operation system with variable time-delay

This paper is devoted to the synchronization problem of tele-operation systems with time-varying delay, disturbances, and uncertainty. Delay-dependent sufficient conditions for the existence of integral sliding surfaces are given in the form of Linear Matrix Inequalities (LMIs). This guarantees the global stability of the tele-operation system with known upper bounds of the time-varying delays. Unlike previous work, in this paper, the controller gains are designed but not chosen, which increases the degree of freedom of the design. Moreover, Wirtinger based integral inequality and reciprocally convex combination techniques used in the constructed Lypunove-Krasoviskii Functional (LKF) are deemed to give less conservative stability condition for the system. Furthermore, to relax the analysis from any assumptions regarding the dynamics of the environment and human operator forces, H_∞ design method is used to involve the dynamics of these forces and ensure the stability of the system against these admissible forces in the H_∞ sense. This design scheme combines the strong robustness of the sliding mode control with the H_∞ design method for tele-operation systems which is coupled using state feedback controllers and inherit variable time-delays in their communication channels. Simulation examples are given to show the effectiveness of the proposed method.

Control for delayed bilateral teleoperation of a quadrotor

This paper proposes a cascade control scheme for delayed bilateral teleoperation of a quadcopter. The strategy transforms a 6D real quadcopter to an easy-to-teleoperate 3D virtual quadcopter. The scheme is formed by a P+d plus PID controller for each dof. The analysis based on Lyapunov theory gets as result the way to set the control parameters depending on the magnitude of the asymmetric time delays (forward and backward delays). This technic aims to reach stability, simplicity and good performance in practice. Besides, experimental tests about delayed bilateral teleoperation of a quadcopter including the proposed control scheme are shown in order to evaluate the system performance.

Adaptive Control of Semi-Autonomous Teleoperation System With Asymmetric Time-Varying Delays and Input Uncertainties

This paper addresses the adaptive task-space bilateral teleoperation for heterogeneous master and slave robots to guarantee stability and tracking performance, where a novel semi-autonomous teleoperation framework is developed to ensure the safety and enhance the efficiency of the robot in remote site. The basic idea is to stabilize the tracking error in task space while enhancing the efficiency of complex teleoperation by using redundant slave robot with subtask control. To unify the study of the asymmetric time-varying delays, passive/nonpassive exogenous forces, dynamic parameter uncertainties and dead-zone input in the same framework, a novel switching technique-based adaptive control scheme is investigated, where a special switched error filter is developed. By replacing the derivatives of position errors with their filtered outputs in the coordinate torque design, and employing the multiple Lyapunov-Krasovskii functionals method, the complete closed-loop master (slave) system is proven to be state-independent input-to-output stable. It is shown that both the position tracking errors in task space and the adaptive parameter estimation errors remain bounded for any bounded exogenous forces. Moreover, by using the redundancy of the slave robot, the proposed teleoperation framework can autonomously achieve additional subtasks in the remote environment. Finally, the obtained results are demonstrated by the simulation.

Passivity-based control framework for task-space bilateral teleoperation with parametric uncertainty over unreliable networks

Bilateral teleoperation systems developed in joint-space or in task-space without taking into account parameter uncertainties and unreliable communication have limited practical applications. In order to ensure stability, improve tracking performance, and enhance applicability, a novel task-space control framework for bilateral teleoperation with kinematic/dynamic uncertainties and time delays/packet losses is studied. In this paper, we have demonstrated that with the proposed control algorithms, the teleoperation system is stable and position tracking is guaranteed when the system is subjected to parametric uncertainties and communication delays. With the transformation of scattering variables, a packet modulation, called Passivity-Based Packet Modulation (PBPM), is proposed to cope with data losses, incurred in transmission of data over unreliable network. Moreover, numerical simulations and experiments are also presented to validate the efficiency of the developed control framework for task-space bilateral teleoperation.

Neural Network-Based Passivity Control of Teleoperation System Under Time-Varying Delays

In this paper, a novel neural network (NN)-based four-channel wave-based time domain passivity approach (TDPA) is proposed for a teleoperation system with time-varying delays. The designed wave-based TDPA aims to robustly guarantee the channels passivity and provide higher transparency than the previous power-based TDPA. The applied NN is used to estimate and eliminate the system's dynamic uncertainties. The system stability with linearity assumption on human and environment has been analyzed using Lyapunov method. The proposed algorithm is validated through experimental work based on a 3-DOF bilateral teleoperation platform in the presence of different time delays.

Dual-user nonlinear teleoperation subjected to varying time delay and bounded inputs

A novel trilateral control architecture for Dual-master/Single-slave teleoperation system with taking account of saturation in actuators, nonlinear dynamics for telemanipulators and bounded varying time delay which affects the transmitted signals in the communication channels, is proposed in this paper. In this research, we will address the stability and desired position coordination problem of trilateral teleoperation system by extension of (nP+D) controller that is used for Single-master/Single-slave teleoperation system. Our proposed controller is weighted summation of nonlinear Proportional plus Damping (nP+D) controller that incorporate gravity compensation and the weights are specified by the dominance factor, which determines the supremacy of each user over the slave robot and over the other user. The asymptotic stability of closed loop dynamics is studied using Lyapunov-Krasovskii functional under conditions on the controller parameters, the actuator saturation characteristics and the maximum values of varying time delays. It is shown that these controllers satisfy the desired position coordination problem in free motion condition. To show the effectiveness of the proposed method, a number of simulations have been conducted on a varying time delay Dual-master/Single-slave teleoperation system using 3-DOF planar robots for each telemanipulator subjected to actuator saturation.

Asymmetric Actuator Backlash Compensation in Quantized Adaptive Control of Uncertain Networked Nonlinear Systems

This paper mainly aims at the problem of adaptive quantized control for a class of uncertain nonlinear systems preceded by asymmetric actuator backlash. One challenging problem that blocks the construction of our control scheme is that the real control signal is wrapped in the coupling of quantization effect and nonsmooth backlash nonlinearity. To resolve this challenge, this paper presents a two-stage separation approach established on two new technical components, which are the approximate asymmetric backlash model and the nonlinear decomposition of quantizer, respectively. Then the real control is successfully separated from the coupling dynamics. Furthermore, by employing the neural networks and adaptation method in control design, a quantized controller is developed to guarantee the asymptotic convergence of tracking error to an adjustable region of zero and uniform ultimate boundedness of all closed-loop signals. Eventually, simulations are conducted to support our theoretical results.

Delay Compensation for Teleoperation Systems Based on Communication Disturbance Observers

This paper investigates the control problem for a class of teleoperation systems with communication delays. The network-induced delays are usually inevitable in teleoperation systems, and may be time varying and unpredictable. Since the conventional Smith predictor is only useful for fixed delays, a novel delay compensation and controller design method is proposed in this paper. The proposed method combines a disturbance rejection controller and a communication disturbance observer (CDOB). Simulations are provided to show the effectiveness and superiority of the proposed delay compensation and controller design method.

Medical telerobotic systems: current status and future trends

Teleoperated medical robotic systems allow procedures such as surgeries, treatments, and diagnoses to be conducted across short or long distances while utilizing wired and/or wireless communication networks. This study presents a systematic review of the relevant literature between the years 2004 and 2015, focusing on medical teleoperated robotic systems which have witnessed tremendous growth over the examined period. A thorough insight of telerobotics systems discussing design concepts, enabling technologies (namely robotic manipulation, telecommunications, and vision systems), and potential applications in clinical practice is provided, while existing limitations and future trends are also highlighted. A representative paradigm of the short-distance case is the da Vinci Surgical System which is described in order to highlight relevant issues. The long-distance telerobotics concept is exemplified through a case study on diagnostic ultrasound scanning. Moreover, the present review provides a classification into short- and long-distance telerobotic systems, depending on the distance from which they are operated. Telerobotic systems are further categorized with respect to their application field. For the reviewed systems are also examined their engineering characteristics and the employed robotics technology. The current status of the field, its significance, the potential, as well as the challenges that lie ahead are thoroughly discussed.

Finite Time Control Design for Bilateral Teleoperation System With Position Synchronization Error Constrained

Due to the cognitive limitations of the human operator and lack of complete information about the remote environment, the work performance of such teleoperation systems cannot be guaranteed in most cases. However, some practical tasks conducted by the teleoperation system require high performances, such as tele-surgery needs satisfactory high speed and more precision control results to guarantee patient' health status. To obtain some satisfactory performances, the error constrained control is employed by applying the barrier Lyapunov function (BLF). With the constrained synchronization errors, some high performances, such as, high convergence speed, small overshoot, and an arbitrarily predefined small residual constrained synchronization error can be achieved simultaneously. Nevertheless, like many classical control schemes only the asymptotic/exponential convergence, i.e., the synchronization errors converge to zero as time goes infinity can be achieved with the error constrained control. It is clear that finite time convergence is more desirable. To obtain a finite-time synchronization performance, the terminal sliding mode (TSM)-based finite time control method is developed for teleoperation system with position error constrained in this paper. First, a new nonsingular fast terminal sliding mode (NFTSM) surface with new transformed synchronization errors is proposed. Second, adaptive neural network system is applied for dealing with the system uncertainties and the external disturbances. Third, the BLF is applied to prove the stability and the nonviolation of the synchronization errors constraints. Finally, some comparisons are conducted in simulation and experiment results are also presented to show the effectiveness of the proposed method.

PD-like controller with impedance for delayed bilateral teleoperation of mobile robots

This paper proposes a control scheme applied to the delayed bilateral teleoperation of mobile robots with force feedback in face of asymmetric and time-varying delays. The scheme is managed by a velocity PD-like control plus impedance and a force feedback based on damping and synchronization error. A fictitious force, depending on the robot motion and its environment, is used to avoid possible collisions. In addition, the stability of the system is analyzed from which simple conditions for the control parameters are established in order to assure stability. Finally, the performance of the delayed teleoperation system is shown through experiments where a human operator drives a mobile robot.

Quality of teleoperator adaptive control for telerobotic operations

Extensive studies have been conducted on telerobotic operations for decades due to their widespread applications in a variety of areas. Most studies have been focused on two major issues: stability and telepresence. Few have studied the influence of the operation status of the teleoperator on the performance of telerobotic operations. As subnormal operation status of the teleoperator may result in insufficient and even incorrect operations, the quality of teleoperator (QoT) is an important impact on the performance of the telerobotic operations in terms of the efficiency and safety even if both the stability and telepresence are guaranteed. Therefore, this paper investigates the online identification of the QoT and its application to telerobotic operations. The QoT is identified based on five QoT indicators which are generated based on the teleoperator’s brain EEG signals. A QoT adaptive control method is designed to adapt the velocity and responsivity of the robotic system to the operation status of the teleoperator such that the teleoperation efficiency and safety can be enhanced. The online QoT identification method was conducted on various teleoperators and the QoT adaptive control method was implemented on a mobile manipulator teleoperation system. The experimental results demonstrated the effectiveness and advantages of the proposed methods.

Task-space bilateral teleoperation systems for heterogeneous robots with time-varying delays

This paper proposes control algorithms for heterogeneous teleoperation systems to guarantee stability and tracking performance in the presence of time-varying communication delays. Because robotic manipulators, in most applications of bilateral teleoperation systems, interact with a human operator and remote environment on the end-effector, the control system is developed in the task-space. When the dynamic parameters of the robots are unknown and the communication network is subject to time-varying delay, the developed controller can ensure stability and task-space position tracking. Additionally, if the robotic systems are influenced by human and environmental forces, the presented teleoperation control system is demonstrated to be stable and all signals are proven to be ultimately bounded. By employing the redundancy of the slave robot for sub-task control, the proposed teleoperation system can autonomously achieve additional missions in the remote environment. Numerical examples utilizing a redundant planar robot are addressed to validate the proposed task-space teleoperators with time-varying delay.

Position and force tracking in nonlinear teleoperation systems under varying delays

In this paper, a novel control scheme is proposed to guarantee position and force tracking in nonlinear teleoperation systems subject to varying communication delays. Stability and tracking performance of the teleoperation system are proved using a proposed Lyapunov–Krasovskii functional. To show its effectiveness, the teleoperation controller is simulated on a pair of planar 2-DOF (degree of freedom) robots and experimented on a pair of 3-DOF PHANToM Premium 1.5A robots connected via a communication channel with time-varying delays. Both the planar robots in simulations and the PHANToM robots in experiments possess nonlinear dynamics.

Finite-time coordination control for networked bilateral teleoperation

A continuous finite-time control scheme for networked bilateral teleoperation is proposed in this brief. The terminal sliding mode technology is used and new master–slave torques are designed. With the new controller, the coordination error of the master manipulator and the slave manipulator converges to zero in finite time. Moreover, the reaching time and the sliding time can be derived. Finally, the comparisons are performed and simulations show the effectiveness of the proposed approach.

Bilateral Teleoperation in Cartesian Space with Time-Varying Delay

The bilateral control of a teleoperator in Cartesian space with time-varying delay is studied in this paper. Compared with the traditional joint-space teleoperation mode, bilateral control in Cartesian space has advantages when dealing with the kinematically dissimilar (KDS) teleoperation systems. A Cartesian space-based PD-like bilateral controller with dissipation factors is designed. Considering the fact that attitude errors derived by rotation matrix cannot be directly used for PD control, a quaternion-based approach is adopted to calculate the attitude errors in Cartesian space. In order to overcome the instability brought about by communication delay, local damping components are employed at both ends of the teleoperator system. The variation of time delay may generate extra energy and influence the stability of the system, thus dissipation factors are introduced into the controller. The stability of the proposed bilateral controller is proved and the simulations show the effectiveness of the approach.

Bilateral control of master-slave manipulators with constant time delay

This paper presents a novel teleoperation controller for a nonlinear master-slave robotic system with constant time delay in communication channel. The proposed controller enables the teleoperation system to compensate human and environmental disturbances, while achieving master and slave position coordination in both free motion and contact situation. The current work basically extends the passivity based architecture upon the earlier work of Lee and Spong (2006) [14] to improve position tracking and consequently transparency in the face of disturbances and environmental contacts. The proposed controller employs a PID controller in each side to overcome some limitations of a PD controller and guarantee an improved performance. Moreover, by using Fourier transform and Parseval's identity in the frequency domain, we demonstrate that this new PID controller preserves the passivity of the system. Simulation and semi-experimental results show that the PID controller tracking performance is superior to that of the PD controller tracking performance in slave/environmental contacts.