Toward Autonomous Pulmonary Artery Catheterization: A Learning-based Robotic Navigation System

Providing imaging during interventional treatments of cardiovascular diseases is challenging. Magnetic Resonance Imaging (MRI) has gained popularity as it is radiation-free and returns high resolution of soft tissue. However, the clinician has limited access to the patient, e.g., to their femoral artery, within the MRI scanner to accurately guide and manipulate an MR-compatible catheter. At the same time, communication will need to be maintained with a clinician, located in a separate control room, to provide the most appropriate image to the screen inside the MRI room. Hence, there is scope to explore the feasibility of how autonomous catheterization robots could support the steering of catheters along trajectories inside complex vessel anatomies.In this paper, we present a Learning from Demonstration based Gaussian Mixture Model for a robot trajectory optimisation during pulmonary artery catheterization. The optimisation algorithm is integrated into a 2 Degree-of-Freedom MR-compatible interventional robot allowing for continuous and simultaneous translation and rotation. Our methodology achieves autonomous navigation of the catheter tip from the inferior vena cava, through the right atrium and the right ventricle into the pulmonary artery where an interventions is performed. Our results show that our MR-compatible robot can follow an advancement trajectory generated by our Learning from Demonstration algorithm. Looking at the overall duration of the intervention, it can be concluded that procedures performed by the robot (teleoperated or autonomously) required significantly less time compared to manual hand-held procedures.

State of the Art and Future Opportunities in MRI-Guided Robot-Assisted Surgery and Interventions

Magnetic resonance imaging (MRI) can provide high-quality 3-D visualization of target anatomy, surrounding tissue, and instrumentation, but there are significant challenges in harnessing it for effectively guiding interventional procedures. Challenges include the strong static magnetic field, rapidly switching magnetic field gradients, high-power radio frequency pulses, sensitivity to electrical noise, and constrained space to operate within the bore of the scanner. MRI has a number of advantages over other medical imaging modalities, including no ionizing radiation, excellent soft-tissue contrast that allows for visualization of tumors and other features that are not readily visible by other modalities, true 3-D imaging capabilities, including the ability to image arbitrary scan plane geometry or perform volumetric imaging, and capability for multimodality sensing, including diffusion, dynamic contrast, blood flow, blood oxygenation, temperature, and tracking of biomarkers. The use of robotic assistants within the MRI bore, alongside the patient during imaging, enables intraoperative MR imaging (iMRI) to guide a surgical intervention in a closed-loop fashion that can include tracking of tissue deformation and target motion, localization of instrumentation, and monitoring of therapy delivery. With the ever-expanding clinical use of MRI, MRI-compatible robotic systems have been heralded as a new approach to assist interventional procedures to allow physicians to treat patients more accurately and effectively. Deploying robotic systems inside the bore synergizes the visual capability of MRI and the manipulation capability of robotic assistance, resulting in a closed-loop surgery architecture. This article details the challenges and history of robotic systems intended to operate in an MRI environment and outlines promising clinical applications and associated state-of-the-art MRI-compatible robotic systems and technology for making this possible.

Visual servoing of continuum robots: Methods, challenges, and prospects

BACKGROUND

Recent advancements in continuum robotics have accentuated developing efficient and stable controllers to handle shape deformation and compliance. The control of continuum robots (CRs) using physical sensors attached to the robot, particularly in confined spaces, is difficult due to their limited accuracy in three-dimensional deflections and challenging localisation. Therefore, using non-contact imaging sensors finds noticeable importance, particularly in medical scenarios. Accordingly, given the need for direct control of the robot tip and notable uncertainties in the kinematics and dynamics of CRs, many papers have focussed on the visual servoing (VS) of CRs in recent years.

METHODS

The significance of this research towards safe human-robot interaction has fuelled our survey on the previous methods, current challenges, and future opportunities.

RESULTS

Beginning with actuation modalities and modelling approaches, the paper investigates VS methods in medical and non-medical scenarios.

CONCLUSIONS

Finally, challenges and prospects of VS for CRs are discussed, followed by concluding remarks.

Remote vascular interventional surgery robotics: a literature review

Vascular interventional doctors are exposed to radiation hazards during surgery and endure high work intensity. Remote vascular interventional surgery robotics is a hot research field, in which researchers aim to not only protect the health of interventional doctors, but to also improve surgical accuracy and efficiency. However, the current vascular interventional robots have numerous shortcomings, such as poor haptic feedback, few compatible surgeries and instruments, and cumbersome maintenance and operational procedures. Nevertheless, vascular interventional surgery combined with robotics provides more cutting-edge directions, such as Internet remote surgery combined with 5G network technology and the application of artificial intelligence in surgical procedures. To summarize the developmental status and key technical points of intravascular interventional surgical robotics research, we performed a systematic literature search to retrieve original articles related to remote vascular interventional surgery robotics published up to December 2020. This review, which includes 113 articles published in English, introduces the mechanical and structural characteristics of various aspects of vascular interventional surgical robotics, discusses the current key features of vascular interventional surgical robotics in force sensing, haptic feedback, and control methods, and summarizes current frontiers in autonomous surgery, long-distance robotic telesurgery, and magnetic resonance imaging (MRI)-compatible structures. On the basis of summarizing the current research status of remote vascular interventional surgery robotics, we aim to propose a variety of prospects for future robotic systems.

Reducing the Guidewire Friction for Endovascular Interventional Surgery by Radial Micro-Vibration

Guidewires for endovascular interventional surgery are inevitably affected by high frictional resistance because of direct contact with the vascular wall, which greatly reduces the operation efficiency and safety. This article presents a method of applying radial ultrasonic microvibration at the proximal end of a conventional passive guidewire to reduce the frictional resistance. The proposed method theoretically reduced the frictional resistance by reducing the friction coefficient, actual contact area, and the net friction time between the guidewire and vascular wall. The effectiveness of the proposed method was experimentally demonstrated in designed simulations of the blood vessel environment, where the influences of the vibration amplitude on the drag reduction effect were considered. The results indicated that vibrating the guidewire at the resonant frequency with the designed device clearly reduced the drag with a maximum frictional reduction rate of 85.19%. At the resonant frequency, the change in frictional resistance showed a linear negative correlation with the applied vibration amplitude. The proposed method offers a new approach to improving the efficiency and safety of vascular interventional surgery.

Contact Stability and Contact Safety of a Magnetic Resonance Imaging-Guided Robotic Catheter Under Heart Surface Motion

Contact force quality is one of the most critical factors for safe and effective lesion formation during catheter based atrial fibrillation ablation procedures. In this paper, the contact stability and contact safety of a novel magnetic resonance imaging (MRI)-actuated robotic cardiac ablation catheter subject to surface motion disturbances are studied. First, a quasi-static contact force optimization algorithm, which calculates the actuation needed to achieve a desired contact force at an instantaneous tissue surface configuration is introduced. This algorithm is then generalized using a least-squares formulation to optimize the contact stability and safety over a prediction horizon for a given estimated heart motion trajectory. Four contact force control schemes are proposed based on these algorithms. The first proposed force control scheme employs instantaneous heart position feedback. The second control scheme applies a constant actuation level using a quasi-periodic heart motion prediction. The third and the last contact force control schemes employ a generalized adaptive filter-based heart motion prediction, where the former uses the predicted instantaneous position feedback, and the latter is a receding horizon controller. The performance of the proposed control schemes is compared and evaluated in a simulation environment.

Contact Stability Analysis of Magnetically-Actuated Robotic Catheter Under Surface Motion

Contact force quality is one of the most critical factors for safe and effective lesion formation during cardiac ablation. The contact force and contact stability plays important roles in determining the lesion size and creating a gap-free lesion. In this paper, the contact stability of a novel magnetic resonance imaging (MRI)-actuated robotic catheter under tissue surface motion is studied. The robotic catheter is modeled using a pseudo-rigid-body model, and the contact model under surface constraint is provided. Two contact force control schemes to improve the contact stability of the catheter under heart surface motions are proposed and their performance are evaluated in simulation.

Steerable catheters for minimally invasive surgery: a review and future directions

The steerable catheter refers to the catheter that is manipulated by a mechanism which may be driven by operators or by actuators. The steerable catheter for minimally invasive surgery has rapidly become a rich and diverse area of research. Many important achievements in design, application and analysis of the steerable catheter have been made in the past decade. This paper aims to provide an overview of the state of arts of steerable catheters. Steerable catheters are classified into four main groups based on the actuation principle: (1) tendon driven catheters, (2) magnetic navigation catheters, (3) soft material driven catheters (shape memory effect catheters, steerable needles, concentric tubes, conducting polymer driven catheters and hydraulic pressure driven catheters), and (4) hybrid actuation catheters. The advantages and limitations of each of them are commented and discussed in this paper. The future directions of research are summarized.

Compensatory force measurement and multimodal force feedback for remote-controlled vascular interventional robot

Minimally invasive vascular interventional surgery is widely used and remote-controlled vascular interventional surgery robots (RVIRs) are being developed to reduce the occupational risk of the intervening physician in minimally invasive vascular interventional surgeries. Skilled surgeon performs surgeries mainly depending on the detection of collisions. Inaccurate force feedback will be difficult for surgeons to perform surgeries or even results in medical accidents. In addition, the surgeon cannot quickly and easily distinguish whether the proximal force exceeds the safety threshold of blood vessels or not, and thus it results in damage to the blood vessels. In this paper, we present a novel method comprising compensatory force measurement and multimodal force feedback (MFF). Calibration experiments and performance evaluation experiments were carried out. Experimental results demonstrated that the proposed method can measure the proximal force of catheter/guidewire accurately and assist surgeons to distinguish the change of proximal force more easily. This novel method is suitable for use in actual surgical operations.

Operation evaluation in-human of a novel remote-controlled vascular interventional robot

Remote-controlled vascular interventional robots (RVIRs) are being developed to increase the accuracy of surgical operations and reduce the number of occupational risks sustained by intervening physicians, such as radiation exposure and chronic neck/back pain. However, complex control of the RVIRs improves the doctor's operation difficulty and reduces the operation efficiency. Furthermore, incomplete sterilization of the RVIRs will increase the risk of infection, or even cause medical accidents. In this study, we introduced a novel method that provides higher operation efficiency than a previous prototype and allows for complete robot sterilization. A prototype was fabricated and validated through laboratory setting experiments and an in-human experiment. The results illustrated that the proposed RVIR has better performance compared with the previous prototype, and preliminarily demonstrated that the proposed RVIR has good safety and reliability and can be used in clinical surgeries.

A cooperation of catheters and guidewires-based novel remote-controlled vascular interventional robot

Remote-controlled vascular interventional robots (RVIRs) are being developed to increase the overall accuracy of surgical operations and reduce the occupational risks of intervening physicians, such as radiation exposure and chronic neck/back pain. Several RVIRs have been used to operate catheters or guidewires accurately. However, a lack of cooperation between the catheters and guidewires results in the surgeon being unable to complete complex surgery by propelling the catheter/guidewire to the target position. Furthermore, it is a significant challenge to operate the catheter/guidewire accurately and detect their proximal force without damaging their surfaces. In this study, we introduce a novel method that allows catheters and guidewires to be operated simultaneously in complex surgery. Our method accurately captures force measurements and enables precisely controlled catheter and guidewire operation. A prototype is validated through various experiments. The results demonstrate the feasibility of the proposed RVIR to operate a catheter and guidewire accurately, detect the resistance forces, and complete complex surgical operations in a cooperative manner.

Model predictive control of a robotically actuated delivery sheath for beating heart compensation

Minimally invasive surgery (MIS) during cardiovascular interventions reduces trauma and enables the treatment of high-risk patients who were initially denied surgery. However, restricted access, reduced visibility and control of the instrument at the treatment locations limits the performance and capabilities of such interventions during MIS. Therefore, the demand for technology such as steerable sheaths or catheters that assist the clinician during the procedure is increasing. In this study, we present and evaluate a robotically actuated delivery sheath (RADS) capable of autonomously and accurately compensating for beating heart motions by using a model-predictive control (MPC) strategy. We develop kinematic models and present online ultrasound segmentation of the RADS that are integrated with the MPC strategy. As a case study, we use pre-operative ultrasound images from a patient to extract motion profiles of the aortic heart valve (AHV). This allows the MPC strategy to anticipate for AHV motions. Further, mechanical hysteresis in the steering mechanism is compensated for in order to improve tip positioning accuracy. The novel integrated system is capable of controlling the articulating tip of the RADS to assist the clinician during cardiovascular surgery. Experiments demonstrate that the RADS follows the AHV motion with a mean positioning error of 1.68 mm. The presented modelling, imaging and control framework could be adapted and applied to a range of continuum-style robots and catheters for various cardiovascular interventions.

Modeling and Validation of the Three-Dimensional Deflection of an MRI-Compatible Magnetically Actuated Steerable Catheter

OBJECTIVE

This paper presents the 3-D kinematic modeling of a novel steerable robotic ablation catheter system. The catheter, embedded with a set of current-carrying microcoils, is actuated by the magnetic forces generated by the magnetic field of the magnetic resonance imaging (MRI) scanner.

METHODS

This paper develops a 3-D model of the MRI-actuated steerable catheter system by using finite differences approach. For each finite segment, a quasi-static torque-deflection equilibrium equation is calculated using beam theory. By using the deflection displacements and torsion angles, the kinematic model of the catheter system is derived.

RESULTS

The proposed models are validated by comparing the simulation results of the proposed model with the experimental results of a hardware prototype of the catheter design. The maximum tip deflection error is 4.70 mm and the maximum root-mean-square error of the shape estimation is 3.48 mm.

CONCLUSION

The results demonstrate that the proposed model can successfully estimate the deflection motion of the catheter.

SIGNIFICANCE

The presented 3-D deflection model of the magnetically controlled catheter design paves the way to efficient control of the robotic catheter for the treatment of atrial fibrillation.

Concentric Tube Robot Design and Optimization Based on Task and Anatomical Constraints

Concentric tube robots are catheter-sized continuum robots that are well suited for minimally invasive surgery inside confined body cavities. These robots are constructed from sets of pre-curved superelastic tubes and are capable of assuming complex 3D curves. The family of 3D curves that the robot can assume depends on the number, curvatures, lengths and stiffnesses of the tubes in its tube set. The robot design problem involves solving for a tube set that will produce the family of curves necessary to perform a surgical procedure. At a minimum, these curves must enable the robot to smoothly extend into the body and to manipulate tools over the desired surgical workspace while respecting anatomical constraints. This paper introduces an optimization framework that utilizes procedureor patient-specific image-based anatomical models along with surgical workspace requirements to generate robot tube set designs. The algorithm searches for designs that minimize robot length and curvature and for which all paths required for the procedure consist of stable robot configurations. Two mechanics-based kinematic models are used. Initial designs are sought using a model assuming torsional rigidity. These designs are then refined using a torsionally-compliant model. The approach is illustrated with clinically relevant examples from neurosurgery and intracardiac surgery.

Design and Kinematic Analysis of a New End-Effector for a Robotic Needle Insertion-Type Intervention System

This paper presents a new end-effector as a key component for a robotic needle insertion-type intervention system and its kinematic analysis. The mechanism is designed as a spherical mechanism with a revolute joint and a curved sliding joint, and its links always move on the surface of a sphere. The remote centre of motion (RCM) of the designed mechanism is placed below the base of the mechanism to avoid contact with the patient's body, unlike the conventional end-effectors developed for needle insertion. For the proposed mechanism, the forward kinematics are solved in terms of input joint parameters and then the reverse kinematics are solved by using the cross-product relationship between each joint vector and a vector mutually perpendicular to the vectors. The kinematic solutions are confirmed by numerical examples.

Visual servoing in medical robotics: a survey. Part II: tomographic imaging modalities--techniques and applications

BACKGROUND

Intraoperative application of tomographic imaging techniques provides a means of visual servoing for objects beneath the surface of organs.

METHODS

The focus of this survey is on therapeutic and diagnostic medical applications where tomographic imaging is used in visual servoing. To this end, a comprehensive search of the electronic databases was completed for the period 2000-2013.

RESULTS

Existing techniques and products are categorized and studied, based on the imaging modality and their medical applications. This part complements Part I of the survey, which covers visual servoing techniques using endoscopic imaging and direct vision.

CONCLUSION

The main challenges in using visual servoing based on tomographic images have been identified. 'Supervised automation of medical robotics' is found to be a major trend in this field and ultrasound is the most commonly used tomographic modality for visual servoing.

Robotic catheter cardiac ablation combining ultrasound guidance and force control

Cardiac catheters allow physicians to access the inside of the heart and perform therapeutic interventions without stopping the heart or opening the chest. However, conventional manual and actuated cardiac catheters are currently unable to precisely track and manipulate the intracardiac tissue structures because of the fast tissue motion and potential for applying damaging forces. This paper addresses these challenges by proposing and implementing a robotic catheter system that uses 3D ultrasound image guidance and force control to enable constant contact with a moving target surface in order to perform interventional procedures, such as intracardiac tissue ablation. The robotic catheter system, consisting of a catheter module, ablation and force sensing end effector, drive system, and image-guidance and control system, was commanded to apply a constant force against a moving target using a position-modulated force control method. The control system uses a combination of position tracking, force feedback, and friction and backlash compensation to achieve accurate and safe catheter–tissue interactions. The catheter was able to maintain a 1 N force on a moving motion simulator target under ultrasound guidance with 0.08 N RMS error. In a simulated ablation experiment, the robotic catheter was also able to apply a consistent force on the target while maintaining ablation electrode contact with 97% less RMS contact resistance variation than a passive mechanical equivalent. In addition, the use of force control improved catheter motion tracking by approximately 20%. These results demonstrate that 3D ultrasound guidance and force tracking allow the robotic system to maintain improved contact with a moving tissue structure, thus allowing for more accurate and repeatable cardiac procedures.

Current and emerging robot-assisted endovascular catheterization technologies: a review

Endovascular techniques have been embraced as a minimally-invasive treatment approach within different disciplines of interventional radiology and cardiology. The current practice of endovascular procedures, however, is limited by a number of factors including exposure to high doses of X-ray radiation, limited 3D imaging, and lack of contact force sensing from the endovascular tools and the vascular anatomy. More recently, advances in steerable catheters and development of master/slave robots have aimed to improve these practices by removing the operator from the radiation source and increasing the precision and stability of catheter motion with added degrees-of-freedom. Despite their increased application and a growing research interest in this area, many such systems have been designed without considering the natural manipulation skills and ergonomic preferences of the operators. Existing studies on tool interactions and natural manipulation skills of the operators are limited. In this manuscript, new technical developments in different aspects of robotic endovascular intervention including catheter instrumentation, intra-operative imaging and navigation techniques, as well as master/slave based robotic catheterization platforms are reviewed. We further address emerging trends and new research opportunities towards more widespread clinical acceptance of robotically assisted endovascular technologies.

A remote-controlled vascular interventional robot: system structure and image guidance

BACKGROUND

Robot-assisted vascular interventional surgery (VIS) enables the surgeon to teleoperate a catheter in a safe cabinet, such that exposure to X-ray radiation is reduced. For safe and accurate teleoperation, system structure and image guidance is important.

METHODS

The system structure of the developed remote-controlled vascular interventional robot (RVIR) and its image guidance system (IGS) are introduced. RVIR is based on a master-slave structure. Key technologies of IGS are addressed, including C-arm calibration, distortion correction, catheter localization and 3D vasculature reconstruction.

RESULTS

Experiments show that the RMS error of distortion correction is 0.35 pixels, and 0.53 mm for distance reconstruction. The error in catheter localization between the IGS and the encoders is small. In vitro and in vivo tests verified the feasibility of RVIR.

CONCLUSIONS

Experiments indicate that the RVIR is feasible and valid to help the surgeon perform VIS remotely; the function and reconstruction accuracy of IGS can satisfy the surgeon's requirement to guide the RVIR.

Optimal transseptal puncture location for robot-assisted left atrial catheter ablation

BACKGROUND

The preferred method of treatment for atrial fibrillation (AF) is by catheter ablation, in which a catheter is guided into the left atrium through a transseptal puncture. However, the transseptal puncture constrains the catheter, thereby limiting its manoeuvrability and increasing the difficulty in reaching various locations in the left atrium. In this paper, we address the problem of choosing the optimal transseptal puncture location for performing cardiac ablation to obtain maximum manoeuvrability of the catheter.

METHODS

We have employed an optimization algorithm to maximize the global isotropy index (GII) to evaluate the optimal transseptal puncture location. As part of this algorithm, a novel kinematic model for the catheter has been developed, based on a continuum robot model. Pre-operative MR/CT images of the heart are segmented using the open source image-guided therapy software, 3D Slicer, to obtain models of the left atrium and septal wall. These models are input to the optimization algorithm to evaluate the optimal transseptal puncture location.

RESULTS

The continuum robot model accurately describes the kinematics of the catheter. Simulation and experimental results for the optimal transseptal puncture location are presented in this paper. The optimization algorithm generates discrete points on the septal wall for which the dexterity of the catheter in the left atrium is maximum, corresponding to a GII of 0.4362.

CONCLUSION

We have developed an optimization algorithm based on the GII to evaluate the optimal position of the transseptal puncture for left atrial cardiac ablation.

Robot-assisted Active Catheter Insertion: Algorithms and Experiments

Angioplasty is a frequently performed clinical procedure in which a catheter is inserted into a blood vessel under image guidance to open narrowed or blocked arteries and to allow normal blood flow to resume. This paper is concerned with the development of algorithms for a robot-assisted method for a more accurate, safer and more reliable approach for catheter insertion that can reduce the potential for injury to patients and radiation exposure or discomfort to clinicians. A force control algorithm is presented for a robot to control the force of insertion of a catheter and prevent the catheter from buckling or “bunching up” during insertion. In addition, the paper also describes a master—slave control strategy to precisely control the bending angle of the tip of an active catheter instrumented with Shape Memory Alloy (SMA) actuators. A novel model for SMAs and a robust H∞loop-shaping controller have been implemented to guarantee robust performance of the active catheter. The algorithms for catheter insertion developed in this paper may help to prevent damage to the epithelial cells of an artery and enable easier guidance of the catheter into appropriate branches. In addition, a robotics-based approach could make it possible for a clinician to remotely perform the insertion of the active catheter from a safe and comfortable environment, thereby reducing exposure to harmful X-ray radiation. Experimental results are presented to illustrate the performance of the algorithms.