1
|
Mendoza-Bautista KJ, Torres-Mendez LA, Chairez I. Systematic review on visual aid technologies for surgical assistant robotic devices . PROGRESS IN BIOMEDICAL ENGINEERING (BRISTOL, ENGLAND) 2025; 7:022006. [PMID: 39999565 DOI: 10.1088/2516-1091/adba20] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/02/2024] [Accepted: 02/25/2025] [Indexed: 02/27/2025]
Abstract
This review comprehensively analyzes the modern literature on including visual aids in diverse surgical assistant robotic systems. The review considered a deep analysis of diverse technical and scientific sources that provide precise information on how the more recent surgical systems, especially those considering robotic devices, perform automatic operations on patients. The search procedure and the corresponding analytics considered only those conditions where vision systems played a significant role in the surgical procedure, despite the type of end-effector and if only position or force were used as part of the feedback analysis. This review is organized considering the robot configuration, the type of end-effector, the vision systems considered for those cases, and the associated control actions, which must include the acquired image or video. The study analyzes the key contributions of the published cases. It provides a critical description of the advantages and shortcomings of the technological implementation of vision systems in surgical robotic devices. Finally, this review provides a general prospective view of ongoing research on vision aids for surgical robotic systems, which will become an ordinary actor in future surgical systems.
Collapse
Affiliation(s)
| | - L Abril Torres-Mendez
- Robotics and Advanced Manufacturing, CINVESTAV Saltillo, Ramos Arizpe, Coahuila, Mexico
| | - Isaac Chairez
- Institute of Advanced Materials for Sustainable Manufacturing, Tecnológico de Monterrey, Zapopan, Jalisco, Mexico
| |
Collapse
|
2
|
Zhang L, Zuo J, Wang K, Jiang T, Gu S, Xu L, Zhang Y. An advanced robotic system incorporating haptic feedback for precision cardiac ablation procedures. Sci Rep 2025; 15:6839. [PMID: 40000834 PMCID: PMC11862161 DOI: 10.1038/s41598-025-91342-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2024] [Accepted: 02/19/2025] [Indexed: 02/27/2025] Open
Abstract
This study introduces an innovative master-slave cardiac ablation catheter robot system that employs magnetorheological fluids. The system incorporates magnetorheological fluid to enable collision detection through haptic feedback, thereby enhancing the operator's situational awareness. A modular clamping and propulsion mechanism has been engineered for the ablation catheter, facilitating omnidirectional operation and force feedback within the cardiac cavity. To evaluate the proposed system, an in vitro experiment was performed. Results from the experiment indicate that the system demonstrates high motion transmission accuracy. Furthermore, the system effectively alerts operators to potential collisions, enabling swift catheter position adjustments, minimizing the risk of vascular perforation, and ultimately enhancing the overall safety and efficiency of the procedure.
Collapse
Affiliation(s)
- Linshuai Zhang
- School of Intelligent Medicine, Chengdu University of Traditional Chinese Medicine, Chengdu, 611137, China
- School of Automation, Chengdu University of Information Technology, Chengdu, 610225, China
- International Joint Research Center of Robotics and Intelligence System of Sichuan Province, Chengdu, Sichuan, China
| | - Jinshan Zuo
- School of Intelligent Medicine, Chengdu University of Traditional Chinese Medicine, Chengdu, 611137, China
| | - Ke Wang
- School of Intelligent Medicine, Chengdu University of Traditional Chinese Medicine, Chengdu, 611137, China
| | - Tao Jiang
- School of Intelligent Medicine, Chengdu University of Traditional Chinese Medicine, Chengdu, 611137, China.
| | - Shuoxin Gu
- School of Automation, Chengdu University of Information Technology, Chengdu, 610225, China.
| | - Lin Xu
- School of Intelligent Medicine, Chengdu University of Traditional Chinese Medicine, Chengdu, 611137, China
| | - Yujie Zhang
- School of Intelligent Medicine, Chengdu University of Traditional Chinese Medicine, Chengdu, 611137, China
| |
Collapse
|
3
|
Gao H, Liu H, Jia H, Lin Z, Zou Y, Xu Z, Huang S, Tan H, Wu H, Chen W, Gao A. Multi-axis robotic forceps with decoupled pneumatic actuation and force sensing for cochlear implantation. Nat Commun 2025; 16:1648. [PMID: 39952944 PMCID: PMC11828907 DOI: 10.1038/s41467-025-56958-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Accepted: 02/03/2025] [Indexed: 02/17/2025] Open
Abstract
Delicate manual microsurgeries rely on sufficient hands-on experience for safe manipulations. Automated surgical devices can enhance the effectiveness, but developing high-resolution, multi-axis force-sensing devices for micro operations remains challenging. In this study, a 6-axis force-sensing pneumatic forceps with a serial-parallel robotic platform for cochlear implantation is developed. The forceps features a curved body shape embedded with parallel and inclined fiber Bragg grating sensors for 6-axis force sensing, and a pneumatic gripper with decoupled actuation is located at its end for actively grasping and releasing the electrode array. The robotic platform comprises a customized spherical parallel mechanism and a robotic arm, which can provide independent 3-DOF rotations and 3-DOF translations. The feasibility of the developed robotic forceps is validated through cadaveric studies on a temporal bone and a human cadaveric head. In summary, the robotic forceps provides a decoupled mechanism for pneumatic actuation and force sensing, further demonstrating its potential for force interaction and stable operation during robotic microsurgery.
Collapse
Affiliation(s)
- Hongyan Gao
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, PR China
- Department of Automation, Shanghai Jiao Tong University, and the Key Laboratory of System Control and Information Processing, Ministry of Education, Shanghai, PR China
| | - Huanghua Liu
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, PR China
- Department of Automation, Shanghai Jiao Tong University, and the Key Laboratory of System Control and Information Processing, Ministry of Education, Shanghai, PR China
| | - Huan Jia
- Department of Otorhinolaryngology Head and Neck Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China
| | - Zecai Lin
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, PR China
- Department of Automation, Shanghai Jiao Tong University, and the Key Laboratory of System Control and Information Processing, Ministry of Education, Shanghai, PR China
| | - Yun Zou
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, PR China
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, PR China
| | - Zheng Xu
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, PR China
- Department of Automation, Shanghai Jiao Tong University, and the Key Laboratory of System Control and Information Processing, Ministry of Education, Shanghai, PR China
| | - Shaoping Huang
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, PR China
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, PR China
| | - Haoyue Tan
- Department of Otorhinolaryngology Head and Neck Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China
| | - Hao Wu
- Department of Otorhinolaryngology Head and Neck Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China.
| | - Weidong Chen
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, PR China.
- Department of Automation, Shanghai Jiao Tong University, and the Key Laboratory of System Control and Information Processing, Ministry of Education, Shanghai, PR China.
| | - Anzhu Gao
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, PR China.
- Department of Automation, Shanghai Jiao Tong University, and the Key Laboratory of System Control and Information Processing, Ministry of Education, Shanghai, PR China.
| |
Collapse
|
4
|
Dey R, Guo Y, Liu Y, Puri A, Savastano L, Zheng Y. An intuitive guidewire control mechanism for robotic intervention. Int J Comput Assist Radiol Surg 2025; 20:333-344. [PMID: 39370493 DOI: 10.1007/s11548-024-03279-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2024] [Accepted: 09/24/2024] [Indexed: 10/08/2024]
Abstract
PURPOSE Teleoperated Interventional Robotic systems (TIRs) are developed to reduce radiation exposure and physical stress of the physicians and enhance device manipulation accuracy and stability. Nevertheless, TIRs are not widely adopted, partly due to the lack of intuitive control interfaces. Current TIR interfaces like joysticks, keyboards, and touchscreens differ significantly from traditional manual techniques, resulting in a shallow, longer learning curve. To this end, this research introduces a novel control mechanism for intuitive operation and seamless adoption of TIRs. METHODS An off-the-shelf medical torque device augmented with a micro-electromagnetic tracker was proposed as the control interface to preserve the tactile sensation and muscle memory integral to interventionalists' proficiency. The control inputs to drive the TIR were extracted via real-time motion mapping of the interface. To verify the efficacy of the proposed control mechanism to accurately operate the TIR, evaluation experiments using industrial grade encoders were conducted. RESULTS A mean tracking error of 0.32 ± 0.12 mm in linear and 0.54 ± 0.07° in angular direction were achieved. The time lag in tracking was found to be 125 ms on average using pade approximation. Ergonomically, the developed control interface is 3.5 mm diametrically larger, and 4.5 g. heavier compared to traditional torque devices. CONCLUSION With uncanny resemblance to traditional torque devices while maintaining results comparable to state-of-the-art commercially available TIRs, this research successfully provides an intuitive control interface for potential wider clinical adoption of robot-assisted interventions.
Collapse
Affiliation(s)
- Rohit Dey
- Mechanical and Materials Engineering, Worcester Polytechnic Institute, Worcester, MA, USA.
| | - Yichen Guo
- Robotics Engineering, Worcester Polytechnic Institute, Worcester, MA, USA
| | - Yang Liu
- Global Institute of Future Technology, Shanghai Jiao Tong University, Shanghai, China
| | - Ajit Puri
- Radiology, UMass Chan Medical School, Worcester, MA, USA
| | - Luis Savastano
- Neurological Surgery, University of California School of Medicine, San Francisco, CA, USA
| | - Yihao Zheng
- Mechanical and Materials Engineering, Worcester Polytechnic Institute, Worcester, MA, USA
- Robotics Engineering, Worcester Polytechnic Institute, Worcester, MA, USA
- Biomedical Engineering, Worcester Polytechnic Institute, Worcester, MA, USA
| |
Collapse
|
5
|
Duan W, Li Z, Omisore OM, Du W, Akinyemi TO, Chen X, Gao X, Wang H, Wang L. Development of an Intuitive Interface With Haptic Enhancement for Robot-Assisted Endovascular Intervention. IEEE TRANSACTIONS ON HAPTICS 2025; 18:80-92. [PMID: 38145539 DOI: 10.1109/toh.2023.3346479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/27/2023]
Abstract
Robot-assisted endovascular intervention has the potential to reduce radiation exposure to surgeons and enhance outcomes of interventions. However, the success and safety of endovascular interventions depend on surgeons' ability to accurately manipulate endovascular tools such as guidewire and catheter and perceive their safety when cannulating patient's vessels. Currently, the existing interventional robots lack a haptic system for accurate force feedback that surgeons can rely on. In this paper, a haptic-enabled endovascular interventional robot was developed. We proposed a dynamic hysteresis compensation model to address the challenges of hysteresis and nonlinearity in magnetic powder brake-based haptic interface, which were used for providing high-precision and higher dynamic range haptic perception. Also, for the first time, a human perceptual-based haptic enhancement model and safety strategy were integrated with the custom-built haptic interface for enhancing sensation discrimination ability during robot-assisted endovascular interventions. This can effectively amplify even subtle changes in low-intensity operational forces such that surgeons can better discern any vessel-tools interaction force. Several experimental studies were performed to show that the haptic interface and the kinesthetic perception enhancement model can enhance the transparency of robot-assisted endovascular interventions, as well as promote the safety awareness of surgeon.
Collapse
|
6
|
Sayadi A, Cecere R, Barralet J, Feldman LS, Hooshiar A. Design and Evaluation of Augmented Reality-Enhanced Robotic System for Epidural Interventions. SENSORS (BASEL, SWITZERLAND) 2024; 24:7959. [PMID: 39771696 PMCID: PMC11679673 DOI: 10.3390/s24247959] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/22/2024] [Revised: 12/02/2024] [Accepted: 12/03/2024] [Indexed: 01/11/2025]
Abstract
The epidural injection is a medical intervention to inject therapeutics directly into the vicinity of the spinal cord for pain management. Because of its proximity to the spinal cord, imprecise insertion of the needle may result in irreversible damage to the nerves or spinal cord. This study explores enhancing procedural accuracy by integrating a telerobotic system and augmented reality (AR) assistance. Tele-kinesthesia is achieved using a leader-follower integrated system, and stable force feedback is provided using a novel impedance-matching force rendering approach. In this domain, augmented reality employs a magnetic-tracker-based approach for real-time 3D model projection onto the patient's body, aiming to augment the physician's visual field and improve needle insertion accuracy. Preliminary results indicate that our AR-enhanced robotic system may reduce the cognitive load and improve the accuracy of ENI, highlighting the promise of AR technologies in complex medical procedures. However, further studies with larger sample sizes and more diverse clinical settings must comprehensively validate these findings. This work lays the groundwork for future research into integrating AR into medical robotics, potentially transforming clinical practices by enhancing procedural safety and efficiency.
Collapse
|
7
|
Kim A, Barnes N, Bailey C, Krieger A, Weiss CR. Remote-Controlled and Teleoperated Systems: Taking Robotic Image Guided Interventions to the Next Stage. Tech Vasc Interv Radiol 2024; 27:101008. [PMID: 39828385 DOI: 10.1016/j.tvir.2024.101008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2025]
Abstract
Remote-controlled and teleoperated robotic systems mark transformative advancements in interventional radiology (IR), with the potential to enhance precision, reduce radiation exposure, and expand access to care. By integrating robotic devices with imaging guidance, these systems enable precise instrument placement and navigation, thereby improving the efficacy and safety of minimally invasive procedures. Remote-controlled and teleoperated robotic systems-operated by clinicians using control interfaces from within or adjacent to the procedure room-are being adopted for both percutaneous and endovascular interventions. In contrast, although their application is still experimental, teleoperation over long distances hold promise for extending IR services to medically underserved areas by enabling remote procedures. This review details the definitions and components of remote-controlled and teleoperated robotic systems in IR, examines their clinical applications in percutaneous and endovascular interventions, and discusses relevant challenges and future directions for their incorporation into IR practices.
Collapse
Affiliation(s)
- Alan Kim
- Division of Vascular and Interventional Radiology, Russell H. Morgan Department of Radiology and Radiological Science, The Johns Hopkins University School of Medicine, Baltimore, MD
| | - Noah Barnes
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD
| | - Christopher Bailey
- Division of Vascular and Interventional Radiology, Russell H. Morgan Department of Radiology and Radiological Science, The Johns Hopkins University School of Medicine, Baltimore, MD
| | - Axel Krieger
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD
| | - Clifford R Weiss
- Division of Vascular and Interventional Radiology, Russell H. Morgan Department of Radiology and Radiological Science, The Johns Hopkins University School of Medicine, Baltimore, MD.
| |
Collapse
|
8
|
Li C, Lee DY. A Hydraulic Haptic Actuator for Simulation of Cardiac Catheters. IEEE TRANSACTIONS ON HAPTICS 2024; 17:461-470. [PMID: 38345951 DOI: 10.1109/toh.2024.3364689] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/15/2024]
Abstract
This article presents a haptic actuator made of silicone rubber to provide both passive and active haptic forces for catheter simulations. The haptic actuator has a torus outer shape with an ellipse-shaped inside chamber which is actuated by hydraulic pressure. Expansion of the chamber by providing positive pressure can squeeze the inside passage to resist the catheter traveling through. Further expansion can hold and push back the catheter in the axial direction to render active haptic forces. The size of the catheter passage is increased by providing negative pressure to the chamber, allowing various diameters of the actual medical catheters to be used and exchanged during the simulation. The diameter of the catheter passage can be enlarged up to 1.6 times to allow 5 to 7 Fr (1 Fr = 1/3 mm) medical catheters to pass through. Experiment results show that the proposed haptic actuator can render 0 to 2.0 N passive feedback force, and a maximum of 2.0 N active feedback force, sufficient for the cardiac catheter simulation. The haptic actuator can render the commanded force profile with 0.10 N RMS (root-mean-squares) and 10.51% L2-norm relative errors.
Collapse
|
9
|
Li P, Feng J, Zhang X, Fang D, Zhang J, Liang C. Modeling and experimental study of the intervention forces between the guidewire and blood vessels. Med Eng Phys 2024; 127:104166. [PMID: 38692765 DOI: 10.1016/j.medengphy.2024.104166] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Revised: 03/25/2024] [Accepted: 04/10/2024] [Indexed: 05/03/2024]
Abstract
A profound investigation of the interaction mechanics between blood vessels and guidewires is necessary to achieve safe intervention. An interactive force model between guidewires and blood vessels is established based on cardiovascular fluid dynamics theory and contact mechanics, considering two intervention phases (straight intervention and contact intervention at a corner named "J-vessel"). The contributing factors of the force model, including intervention conditions, guidewire characteristics, and intravascular environment, are analyzed. A series of experiments were performed to validate the availability of the interactive force model and explore the effects of influential factors on intervention force. The intervention force data were collected using a 2-DOF mechanical testing system instrumented with a force sensor. The guidewire diameter and material were found to significantly impact the intervention force. Additionally, the intervention force was influenced by factors such as blood viscosity, blood vessel wall thickness, blood flow velocity, as well as the interventional velocity and interventional mode. The experiment of the intervention in a coronary artery physical vascular model confirms the practicality validation of the predicted force model and can provide an optimized interventional strategy for vascular interventional surgery. The enhanced intervention strategy has resulted in a considerable reduction of approximately 21.97 % in the force exerted on blood vessels, effectively minimizing the potential for complications associated with the interventional surgery.
Collapse
Affiliation(s)
- Pan Li
- Tianjin Key Laboratory of Integrated Design and On-line Monitoring for Light Industry & Food Machinery and Equipment, College of Mechanical Engineering, Tianjin University of Science & Technology, Tianjin 300222, China
| | - Jing Feng
- Tianjin Key Laboratory of Integrated Design and On-line Monitoring for Light Industry & Food Machinery and Equipment, College of Mechanical Engineering, Tianjin University of Science & Technology, Tianjin 300222, China
| | - Xue Zhang
- Tianjin Key Laboratory of Integrated Design and On-line Monitoring for Light Industry & Food Machinery and Equipment, College of Mechanical Engineering, Tianjin University of Science & Technology, Tianjin 300222, China
| | - Delei Fang
- Tianjin Key Laboratory of Integrated Design and On-line Monitoring for Light Industry & Food Machinery and Equipment, College of Mechanical Engineering, Tianjin University of Science & Technology, Tianjin 300222, China
| | - Junxia Zhang
- Tianjin Key Laboratory of Integrated Design and On-line Monitoring for Light Industry & Food Machinery and Equipment, College of Mechanical Engineering, Tianjin University of Science & Technology, Tianjin 300222, China
| | - Cunman Liang
- Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, SAR 999077, China; School of Mechanical Engineering, Tianjin University, Tianjin 300354, China.
| |
Collapse
|
10
|
Wu Z, Zhang J, Wei S, Chen D. Kirchhoff rod-based three-dimensional dynamical model and real-time simulation for medical-magnetic guidewires. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 240:107646. [PMID: 37320941 DOI: 10.1016/j.cmpb.2023.107646] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/25/2022] [Revised: 05/01/2023] [Accepted: 06/05/2023] [Indexed: 06/17/2023]
Abstract
BACKGROUND AND OBJECTIVE Magnetic guidewire, fabricated from hard-magnetic soft composites, has recently emerged as an appropriate candidate for magnetic actuation systems to perform intravascular surgical navigation, owing to its elastic, magnetically steerable properties and good interphase with biological tissues. A suitable and efficient mathematical model for the magnetic guidewire is essential in the system to execute remote manipulation and active control. METHODS This paper presents a real-time Kirchhoff rod-based dynamical modeling approach, the magneto-elastic rod model, to simulate magnetic guidewire, which provides accurate simulations for two- and three-dimensional dynamic deflections induced by external magnetic fields and obtains deformed guidewire shapes in quasi-static status. RESULTS The proposed model is capable of describing the intrinsic principles of elastic body actuation by torques generated from the hard-magnetic soft matrix. The effectiveness of the developed model is validated, and the real-time simulation application is conducted via the semi-implicit numerical integration method. CONCLUSIONS It has been shown that the presented dynamical model captures large nonlinear deformations and transient responses of the magnetic guidewire in an imitated human blood environment, which could offer robust support for the construction of a simulated magnetically driven surgical system.
Collapse
Affiliation(s)
- Zhiwei Wu
- School of Automation, Beijing Institute of Technology, Beijing, 100081, China.
| | - Jinhui Zhang
- School of Automation, Beijing Institute of Technology, Beijing, 100081, China.
| | - Siyi Wei
- School of Automation, Beijing Institute of Technology, Beijing, 100081, China.
| | - Duanduan Chen
- School of Life Science, Beijing lnstitute of Technology, Beijing, 100081, China.
| |
Collapse
|
11
|
Wang S, Liu Z, Yang W, Cao Y, Zhao L, Xie L. Learning-Based Multimodal Information Fusion and Behavior Recognition of Vascular Interventionists' Operating Skills. IEEE J Biomed Health Inform 2023; 27:4536-4547. [PMID: 37363852 DOI: 10.1109/jbhi.2023.3289548] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/28/2023]
Abstract
The operating skills of vascular interventionists have an important impact on the effect of surgery. However, current research on behavior recognition and skills learning of interventionists' operating skills is limited. In this study, an innovative deep learning-based multimodal information fusion architecture is proposed for recognizing and analyzing eight common operating behaviors of interventionists. An experimental platform integrating four modal sensors is used to collect multimodal data from interventionists. The ANOVA and Manner-Whitney tests is used for relevance analysis of the data. The analysis results demonstrate that there is almost no significant difference ( p <0.001) between the actions related to the unimodal data, which cannot be used for accurate behavior recognition. Therefore, a study of the fusion architecture based on the existing machine learning classifier and the proposed deep learning fusion architecture is carried out. The research findings indicate that the proposed deep learning-based fusion architecture achieves an impressive overall accuracy of 98.5%, surpassing both the machine learning classifier (93.51%) and the unimodal data (90.05%). The deep learning-based multimodal information fusion architecture proves the feasibility of behavior recognition and skills learning of interventionist's operating skills. Furthermore, the application of deep learning-based multimodal fusion technology of surgeon's operating skills will help to improve the autonomy and intelligence of surgical robotic systems.
Collapse
|
12
|
Barnes N, Young O, Colton A, Liu X, Janowski M, Gandhi D, Sochol R, Brown J, Krieger A. Toward a novel soft robotic system for minimally invasive interventions. Int J Comput Assist Radiol Surg 2023; 18:1547-1557. [PMID: 37486544 PMCID: PMC10928906 DOI: 10.1007/s11548-023-02997-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Accepted: 07/04/2023] [Indexed: 07/25/2023]
Abstract
PURPOSE During minimally invasive surgery, surgeons maneuver tools through complex anatomies, which is difficult without the ability to control the position of the tools inside the body. A potential solution for a substantial portion of these procedures is the efficient design and control of a pneumatically actuated soft robot system. METHODS We designed and evaluated a system to control a steerable catheter tip. A macroscale 3D printed catheter tip was designed to have two separately pressurized channels to induce bending in two directions. A motorized hand controller was developed to allow users to control the bending angle while manually inserting the steerable tip. Preliminary characterization of two catheter tip prototypes was performed and used to map desired angle inputs into pressure commands. RESULTS The integrated robotic system allowed both a novice and a skilled surgeon to position the steerable catheter tip at the location of cylindrical targets with sub-millimeter accuracy. The novice was able to reach each target within ten seconds and the skilled surgeon within five seconds on average. CONCLUSION This soft robotic system enables its user to simultaneously insert and bend the pneumatically actuated catheter tip with high accuracy and in a short amount of time. These results show promise concerning the development of a soft robotic system that can improve outcomes in minimally invasive interventions.
Collapse
Affiliation(s)
- Noah Barnes
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, USA
| | - Olivia Young
- Department of Mechanical Engineering, University of Maryland, College Park, MD, USA
- Maryland Robotics Center, University of Maryland, College Park, MD, USA
- Institute for Systems Research, University of Maryland, College Park, MD, USA
| | - Adira Colton
- Department of Mechanical Engineering, University of Maryland, College Park, MD, USA
- Maryland Robotics Center, University of Maryland, College Park, MD, USA
- Institute for Systems Research, University of Maryland, College Park, MD, USA
| | - Xiaolong Liu
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, USA
| | - Miroslaw Janowski
- Department of Diagnostic Radiology and Nuclear Medicine, University of Maryland, Baltimore, Baltimore, MD, USA
| | - Dheeraj Gandhi
- Department of Neurosurgery, University of Maryland Medical Center, Baltimore, MD, USA
- Department of Diagnostic Radiology, Neuroradiology, University of Maryland Medical Center, Baltimore, MD, USA
| | - Ryan Sochol
- Department of Mechanical Engineering, University of Maryland, College Park, MD, USA
- Maryland Robotics Center, University of Maryland, College Park, MD, USA
- Institute for Systems Research, University of Maryland, College Park, MD, USA
- Fischell Department of Bioengineering, University of Maryland, College Park, MD, USA
- Robert E. Fischell Institute for Biomedical Devices, University of Maryland, College Park, MD, USA
| | - Jeremy Brown
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, USA
| | - Axel Krieger
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, USA.
| |
Collapse
|
13
|
Song Y, Li L, Tian Y, Li Z, Yin X. A Novel Master-Slave Interventional Surgery Robot with Force Feedback and Collaborative Operation. SENSORS (BASEL, SWITZERLAND) 2023; 23:3584. [PMID: 37050644 PMCID: PMC10099359 DOI: 10.3390/s23073584] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Revised: 03/11/2023] [Accepted: 03/27/2023] [Indexed: 06/19/2023]
Abstract
In recent years, master-slave vascular robots have been developed to address the problem of radiation exposure during vascular interventions for surgeons. However, the single visual feedback reduces surgeon immersion and transparency of the system. In this work, we have developed a haptic interface based on the magnetorheological fluid (MRF) on the master side. The haptic interface can provide passive feedback force with high force fidelity and low inertia. Additionally, the manipulation of the master device does not change the operating posture of traditional surgery, which allows the surgeon to better adapt to the robotic system. For the slave robot, the catheter and guidewire can be navigated simultaneously which allows the two degrees of action on the catheter and axial action of a guidewire. The resistance force of the catheter navigation is measured and reflected to the user through the master haptic interface. To verify the proposed master-slave robotic system, the evaluation experiments are carried out in vitro, and the effectiveness of the system was demonstrated experimentally.
Collapse
Affiliation(s)
- Yu Song
- Tianjin Key Laboratory for Control Theory and Applications in Complicated Industry Systems, School of Electrical Engineering and Automation, Tianjin University of Technology, Tianjin 300384, China
| | - Liutao Li
- Tianjin Key Laboratory for Control Theory and Applications in Complicated Industry Systems, School of Electrical Engineering and Automation, Tianjin University of Technology, Tianjin 300384, China
| | - Yu Tian
- Tianjin Key Laboratory for Control Theory and Applications in Complicated Industry Systems, School of Electrical Engineering and Automation, Tianjin University of Technology, Tianjin 300384, China
| | - Zhiwei Li
- Tianjin Key Laboratory for Control Theory and Applications in Complicated Industry Systems, School of Electrical Engineering and Automation, Tianjin University of Technology, Tianjin 300384, China
| | - Xuanchun Yin
- School of Engineering, South China Agricultural University, Guangzhou 510642, China
| |
Collapse
|
14
|
Shi P, Guo S, Jin X, Hirata H, Tamiya T, Kawanishi M. A novel catheter interaction simulating method for virtual reality interventional training systems. Med Biol Eng Comput 2023; 61:685-697. [PMID: 36585560 DOI: 10.1007/s11517-022-02730-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Accepted: 12/09/2022] [Indexed: 12/31/2022]
Abstract
Endovascular robotic systems have been applied in robot-assisted interventional surgery to improve surgical safety and reduce radiation to surgeons. However, this surgery requires surgeons to be highly skilled at operating vascular interventional surgical robot. Virtual reality (VR) interventional training systems for robot-assisted interventional surgical training have many advantages over traditional training methods. For virtual interventional radiology, simulation of the behaviors of surgical tools (here mainly refers to catheter and guidewire) is a challenging work. In this paper, we developed a novel virtual reality interventional training system. This system is an extension of the endovascular robotic system. Because the master side of this system can be used for both the endovascular robotic system and the VR interventional training system, the proposed system improves training and reduces the cost of education. Moreover, we proposed a novel method to solve catheterization modeling during the interventional simulation. Our method discretizes the catheter by the collision points. The catheter between two adjacent collision points is treated as thin torsion-free elastic rods. The deformation of the rod is mainly affected by the force applied at the collision points. Meanwhile, the virtual contact force is determined by the collision points. This simplification makes the model more stable and reduces the computational complexity, and the behavior of the surgical tools can be approximated. Therefore, we realized the catheter interaction simulation and virtual force feedback for the proposed VR interventional training system. The performance of our method is experimentally validated.
Collapse
Affiliation(s)
- Peng Shi
- School of Medical Technology and Engineering, Henan University of Science and Technology, Luoyang, 471023, China.,Faculty of Engineering and Design, Kagawa University, 2217-20 Hayashi-Cho, Takamatsu, 760-8521, Japan
| | - Shuxiang Guo
- Key Laboratory of Convergence Medical Engineering System and Healthcare Technology, the Ministry of Industry and Information Technology, Beijing Institute of Technology, No. 5, Zhongguancun South Street, Haidian District, Beijing, 100081, China. .,Faculty of Engineering and Design, Kagawa University, 2217-20 Hayashi-Cho, Takamatsu, 760-8521, Japan.
| | - Xiaoliang Jin
- Faculty of Engineering and Design, Kagawa University, 2217-20 Hayashi-Cho, Takamatsu, 760-8521, Japan.,State Key Laboratory of Bioelectronics and the Jiangsu Key Laboratory of Remote Measurement and Control, School of Instrument Science and Engineering, Southeast University, Nanjing, 210096, China
| | - Hideyuki Hirata
- Faculty of Engineering and Design, Kagawa University, 2217-20 Hayashi-Cho, Takamatsu, 760-8521, Japan
| | - Takashi Tamiya
- Department of Neurological Surgery, Faculty of Medicine, Kagawa University, Takamatsu, 761-0793, Japan
| | - Masahiko Kawanishi
- Department of Neurological Surgery, Faculty of Medicine, Kagawa University, Takamatsu, 761-0793, Japan
| |
Collapse
|
15
|
Design and evaluation of vascular interventional robot system for complex coronary artery lesions. Med Biol Eng Comput 2023; 61:1365-1380. [PMID: 36705768 DOI: 10.1007/s11517-023-02775-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Accepted: 01/05/2023] [Indexed: 01/28/2023]
Abstract
At present, most vascular intervention robots cannot cope with the more common coronary complex lesions in the clinic. Moreover, the lack of effective force feedback increases the risk of surgery. In this paper, a vascular interventional robot that can collaboratively deliver multiple interventional instruments has been developed to assist doctors in the operation of complex lesions. Based on the doctor's skills and the delivery principle of interventional instruments, the main and slave manipulators of the robot system are designed. Haptic force feedback is generated through resistance measuring mechanism and active drag system. In addition, a force feedback control strategy based on force-velocity mapping is proposed to realize the continuous change of force and avoid vibration. The proposed robot system was evaluated through a series of experiments. The experimental results show that the system can accurately measure the delivery resistance of interventional instruments, and provide haptic force feedback to doctors. The capability of the system to collaboratively deliver multiple interventional instruments is effective. Therefore, it can be considered that the robot system is feasible and effective.
Collapse
|
16
|
Duan W, Akinyemi T, Du W, Ma J, Chen X, Wang F, Omisore O, Luo J, Wang H, Wang L. Technical and Clinical Progress on Robot-Assisted Endovascular Interventions: A Review. MICROMACHINES 2023; 14:197. [PMID: 36677258 PMCID: PMC9864595 DOI: 10.3390/mi14010197] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/23/2022] [Revised: 01/05/2023] [Accepted: 01/12/2023] [Indexed: 06/17/2023]
Abstract
Prior methods of patient care have changed in recent years due to the availability of minimally invasive surgical platforms for endovascular interventions. These platforms have demonstrated the ability to improve patients' vascular intervention outcomes, and global morbidities and mortalities from vascular disease are decreasing. Nonetheless, there are still concerns about the long-term effects of exposing interventionalists and patients to the operational hazards in the cath lab, and the perioperative risks that patients undergo. For these reasons, robot-assisted vascular interventions were developed to provide interventionalists with the ability to perform minimally invasive procedures with improved surgical workflow. We conducted a thorough literature search and presented a review of 130 studies published within the last 20 years that focused on robot-assisted endovascular interventions and are closely related to the current gains and obstacles of vascular interventional robots published up to 2022. We assessed both the research-based prototypes and commercial products, with an emphasis on their technical characteristics and application domains. Furthermore, we outlined how the robotic platforms enhanced both surgeons' and patients' perioperative experiences of robot-assisted vascular interventions. Finally, we summarized our findings and proposed three key milestones that could improve the development of the next-generation vascular interventional robots.
Collapse
Affiliation(s)
- Wenke Duan
- Academy for Engineering and Technology, Fudan University, Shanghai 200433, China
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Toluwanimi Akinyemi
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Wenjing Du
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Jun Ma
- Shenzhen Raysight Intelligent Medical Technology Co., Ltd., Shenzhen 518063, China
| | - Xingyu Chen
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Fuhao Wang
- Academy for Engineering and Technology, Fudan University, Shanghai 200433, China
| | - Olatunji Omisore
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
- Shenzhen Engineering Laboratory for Diagnosis & Treatment Key Technologies of Interventional Surgical Robots, Shenzhen 518055, China
| | - Jingjing Luo
- Academy for Engineering and Technology, Fudan University, Shanghai 200433, China
| | - Hongbo Wang
- Academy for Engineering and Technology, Fudan University, Shanghai 200433, China
| | - Lei Wang
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
- Shenzhen Engineering Laboratory for Diagnosis & Treatment Key Technologies of Interventional Surgical Robots, Shenzhen 518055, China
| |
Collapse
|
17
|
Discrete soft actor-critic with auto-encoder on vascular robotic system. ROBOTICA 2022. [DOI: 10.1017/s0263574722001527] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Abstract
Instrument delivery is critical part in vascular intervention surgery. Due to the soft-body structure of instruments, the relationship between manipulation commands and instrument motion is non-linear, making instrument delivery challenging and time-consuming. Reinforcement learning has the potential to learn manipulation skills and automate instrument delivery with enhanced success rates and reduced workload of physicians. However, due to the sample inefficiency when using high-dimensional images, existing reinforcement learning algorithms are limited on realistic vascular robotic systems. To alleviate this problem, this paper proposes discrete soft actor-critic with auto-encoder (DSAC-AE) that augments SAC-discrete with an auxiliary reconstruction task. The algorithm is applied with distributed sample collection and parameter update in a robot-assisted preclinical environment. Experimental results indicate that guidewire delivery can be automatically implemented after 50k sampling steps in less than 15 h, demonstrating the proposed algorithm has the great potential to learn manipulation skill for vascular robotic systems.
Collapse
|
18
|
Zhao Y, Wang Y, Zhang J, Liu X, Li Y, Guo S, Yang X, Hong S. Surgical GAN: Towards real-time path planning for passive flexible tools in endovascular surgeries. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.05.044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
19
|
Wang S, Liu Z, Shu X, Xie L. Mechanism design and force sensing of a novel cardiovascular interventional surgery robot. Int J Med Robot 2022; 18:e2406. [DOI: 10.1002/rcs.2406] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2021] [Revised: 04/05/2022] [Accepted: 04/10/2022] [Indexed: 11/06/2022]
Affiliation(s)
- Shuang Wang
- Institute of Forming Technology & Equipment Shanghai Jiao Tong University Shanghai China
| | - Zheng Liu
- Institute of Forming Technology & Equipment Shanghai Jiao Tong University Shanghai China
| | - Xiongpeng Shu
- Institute of Forming Technology & Equipment Shanghai Jiao Tong University Shanghai China
| | - Le Xie
- Institute of Forming Technology & Equipment Shanghai Jiao Tong University Shanghai China
- Institute of Medical Robotics Shanghai Jiao Tong University Shanghai China
| |
Collapse
|
20
|
Zhou W, Guo S, Guo J, Chen Z, Meng F. Kinetics Analysis and ADRC-Based Controller for a String-Driven Vascular Intervention Surgical Robotic System. MICROMACHINES 2022; 13:mi13050770. [PMID: 35630237 PMCID: PMC9145301 DOI: 10.3390/mi13050770] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Revised: 05/09/2022] [Accepted: 05/11/2022] [Indexed: 02/01/2023]
Abstract
Vascular interventional surgery is a typical method for diagnosing and treating cardio-cerebrovascular diseases. However, a surgeon is exposed to significant X-radiation exposure when the operation is conducted for a long period of time. A vascular intervention surgical robotic system for assisting the surgeon is a promising approach to address the aforementioned issue. When developing the robotic system, a high displacement accuracy is crucial, and this can aid in enhancing operating efficiency and safety. In this study, a novel kinetics analysis and active disturbance rejection control (ADRC)-based controller is proposed to provide high accuracy for a string-driven robotic system. In this controller, kinetics analysis is initially used to improve the accuracy affected by the inner factors of the slave manipulator. Then, the ADRC controller is used to further improve the operating accuracy of the robotic system. Finally, the proposed controller is evaluated by conducting experiments on a vascular model. The results indicate maximum steady errors of 0.45 mm and 6.67°. The experimental results demonstrate that the proposed controller can satisfy the safety requirements of the string-driven robotic system.
Collapse
Affiliation(s)
- Wei Zhou
- School of Life Science, Beijing Institute of Technology, Beijing 100081, China; (W.Z.); (Z.C.); (F.M.)
| | - Shuxiang Guo
- School of Life Science, Beijing Institute of Technology, Beijing 100081, China; (W.Z.); (Z.C.); (F.M.)
- Key Laboratory of Convergence Medical Engineering System and Healthcare Technology, Ministry of Industry and Information Technology, School of Life Science, Beijing Institute of Technology, Beijing 100081, China
- Correspondence: (S.G.); (J.G.); Tel.: +86-186-0020-0326 (S.G.)
| | - Jin Guo
- School of Life Science, Beijing Institute of Technology, Beijing 100081, China; (W.Z.); (Z.C.); (F.M.)
- Correspondence: (S.G.); (J.G.); Tel.: +86-186-0020-0326 (S.G.)
| | - Zhengyang Chen
- School of Life Science, Beijing Institute of Technology, Beijing 100081, China; (W.Z.); (Z.C.); (F.M.)
| | - Fanxu Meng
- School of Life Science, Beijing Institute of Technology, Beijing 100081, China; (W.Z.); (Z.C.); (F.M.)
| |
Collapse
|
21
|
Zhao Y, Mei Z, Luo X, Mao J, Zhao Q, Liu G, Wu D. Remote vascular interventional surgery robotics: a literature review. Quant Imaging Med Surg 2022; 12:2552-2574. [PMID: 35371939 PMCID: PMC8923856 DOI: 10.21037/qims-21-792] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2021] [Accepted: 12/22/2021] [Indexed: 07/25/2023]
Abstract
Vascular interventional doctors are exposed to radiation hazards during surgery and endure high work intensity. Remote vascular interventional surgery robotics is a hot research field, in which researchers aim to not only protect the health of interventional doctors, but to also improve surgical accuracy and efficiency. However, the current vascular interventional robots have numerous shortcomings, such as poor haptic feedback, few compatible surgeries and instruments, and cumbersome maintenance and operational procedures. Nevertheless, vascular interventional surgery combined with robotics provides more cutting-edge directions, such as Internet remote surgery combined with 5G network technology and the application of artificial intelligence in surgical procedures. To summarize the developmental status and key technical points of intravascular interventional surgical robotics research, we performed a systematic literature search to retrieve original articles related to remote vascular interventional surgery robotics published up to December 2020. This review, which includes 113 articles published in English, introduces the mechanical and structural characteristics of various aspects of vascular interventional surgical robotics, discusses the current key features of vascular interventional surgical robotics in force sensing, haptic feedback, and control methods, and summarizes current frontiers in autonomous surgery, long-distance robotic telesurgery, and magnetic resonance imaging (MRI)-compatible structures. On the basis of summarizing the current research status of remote vascular interventional surgery robotics, we aim to propose a variety of prospects for future robotic systems.
Collapse
Affiliation(s)
- Yang Zhao
- Department of Mechanical & Electrical Engineering, Xiamen University, Xiamen, China
| | - Ziyang Mei
- Department of Mechanical & Electrical Engineering, Xiamen University, Xiamen, China
| | - Xiaoxiao Luo
- Department of Mechanical & Electrical Engineering, Xiamen University, Xiamen, China
| | - Jingsong Mao
- Department of Radiology, Xiang’an Hospital of Xiamen University, Xiamen, China
| | - Qingliang Zhao
- State Key Laboratory of Molecular Vaccinology and Molecular Diagnostics Center for Molecular Imaging and Translational Medicine, School of Public Health, Xiamen University, Xiamen, China
| | - Gang Liu
- State Key Laboratory of Molecular Vaccinology and Molecular Diagnostics Center for Molecular Imaging and Translational Medicine, School of Public Health, Xiamen University, Xiamen, China
| | - Dezhi Wu
- Department of Mechanical & Electrical Engineering, Xiamen University, Xiamen, China
| |
Collapse
|
22
|
Li X, Guo S, Shi P, Jin X, Kawanishi M. An Endovascular Catheterization Robotic System Using Collaborative Operation with Magnetically Controlled Haptic Force Feedback. MICROMACHINES 2022; 13:mi13040505. [PMID: 35457811 PMCID: PMC9029488 DOI: 10.3390/mi13040505] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Revised: 03/16/2022] [Accepted: 03/23/2022] [Indexed: 01/15/2023]
Abstract
Robot-assisted technology is often used to perform endovascular catheterization surgeries, which generally depend on the flexible operability and the accurate force feedback of a robotic system. In this paper, an endovascular catheterization robotic system (ECRS) was developed to improve collaborative operation and haptic force feedback. A couple of operating handles were designed to maximize the use of the natural operations of surgeons on the master side, which is a flexible and ergonomic device. A magnetically controlled haptic force feedback structure is proposed based on hydrogel and solid magnetorheological (MR) fluid to offer a sense of haptic feedback to operators; this has potential influence on the field of force feedback. In addition, a unique tremor-reduction structure is introduced to enhance operating safety. Tracking performance experiments and in vitro experiments were conducted to evaluate the performance of the developed ECRS. According to these experimental results, the average translation-tracking error is 0.94 mm, and the average error of rotation is 0.89 degrees. Moreover, in vitro experiments demonstrated that haptic feedback has the advantage of reducing workload and shortening surgery completion time. The developed ECRS also has the benefits of inspiring other researchers to study collaborative robots and magnetically controlled feedback.
Collapse
Affiliation(s)
- Xinming Li
- Graduate School of Engineering, Kagawa University, Takamatsu 761-0396, Japan; (X.L.); (P.S.); (X.J.)
| | - Shuxiang Guo
- Graduate School of Engineering, Kagawa University, Takamatsu 761-0396, Japan; (X.L.); (P.S.); (X.J.)
- Key Laboratory of Convergence Medical Engineering System and Healthcare Technology, Ministry of Industry and Information Technology, School of Life Science and Technology, Beijing Institute of Technology, Beijing 100081, China
- Correspondence:
| | - Peng Shi
- Graduate School of Engineering, Kagawa University, Takamatsu 761-0396, Japan; (X.L.); (P.S.); (X.J.)
| | - Xiaoliang Jin
- Graduate School of Engineering, Kagawa University, Takamatsu 761-0396, Japan; (X.L.); (P.S.); (X.J.)
| | - Masahiko Kawanishi
- Department of Neurological Surgery, Kagawa University, Takamatsu 761-0793, Japan;
| |
Collapse
|
23
|
Apamon C, Marie F, Miroir APM, Le Breton R, Courteille APE, FournierBruno. Screening of factors influencing catheter rotation of a vascular interventional surgical robot using design of experiment approach. Med Eng Phys 2022; 102:103764. [DOI: 10.1016/j.medengphy.2022.103764] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2021] [Revised: 12/20/2021] [Accepted: 02/05/2022] [Indexed: 01/01/2023]
|
24
|
Multilevel Operation Strategy of a Vascular Interventional Robot System for Surgical Safety in Teleoperation. IEEE T ROBOT 2022. [DOI: 10.1109/tro.2022.3140887] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
25
|
Zhou W, Guo S, Guo J, Meng F, Chen Z. ADRC-Based Control Method for the Vascular Intervention Master-Slave Surgical Robotic System. MICROMACHINES 2021; 12:mi12121439. [PMID: 34945289 PMCID: PMC8707856 DOI: 10.3390/mi12121439] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Revised: 11/20/2021] [Accepted: 11/23/2021] [Indexed: 12/25/2022]
Abstract
In vascular interventional surgery, surgeons operate guidewires and catheters to diagnose and treat patients with the assistance of the digital subtraction angiography (DSA). Therefore, the surgeon will be exposed to X-rays for extended periods. To protect the surgeon, the development of a robot-assisted surgical system is of great significance. The displacement tracking accuracy is the most important issue to be considered in the development of the system. In this study, the active disturbance rejection control (ADRC) method is applied to guarantee displacement tracking accuracy. First, the core contents of the proportional–integral–derivative (PID) and ADRC methods are analyzed. Second, comparative evaluation experiments for incremental PID and ADRC methods are presented. The results show that the ADRC method has better performance of than that of the incremental PID method. Finally, the calibration experiments for the ADRC control method are implemented using the master–slave robotic system. These experiments demonstrate that the maximum tracking error is 0.87 mm using the ADRC method, effectively guaranteeing surgical safety.
Collapse
Affiliation(s)
- Wei Zhou
- School of Life Science, Beijing Institute of Technology, Beijing 100081, China; (W.Z.); (F.M.); (Z.C.)
| | - Shuxiang Guo
- School of Life Science, Beijing Institute of Technology, Beijing 100081, China; (W.Z.); (F.M.); (Z.C.)
- Key Laboratory of Convergence Medical Engineering System and Healthcare Technology, Ministry of Industry and Information Technology, School of Life Science, Beijing Institute of Technology, Beijing 100081, China
- Faculty of Engineering, Kagawa University, 2217-20 Hayashi-cho, Takamatsu 760-8521, Japan
- Correspondence: (S.G.); (J.G.); Tel.: +86-186-0020-0326 (S.G.)
| | - Jin Guo
- School of Life Science, Beijing Institute of Technology, Beijing 100081, China; (W.Z.); (F.M.); (Z.C.)
- Correspondence: (S.G.); (J.G.); Tel.: +86-186-0020-0326 (S.G.)
| | - Fanxu Meng
- School of Life Science, Beijing Institute of Technology, Beijing 100081, China; (W.Z.); (F.M.); (Z.C.)
| | - Zhengyang Chen
- School of Life Science, Beijing Institute of Technology, Beijing 100081, China; (W.Z.); (F.M.); (Z.C.)
| |
Collapse
|
26
|
Zhao HL, Liu SQ, Zhou XH, Xie XL, Hou ZG, Zhou YJ, Zhang LS, Gui MJ, Wang JL. Design and Performance Evaluation of a Novel Vascular Robotic System for Complex Percutaneous Coronary Interventions. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:4679-4682. [PMID: 34892257 DOI: 10.1109/embc46164.2021.9629943] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The robotic-assisted percutaneous coronary intervention is an emerging technology with great potential to solve the shortcomings of existing treatments. However, the current robotic systems can not manipulate two guidewires or ballons/stents simultaneously for coronary bifurcation lesions. This paper presents VasCure, a novel bio-inspired vascular robotic system, to deliver two guidewires and stents into the main branch and side branch of bifurcation lesions in sequence. The system is designed in master-slave architecture to reduce occupational hazards of radiation exposure and orthopedic injury to interventional surgeons. The slave delivery device has one active roller and two passive rollers to manipulate two interventional devices. The performance of the VasCure was verified by in vitro and in vivo animal experiments. In vitro results showed the robotic system has good accuracy to deliver guidewires and the maximum error is 0.38mm. In an animal experiment, the interventional surgeon delivered two guidewires and balloons to the left circumflex branch and the left anterior descending branch of the pig, which confirmed the feasibility of the vascular robotic system.
Collapse
|
27
|
Kundrat D, Dagnino G, Kwok TMY, Abdelaziz MEMK, Chi W, Nguyen A, Riga C, Yang GZ. An MR-Safe Endovascular Robotic Platform: Design, Control, and Ex-Vivo Evaluation. IEEE Trans Biomed Eng 2021; 68:3110-3121. [PMID: 33705306 DOI: 10.1109/tbme.2021.3065146] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECTIVE Cardiovascular diseases are the most common cause of global death. Endovascular interventions, in combination with advanced imaging technologies, are promising approaches for minimally invasive diagnosis and therapy. More recently, teleoperated robotic platforms target improved manipulation accuracy, stabilisation of instruments in the vasculature, and reduction of patient recovery times. However, benefits of recent platforms are undermined by a lack of haptics and residual patient exposure to ionising radiation. The purpose of this research was to design, implement, and evaluate a novel endovascular robotic platform, which accommodates emerging non-ionising magnetic resonance imaging (MRI). METHODS We proposed a pneumatically actuated MR-safe teleoperation platform to manipulate endovascular instrumentation remotely and to provide operators with haptic feedback for endovascular tasks. The platform task performance was evaluated in an ex vivo cannulation study with clinical experts ( N = 7) under fluoroscopic guidance and haptic assistance on abdominal and thoracic phantoms. RESULTS The study demonstrated that the robotic dexterity involving pneumatic actuation concepts enabled successful remote cannulation of different vascular anatomies with success rates of 90%-100%. Compared to manual cannulation, slightly lower interaction forces between instrumentation and phantoms were measured for specific tasks. The maximum robotic interaction forces did not exceed 3N. CONCLUSION This research demonstrates a promising versatile robotic technology for remote manipulation of endovascular instrumentation in MR environments. SIGNIFICANCE The results pave the way for clinical translation with device deployment to endovascular interventions using non-ionising real-time 3D MR guidance.
Collapse
|
28
|
Pei P, Peng Y. The squeeze strengthening effect on the rheological and microstructured behaviors of magnetorheological fluids: a molecular dynamics study. SOFT MATTER 2021; 17:184-200. [PMID: 33332517 DOI: 10.1039/d0sm01149e] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Systematic molecular dynamics simulations are conducted on magnetorheological (MR) fluids under steady state, squeeze flows and shear flows. The present study concerns the squeeze-assisted MR fluid strengthening and correlates the suspensions' macroscopic rheological properties to their microstructure evolution in terms of the aggregation kinetics. Simulation results demonstrate that the squeeze strengthening effect on the rheological properties of MR fluids is enhanced with the increasing magnetic field and becomes more prominent for dilute suspensions, but weakened with the increasing squeeze rate after the critical squeeze rate is surpassed. By microscopic inspection, it is found that the rheological properties of MR fluids under squeeze flows are consistent with the microstructured behaviors of MR suspensions in terms of the particle distribution, cluster kinetics, particle connectivity and magnetic energy. This study provides a microstructural insight into the squeeze-assisted MR fluid strengthening, which helps to attain an elegant design of MR devices with high shear performance requirements.
Collapse
Affiliation(s)
- Pei Pei
- State Key Laboratory of Disaster Reduction in Civil Engineering, Tongji University, Shanghai 200092, P. R. China.
| | | |
Collapse
|
29
|
Investigation of a Haptic Actuator Made with Magneto-Rheological Fluids for Haptic Shoes Applications. ACTUATORS 2020. [DOI: 10.3390/act10010005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
This paper presents a magneto-rheological (MR) actuator that can be easily inserted into haptic shoes and can haptically simulate the material properties of the ground. To increase the resistive force of the proposed actuator, we designed a movable piston having multiple operation modes of MR fluids. Further, the design of a solenoid coil was optimized to maximize the resistive force in a limited-sized MR actuator. Simulations were conducted to predict the actuation performance and to show that the magnetic flux flows well by forming a closed loop in the proposed actuator. The quantitative evaluation of the proposed actuator was investigated by measuring the resistive force as a function of the input current and its pressed depth. From the result, we found that the proposed actuator can create over 600 N by adjusting the input current.
Collapse
|
30
|
Guo S, Cui J, Zhao Y, Wang Y, Ma Y, Gao W, Mao G, Hong S. Machine learning-based operation skills assessment with vascular difficulty index for vascular intervention surgery. Med Biol Eng Comput 2020; 58:1707-1721. [PMID: 32468299 DOI: 10.1007/s11517-020-02195-9] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2019] [Accepted: 05/20/2020] [Indexed: 11/28/2022]
Abstract
An accurate assessment of surgical operation skills is essential for improving the vascular intervention surgical outcome and the performance of endovascular surgery robots. In existing studies, subjective and objective assessments of surgical operation skills use a variety of indicators, such as the operation speed and operation smoothness. However, the vascular conditions of particular patients have not been considered in the assessment, leading to deviations in the evaluation. Therefore, in this paper, an operation skills assessment method including the vascular difficulty level index for catheter insertion at the aortic arch in endovascular surgery is proposed. First, the model describing the difficulty of the vascular anatomical structure is established with characteristics of different aortic arch branches based on machine learning. Afterwards, the vascular difficulty level is set as an objective index combined with operating characteristics extracted from the operations performed by surgeons to evaluate the surgical operation skills at the aortic arch using machine learning. The accuracy of the assessment improves from 86.67 to 96.67% after inclusion of the vascular difficulty as an evaluation indicator to more objectively and accurately evaluate skills. The method described in this paper can be adopted to train novice surgeons in endovascular surgery, and for studies of vascular interventional surgery robots. Graphical abstract Operation skill assessment with vascular difficulty for vascular interventional surgery.
Collapse
Affiliation(s)
- Shuxiang Guo
- Key Laboratory of Convergence Biomedical Engineering System and Healthcare Technology, The Ministry of Industry and Information Technology, Beijing Institute of Technology, No. 5, Zhongguancun South Street, Haidian District, Beijing, 100081, China. .,Faculty of Engineering, Kagawa University, 2217-20 Hayashi-cho, Takamatsu, Kagawa, 760-8521, Japan.
| | - Jinxin Cui
- Key Laboratory of Convergence Biomedical Engineering System and Healthcare Technology, The Ministry of Industry and Information Technology, Beijing Institute of Technology, No. 5, Zhongguancun South Street, Haidian District, Beijing, 100081, China
| | - Yan Zhao
- Key Laboratory of Convergence Biomedical Engineering System and Healthcare Technology, The Ministry of Industry and Information Technology, Beijing Institute of Technology, No. 5, Zhongguancun South Street, Haidian District, Beijing, 100081, China
| | - Yuxin Wang
- Key Laboratory of Convergence Biomedical Engineering System and Healthcare Technology, The Ministry of Industry and Information Technology, Beijing Institute of Technology, No. 5, Zhongguancun South Street, Haidian District, Beijing, 100081, China
| | - Youchun Ma
- Key Laboratory of Convergence Biomedical Engineering System and Healthcare Technology, The Ministry of Industry and Information Technology, Beijing Institute of Technology, No. 5, Zhongguancun South Street, Haidian District, Beijing, 100081, China
| | - Wenyang Gao
- Key Laboratory of Convergence Biomedical Engineering System and Healthcare Technology, The Ministry of Industry and Information Technology, Beijing Institute of Technology, No. 5, Zhongguancun South Street, Haidian District, Beijing, 100081, China
| | - Gengsheng Mao
- The Third Medical Center of People's Liberation Army General Hospital, Beijing, 100583, China
| | - Shunming Hong
- The Third Medical Center of People's Liberation Army General Hospital, Beijing, 100583, China
| |
Collapse
|