1
|
Iovene E, Monaco R, Fu J, Costa F, Ferrigno G, Momi ED. EMG-Based Variable Impedance Control for Enhanced Haptic Feedback in Real-Time Material Recognition. IEEE TRANSACTIONS ON HAPTICS 2025; 18:220-231. [PMID: 40030947 DOI: 10.1109/toh.2024.3524023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/05/2025]
Abstract
Advancements in robotic systems hold significant promise for enhancing spinal interventions. Despite this potential, the integration of robotic platforms in spine surgeries remains limited to only a few procedures. This paper presents a variable impedance control scheme within a shared-control framework to enhance haptic feedback during spinal surgeries. The system allows surgeons to guide the robot while dynamically adjusting stiffness based on contact forces and human intent, using electromyography signals. This adaptive control offers real-time guidance during interactions with different materials, serving as a safety measure to safeguard delicate structures encountered during surgical maneuvers. The system comprises a 7-DoF robotic manipulator with a 6-axis force/torque sensor and an 8-channel EMG sensor. Technical validation and a user study assessed performance compared to constant parameter (CIC) and linear variable (LVIC) impedance control methods. Results showed reduced contact force ( vs CIC's and LVIC's ) and in-contact displacement ( vs CIC's and LVIC's ), when interacting with delicate materials, minimizing the risk to critical anatomical structures. Additionally, a user survey confirmed that the proposed system improved haptic perception and control while preventing undesired movements during interactions with various tissues and structures.
Collapse
|
2
|
Shi Y, Zhu P, Wang T, Mai H, Yeh X, Yang L, Wang J. Dynamic Virtual Fixture Generation Based on Intra-Operative 3D Image Feedback in Robot-Assisted Minimally Invasive Thoracic Surgery. SENSORS (BASEL, SWITZERLAND) 2024; 24:492. [PMID: 38257585 PMCID: PMC10820968 DOI: 10.3390/s24020492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/12/2023] [Revised: 01/09/2024] [Accepted: 01/10/2024] [Indexed: 01/24/2024]
Abstract
This paper proposes a method for generating dynamic virtual fixtures with real-time 3D image feedback to facilitate human-robot collaboration in medical robotics. Seamless shared control in a dynamic environment, like that of a surgical field, remains challenging despite extensive research on collaborative control and planning. To address this problem, our method dynamically creates virtual fixtures to guide the manipulation of a trocar-placing robot arm using the force field generated by point cloud data from an RGB-D camera. Additionally, the "view scope" concept selectively determines the region for computational points, thereby reducing computational load. In a phantom experiment for robot-assisted port incision in minimally invasive thoracic surgery, our method demonstrates substantially improved accuracy for port placement, reducing error and completion time by 50% (p=1.06×10-2) and 35% (p=3.23×10-2), respectively. These results suggest that our proposed approach is promising in improving surgical human-robot collaboration.
Collapse
Affiliation(s)
- Yunze Shi
- ZJU-UIUC Institute, International Campus, Zhejiang University, Haining 314400, China; (Y.S.); (T.W.); (H.M.)
- School of Mechanical Engineering, Zhejiang University, Hangzhou 310058, China
| | - Peizhang Zhu
- Flexiv Ltd., Santa Clara, CA 95054, USA; (P.Z.); (X.Y.)
| | - Tengyue Wang
- ZJU-UIUC Institute, International Campus, Zhejiang University, Haining 314400, China; (Y.S.); (T.W.); (H.M.)
- School of Mechanical Engineering, Zhejiang University, Hangzhou 310058, China
| | - Haonan Mai
- ZJU-UIUC Institute, International Campus, Zhejiang University, Haining 314400, China; (Y.S.); (T.W.); (H.M.)
| | - Xiyang Yeh
- Flexiv Ltd., Santa Clara, CA 95054, USA; (P.Z.); (X.Y.)
| | - Liangjing Yang
- ZJU-UIUC Institute, International Campus, Zhejiang University, Haining 314400, China; (Y.S.); (T.W.); (H.M.)
- School of Mechanical Engineering, Zhejiang University, Hangzhou 310058, China
- Department of Mechanical Engineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
| | - Jingfan Wang
- Flexiv Ltd., Santa Clara, CA 95054, USA; (P.Z.); (X.Y.)
| |
Collapse
|
3
|
Chen Z, Guo Q, Li T, Yan Y, Jiang D. Gait Prediction and Variable Admittance Control for Lower Limb Exoskeleton With Measurement Delay and Extended-State-Observer. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:8693-8706. [PMID: 35302939 DOI: 10.1109/tnnls.2022.3152255] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The measurement delay of the feedback control system is a universal problem in industrial engineering, which will degrade output performance, especially causing undesirable chatter responses. In this study, a deep-Gaussian-process (DGP)-based method for operator's gait prediction is proposed to estimate the real-time motion intention and to compensate for the measurement delay of the inertial measurement unit (IMU). On the basis of these gait prediction uncertainties quantified by the DGP method, a variable admittance controller is designed to reduce real-time human-exoskeleton interaction torque. The reference trajectory is generated by the admittance controller, which is smoothed by the two-order Bessel interpolation. Meanwhile, the admittance parameters are self-regulated based on the defined uncertainty index of gait prediction. The extend-state observer (ESO) with backstepping iteration is adopted to compensate unmeasured system state, model uncertainties, and unmodeled dynamics of lower limb exoskeleton. The effectiveness of the proposed gait prediction and control scheme is verified by both the comparative simulations and experimental results of the human-exoskeleton cooperative motion.
Collapse
|
4
|
Sai H, Wang L, Zhang J, Xia C, Xu Z. Portable Device to Assist With Force Control in Ultrasound Acquisition. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2023; 70:930-943. [PMID: 35675230 DOI: 10.1109/tuffc.2022.3181287] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
This study presents a portable device that ensures precise contact force between a subject and a probe to improve the stability and reproducibility of ultrasound (US) acquisition. The mechanical portion of the device includes a servo motor, gears, and a ball screw linear actuator; two photoelectric switches are used to limit the stroke. A combined force and position control system is developed, and a pressure threshold is introduced to reduce the chattering of the system so that it can be applied to US examinations of tissues of different stiffness levels. Force control experiments were conducted on the device, and the results showed that the device can overcome the chattering of a physician's hand and movement caused by a subject's respiration. Additionally, the stability of the US acquisition was substantially improved. Based on clinical trials on humans, this device was observed to improve the consistency of ultrasonic results and the repeatability of images, and it assisted sonographers with maintaining suitable contact force and improving imaging quality. The device can either be handheld by a physician or easily integrated with a manipulator as an autonomous robotic US acquisition device, thereby validating its potential for US applications.
Collapse
|
5
|
Li G, Li Z, Kan Z. Assimilation Control of a Robotic Exoskeleton for Physical Human-Robot Interaction. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3144537] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
6
|
Tang R, Yang Q, Song R. Variable Impedance Control Based on Target Position and Tracking Error for Rehabilitation Robots During a Reaching Task. Front Neurorobot 2022; 16:850692. [PMID: 35308312 PMCID: PMC8927629 DOI: 10.3389/fnbot.2022.850692] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2022] [Accepted: 01/28/2022] [Indexed: 11/13/2022] Open
Abstract
To obtain an anthropomorphic performance in physical human-robot interaction during a reaching task, a variable impedance control (vIC) algorithm with human-like characteristics is proposed in this article. The damping value of the proposed method is varied with the target position as well as through the tracking error. The proposed control algorithm is compared with the impedance control algorithm with constant parameters (IC) and another vIC algorithm, which is only changed with the tracking error (vIC-e). The different control algorithms are validated through the simulation study, and are experimentally implemented on a cable-driven rehabilitation robot. The results show that the proposed vIC can improve the tracking accuracy and trajectory smoothness, and reduce the interaction force at the same time.
Collapse
Affiliation(s)
- Rongrong Tang
- The Key Laboratory of Sensing Technology and Biomedical Instrument of Guangdong Province, School of Biomedical Engineering, Sun Yat-sen University, Guangzhou, China
- The Shenzhen Research Institute, Sun Yat-sen University, Guangzhou, China
| | - Qianqian Yang
- The Key Laboratory of Sensing Technology and Biomedical Instrument of Guangdong Province, School of Biomedical Engineering, Sun Yat-sen University, Guangzhou, China
- The Shenzhen Research Institute, Sun Yat-sen University, Guangzhou, China
- The School of Mechatronic Engineering, Guangdong Polytechnic Normal University, Guangzhou, China
- *Correspondence: Qianqian Yang
| | - Rong Song
- The Key Laboratory of Sensing Technology and Biomedical Instrument of Guangdong Province, School of Biomedical Engineering, Sun Yat-sen University, Guangzhou, China
- The Shenzhen Research Institute, Sun Yat-sen University, Guangzhou, China
- Rong Song
| |
Collapse
|
7
|
Hamad YM, Aydin Y, Basdogan C. Adaptive Human Force Scaling via Admittance Control for Physical Human-Robot Interaction. IEEE TRANSACTIONS ON HAPTICS 2021; 14:750-761. [PMID: 33826517 DOI: 10.1109/toh.2021.3071626] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
The goal of this article is to design an admittance controller for a robot to adaptively change its contribution to a collaborative manipulation task executed with a human partner to improve the task performance. This has been achieved by adaptive scaling of human force based on her/his movement intention while paying attention to the requirements of different task phases. In our approach, movement intentions of human are estimated from measured human force and velocity of manipulated object, and converted to a quantitative value using a fuzzy logic scheme. This value is then utilized as a variable gain in an admittance controller to adaptively adjust the contribution of robot to the task without changing the admittance time constant. We demonstrate the benefits of the proposed approach by a pHRI experiment utilizing Fitts' reaching movement task. The results of the experiment show that there is a) an optimum admittance time constant maximizing the human force amplification and b) a desirable admittance gain profile which leads to a more effective co-manipulation in terms of overall task performance.
Collapse
|
8
|
Arnold J, Lee H. Variable Impedance Control for pHRI: Impact on Stability, Agility, and Human Effort in Controlling a Wearable Ankle Robot. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3062015] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
9
|
Li HY, Yang L, Tan UX. A Control Scheme for Smooth Transition in Physical Human-Robot-Environment Between Two Modes: Augmentation and Autonomous. IEEE Robot Autom Lett 2020. [DOI: 10.1109/lra.2020.3010450] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
10
|
A Control Scheme for Physical Human-Robot Interaction Coupled with an Environment of Unknown Stiffness. J INTELL ROBOT SYST 2020. [DOI: 10.1007/s10846-020-01176-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
11
|
Jujjavarapu SS, Esfahani ET. Improving Stability in Upper Limb Rehabilitation Using Variable Stiffness. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2019:122-125. [PMID: 31945859 DOI: 10.1109/embc.2019.8857369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
In a robotic rehabilitation setup, patient's safety and interaction stability are critical throughout the therapy. This paper addresses the stability aspect by proposing a method to vary the endpoint stiffness using a variable impedance mechanism. The proposed device consists of permanent magnets in an antagonistic configuration that acts as springs and the variation in stiffness is achieved by modifying the separation between those magnets. This device is mounted on the end-effector of an admittance controlled robotic arm and tested with the help of healthy humans on a virtual maze traversal experiment consisting of both fine and gross motor regions. Moreover, the subjects are tested both in normal and simulated tremor conditions to verify the effectiveness of the device. The experimental results show that the VSM can not only suppress the high-frequency forces but can also reduce the interference of human endpoint stiffness in the stability of the robot.
Collapse
|