51
|
Fang G, Wang X, Wang K, Lee KH, Ho JDL, Fu HC, Fu DKC, Kwok KW. Vision-Based Online Learning Kinematic Control for Soft Robots Using Local Gaussian Process Regression. IEEE Robot Autom Lett 2019. [DOI: 10.1109/lra.2019.2893691] [Citation(s) in RCA: 46] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
52
|
Rayyes R, Kubus D, Steil J. Learning Inverse Statics Models Efficiently With Symmetry-Based Exploration. Front Neurorobot 2018; 12:68. [PMID: 30405387 PMCID: PMC6206748 DOI: 10.3389/fnbot.2018.00068] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2018] [Accepted: 09/26/2018] [Indexed: 11/28/2022] Open
Abstract
Learning (inverse) kinematics and dynamics models of dexterous robots for the entire action or observation space is challenging and costly. Sampling the entire space is usually intractable in terms of time, tear, and wear. We propose an efficient approach to learn inverse statics models—primarily for gravity compensation—by exploring only a small part of the configuration space and exploiting the symmetry properties of the inverse statics mapping. In particular, there exist symmetric configurations that require the same absolute motor torques to be maintained. We show that those symmetric configurations can be discovered, the functional relations between them can be successfully learned and exploited to generate multiple training samples from one sampled configuration-torque pair. This strategy drastically reduces the number of samples required for learning inverse statics models. Moreover, we demonstrate that exploiting symmetries for learning inverse statics models is a generally applicable strategy for online and offline learning algorithms. We exemplify this by two different learning approaches. First, we modify the Direction Sampling approach for learning inverse statics models online, in a plain exploratory fashion, from scratch and without using a closed-loop controller. Second, we show that inverse statics mappings can be efficiently learned offline utilizing lattice sampling. Results for a 2R planar robot and a 3R simplified human arm demonstrate that their inverse statics mappings can be learned successfully for the entire configuration space. Furthermore, we demonstrate that the number of samples required for learning inverse statics mappings for 2R and 3R manipulators can be reduced at least by factors of approximately 8 and 16, respectively–depending on the number of discovered symmetries.
Collapse
Affiliation(s)
- Rania Rayyes
- Institut für Robotik und Prozessinformatik, Technische Universität Braunschweig, Braunschweig, Germany
| | - Daniel Kubus
- Institut für Robotik und Prozessinformatik, Technische Universität Braunschweig, Braunschweig, Germany
| | - Jochen Steil
- Institut für Robotik und Prozessinformatik, Technische Universität Braunschweig, Braunschweig, Germany
| |
Collapse
|
53
|
Ho JDL, Lee KH, Tang WL, Hui KM, Althoefer K, Lam J, Kwok KW. Localized online learning-based control of a soft redundant manipulator under variable loading. Adv Robot 2018. [DOI: 10.1080/01691864.2018.1528178] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
Affiliation(s)
- Justin D. L. Ho
- Department of Mechanical Engineering, The University of Hong Kong, Hong Kong, China
| | - Kit-Hang Lee
- Department of Mechanical Engineering, The University of Hong Kong, Hong Kong, China
| | - Wai Lun Tang
- Department of Mechanical Engineering, The University of Hong Kong, Hong Kong, China
| | - Ka-Ming Hui
- Department of Mechanical Engineering, The University of Hong Kong, Hong Kong, China
| | - Kaspar Althoefer
- Centre for Advanced Robotics @ Queen Mary, School of Engineering and Materials Science, Queen Mary University of London, London, UK
| | - James Lam
- Department of Mechanical Engineering, The University of Hong Kong, Hong Kong, China
| | - Ka-Wai Kwok
- Department of Mechanical Engineering, The University of Hong Kong, Hong Kong, China
| |
Collapse
|
54
|
Li S, Zhou M, Luo X. Modified Primal-Dual Neural Networks for Motion Control of Redundant Manipulators With Dynamic Rejection of Harmonic Noises. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2018; 29:4791-4801. [PMID: 29990144 DOI: 10.1109/tnnls.2017.2770172] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
In recent decades, primal-dual neural networks, as a special type of recurrent neural networks, have received great success in real-time manipulator control. However, noises are usually ignored when neural controllers are designed based on them, and thus, they may fail to perform well in the presence of intensive noises. Harmonic noises widely exist in real applications and can severely affect the control accuracy. This work proposes a novel primal-dual neural network design that directly takes noise control into account. By taking advantage of the fact that the unknown amplitude and phase information of a harmonic signal can be eliminated from its dynamics, our deliberately designed neural controller is able to reach the accurate tracking of reference trajectories in a noisy environment. Theoretical analysis and extensive simulations show that the proposed controller stabilizes the control system polluted by harmonic noises and converges the position tracking error to zero. Comparisons show that our proposed solution consistently and significantly outperforms the existing primal-dual neural solutions as well as feedforward neural one and adaptive neural one for redundancy resolution of manipulators.
Collapse
|
55
|
Deutschmann B, Liu T, Dietrich A, Ott C, Lee D. A Method to Identify the Nonlinear Stiffness Characteristics of an Elastic Continuum Mechanism. IEEE Robot Autom Lett 2018. [DOI: 10.1109/lra.2018.2800098] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
56
|
|
57
|
George Thuruthel T, Ansari Y, Falotico E, Laschi C. Control Strategies for Soft Robotic Manipulators: A Survey. Soft Robot 2018; 5:149-163. [DOI: 10.1089/soro.2017.0007] [Citation(s) in RCA: 259] [Impact Index Per Article: 37.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Affiliation(s)
- Thomas George Thuruthel
- Soft Robotics Laboratory, The Biorobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Yasmin Ansari
- Soft Robotics Laboratory, The Biorobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Egidio Falotico
- Soft Robotics Laboratory, The Biorobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Cecilia Laschi
- Soft Robotics Laboratory, The Biorobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| |
Collapse
|
58
|
Edelmann J, Petruska AJ, Nelson BJ. Estimation-Based Control of a Magnetic Endoscope without Device Localization. ACTA ACUST UNITED AC 2018. [DOI: 10.1142/s2424905x18500022] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Magnetically controlled catheters and endoscopes can improve minimally invasive procedures as a result of their increased maneuverability when combined with modern magnetic steering systems. However, such systems have two distinct shortcomings: they require continuous information about the location of the instrument inside the human body and they rely on models that accurately capture the device behavior, which are difficult to obtain in realistic settings. To address both of these issues, we propose a control algorithm that continuously estimates a magnetic endoscope’s response to changes in the actuating magnetic field. Experiments in a structured visual environment show that the control method is able to follow image-based trajectories under different initial conditions with an average control error that measures 1.8 % of the trajectory length. The usefulness for medical procedures is demonstrated with a bronchoscopic inspection task. In a proof-of-concept study, a custom 2[Formula: see text]mm diameter miniature camera endoscope is navigated through an anatomically correct lung phantom in a clinician-controlled manner. This represents the first demonstration of the controlled manipulation of a magnetic device without localization, which is critical for a wide range of medical procedures.
Collapse
Affiliation(s)
- Janis Edelmann
- Multi-Scale Robotics Lab, Swiss Federal Institute of Technology (ETH) Zurich, Switzerland
| | | | - Bradley J. Nelson
- Multi-Scale Robotics Lab, Swiss Federal Institute of Technology (ETH) Zurich, Switzerland
| |
Collapse
|
59
|
George Thuruthel T, Falotico E, Manti M, Pratesi A, Cianchetti M, Laschi C. Learning Closed Loop Kinematic Controllers for Continuum Manipulators in Unstructured Environments. Soft Robot 2017; 4:285-296. [DOI: 10.1089/soro.2016.0051] [Citation(s) in RCA: 50] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Affiliation(s)
| | - Egidio Falotico
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Mariangela Manti
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Andrea Pratesi
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| | | | - Cecilia Laschi
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| |
Collapse
|
60
|
Lee KH, Fu DKC, Leong MCW, Chow M, Fu HC, Althoefer K, Sze KY, Yeung CK, Kwok KW. Nonparametric Online Learning Control for Soft Continuum Robot: An Enabling Technique for Effective Endoscopic Navigation. Soft Robot 2017; 4:324-337. [PMID: 29251567 PMCID: PMC5734182 DOI: 10.1089/soro.2016.0065] [Citation(s) in RCA: 29] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023] Open
Abstract
Bioinspired robotic structures comprising soft actuation units have attracted increasing research interest. Taking advantage of its inherent compliance, soft robots can assure safe interaction with external environments, provided that precise and effective manipulation could be achieved. Endoscopy is a typical application. However, previous model-based control approaches often require simplified geometric assumptions on the soft manipulator, but which could be very inaccurate in the presence of unmodeled external interaction forces. In this study, we propose a generic control framework based on nonparametric and online, as well as local, training to learn the inverse model directly, without prior knowledge of the robot's structural parameters. Detailed experimental evaluation was conducted on a soft robot prototype with control redundancy, performing trajectory tracking in dynamically constrained environments. Advanced element formulation of finite element analysis is employed to initialize the control policy, hence eliminating the need for random exploration in the robot's workspace. The proposed control framework enabled a soft fluid-driven continuum robot to follow a 3D trajectory precisely, even under dynamic external disturbance. Such enhanced control accuracy and adaptability would facilitate effective endoscopic navigation in complex and changing environments.
Collapse
Affiliation(s)
- Kit-Hang Lee
- 1 Department of Mechanical Engineering, The University of Hong Kong , Hong Kong, Hong Kong
| | - Denny K C Fu
- 1 Department of Mechanical Engineering, The University of Hong Kong , Hong Kong, Hong Kong
| | - Martin C W Leong
- 1 Department of Mechanical Engineering, The University of Hong Kong , Hong Kong, Hong Kong
| | - Marco Chow
- 1 Department of Mechanical Engineering, The University of Hong Kong , Hong Kong, Hong Kong
| | - Hing-Choi Fu
- 1 Department of Mechanical Engineering, The University of Hong Kong , Hong Kong, Hong Kong
| | - Kaspar Althoefer
- 2 School of Engineering and Materials Science, Queen Mary University of London , London, United Kingdom
| | - Kam Yim Sze
- 1 Department of Mechanical Engineering, The University of Hong Kong , Hong Kong, Hong Kong
| | - Chung-Kwong Yeung
- 3 Department of Surgery, Li Ka Shing Faculty of Medicine, The University of Hong Kong , Hong Kong, Hong Kong
| | - Ka-Wai Kwok
- 1 Department of Mechanical Engineering, The University of Hong Kong , Hong Kong, Hong Kong
| |
Collapse
|
61
|
Gao X, Wu H, Du M, Chen G, Sun H, Jia Q, Wang Y. Research on the operational reliability system control methodology and its application for aerospace mechanism. INT J ADV ROBOT SYST 2016. [DOI: 10.1177/1729881416677482] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
According to the characteristics of space missions and space environment, to slow performance deterioration and possible reliability attenuation for aerospace mechanisms, an operational reliability system control methodology is proposed in this article. A space manipulator – a kind of typical complicated aerospace mechanism – is chosen as the research object. First, considering relevant materials and structure mechanism of joint and link parts, the influence factors of operational reliability for space manipulator are divided. Then, by introducing the responding layer factors, a mapping relationship between the influence factors of operational reliability and control variables is analysed. On this basis, a new method to build a hierarchical control system of operational reliability for the aerospace mechanisms is proposed. In this method, the mechanism how the influence factors of operational reliability are introduced into the control system is defined, and an operational reliability system control model is built, which is made up of task planning, path planning, and motion control. Finally, the proposed methodology is further explained with the operational stability of a space manipulator as an example. After analysing the mapping relationship among the influence factors of operational reliability, the factors of responding layer and control variables, a multi-objective optimization method based on Nondominated Sorting Genetic Algorithm II (NSGA-II) is proposed to ensure the operation stability for a space manipulator. These optimization objectives are introduced into the optimized control model at path planning level as constraints. According to these constraints, the optimized control system can be adjusted to improve the operation stability of the manipulator, and the operational reliability is also improved during this process correspondingly. Simulation results prove the effectiveness of the proposed method.
Collapse
Affiliation(s)
- Xin Gao
- School of Automation, Beijing University of Posts and Telecommunications, Beijing, China
| | - Haoxin Wu
- School of Automation, Beijing University of Posts and Telecommunications, Beijing, China
| | - Mingtao Du
- School of Automation, Beijing University of Posts and Telecommunications, Beijing, China
| | - Gang Chen
- School of Automation, Beijing University of Posts and Telecommunications, Beijing, China
| | - Hanxu Sun
- School of Automation, Beijing University of Posts and Telecommunications, Beijing, China
| | - Qingxuan Jia
- School of Automation, Beijing University of Posts and Telecommunications, Beijing, China
| | - Yifan Wang
- School of Automation, Beijing University of Posts and Telecommunications, Beijing, China
| |
Collapse
|
62
|
Xu W, Chen J, Lau HY, Ren H. Data-driven methods towards learning the highly nonlinear inverse kinematics of tendon-driven surgical manipulators. Int J Med Robot 2016; 13. [DOI: 10.1002/rcs.1774] [Citation(s) in RCA: 36] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2016] [Revised: 07/25/2016] [Accepted: 08/16/2016] [Indexed: 11/10/2022]
Affiliation(s)
- Wenjun Xu
- Department of Biomedical Engineering; National University of Singapore; Singapore
| | - Jie Chen
- Department of Industrial and Manufacturing Systems Engineering; The University of Hong Kong; Hong Kong SAR
| | - Henry Y.K. Lau
- Department of Industrial and Manufacturing Systems Engineering; The University of Hong Kong; Hong Kong SAR
| | - Hongliang Ren
- Department of Biomedical Engineering; National University of Singapore; Singapore
| |
Collapse
|