1
|
Yu X, Chen Y, Shi B, Zhuo H, Zhou L, Ma Y, Wei Y, Ou L. Design and Evaluation of an Omnidirectional Wheel-Driven Endoscope-Assisted Robotic System Based on Motion Capture Control. Int J Med Robot 2025; 21:e70070. [PMID: 40366106 DOI: 10.1002/rcs.70070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2024] [Revised: 03/05/2025] [Accepted: 04/24/2025] [Indexed: 05/15/2025]
Abstract
BACKGROUND In endoscopic surgery, surgeons collaborate with assistants to manipulate the endoscope and instruments, making it impossible to perform the surgery independently. METHODS We propose an endoscopic assistive robot based on motion capture control, enabling surgeons to control the endoscope with one hand. The system uses cameras at the master end to capture real-time motion information from the marker accessory, determining the surgeon's intent. It then controls the robot at the slave end to simulate surgical delivery actions, enabling precise endoscopic positioning through master-slave mapping. The omnidirectional wheel design addresses coupling issues of traditional friction wheels, significantly improving control accuracy. RESULTS Testing demonstrated a maximum delivery error of 3.99% and 45.77% improvement in rotational precision. The system received positive feedback in both simulated and animal trials. CONCLUSIONS The system empowers surgeons to perform endoscopic procedures independently, establishing a foundation for advancing diagnosis and treatment of gastric diseases.
Collapse
Affiliation(s)
- Xinyi Yu
- School of Information Engineering, Zhejiang University of Technology, Zhejiang, China
| | - Yinkai Chen
- School of Information Engineering, Zhejiang University of Technology, Zhejiang, China
| | - Baiming Shi
- Hangzhou AGS Medical Technology Co. Ltd, Zhejiang, China
| | - Hao Zhuo
- School of Information Engineering, Zhejiang University of Technology, Zhejiang, China
| | - Libo Zhou
- School of Information Engineering, Zhejiang University of Technology, Zhejiang, China
| | - Yuye Ma
- School of Information Engineering, Zhejiang University of Technology, Zhejiang, China
| | - Yan Wei
- School of Information Engineering, Zhejiang University of Technology, Zhejiang, China
| | - Linlin Ou
- School of Information Engineering, Zhejiang University of Technology, Zhejiang, China
| |
Collapse
|
2
|
DeBuys C, Ghesu FC, Jayender J, Langari R, Kim YH. Separable Tendon-Driven Robotic Manipulator with a Long, Flexible, Passive Proximal Section. JOURNAL OF MECHANISMS AND ROBOTICS 2023; 15:061019. [PMID: 38328596 PMCID: PMC10845131 DOI: 10.1115/1.4062354] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/09/2024]
Abstract
This work tackles practical issues which arise when using a tendon-driven robotic manipulator (TDRM) with a long, flexible, passive proximal section in medical applications. Tendon-driven devices are preferred in medicine for their improved outcomes via minimally invasive procedures, but TDRMs come with unique challenges such as sterilization and reuse, simultaneous control of tendons, hysteresis in the tendon-sheath mechanism, and unmodeled effects of the proximal section shape. A separable TDRM which overcomes difficulties in actuation and sterilization is introduced, in which the body containing the electronics is reusable and the remainder is disposable. An open-loop redundant controller which resolves the redundancy in the kinematics is developed. Simple linear hysteresis compensation and re-tension compensation based on the physical properties of the device are proposed. The controller and compensation methods are evaluated on a testbed for a straight proximal section, a curved proximal section at various static angles, and a proximal section which dynamically changes angles; and overall, distal tip error was reduced.
Collapse
Affiliation(s)
- Christian DeBuys
- Texas A&M University, Mechanical Engineering, College Station, TX, USA
| | - Florin C Ghesu
- Siemens Healthineersm, Digital Technology & Innovation, Princeton, NJ, USA
| | - Jagadeesan Jayender
- Surgical Planning Laboratory, Brigham and Women's Hospital, Harvard Medical School, Boston, USA
| | - Reza Langari
- Texas A&M University, Mechanical Engineering, College Station, TX, USA
| | - Young-Ho Kim
- Siemens Healthineers, Digital Technology & Innovation, Princeton, NJ, USA
| |
Collapse
|
3
|
Schlenk C, Hagmann K, Steidle F, Oliva Maza L, Kolb A, Hellings-Kuß A, Schöb DS, Klodmann J, Miernik A, Albu-Schäffer A. A robotic system for solo surgery in flexible ureteroscopy: development and evaluation with clinical users. Int J Comput Assist Radiol Surg 2023; 18:1559-1569. [PMID: 37032384 PMCID: PMC10491575 DOI: 10.1007/s11548-023-02883-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2023] [Accepted: 03/20/2023] [Indexed: 04/11/2023]
Abstract
PURPOSE The robotic system CoFlex for kidney stone removal via flexible ureteroscopy (fURS) by a single surgeon (solo surgery, abbreviated SSU) is introduced. It combines a versatile robotic arm and a commercially available ureteroscope to enable gravity compensation and safety functions like virtual walls. The haptic feedback from the operation site is comparable to manual fURS, as the surgeon actuates all ureteroscope DoF manually. METHODS The system hardware and software as well as the design of an exploratory user study on the simulator model with non-medical participants and urology surgeons are described. For each user study task both objective measurements (e.g., completion time) and subjective user ratings of workload (using the NASA-TLX) and usability (using the System Usability Scale SUS) were obtained. RESULTS CoFlex enabled SSU in fURS. The implemented setup procedure resulted in an average added setup time of 341.7 ± 71.6 s, a NASA-TLX value of 25.2 ± 13.3 and a SUS value of 82.9 ± 14.4. The ratio of inspected kidney calyces remained similar for robotic (93.68 %) and manual endoscope guidance (94.74 %), but the NASA-TLX values were higher (58.1 ± 16.0 vs. 48.9 ± 20.1) and the SUS values lower (51.5 ± 19.9 vs. 63.6 ± 15.3) in the robotic scenario. SSU in the fURS procedure increased the overall operation time from 1173.5 ± 355.7 s to 2131.0 ± 338.0 s, but reduced the number of required surgeons from two to one. CONCLUSIONS The evaluation of CoFlex in a user study covering a complete fURS intervention confirmed the technical feasibility of the concept and its potential to reduce surgeon working time. Future development steps will enhance the system ergonomics, minimize the users' physical load while interacting with the robot and exploit the logged data from the user study to optimize the current fURS workflow.
Collapse
Affiliation(s)
- Christopher Schlenk
- German Aerospace Center (DLR), Institute of Robotics and Mechatronics, Wessling, Germany.
| | - Katharina Hagmann
- German Aerospace Center (DLR), Institute of Robotics and Mechatronics, Wessling, Germany
| | - Florian Steidle
- German Aerospace Center (DLR), Institute of Robotics and Mechatronics, Wessling, Germany
| | - Laura Oliva Maza
- German Aerospace Center (DLR), Institute of Robotics and Mechatronics, Wessling, Germany
| | - Alexander Kolb
- German Aerospace Center (DLR), Institute of Robotics and Mechatronics, Wessling, Germany
| | - Anja Hellings-Kuß
- German Aerospace Center (DLR), Institute of Robotics and Mechatronics, Wessling, Germany
| | - Dominik Stefan Schöb
- Department of Urology, Faculty of Medicine, University of Freiburg - Medical Centre, Freiburg im Breisgau, Germany
| | - Julian Klodmann
- German Aerospace Center (DLR), Institute of Robotics and Mechatronics, Wessling, Germany
| | - Arkadiusz Miernik
- Department of Urology, Faculty of Medicine, University of Freiburg - Medical Centre, Freiburg im Breisgau, Germany
| | - Alin Albu-Schäffer
- German Aerospace Center (DLR), Institute of Robotics and Mechatronics, Wessling, Germany
| |
Collapse
|
4
|
Kobayashi S, Masaki F, King F, Wollin DA, Kibel AS, Hata N. Feasibility of multi-section continuum robotic ureteroscope in the kidney. J Robot Surg 2023; 17:1411-1420. [PMID: 36689076 DOI: 10.1007/s11701-023-01530-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Accepted: 01/08/2023] [Indexed: 01/24/2023]
Abstract
Our objective was to evaluate the feasibility of a multi-section continuum robotic ureteroscope to address the difficulties with access into certain renal calyces during flexible ureteroscopy. First, the robotic ureteroscope developed in previous research, which utilizes three actuated bendable sections controlled by wires, was modified for use in this project. Second, using phantom models created from five randomly selected computer tomography urograms, the flexible ureteroscope and robotic ureteroscope were evaluated, focusing on several factors: time taken to access each renal calyx, time taken to aim at three targets on each renal calyx, the force generated in the renal pelvic wall associated with ureteroscope manipulation, and the distance and standard deviation between the ureteroscope and the target. As a result, the robotic ureteroscope utilized significantly less force during lower pole calyx access (flexible ureteroscope vs. robotic ureteroscope; 2.0 vs. 0.98 N, p = 0.03). When aiming at targets, the standard deviation of proper target access was smaller for each renal calyx (upper pole: 0.49 vs. 0.11 mm, middle: 0.84 vs. 0.12 mm, lower pole: 3.4 vs. 0.19 mm) in the robotic ureteroscope group, and the distance between the center point of the ureteroscope image and the target was significantly smaller in the robotic ureteroscope group (upper: 0.49 vs. 0.19 mm, p < 0.001, middle: 0.77 vs. 0.17 mm, p < 0.001, lower: 0.77 vs. 0.22 mm, p < 0.001). In conclusion, our robotic ureteroscope demonstrated improved maneuverability and facilitated accuracy and precision while reducing the force on the renal pelvic wall during access into each renal calyx.
Collapse
Affiliation(s)
- Satoshi Kobayashi
- National Center for Image Guided Therapy, Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, 75 Francis Street, Boston, MA, 02115, USA.
- Department of Urology, Kyushu University, 3-1-1 Maidashi, Higashi-ku, Fukuoka, Fukuoka, 8128582, Japan.
| | - Fumitaro Masaki
- National Center for Image Guided Therapy, Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, 75 Francis Street, Boston, MA, 02115, USA
- Healthcare Optics Research Laboratory, Canon U.S.A., 210 Broadway, Cambridge, MA, 02139, USA
| | - Franklin King
- National Center for Image Guided Therapy, Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, 75 Francis Street, Boston, MA, 02115, USA
| | - Daniel A Wollin
- Division of Urology, Brigham and Women's Hospital, Harvard Medical School, 75 Francis Street, Boston, MA, 02115, USA
| | - Adam S Kibel
- Division of Urology, Brigham and Women's Hospital, Harvard Medical School, 75 Francis Street, Boston, MA, 02115, USA
| | - Nobuhiko Hata
- National Center for Image Guided Therapy, Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, 75 Francis Street, Boston, MA, 02115, USA
| |
Collapse
|
5
|
Cheon B, Kim C, Kwon D. Intuitive endoscopic robot master device with image orientation correction. Int J Med Robot 2022; 18:e2415. [DOI: 10.1002/rcs.2415] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Revised: 04/18/2022] [Accepted: 04/18/2022] [Indexed: 11/08/2022]
Affiliation(s)
- Byungsik Cheon
- School of Mechatronics Engineering Korea University of Technology and Education (KOREATECH) Cheonan Republic of Korea
- ROEN Surgical Co., Ltd. Truth Hall Korea Advanced Institute of Science and Technology (KAIST) Daejeon Republic of Korea
| | - Chang‐Kyun Kim
- ROEN Surgical Co., Ltd. Truth Hall Korea Advanced Institute of Science and Technology (KAIST) Daejeon Republic of Korea
- Department of Mechanical Engineering Korea Advanced Institute of Science and Technology (KAIST) Daejeon Republic of Korea
| | - Dong‐Soo Kwon
- ROEN Surgical Co., Ltd. Truth Hall Korea Advanced Institute of Science and Technology (KAIST) Daejeon Republic of Korea
- Department of Mechanical Engineering Korea Advanced Institute of Science and Technology (KAIST) Daejeon Republic of Korea
| |
Collapse
|
6
|
Intuitive master device for endoscopic robots with visual‐motor correspondence. Int J Med Robot 2022; 18:e2397. [DOI: 10.1002/rcs.2397] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2022] [Revised: 03/24/2022] [Accepted: 03/25/2022] [Indexed: 12/25/2022]
|
7
|
Schlenk C, Klodmann J, Hagmann K, Kolb A, Hellings-Kus A, Steidle F, Schoeb D, Jurgens T, Miernik A, Albu-Schaffer A. A Robotic System for Solo Surgery in Flexible Ureterorenoscopy. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3194668] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Affiliation(s)
- Christopher Schlenk
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Germany
| | - Julian Klodmann
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Germany
| | - Katharina Hagmann
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Germany
| | - Alexander Kolb
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Germany
| | - Anja Hellings-Kus
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Germany
| | - Florian Steidle
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Germany
| | | | | | | | - Alin Albu-Schaffer
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Germany
| |
Collapse
|
8
|
Dolan RD, Ryou M. Endoscopic simulators: training the next generation. Curr Opin Gastroenterol 2021; 37:589-595. [PMID: 34482322 DOI: 10.1097/mog.0000000000000788] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
PURPOSE OF REVIEW To provide a review of current evidence evaluating endoscopic simulators as teaching platforms in gastroenterology training, with emphasis on upper gastrointestinal anatomy. RECENT FINDINGS Endoscopic simulators have leveraged mechanical, virtual reality and ex-vivo or live animal platforms to deliver training in both general and therapeutic endoscopy. Simulators have demonstrated their greatest utility in training novice endoscopists. Intermediate and expert endoscopists may additionally benefit from simulator exposure when learning advanced therapeutic techniques including large tissue resection or natural orifice transluminal endoscopic surgery. SUMMARY Simulator-based learning offers promise to complement conventional endoscopic training modalities for novice trainees. Nevertheless, additional evidence demonstrating a clear benefit is required for simulators to become an integral part of gastroenterology training. As novel advanced endoscopic therapies are developed, endoscopic simulators may assume a larger role in training prior to clinical practice.
Collapse
Affiliation(s)
- Russell D Dolan
- Division of Gastroenterology, Hepatology and Endoscopy, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | | |
Collapse
|
9
|
Kim H, Kim J, You JM, Lee SW, Kyung KU, Kwon DS. A Sigmoid-Colon-Straightening Soft Actuator With Peristaltic Motion for Colonoscopy Insertion Assistance: Easycolon. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3060391] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
|
10
|
Lee DH, Kim YH, Collins J, Kapoor A, Kwon DS, Mansi T. Non-Linear Hysteresis Compensation of a Tendon-Sheath-Driven Robotic Manipulator Using Motor Current. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3057043] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|