1
|
Li G, Yarmolenko P, Cleary K, Monfaredi R. An MR-Safe Pneumatic Stepper Motor: Design, Control, and Characterization. J Med Device 2025; 19:011007. [PMID: 40206181 PMCID: PMC11977570 DOI: 10.1115/1.4067605] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2024] [Revised: 12/16/2024] [Indexed: 04/11/2025] Open
Abstract
Magnetic resonance imaging (MRI) can provide high contrast soft tissue visualization without ionizing radiation, which makes it an attractive imaging modality for interventional procedures. However, the strong magnetic and radio frequency (RF) fields impose significant challenges to the development of robotic systems within the magnetic resonance environment. Consequently, designing MRI-compatible actuators is crucial for advancing MRI-guided robotic systems. This paper reports the design, control, and characterization of a gear-based pneumatic stepper motor. The motor is designed with three actuating piston units and a geared rotor. The three actuating pistons are driven sequentially by compressed air to push the geared rotor and to generate bidirectional stepwise motion. Experiments were conducted to characterize the motor in terms of torque, speed, control, and MRI compatibility. The results demonstrate that the motor can deliver a maximum continuous torque of 1300 mNm at 80 pounds per square inch (PSI) (0.55 MPa) with 9 m air hoses. The closed-loop control evaluation demonstrates the steady-state error of position tracking was 0.81±0.52 deg. The MRI compatibility study indicated negligible image quality degradation. Therefore, the proposed pneumatic stepper motor can effectively serve as an actuator for MRI-guided robotic applications.
Collapse
Affiliation(s)
- Gang Li
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Medical Center, Washington, DC 20010
| | - Pavel Yarmolenko
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Medical Center, Washington, DC 20010
| | - Kevin Cleary
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Medical Center, Washington, DC 20010
| | - Reza Monfaredi
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Medical Center, Washington, DC 20010
| |
Collapse
|
2
|
Lafreniere S, Padasdao B, Konh B. Towards Design and Development of an MRI Conditional Robot to Enable Curvilinear Transperineal Prostate Biopsy. Int J Med Robot 2024; 20:e70015. [PMID: 39641325 PMCID: PMC11745543 DOI: 10.1002/rcs.70015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2024] [Revised: 11/11/2024] [Accepted: 11/18/2024] [Indexed: 12/07/2024]
Abstract
BACKGROUND In-bore MRI prostate biopsy offers improved visualisation and detection of significant prostate cancer; however, it is not widely practiced in cancer diagnosis due to its associated costs. METHODS This work introduces the first prototype towards a 7-degrees-of-freedom (DOF) MRI-conditional piezoelectrically actuated robotic system for transperineal prostate biopsy. The robot enables needle insertions in the desired trajectories. Kinematic and static models of the active needle as well as automated control of the robot are presented. RESULTS It is shown that the controller can force the needle to realize the reference sine and triangular bending angles with an accuracy of 1.78 and 1.88°, respectively, in air. The trajectory tracking capability of the system in free space is shown with an RMS error of 0.86 mm and a standard deviation of 0.36 mm. CONCLUSIONS The robot's capability to steer the needle towards target inside a phantom and extract a sample was evaluated.
Collapse
Affiliation(s)
- Samuel Lafreniere
- Department of Mechanical Engineering, University of Hawaii at Manoa, 2540 Dole St., Holmes Hall 302, Honolulu, HI 96822
| | - Blayton Padasdao
- Department of Mechanical Engineering, University of Hawaii at Manoa, 2540 Dole St., Holmes Hall 302, Honolulu, HI 96822
| | - Bardia Konh
- Department of Mechanical Engineering, University of Hawaii at Manoa, 2540 Dole St., Holmes Hall 302, Honolulu, HI 96822
| |
Collapse
|
3
|
Antoniou A, Evripidou N, Chrysanthou A, Georgiou L, Ioannides C, Spanoudes K, Damianou C. Effect of Magnetic Resonance Imaging on the Motion Accuracy of Magnetic Resonance Imaging-compatible Focused Ultrasound Robotic System. J Med Phys 2024; 49:203-212. [PMID: 39131431 PMCID: PMC11309133 DOI: 10.4103/jmp.jmp_7_24] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Revised: 02/23/2024] [Accepted: 03/29/2024] [Indexed: 08/13/2024] Open
Abstract
PURPOSE The current study provides insights into the challenges of safely operating a magnetic resonance imaging (MRI)-guided focused ultrasound (MRgFUS) robotic system in a high-field MRI scanner in terms of robotic motion accuracy. MATERIALS AND METHODS Grid sonications were carried out in phantoms and excised porcine tissue in a 3T MRI scanner using an existing MRgFUS robotic system. Fast low-angle shot-based magnetic resonance thermometry was employed for the intraprocedural monitoring of thermal distribution. RESULTS Strong shifting of the heated spots from the intended points was observed owing to electromagnetic interference (EMI)-induced malfunctions in system's operation. Increasing the slice thickness of the thermometry sequence to at least 8 mm was proven an efficient method for preserving the robotic motion accuracy. CONCLUSIONS These findings raise awareness about EMI effects on the motion accuracy of MRgFUS robotic devices and how they can be mitigated by employing suitable thermometry parameters.
Collapse
Affiliation(s)
- Anastasia Antoniou
- Department of Electrical Engineering, Computer Engineering, and Informatics, Cyprus University of Technology, Limassol, Cyprus
| | - Nikolas Evripidou
- Department of Electrical Engineering, Computer Engineering, and Informatics, Cyprus University of Technology, Limassol, Cyprus
| | - Antreas Chrysanthou
- Department of Interventional Radiology, German Oncology Center, Limassol, Cyprus
| | - Leonidas Georgiou
- Department of Interventional Radiology, German Oncology Center, Limassol, Cyprus
| | - Cleanthis Ioannides
- Department of Interventional Radiology, German Oncology Center, Limassol, Cyprus
| | | | - Christakis Damianou
- Department of Electrical Engineering, Computer Engineering, and Informatics, Cyprus University of Technology, Limassol, Cyprus
| |
Collapse
|
4
|
Jiang W, Gao Y, Wen M, Ye Z, Liang H, Wu D, Dong W. Preliminary evaluation for ultrasound-guided targeted prostate biopsy using a portable surgical robot: Ex vivo results. Int J Med Robot 2023:e2597. [PMID: 37984069 DOI: 10.1002/rcs.2597] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Revised: 10/17/2023] [Accepted: 10/26/2023] [Indexed: 11/22/2023]
Abstract
BACKGROUND Robotic systems are increasingly used to enhance clinical outcomes in prostate intervention. To evaluate the clinical value of the proposed portable robot, the robot-assisted and robot-targeted punctures were validated experimentally. METHOD The robot registration utilising the electromagnetic tracker achieves coordinate transformation from the ultrasound (US) image to the robot. Subsequently, Transrectal ultrasound (TRUS)-guided phantom trials were conducted for robot-assisted, free-hand, and robot-targeted punctures. RESULTS The accuracy of robot registration was 0.95 mm, and the accuracy of robot-assisted, free-hand, and robot-targeted punctures was 2.38 ± 0.64 mm, 3.11 ± 0.72 mm, and 3.29 ± 0.83 mm sequentially. CONCLUSION The registration method has been successfully applied to robot-targeted puncture. Current results indicate that the accuracy of robot-targeted puncture is slightly inferior to that of manual operations. Moreover, in manual operation, robot-assisted puncture improves the accuracy of free-hand puncture. Accuracy superior to 3.5 mm demonstrates the clinical applicability of both robot-assisted and robot-targeted punctures.
Collapse
Affiliation(s)
- Wenhe Jiang
- State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin, China
| | - Yongzhuo Gao
- State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin, China
| | - Mingwei Wen
- Department of Biomedical Engineering, College of Life Science and Technology, Huazhong University of Science and Technology, Wuhan, China
| | - Zhichao Ye
- Department of Urology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Huageng Liang
- Department of Urology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Dongmei Wu
- State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin, China
| | - Wei Dong
- State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin, China
| |
Collapse
|
5
|
Hu S, Lu R, Zhu Y, Zhu W, Jiang H, Bi S. Application of Medical Image Navigation Technology in Minimally Invasive Puncture Robot. SENSORS (BASEL, SWITZERLAND) 2023; 23:7196. [PMID: 37631733 PMCID: PMC10459274 DOI: 10.3390/s23167196] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Revised: 08/11/2023] [Accepted: 08/14/2023] [Indexed: 08/27/2023]
Abstract
Microneedle puncture is a standard minimally invasive treatment and surgical method, which is widely used in extracting blood, tissues, and their secretions for pathological examination, needle-puncture-directed drug therapy, local anaesthesia, microwave ablation needle therapy, radiotherapy, and other procedures. The use of robots for microneedle puncture has become a worldwide research hotspot, and medical imaging navigation technology plays an essential role in preoperative robotic puncture path planning, intraoperative assisted puncture, and surgical efficacy detection. This paper introduces medical imaging technology and minimally invasive puncture robots, reviews the current status of research on the application of medical imaging navigation technology in minimally invasive puncture robots, and points out its future development trends and challenges.
Collapse
Affiliation(s)
| | - Rongjian Lu
- School of Mechanical and Electronic Engineering, Nanjing Forestry University, Nanjing 210037, China; (S.H.)
| | | | | | | | | |
Collapse
|
6
|
Zhang Y, Yuan Q, Muzzammil HM, Gao G, Xu Y. Image-guided prostate biopsy robots: A review. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2023; 20:15135-15166. [PMID: 37679175 DOI: 10.3934/mbe.2023678] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/09/2023]
Abstract
At present, the incidence of prostate cancer (PCa) in men is increasing year by year. So, the early diagnosis of PCa is of great significance. Transrectal ultrasonography (TRUS)-guided biopsy is a common method for diagnosing PCa. The biopsy process is performed manually by urologists but the diagnostic rate is only 20%-30% and its reliability and accuracy can no longer meet clinical needs. The image-guided prostate biopsy robot has the advantages of a high degree of automation, does not rely on the skills and experience of operators, reduces the work intensity and operation time of urologists and so on. Capable of delivering biopsy needles to pre-defined biopsy locations with minimal needle placement errors, it makes up for the shortcomings of traditional free-hand biopsy and improves the reliability and accuracy of biopsy. The integration of medical imaging technology and the robotic system is an important means for accurate tumor location, biopsy puncture path planning and visualization. This paper mainly reviews image-guided prostate biopsy robots. According to the existing literature, guidance modalities are divided into magnetic resonance imaging (MRI), ultrasound (US) and fusion image. First, the robot structure research by different guided methods is the main line and the actuators and material research of these guided modalities is the auxiliary line to introduce and compare. Second, the robot image-guided localization technology is discussed. Finally, the image-guided prostate biopsy robot is summarized and suggestions for future development are provided.
Collapse
Affiliation(s)
- Yongde Zhang
- Key Laboratory of Advanced Manufacturing and Intelligent Technology, Ministry of Education, Harbin University of Science and Technology, Harbin 150080, China
- Foshan Baikang Robot Technology Co., Ltd, Nanhai District, Foshan City, Guangdong Province 528225, China
| | - Qihang Yuan
- Key Laboratory of Advanced Manufacturing and Intelligent Technology, Ministry of Education, Harbin University of Science and Technology, Harbin 150080, China
| | - Hafiz Muhammad Muzzammil
- Key Laboratory of Advanced Manufacturing and Intelligent Technology, Ministry of Education, Harbin University of Science and Technology, Harbin 150080, China
| | - Guoqiang Gao
- Key Laboratory of Advanced Manufacturing and Intelligent Technology, Ministry of Education, Harbin University of Science and Technology, Harbin 150080, China
| | - Yong Xu
- Department of Urology, the Third Medical Centre, Chinese PLA (People's Liberation Army) General Hospital, Beijing 100039, China
| |
Collapse
|
7
|
Gunderman AL, Azizkhani M, Sengupta S, Cleary K, Chen Y. Open Source MR-Safe Pneumatic Radial Inflow Motor and Encoder (PRIME): Design and Manufacturing Guidelines. ... INTERNATIONAL SYMPOSIUM ON MEDICAL ROBOTICS. INTERNATIONAL SYMPOSIUM ON MEDICAL ROBOTICS 2023; 2023:10.1109/ismr57123.2023.10130240. [PMID: 38073863 PMCID: PMC10704579 DOI: 10.1109/ismr57123.2023.10130240] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/13/2025]
Abstract
Actuators and encoders used in MR-guided robotic interventions are subject to strict requirements to ensure patient safety and MR imaging quality. In this paper, we present an open source computer aided design (CAD) of our MR-safe Pneumatic Radial Inflow Motor and Encoder (PRIME). PRIME is a parametrically designed motor that enables scalability based on torque and speed requirements for a wide range of MR-guided robotic procedures. The design consists of five primary modifiable parameters that define the entire motor geometry. All components of the motor are either 3D printed or available off-the-shelf. Quadrature encoding is achieved using a 3D printed housing and four fiber optic cables. Benchtop experiments were performed to validate the performance of the proposed design. To the best of our knowledge, this is the first open source MR-safe pneumatic motor and encoder in the field. We aim to share the design and manufacturing guidelines to lower the entry barriers for researchers interested in MR-guided robotics.
Collapse
Affiliation(s)
- Anthony L Gunderman
- Georgia Tech Institute for Robotics and Intelligent Machines (IRIM), Atlanta, GA 30313, USA
| | - Milad Azizkhani
- Georgia Tech Institute for Robotics and Intelligent Machines (IRIM), Atlanta, GA 30313, USA
| | - Saikat Sengupta
- Vanderbilt University Institute of Imaging Science, Vanderbilt University Medical Center, Nashville, TN 37232 USA
| | - Kevin Cleary
- Children's National Hospital, Washington, DC 20010 USA
| | - Yue Chen
- Georgia Tech Institute for Robotics and Intelligent Machines (IRIM), Atlanta, GA 30313, USA
| |
Collapse
|
8
|
Liang H, Tse ZTH. MR conditional prostate intervention systems and actuations review. Proc Inst Mech Eng H 2023; 237:18-34. [PMID: 36458323 PMCID: PMC9841823 DOI: 10.1177/09544119221136169] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022]
Abstract
Magnetic resonance imaging (MRI) has the ability to provide high-resolution images of soft tissues without the use of radiation. So much research has been focused on the development of actuators and robotic devices that can be used in the MRI environment so "real-time" images can be obtained during surgeries. With real-time guidance from MRI, robots can perform surgical procedures with high accuracy and through less invasive routes. This technique can also significantly reduce the operation time and simplify pre-surgical procedures. Therefore, research on robot-assisted MRI-guided prostate intervention has attracted a great deal of interest, and several successful clinical trials have been published in recent years, pointing to the great potential of this technology. However, the development of MRI-guided robots is still in the primary stage, and collaboration between researchers and commercial suppliers is still needed to improve such robot systems. This review presents an overview of MRI-guided prostate intervention devices and actuators. Additionally, the expected technical challenges and future advances in this field are discussed.
Collapse
Affiliation(s)
| | - Zion Tsz Ho Tse
- Zion Tsz Ho Tse, School of Engineering and Materials Science, Queen Mary University of London, Mile End Road, London E1 4NS, UK.
| |
Collapse
|
9
|
Wu K, Li B, Zhang Y, Dai X. Review of research on path planning and control methods of flexible steerable needle puncture robot. Comput Assist Surg (Abingdon) 2022; 27:91-112. [PMID: 36052822 DOI: 10.1080/24699322.2021.2023647] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022] Open
Abstract
In the field of minimally invasive interventional therapy, the related research on the soft tissue puncture robot and its technology based on the flexible steerable needle as a research hot topic at present, and it has been developed rapidly in the past ten years. In order to better understand the development status of the flexible steerable needle puncture (FSNP) robot and provide reference for its design and improvement in subsequent research, it is necessary to introduce in two aspects of FSNP robot: the puncture path planning and the control methods. First, this article introduced the concept of the FSNP technology, and the necessity of the application of FSNP soft tissue robot in minimally invasive interventional surgery. Second, this article mainly introduced the principle of FSNP, the path planning of FSNP, the navigation and positioning control of the needle tip of the flexible steerable needle, the control method of FSNP system, and the controllable flexible needle. Finally, combined with the above analysis and introduction, it was pointed out that FSNP soft tissue robot and its related technology would be an important development direction in the field of minimally invasive interventional therapy in the future, and the current existing problems were pointed out. Meanwhile, the development trend of FSNP robot control technology was summarized and prospected.
Collapse
Affiliation(s)
- Kaiyu Wu
- Robotics & Its Engineering Research Center, Mechatronic engineering, Harbin University of Science and Technology, Harbin, China
| | - Bing Li
- Robotics & Its Engineering Research Center, Mechatronic engineering, Harbin University of Science and Technology, Harbin, China
| | - Yongde Zhang
- Robotics & Its Engineering Research Center, Mechatronic engineering, Harbin University of Science and Technology, Harbin, China
| | - Xuesong Dai
- Robotics & Its Engineering Research Center, Mechatronic engineering, Harbin University of Science and Technology, Harbin, China
| |
Collapse
|
10
|
Secoli R, Matheson E, Pinzi M, Galvan S, Donder A, Watts T, Riva M, Zani DD, Bello L, Rodriguez y Baena F. Modular robotic platform for precision neurosurgery with a bio-inspired needle: System overview and first in-vivo deployment. PLoS One 2022; 17:e0275686. [PMID: 36260553 PMCID: PMC9581417 DOI: 10.1371/journal.pone.0275686] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Accepted: 09/22/2022] [Indexed: 11/23/2022] Open
Abstract
Over the past 10 years, minimally invasive surgery (MIS) has shown significant benefits compared to conventional surgical techniques, with reduced trauma, shorter hospital stays, and shorter patient recovery times. In neurosurgical MIS procedures, inserting a straight tool (e.g. catheter) is common practice in applications ranging from biopsy and laser ablation, to drug delivery and fluid evacuation. How to handle tissue deformation, target migration and access to deep-seated anatomical structures remain an open challenge, affecting both the preoperative planning phase and eventual surgical intervention. Here, we present the first neurosurgical platform in the literature, able to deliver an implantable steerable needle for a range of diagnostic and therapeutic applications, with a short-term focus on localised drug delivery. This work presents the system's architecture and first in vivo deployment with an optimised surgical workflow designed for pre-clinical trials with the ovine model, which demonstrate appropriate function and safe implantation.
Collapse
Affiliation(s)
- Riccardo Secoli
- The Mechatronics in Medicine Lab, Department of Mechanical Engineering, Imperial College London, London, United Kingdom
- * E-mail:
| | - Eloise Matheson
- The Mechatronics in Medicine Lab, Department of Mechanical Engineering, Imperial College London, London, United Kingdom
| | - Marlene Pinzi
- The Mechatronics in Medicine Lab, Department of Mechanical Engineering, Imperial College London, London, United Kingdom
| | - Stefano Galvan
- The Mechatronics in Medicine Lab, Department of Mechanical Engineering, Imperial College London, London, United Kingdom
| | - Abdulhamit Donder
- The Mechatronics in Medicine Lab, Department of Mechanical Engineering, Imperial College London, London, United Kingdom
| | - Thomas Watts
- The Mechatronics in Medicine Lab, Department of Mechanical Engineering, Imperial College London, London, United Kingdom
| | - Marco Riva
- Department of Biomedical Sciences, Humanitas University, Milan, Italy
- Istituto di Ricovero e Cura a Carattere Scientifico Humanitas Research Hospital Rozzano, Rozzano, Italy
| | - Davide Danilo Zani
- Department of Veterinary Medicine, Universitá degli Studi di Milano, Lodi, Italy
| | - Lorenzo Bello
- Department of Oncology and Hematology-Oncology, Universitá degli Studi di Milano, Milan, Italy
| | - Ferdinando Rodriguez y Baena
- The Mechatronics in Medicine Lab, Department of Mechanical Engineering, Imperial College London, London, United Kingdom
| |
Collapse
|
11
|
A Visual Servo Controlled Robotic System for MRI-guided Breast Biopsy. J INTELL ROBOT SYST 2022. [DOI: 10.1007/s10846-022-01615-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/16/2022]
|
12
|
Su H, Kwok KW, Cleary K, Iordachita I, Cavusoglu MC, Desai JP, Fischer GS. State of the Art and Future Opportunities in MRI-Guided Robot-Assisted Surgery and Interventions. PROCEEDINGS OF THE IEEE. INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS 2022; 110:968-992. [PMID: 35756185 PMCID: PMC9231642 DOI: 10.1109/jproc.2022.3169146] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/17/2023]
Abstract
Magnetic resonance imaging (MRI) can provide high-quality 3-D visualization of target anatomy, surrounding tissue, and instrumentation, but there are significant challenges in harnessing it for effectively guiding interventional procedures. Challenges include the strong static magnetic field, rapidly switching magnetic field gradients, high-power radio frequency pulses, sensitivity to electrical noise, and constrained space to operate within the bore of the scanner. MRI has a number of advantages over other medical imaging modalities, including no ionizing radiation, excellent soft-tissue contrast that allows for visualization of tumors and other features that are not readily visible by other modalities, true 3-D imaging capabilities, including the ability to image arbitrary scan plane geometry or perform volumetric imaging, and capability for multimodality sensing, including diffusion, dynamic contrast, blood flow, blood oxygenation, temperature, and tracking of biomarkers. The use of robotic assistants within the MRI bore, alongside the patient during imaging, enables intraoperative MR imaging (iMRI) to guide a surgical intervention in a closed-loop fashion that can include tracking of tissue deformation and target motion, localization of instrumentation, and monitoring of therapy delivery. With the ever-expanding clinical use of MRI, MRI-compatible robotic systems have been heralded as a new approach to assist interventional procedures to allow physicians to treat patients more accurately and effectively. Deploying robotic systems inside the bore synergizes the visual capability of MRI and the manipulation capability of robotic assistance, resulting in a closed-loop surgery architecture. This article details the challenges and history of robotic systems intended to operate in an MRI environment and outlines promising clinical applications and associated state-of-the-art MRI-compatible robotic systems and technology for making this possible.
Collapse
Affiliation(s)
- Hao Su
- Department of Mechanical and Aerospace Engineering, North Carolina State University, Raleigh, NC 27695 USA
| | - Ka-Wai Kwok
- Department of Mechanical Engineering, The University of Hong Kong, Hong Kong
| | - Kevin Cleary
- Children's National Health System, Washington, DC 20010 USA
| | - Iulian Iordachita
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, MD 21218 USA
| | - M Cenk Cavusoglu
- Department of Electrical, Computer, and Systems Engineering, Case Western Reserve University, Cleveland, OH 44106 USA
| | - Jaydev P Desai
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, GA 30332 USA
| | - Gregory S Fischer
- Department of Robotics Engineering, Worcester Polytechnic Institute, Worcester, MA 01609 USA
| |
Collapse
|
13
|
Hofstetter LW, Hadley JR, Merrill R, Pham H, Fine GC, Parker DL. MRI-compatible electromagnetic servomotor for image-guided medical robotics. COMMUNICATIONS ENGINEERING 2022; 1:4. [PMID: 36700241 PMCID: PMC9873480 DOI: 10.1038/s44172-022-00001-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Accepted: 02/22/2022] [Indexed: 02/01/2023]
Abstract
The soft-tissue imaging capabilities of magnetic resonance imaging (MRI) combined with high precision robotics has the potential to improve the precision and safety of a wide range of image-guided medical procedures. However, functional MRI-compatible robotics have not yet been realized in part because conventional electromagnetic servomotors can become dangerous projectiles near the strong magnetic field of an MRI scanner. Here we report an electromagnetic servomotor constructed from non-magnetic components, where high-torque and controlled rotary actuation is produced via interaction between electrical current in the servomotor armature and the magnetic field generated by the superconducting magnet of the MRI scanner itself. Using this servomotor design, we then build and test an MRI-compatible robot which can achieve the linear forces required to insert a large-diameter biopsy instrument in tissue during simultaneous MRI. Our electromagnetic servomotor can be safely operated (while imaging) in the patient area of a 3 Tesla clinical MRI scanner.
Collapse
Affiliation(s)
- Lorne W. Hofstetter
- Department of Radiology and Imaging Sciences, University of Utah School of Medicine, 30 North 1900 East #1A071, Salt Lake City, UT 84132 USA
| | - J. Rock Hadley
- Department of Radiology and Imaging Sciences, University of Utah School of Medicine, 30 North 1900 East #1A071, Salt Lake City, UT 84132 USA
| | - Robb Merrill
- Department of Radiology and Imaging Sciences, University of Utah School of Medicine, 30 North 1900 East #1A071, Salt Lake City, UT 84132 USA
| | - Huy Pham
- Department of Radiology and Imaging Sciences, University of Utah School of Medicine, 30 North 1900 East #1A071, Salt Lake City, UT 84132 USA
| | - Gabriel C. Fine
- Department of Radiology and Imaging Sciences, University of Utah School of Medicine, 30 North 1900 East #1A071, Salt Lake City, UT 84132 USA
| | - Dennis L. Parker
- Department of Radiology and Imaging Sciences, University of Utah School of Medicine, 30 North 1900 East #1A071, Salt Lake City, UT 84132 USA
| |
Collapse
|
14
|
Li G, Patel NA, Melzer A, Sharma K, Iordachita I, Cleary K. MRI-guided lumbar spinal injections with body-mounted robotic system: cadaver studies. MINIM INVASIV THER 2022; 31:297-305. [PMID: 32729771 PMCID: PMC7855543 DOI: 10.1080/13645706.2020.1799017] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2020] [Accepted: 06/26/2020] [Indexed: 02/03/2023]
Abstract
INTRODUCTION This paper reports the system integration and cadaveric assessment of a body-mounted robotic system for MRI-guided lumbar spine injections. The system is developed to enable MR-guided interventions in closed bore magnet and avoid problems due to patient movement during cannula guidance. MATERIAL AND METHODS The robot is comprised by a lightweight and compact structure so that it can be mounted directly onto the lower back of a patient using straps. Therefore, it can minimize the influence of patient movement by moving with the patient. The MR-Conditional robot is integrated with an image-guided surgical planning workstation. A dedicated clinical workflow is created for the robot-assisted procedure to improve the conventional freehand MRI-guided procedure. RESULTS Cadaver studies were performed with both freehand and robot-assisted approaches to validate the feasibility of the clinical workflow and to assess the positioning accuracy of the robotic system. The experiment results demonstrate that the root mean square (RMS) error of the target position to be 2.57 ± 1.09 mm and of the insertion angle to be 2.17 ± 0.89°. CONCLUSION The robot-assisted approach is able to provide more accurate and reproducible cannula placements than the freehand procedure, as well as to reduce the number of insertion attempts.
Collapse
Affiliation(s)
- Gang Li
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, USA
| | - Niravkumar A. Patel
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, USA
| | - Andreas Melzer
- Institute of Medical Science and Technology, University of Dundee, Dundee, UK
| | - Karun Sharma
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children’s National Health System, Washington, DC, USA
| | - Iulian Iordachita
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, USA
| | - Kevin Cleary
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children’s National Health System, Washington, DC, USA
| |
Collapse
|
15
|
Antoniou A, Drakos T, Giannakou M, Evripidou N, Georgiou L, Christodoulou T, Panayiotou N, Ioannides C, Zamboglou N, Damianou C. Simple methods to test the accuracy of MRgFUS robotic systems. Int J Med Robot 2021; 17:e2287. [PMID: 34021694 PMCID: PMC8365756 DOI: 10.1002/rcs.2287] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2021] [Revised: 05/21/2021] [Accepted: 05/21/2021] [Indexed: 01/09/2023]
Abstract
BACKGROUND Robotic-assisted diagnostic and therapeutic modalities require a highly accurate performance to be certified for clinical application. In this paper, three simple methods for assessing the accuracy of motion of magnetic resonance-guided focused ultrasound (MRgFUS) robotic systems are presented. METHODS The accuracy of motion of a 4 degrees of freedom robotic system intended for preclinical use of MRgFUS was evaluated by calliper-based and magnetic resonance imaging (MRI) methods, as well as visually by performing multiple ablations on a plastic film. RESULTS The benchtop results confirmed a highly accurate motion in all axes of operation. The spatial positioning errors estimated by MRI evaluation were defined by the size of the imaging pixels. Lesions arrangement in discrete and overlapping patterns confirmed satisfactory alignment of motion trajectories. CONCLUSIONS We believe the methods presented here should serve as a standard for evaluating the accuracy of motion of MRgFUS robotic systems.
Collapse
Affiliation(s)
- Anastasia Antoniou
- Department of Electrical Engineering, Computer Engineering, and InformaticsCyprus University of TechnologyLimassolCyprus
| | | | | | - Nikolas Evripidou
- Department of Electrical Engineering, Computer Engineering, and InformaticsCyprus University of TechnologyLimassolCyprus
| | | | | | | | | | | | - Christakis Damianou
- Department of Electrical Engineering, Computer Engineering, and InformaticsCyprus University of TechnologyLimassolCyprus
| |
Collapse
|
16
|
Mahcicek DI, Yildirim KD, Kasaci G, Kocaturk O. Preliminary Evaluation of Hydraulic Needle Delivery System for Magnetic Resonance Imaging-Guided Prostate Biopsy Procedures. J Med Device 2021. [DOI: 10.1115/1.4051610] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022] Open
Abstract
Abstract
In clinical routine, the prostate biopsy procedure is performed with the guidance of transrectal ultrasound (TRUS) imaging to diagnose prostate cancer. However, the TRUS-guided prostate biopsy brings reliability concerns due to the lack of contrast difference between prostate tissue and lesions. In this study, a novel hydraulic needle delivery system that is designed for performing magnetic resonance imaging (MRI)-guided prostate biopsy procedure with transperineal approach is introduced. The feasibility of the overall system was evaluated through in vitro phantom experiments under an MRI guidance. The in vitro experiments performed using a certified prostate phantom (incorporating MRI visible lesions). MRI experiments showed that overall hydraulic biopsy needle delivery system has excellent MRI compatibility (signal to noise ratio (SNR) loss < 3%), provides acceptable targeting accuracy (average 2.05±0.46 mm) and procedure time (average 40 min).
Collapse
Affiliation(s)
- Davut Ibrahim Mahcicek
- Biomedical Engineering Department, Institute of Biomedical Engineering, Bogazici University, Kandilli Kampus, Istanbul, Cengelkoy 34684, Turkey
| | - Korel D. Yildirim
- National Institutes of Health Cardiovascular Branch, Division of Intramural Research, National Heart Lung and Blood Institute, National Institutes of Health, Building 10, Room 2c713, Bethesda, MD 20892-1538; Biomedical Engineering Department, Institute of Biomedical Engineering, Bogazici University, Kandilli Kampus, Istanbul, Cengelkoy 34684, Turkey
| | - Gokce Kasaci
- Biomedical Engineering Department, Institute of Biomedical Engineering, Bogazici University, Kandilli Kampus, Istanbul, Cengelkoy 34684, Turkey
| | - Ozgur Kocaturk
- National Institutes of Health Cardiovascular Branch, Division of Intramural Research, National Heart Lung and Blood Institute, National Institutes of Health, Building 10, Room 2c713, Bethesda, MD 20892-1538; Biomedical Engineering Department, Institute of Biomedical Engineering, Bogazici University, Kandilli Kampus, Istanbul, Cengelkoy 34684, Turkey
| |
Collapse
|
17
|
Velazco-Garcia JD, Navkar NV, Balakrishnan S, Younes G, Abi-Nahed J, Al-Rumaihi K, Darweesh A, Elakkad MSM, Al-Ansari A, Christoforou EG, Karkoub M, Leiss EL, Tsiamyrtzis P, Tsekos NV. Evaluation of how users interface with holographic augmented reality surgical scenes: Interactive planning MR-Guided prostate biopsies. Int J Med Robot 2021; 17:e2290. [PMID: 34060214 DOI: 10.1002/rcs.2290] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2020] [Revised: 05/04/2021] [Accepted: 05/27/2021] [Indexed: 12/15/2022]
Abstract
BACKGROUND User interfaces play a vital role in the planning and execution of an interventional procedure. The objective of this study is to investigate the effect of using different user interfaces for planning transrectal robot-assisted MR-guided prostate biopsy (MRgPBx) in an augmented reality (AR) environment. METHOD End-user studies were conducted by simulating an MRgPBx system with end- and side-firing modes. The information from the system to the operator was rendered on HoloLens as an output interface. Joystick, mouse/keyboard, and holographic menus were used as input interfaces to the system. RESULTS The studies indicated that using a joystick improved the interactive capacity and enabled operator to plan MRgPBx in less time. It efficiently captures the operator's commands to manipulate the augmented environment representing the state of MRgPBx system. CONCLUSIONS The study demonstrates an alternative to conventional input interfaces to interact and manipulate an AR environment within the context of MRgPBx planning.
Collapse
Affiliation(s)
| | - Nikhil V Navkar
- Department of Surgery, Hamad Medical Corporation, Doha, Qatar
| | | | - Georges Younes
- Department of Surgery, Hamad Medical Corporation, Doha, Qatar
| | | | | | - Adham Darweesh
- Department of Clinical Imaging, Hamad Medical Corporation, Doha, Qatar
| | | | | | | | - Mansour Karkoub
- Department of Mechanical Engineering, Texas A&M University-Qatar, Doha, Qatar
| | - Ernst L Leiss
- Department of Computer Science, University of Houston, Houston, Texas, USA
| | | | - Nikolaos V Tsekos
- Department of Computer Science, University of Houston, Houston, Texas, USA
| |
Collapse
|
18
|
Patel N, Yan J, Li G, Monfaredi R, Priba L, Donald-Simpson H, Joy J, Dennison A, Melzer A, Sharma K, Iordachita I, Cleary K. Body-Mounted Robotic System for MRI-Guided Shoulder Arthrography: Cadaver and Clinical Workflow Studies. Front Robot AI 2021; 8:667121. [PMID: 34041276 PMCID: PMC8141739 DOI: 10.3389/frobt.2021.667121] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2021] [Accepted: 04/20/2021] [Indexed: 12/13/2022] Open
Abstract
This paper presents an intraoperative MRI-guided, patient-mounted robotic system for shoulder arthrography procedures in pediatric patients. The robot is designed to be compact and lightweight and is constructed with nonmagnetic materials for MRI safety. Our goal is to transform the current two-step arthrography procedure (CT/x-ray-guided needle insertion followed by diagnostic MRI) into a streamlined single-step ionizing radiation-free procedure under MRI guidance. The MR-conditional robot was evaluated in a Thiel embalmed cadaver study and healthy volunteer studies. The robot was attached to the shoulder using straps and ten locations in the shoulder joint space were selected as targets. For the first target, contrast agent (saline) was injected to complete the clinical workflow. After each targeting attempt, a confirmation scan was acquired to analyze the needle placement accuracy. During the volunteer studies, a more comfortable and ergonomic shoulder brace was used, and the complete clinical workflow was followed to measure the total procedure time. In the cadaver study, the needle was successfully placed in the shoulder joint space in all the targeting attempts with translational and rotational accuracy of 2.07 ± 1.22 mm and 1.46 ± 1.06 degrees, respectively. The total time for the entire procedure was 94 min and the average time for each targeting attempt was 20 min in the cadaver study, while the average time for the entire workflow for the volunteer studies was 36 min. No image quality degradation due to the presence of the robot was detected. This Thiel-embalmed cadaver study along with the clinical workflow studies on human volunteers demonstrated the feasibility of using an MR-conditional, patient-mounted robotic system for MRI-guided shoulder arthrography procedure. Future work will be focused on moving the technology to clinical practice.
Collapse
Affiliation(s)
| | - Jiawen Yan
- LCSR, Johns Hopkins University, Baltimore, MD, United States
| | - Gang Li
- LCSR, Johns Hopkins University, Baltimore, MD, United States
| | - Reza Monfaredi
- Children's National Health System, Washington, DC, United States
| | - Lukasz Priba
- Institute for Medical Science and Technology, University of Dundee, Dundee, United Kingdom
| | - Helen Donald-Simpson
- Institute for Medical Science and Technology, University of Dundee, Dundee, United Kingdom
| | - Joyce Joy
- Institute for Medical Science and Technology, University of Dundee, Dundee, United Kingdom
| | - Andrew Dennison
- Institute for Medical Science and Technology, University of Dundee, Dundee, United Kingdom
| | - Andreas Melzer
- Institute for Medical Science and Technology, University of Dundee, Dundee, United Kingdom.,Institute for Computer Aided Surgery, University Leipzig, Leipzig, Germany
| | - Karun Sharma
- Children's National Health System, Washington, DC, United States
| | | | - Kevin Cleary
- Children's National Health System, Washington, DC, United States
| |
Collapse
|
19
|
Li ADR, Liu Y, Plott J, Chen L, Montgomery JS, Shih A. Multi-Bevel Needle Design Enabling Accurate Insertion in Biopsy for Cancer Diagnosis. IEEE Trans Biomed Eng 2021; 68:1477-1486. [PMID: 33507862 PMCID: PMC8104469 DOI: 10.1109/tbme.2021.3054922] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
Abstract
OBJECTIVE To obtain definitive cancer diagnosis for suspicious lesions, accurate needle deployment and adequate tissue sampling in needle biopsy are essential. However, the single-bevel needles in current biopsy devices often induce deflection during insertion, potentially causing lesion missampling/undersampling and cancer misdiagnosis. This study aims to reveal the biopsy needle design criteria enabling both low deflection and adequate tissue sampling. METHODS A novel model capable of predicting needle deflection and tissue deformation was first established to understand needle-tissue interaction with different needle tip geometries. Experiments of needle deflection and ex-vivo tissue biopsy were conducted for model validation. RESULTS The developed model showed a reasonably good prediction on the correlation of needle tip type vs. the resultant needle deflection and tissue sampling length. A new multi-bevel needle with the tissue separation point below the needle groove face has demonstrated to be an effective design with an 87% reduction in deflection magnitude and equivalently long tissue sampling length compared to the current single-bevel needle. CONCLUSION This study has revealed two critical design criteria for biopsy needles: 1) multiple bevel faces at the needle tip can generate forces to balance bending moments during insertion to enable a low needle deflection and 2) the tissue separation point should be below the needle groove face to ensure long tissue sampling length. SIGNIFICANCE The developed methodologies and findings in this study serve as proof-of-concept and can be utilized to investigate various biopsy procedures to improve cancer diagnostic accuracy as well as other procedures requiring accurate needle insertion.
Collapse
|
20
|
Lin Y, Shi Y, Wang F, Zhang J, Sun H, Wu W. Development and placement accuracy evaluation of an MR conditional robot for prostate intervention. Med Biol Eng Comput 2021; 59:1023-1034. [PMID: 33860444 DOI: 10.1007/s11517-021-02347-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Accepted: 03/17/2021] [Indexed: 11/30/2022]
Abstract
Robot-assisted prostate intervention under magnetic resonance imaging (MRI) guidance is a promising method to improve the clinical performance compared with the manual method. An MR conditional 6-DOF prostate intervention serial robot is developed and a binocular vision system (BVS) is established to evaluate the needle placement accuracy and located the penetration point precisely. The robot is designed by the MR conditional criteria. The serial configuration of the robot provides adequate flexibility and large workspace and excellent friendliness to the physicians. The kinematics are deduced and the needle placement control flow is proposed according to the configuration of the robot. The robot-assisted prostate intervention is divided into two phases including needle placement and needle penetration. A custom-made robust BVS is developed to obtain the needle tip position automatically in the needle placement phase where the needle cannot be detected by the MRI for lack of hydrogen atom. A simple and general algorithm used for needle tip camera coordinate estimation is proposed. Experiments on the BVS validation and robot accuracy evaluation are performed. The experiment results show that the errors of the BVS are under 0.3621 mm and the position error of the proposed robot is 2.815 mm which indicate the adequate accuracy for the prostate intervention. Graphical abstract.
Collapse
Affiliation(s)
- Yuyang Lin
- State Key Laboratory of Mechanics and Control of Mechanical Structures, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, People's Republic of China
| | - Yunlai Shi
- State Key Laboratory of Mechanics and Control of Mechanical Structures, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, People's Republic of China.
| | - Fugang Wang
- State Key Laboratory of Mechanics and Control of Mechanical Structures, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, People's Republic of China
| | - Jun Zhang
- College of Mechanical and Electronic Engineering, Northwest A&F University, Yangling, 712100, People's Republic of China
| | - Haichao Sun
- State Key Laboratory of Mechanics and Control of Mechanical Structures, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, People's Republic of China
| | - Wenbo Wu
- State Key Laboratory of Mechanics and Control of Mechanical Structures, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, People's Republic of China
| |
Collapse
|
21
|
Moreira P, Grimble J, Iftimia N, Bay CP, Tuncali K, Park J, Tokuda J. In vivo evaluation of angulated needle-guide template for MRI-guided transperineal prostate biopsy. Med Phys 2021; 48:2553-2565. [PMID: 33651407 DOI: 10.1002/mp.14816] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2020] [Revised: 01/28/2021] [Accepted: 02/10/2021] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Magnetic resonance imaging (MRI)-guided transperineal prostate biopsy has been practiced since the early 2000s. The technique often suffers from targeting error due to deviation of the needle as a result of physical interaction between the needle and inhomogeneous tissues. Existing needle guide devices, such as a grid template, do not allow choosing an alternative insertion path to mitigate the deviation because of their limited degree-of-freedom (DoF). This study evaluates how an angulated needle insertion path can reduce needle deviation and improve needle placement accuracy. METHODS We extended a robotic needle-guidance device (Smart Template) for in-bore MRI-guided transperineal prostate biopsy. The new Smart Template has a 4-DoF needle-guiding mechanism allowing a translational range of motion of 65 and 58 mm along the vertical and horizontal axis, and a needle rotational motion around the vertical and horizontal axis ± 30 ∘ and a vertical rotational range of - 30 ∘ , + 10 ∘ , respectively. We defined a path planning strategy, which chooses between straight and angulated insertion paths depending on the anatomical structures on the potential insertion path. We performed (a) a set of experiments to evaluate the device positioning accuracy outside the MR-bore, and (b) an in vivo experiment to evaluate the improvement of targeting accuracy combining straight and angulated insertions in animal models (swine, n = 3 ). RESULTS We analyzed 46 in vivo insertions using either straight or angulated insertions paths. The experiment showed that the proposed strategy of selecting straight or angulated insertions based on the subject's anatomy outperformed the conventional approach of just straight insertions in terms of targeting accuracy (2.4 mm [1.3-3.7] vs 3.9 mm [2.4-5.0] {Median IQR } ); p = 0.041 after the bias correction). CONCLUSION The in vivo experiment successfully demonstrated that an angulated needle insertion path could improve needle placement accuracy with a path planning strategy that takes account of the subject-specific anatomical structures.
Collapse
Affiliation(s)
- Pedro Moreira
- Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, 75 Francis St., Boston, MA, USA
| | - John Grimble
- Physical Sciences Inc., 20 New England Bus Center Dr, Andover, MA, USA
| | - Nicusor Iftimia
- Physical Sciences Inc., 20 New England Bus Center Dr, Andover, MA, USA
| | - Camden P Bay
- Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, 75 Francis St., Boston, MA, USA
| | - Kemal Tuncali
- Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, 75 Francis St., Boston, MA, USA
| | - Jesung Park
- Physical Sciences Inc., 20 New England Bus Center Dr, Andover, MA, USA
| | - Junichi Tokuda
- Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, 75 Francis St., Boston, MA, USA
| |
Collapse
|
22
|
Abstract
PURPOSE OF REVIEW The goal of this study is to review recent findings and evaluate the utility of MRI transrectal ultrasound fusion biopsy (FBx) techniques and discuss future directions. RECENT FINDINGS FBx detects significantly higher rates of clinically significant prostate cancer (csPCa) than ultrasound-guided systematic prostate biopsy (SBx), particularly in repeat biopsy settings. FBx has also been shown to detect significantly lower rates of clinically insignificant prostate cancer. In addition, a dedicated prostate MRI can assist in more accurately predicting the Gleason score and provide further information regarding the index cancer location, prostate volume, and clinical stage. The ability to accurately evaluate specific lesions is vital to both focal therapy and active surveillance, for treatment selection, planning, and adequate follow-up. FBx has been demonstrated in multiple high-quality studies to have improved performance in diagnosis of csPCa compared to SBx. The combination of FBx with novel technologies including radiomics, prostate-specific membrane antigen positron emission tomography (PSMA PET), and high-resolution micro-ultrasound may have the potential to further enhance this performance.
Collapse
|
23
|
Xiao Q, Monfaredi R, Musa M, Cleary K, Chen Y. MR-Conditional Actuations: A Review. Ann Biomed Eng 2020; 48:2707-2733. [PMID: 32856179 PMCID: PMC10620609 DOI: 10.1007/s10439-020-02597-8] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2020] [Accepted: 08/14/2020] [Indexed: 10/23/2022]
Abstract
Magnetic resonance imaging (MRI) is one of the most prevailing technologies to enable noninvasive and radiation-free soft tissue imaging. Operating a robotic device under MRI guidance is an active research area that has the potential to provide efficient and precise surgical therapies. MR-conditional actuators that can safely drive these robotic devices without causing safety hazards or adversely affecting the image quality are crucial for the development of MR-guided robotic devices. This paper aims to summarize recent advances in actuation methods for MR-guided robots and each MR-conditional actuator was reviewed based on its working principles, construction materials, the noteworthy features, and corresponding robotic application systems, if any. Primary characteristics, such as torque, force, accuracy, and signal-to-noise ratio (SNR) variation due to the variance of the actuator, are also covered. This paper concludes with a perspective on the current development and future of MR-conditional actuators.
Collapse
Affiliation(s)
- Qingyu Xiao
- Department of Mechanical Engineering, University of Arkansas, Fayetteville, AR, USA
| | | | - Mishek Musa
- Department of Mechanical Engineering, University of Arkansas, Fayetteville, AR, USA
| | - Kevin Cleary
- Children's National Medical Center, Washington, DC, USA
| | - Yue Chen
- Department of Mechanical Engineering, University of Arkansas, Fayetteville, AR, USA.
| |
Collapse
|
24
|
Velazco‐Garcia JD, Navkar NV, Balakrishnan S, Abi‐Nahed J, Al‐Rumaihi K, Darweesh A, Al‐Ansari A, Christoforou EG, Karkoub M, Leiss EL, Tsiamyrtzis P, Tsekos NV. End‐user evaluation of software‐generated intervention planning environment for transrectal magnetic resonance‐guided prostate biopsies. Int J Med Robot 2020; 17:1-12. [DOI: 10.1002/rcs.2179] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2020] [Revised: 09/25/2020] [Accepted: 09/30/2020] [Indexed: 01/20/2023]
Affiliation(s)
| | | | | | | | | | - Adham Darweesh
- Department of Clinical Imaging Hamad Medical Corporation Doha Qatar
| | | | | | - Mansour Karkoub
- Department of Mechanical Engineering Texas A&M University—Qatar Doha Qatar
| | - Ernst L. Leiss
- Department of Computer Science University of Houston Houston Texas USA
| | | | | |
Collapse
|
25
|
Patel NA, Nycz CJ, Carvalho PA, Gandomi KY, Gondokaryono R, Li G, Heffter T, Burdette EC, Pilitsis JG, Fischer GS. An Integrated Robotic System for MRI-Guided Neuroablation: Preclinical Evaluation. IEEE Trans Biomed Eng 2020; 67:2990-2999. [PMID: 32078530 PMCID: PMC7529397 DOI: 10.1109/tbme.2020.2974583] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
Abstract
OBJECTIVE Treatment of brain tumors requires high precision in order to ensure sufficient treatment while minimizing damage to surrounding healthy tissue. Ablation of such tumors using needle-based therapeutic ultrasound (NBTU) under real-time magnetic resonance imaging (MRI) can fulfill this need. However, the constrained space and strong magnetic field in the MRI bore restricts patient access limiting precise placement of the NBTU ablation tool. A surgical robot compatible with use inside the bore of an MRI scanner can alleviate these challenges. METHODS We present preclinical trials of a robotic system for NBTU ablation of brain tumors under real-time MRI guidance. The system comprises of an updated robotic manipulator and corresponding control electronics, the NBTU ablation system and applications for planning, navigation and monitoring of the system. RESULTS The robotic system had a mean translational and rotational accuracy of 1.39 ± 0.64 mm and 1.27 [Formula: see text] in gelatin phantoms and 3.13 ± 1.41 mm and 5.58 [Formula: see text] in 10 porcine trials while causing a maximum reduction in signal to noise ratio (SNR) of 10.3%. CONCLUSION The integrated robotic system can place NBTU ablator at a desired target location in porcine brain and monitor the ablation in realtime via magnetic resonance thermal imaging (MRTI). SIGNIFICANCE Further optimization of this system could result in a clinically viable system for use in human trials for various diagnostic or therapeutic neurosurgical interventions.
Collapse
|
26
|
Lu M, Zhang Y, Du H. Design and control of a novel magnetic resonance imaging-compatible breast intervention robot. INT J ADV ROBOT SYST 2020. [DOI: 10.1177/1729881420927853] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Breast cancer is one of the most frequent cancers and a major cause of cancer death in women. In this article, the design and control of a novel magnetic resonance imaging-compatible breast intervention robot are proposed. The dimensions and tolerance of the robot system are considered, and a novel pitching mechanism is designed to achieve a dexterous operation in the limited space. The magnetic resonance imaging compatibility of the robot materials is tested. The nonmagnetic structure and compact Cartesian mechanism of the robot allow it to operate safely in a magnetic resonance imaging scanner. According to the robot’s structure, a kinematics analysis based on a coupled motions model is established. The workspace simulation analysis of the robot proves that it is suitable for the whole breast surgery. To control the needle insertion tasks, the overall control system in the form of “personal computer (PC) + single-chip micyoco (SCM)” is designed. Finally, the motion control experiment is carried out, and the robot positioning error is 0.37 mm, which proves that the breast intervention robot and its control system designed in this article can meet the requirements of breast intervention.
Collapse
Affiliation(s)
- Mingyue Lu
- Intelligent Machine Institute, Harbin University of Science and Technology, Harbin, China
- Foshan Baikang Robot Technology Co., Ltd., Foshan, China
| | - Yongde Zhang
- Intelligent Machine Institute, Harbin University of Science and Technology, Harbin, China
| | - Haiyan Du
- Intelligent Machine Institute, Harbin University of Science and Technology, Harbin, China
| |
Collapse
|
27
|
Li G, Patel NA, Liu W, Wu D, Sharma K, Cleary K, Fritz J, Iordachita I. A Fully Actuated Body-Mounted Robotic Assistant for MRI-Guided Low Back Pain Injection. IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION : ICRA : [PROCEEDINGS]. IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION 2020; 2020:10.1109/icra40945.2020.9197534. [PMID: 34422445 PMCID: PMC8375549 DOI: 10.1109/icra40945.2020.9197534] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/29/2023]
Abstract
This paper reports the development of a fully actuated body-mounted robotic assistant for MRI-guided low back pain injection. The robot is designed with a 4-DOF needle alignment module and a 2-DOF remotely actuated needle driver module. The 6-DOF fully actuated robot can operate inside the scanner bore during imaging; hence, minimizing the need of moving the patient in or out of the scanner during the procedure, and thus potentially reducing the procedure time and streamlining the workflow. The robot is built with a lightweight and compact structure that can be attached directly to the patient's lower back using straps; therefore, attenuating the effect of patient motion by moving with the patient. The novel remote actuation design of the needle driver module with beaded chain transmission can reduce the weight and profile on the patient, as well as minimize the imaging degradation caused by the actuation electronics. The free space positioning accuracy of the system was evaluated with an optical tracking system, demonstrating the mean absolute errors (MAE) of the tip position to be 0.99±0.46 mm and orientation to be 0.99±0.65°. Qualitative imaging quality evaluation was performed on a human volunteer, revealing minimal visible image degradation that should not affect the procedure. The mounting stability of the system was assessed on a human volunteer, indicating the 3D position variation of target movement with respect to the robot frame to be less than 0.7 mm.
Collapse
Affiliation(s)
- Gang Li
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, MD, USA
| | - Niravkumar A Patel
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, MD, USA
| | - Weiqiang Liu
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, MD, USA
| | - Di Wu
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, MD, USA
| | - Karun Sharma
- Institute for Pediatric Surgical Innovation, Children's National Health System, Washington, DC, USA
| | - Kevin Cleary
- Institute for Pediatric Surgical Innovation, Children's National Health System, Washington, DC, USA
| | - Jan Fritz
- Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Iulian Iordachita
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, MD, USA
| |
Collapse
|
28
|
Li G, Patel NA, Hagemeister J, Yan J, Wu D, Sharma K, Cleary K, Iordachita I. Body-mounted robotic assistant for MRI-guided low back pain injection. Int J Comput Assist Radiol Surg 2020; 15:321-331. [PMID: 31625021 PMCID: PMC7027988 DOI: 10.1007/s11548-019-02080-3] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2019] [Accepted: 10/04/2019] [Indexed: 10/25/2022]
Abstract
PURPOSE This paper presents the development of a body-mounted robotic assistant for magnetic resonance imaging (MRI)-guided low back pain injection. Our goal was to eliminate the radiation exposure of traditional X-ray guided procedures while enabling the exquisite image quality available under MRI. The robot is designed with a compact and lightweight profile that can be mounted directly on the patient's lower back via straps, thus minimizing the effect of patient motion by moving along with the patient. The robot was built with MR-conditional materials and actuated with piezoelectric motors so it can operate inside the MRI scanner bore during imaging and therefore streamline the clinical workflow by utilizing intraoperative MR images. METHODS The robot is designed with a four degrees of freedom parallel mechanism, stacking two identical Cartesian stages, to align the needle under intraoperative MRI-guidance. The system targeting accuracy was first evaluated in free space with an optical tracking system, and further assessed with a phantom study under live MRI-guidance. Qualitative imaging quality evaluation was performed on a human volunteer to assess the image quality degradation caused by the robotic assistant. RESULTS Free space positioning accuracy study demonstrated that the mean error of the tip position to be [Formula: see text] mm and needle angle to be [Formula: see text]. MRI-guided phantom study indicated the mean errors of the target to be [Formula: see text] mm, entry point to be [Formula: see text] mm, and needle angle to be [Formula: see text]. Qualitative imaging quality evaluation validated that the image degradation caused by the robotic assistant in the lumbar spine anatomy is negligible. CONCLUSIONS The study demonstrates that the proposed body-mounted robotic system is able to perform MRI-guided low back injection in a phantom study with sufficient accuracy and with minimal visible image degradation that should not affect the procedure.
Collapse
Affiliation(s)
- Gang Li
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, MD, USA.
| | - Niravkumar A Patel
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, MD, USA
| | - Jan Hagemeister
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, MD, USA
| | - Jiawen Yan
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, MD, USA
| | - Di Wu
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, MD, USA
| | - Karun Sharma
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Health System, Washington, DC, USA
| | - Kevin Cleary
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Health System, Washington, DC, USA
| | - Iulian Iordachita
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, MD, USA
| |
Collapse
|
29
|
Needle deflection and tissue sampling length in needle biopsy. J Mech Behav Biomed Mater 2020; 104:103632. [PMID: 32174391 DOI: 10.1016/j.jmbbm.2020.103632] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2019] [Revised: 10/01/2019] [Accepted: 01/08/2020] [Indexed: 01/07/2023]
Abstract
This study investigates the effect of needle tip geometry on the needle deflection and tissue sampling length in biopsy. Advances in medical imaging have allowed the identification of suspicious cancerous lesions which then require needle biopsy for tissue sampling and subsequent confirmatory pathological analysis. Precise needle insertion and adequate tissue sampling are essential for accurate cancer diagnosis and individualized treatment decisions. However, the single-bevel needles in current hand-held biopsy devices often deflect significantly during needle insertion, causing variance in the targeted and actual locations of the sampled tissue. This variance can lead to inaccurate sampling and false-negative results. There is also a limited understanding of factors affecting the tissue sampling length which is a critical component of accurate cancer diagnosis. This study compares the needle deflection and tissue sampling length between the existing single-bevel and exploratory multi-bevel needle tip geometries. A coupled Eulerian-Lagrangian finite element analysis was applied to understand the needle-tissue interaction during needle insertion. The needle deflection and tissue sampling length were experimentally studied using tissue-mimicking phantoms and ex-vivo tissue, respectively. This study reveals that the tissue separation location at the needle tip affects both needle deflection and tissue sampling length. By varying the tissue separation location and creating a multi-bevel needle tip geometry, the bending moments induced by the insertion forces can be altered to reduce the needle deflection. However, the tissue separation location also affects the tissue contact inside the needle groove, potentially reducing the tissue sampling length. A multi-bevel needle tip geometry with the tissue separation point below the needle groove face may reduce the needle deflection while maintaining a long tissue sampling length. Results from this study can guide needle tip design to enable the precise needle deployment and adequate tissue sampling for the needle biopsy procedures.
Collapse
|
30
|
Zhao B, Fu Y, Yang Y, Zhang P, Hu Y. Design and control of a MRI-compatible pneumatic needle puncture robot. Comput Assist Surg (Abingdon) 2019; 24:87-93. [PMID: 31448960 DOI: 10.1080/24699322.2019.1649067] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022] Open
Abstract
Percutaneous needle puncture operation is widely used in the image-guided interventions, including biopsy and ablation. MRI guidance has the advantages of high-resolution soft tissue imaging and thermal monitoring during energy-based ablation. This paper proposes the design of a 5-DOF pneumatic needle puncture robot, with all the cylinders, sensors and structure material MRI-compatible. Also, a hybrid fuzzy-PID controller is designed for the pneumatic driven system to adjust the PID parameters adaptively. The experiment validation result shows that, compared with the traditional fix-parameter PID control, the proposed hybrid fuzzy-PID control has no overshoot, and the settle time/steady state error remains low even with increasing load. This proves that the hybrid fuzzy-PID control strategy can increases the positioning accuracy and robustness of the pneumatic driven needle puncture robot, which is significant for the safety of percutaneous needle puncture operation.
Collapse
Affiliation(s)
- Baoliang Zhao
- Shenzhen Key Laboratory of Minimally Invasive Surgical Robotics and System, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences , Shenzhen , China
| | - Yi Fu
- Department of Mechanical Engineering, Harbin Institute of Technology at Shenzhen , Shenzhen , China
| | - Yuanyuan Yang
- Shenzhen Key Laboratory of Minimally Invasive Surgical Robotics and System, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences , Shenzhen , China
| | - Peng Zhang
- Shenzhen Key Laboratory of Minimally Invasive Surgical Robotics and System, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences , Shenzhen , China
| | - Ying Hu
- Shenzhen Key Laboratory of Minimally Invasive Surgical Robotics and System, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences , Shenzhen , China
| |
Collapse
|
31
|
Bi J, Zhang Y. US/MRI Guided Robotic System for the Interventional Treatment of Prostate. INT J PATTERN RECOGN 2019. [DOI: 10.1142/s0218001420590144] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Needle-based percutaneous prostate interventions include biopsy and brachytherapy and the former is the gold standard for the diagnosis of prostate cancer and the latter is often used in the treatment of prostate cancer. This paper introduces a novel robotic assistant system for prostate intervention and the system architecture and workflow are described, which is significant for the design of similar systems. In order to offer higher precision and better real-time performance, a Ultrasound (US)/Magnetic Resonance Imaging (MRI) fusion method is proposed to guide the procedures in this study. Moreover, image registration is a key step and a hot issue in image fusion, especially in multimodal image fusion. In this work, we adopt a novel registration method based on active demons and optic flow for prostate image fusion. To verify the availability of the system, we evaluate our approach of the US/MRI image fusion by using data acquired from six patients, and root mean square error (RMSE) for anatomical landmarks is 3.15[Formula: see text]mm. In order to verify the accuracy and validity of the system developed in this paper, a system experimental platform was built and used for bionic tissue puncture of prostate under the guidance of MR and Transrectal Ultrasound (TRUS) fusion images. The experimental results show that the deviations of the final actual needle points of the three target points on the bionic tissue model measured in the laboratory environment are less than 2.5[Formula: see text]mm.
Collapse
Affiliation(s)
- Jintao Bi
- Intelligent Machine Institute, Harbin University of Science and Technology, Harbin, P. R. China
- School of Information Engineering, Huangshan University, Huangshan, P. R. China
| | - Yongde Zhang
- Intelligent Machine Institute, Harbin University of Science and Technology, Harbin, P. R. China
| |
Collapse
|
32
|
Kulkarni P, Sikander S, Biswas P, Frawley S, Song SE. Review of Robotic Needle Guide Systems for Percutaneous Intervention. Ann Biomed Eng 2019; 47:2489-2513. [PMID: 31372856 DOI: 10.1007/s10439-019-02319-9] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2019] [Accepted: 07/02/2019] [Indexed: 01/24/2023]
Abstract
Numerous research groups in the past have designed and developed robotic needle guide systems that improve the targeting accuracy and precision by either providing a physical guidance for manual insertion or enabling a complete automated intervention. Here we review systems that have been reported in the last 11 years and limited to straight line needle interventions. Most systems fall under the category of image guided systems as they either use magnetic resonance image, computed tomography, ultrasound or a combination of these modalities for real time image feedback of the intervention path being followed. Actuation and control technology along with materials used for construction are the main aspects that differentiate these systems from each other and have been reviewed here. Image compatibility test details and results are also reviewed as they are used to ensure proper functioning of these systems under the respective imaging environments. We have also reviewed needle guide systems which either don't use any image feedback or have not reported any but provide physical guidance. Throughout this paper, we provide a comprehensive review of the technological aspects and trends in the field of robotic, straight line, needle guide intervention systems.
Collapse
Affiliation(s)
- Pankaj Kulkarni
- Department of Mechanical and Aerospace Engineering, University of Central Florida, 12760 Pegasus Dr., ENGR 1, Room 307, Orlando, FL, 32816-2450, USA
| | - Sakura Sikander
- Department of Mechanical and Aerospace Engineering, University of Central Florida, 12760 Pegasus Dr., ENGR 1, Room 307, Orlando, FL, 32816-2450, USA
| | - Pradipta Biswas
- Department of Mechanical and Aerospace Engineering, University of Central Florida, 12760 Pegasus Dr., ENGR 1, Room 307, Orlando, FL, 32816-2450, USA
| | - Shawn Frawley
- Department of Mechanical and Aerospace Engineering, University of Central Florida, 12760 Pegasus Dr., ENGR 1, Room 307, Orlando, FL, 32816-2450, USA
| | - Sang-Eun Song
- Department of Mechanical and Aerospace Engineering, University of Central Florida, 12760 Pegasus Dr., ENGR 1, Room 307, Orlando, FL, 32816-2450, USA.
| |
Collapse
|
33
|
Patel NA, Li G, Shang W, Wartenberg M, Heffter T, Burdette EC, Iordachita I, Tokuda J, Hata N, Tempany CM, Fischer GS. System Integration and Preliminary Clinical Evaluation of a Robotic System for MRI-Guided Transperineal Prostate Biopsy. JOURNAL OF MEDICAL ROBOTICS RESEARCH 2019; 4:1950001. [PMID: 31485544 PMCID: PMC6726403 DOI: 10.1142/s2424905x19500016] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
This paper presents the development, preclinical evaluation, and preliminary clinical study of a robotic system for targeted transperineal prostate biopsy under direct interventional magnetic resonance imaging (MRI) guidance. The clinically integrated robotic system is developed based on a modular design approach, comprised of surgical navigation application, robot control software, MRI robot controller hardware, and robotic needle placement manipulator. The system provides enabling technologies for MRI-guided procedures. It can be easily transported and setup for supporting the clinical workflow of interventional procedures, and the system is readily extensible and reconfigurable to other clinical applications. Preclinical evaluation of the system is performed with phantom studies in a 3 Tesla MRI scanner, rehearsing the proposed clinical workflow, and demonstrating an in-plane targeting error of 1.5mm. The robotic system has been approved by the institutional review board (IRB) for clinical trials. A preliminary clinical study is conducted with the patient consent, demonstrating the targeting errors at two biopsy target sites to be 4.0mm and 3.7mm, which is sufficient to target a clinically significant tumor foci. First-in-human trials to evaluate the system's effectiveness and accuracy for MR image-guide prostate biopsy are underway.
Collapse
Affiliation(s)
- Niravkumar A Patel
- Automation and Interventional Medicine Laboratory, Worcester Polytechnic Institute, Worcester, MA 01609, USA [napatel, gfischerj]@wpi.edu
- indicates shared first authorship
| | - Gang Li
- Automation and Interventional Medicine Laboratory, Worcester Polytechnic Institute, Worcester, MA 01609, USA [napatel, gfischerj]@wpi.edu
- indicates shared first authorship
| | - Weijian Shang
- Automation and Interventional Medicine Laboratory, Worcester Polytechnic Institute, Worcester, MA 01609, USA [napatel, gfischerj]@wpi.edu
| | - Marek Wartenberg
- Automation and Interventional Medicine Laboratory, Worcester Polytechnic Institute, Worcester, MA 01609, USA [napatel, gfischerj]@wpi.edu
| | - Tamas Heffter
- Automation and Interventional Medicine Laboratory, Worcester Polytechnic Institute, Worcester, MA 01609, USA [napatel, gfischerj]@wpi.edu
| | - Everette C Burdette
- Automation and Interventional Medicine Laboratory, Worcester Polytechnic Institute, Worcester, MA 01609, USA [napatel, gfischerj]@wpi.edu
| | - Iulian Iordachita
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, MD, USA
| | - Junichi Tokuda
- Department of Radiology, Surgical Navigation and Robotics Laboratory, Brigham and Womens Hospital, Harvard Medical School, Boston, MA, USA
| | - Nobuhiko Hata
- Department of Radiology, Surgical Navigation and Robotics Laboratory, Brigham and Womens Hospital, Harvard Medical School, Boston, MA, USA
| | - Clare M Tempany
- Department of Radiology, Surgical Navigation and Robotics Laboratory, Brigham and Womens Hospital, Harvard Medical School, Boston, MA, USA
| | - Gregory S Fischer
- Automation and Interventional Medicine Laboratory, Worcester Polytechnic Institute, Worcester, MA 01609, USA [napatel, gfischerj]@wpi.edu
| |
Collapse
|
34
|
Mehrtash A, Ghafoorian M, Pernelle G, Ziaei A, Heslinga FG, Tuncali K, Fedorov A, Kikinis R, Tempany CM, Wells WM, Abolmaesumi P, Kapur T. Automatic Needle Segmentation and Localization in MRI With 3-D Convolutional Neural Networks: Application to MRI-Targeted Prostate Biopsy. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:1026-1036. [PMID: 30334789 PMCID: PMC6450731 DOI: 10.1109/tmi.2018.2876796] [Citation(s) in RCA: 33] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
Image guidance improves tissue sampling during biopsy by allowing the physician to visualize the tip and trajectory of the biopsy needle relative to the target in MRI, CT, ultrasound, or other relevant imagery. This paper reports a system for fast automatic needle tip and trajectory localization and visualization in MRI that has been developed and tested in the context of an active clinical research program in prostate biopsy. To the best of our knowledge, this is the first reported system for this clinical application and also the first reported system that leverages deep neural networks for segmentation and localization of needles in MRI across biomedical applications. Needle tip and trajectory were annotated on 583 T2-weighted intra-procedural MRI scans acquired after needle insertion for 71 patients who underwent transperineal MRI-targeted biopsy procedure at our institution. The images were divided into two independent training-validation and test sets at the patient level. A deep 3-D fully convolutional neural network model was developed, trained, and deployed on these samples. The accuracy of the proposed method, as tested on previously unseen data, was 2.80-mm average in needle tip detection and 0.98° in needle trajectory angle. An observer study was designed in which independent annotations by a second observer, blinded to the original observer, were compared with the output of the proposed method. The resultant error was comparable to the measured inter-observer concordance, reinforcing the clinical acceptability of the proposed method. The proposed system has the potential for deployment in clinical routine.
Collapse
Affiliation(s)
- Alireza Mehrtash
- Department of Electrical and Computer Engineering, The University of British Columbia, Vancouver, BC, V6T 1Z4, Canada
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, 02115, USA
| | | | | | - Alireza Ziaei
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, 02115, USA
| | - Friso G. Heslinga
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, 02115, USA
| | - Kemal Tuncali
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, 02115, USA
| | - Andriy Fedorov
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, 02115, USA
| | - Ron Kikinis
- Department of Computer Science at the University of Bremen, Bremen, Germany
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, 02115, USA
| | - Clare M. Tempany
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, 02115, USA
| | - William M. Wells
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, 02115, USA
| | - Purang Abolmaesumi
- Department of Electrical and Computer Engineering, The University of British Columbia Vancouver, BC, V5T 1Z4, Canada
| | - Tina Kapur
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, 02115, USA
| |
Collapse
|
35
|
Patel N, Yan J, Monfaredi R, Sharma K, Cleary K, Iordachita I. Preclinical evaluation of an integrated robotic system for magnetic resonance imaging guided shoulder arthrography. J Med Imaging (Bellingham) 2019; 6:025006. [PMID: 31131290 PMCID: PMC6519665 DOI: 10.1117/1.jmi.6.2.025006] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2018] [Accepted: 04/15/2019] [Indexed: 11/14/2022] Open
Abstract
Shoulder arthrography is a diagnostic procedure which involves injecting a contrast agent into the joint space for enhanced visualization of anatomical structures. Typically, a contrast agent is injected under fluoroscopy or computed tomography (CT) guidance, resulting in exposure to ionizing radiation, which should be avoided especially in pediatric patients. The patient then waits for the next available magnetic resonance imaging (MRI) slot for obtaining high-resolution anatomical images for diagnosis, which can result in long procedure times. Performing the contrast agent injection under MRI guidance could overcome both these issues. However, it comes with the challenges of the MRI environment including high magnetic field strength, limited ergonomic patient access, and lack of real-time needle guidance. We present the development of an integrated robotic system to perform shoulder arthrography procedures under intraoperative MRI guidance, eliminating fluoroscopy/CT guidance and patient transportation from the fluoroscopy/CT room to the MRI suite. The average accuracy of the robotic manipulator in benchtop experiments is 0.90 mm and 1.04 deg, whereas the average accuracy of the integrated system in MRI phantom experiments is 1.92 mm and 1.28 deg at the needle tip. Based on the American Society for Testing and Materials (ASTM) tests performed, the system is classified as MR conditional.
Collapse
Affiliation(s)
- Niravkumar Patel
- Johns Hopkins University, Laboratory for Computational Sensing and Robotics, Baltimore, Maryland, United States
| | - Jiawen Yan
- Johns Hopkins University, Laboratory for Computational Sensing and Robotics, Baltimore, Maryland, United States
| | - Reza Monfaredi
- Children’s National Medical Center, Washington, DC, United States
| | - Karun Sharma
- Children’s National Medical Center, Washington, DC, United States
| | - Kevin Cleary
- Children’s National Medical Center, Washington, DC, United States
| | - Iulian Iordachita
- Johns Hopkins University, Laboratory for Computational Sensing and Robotics, Baltimore, Maryland, United States
| |
Collapse
|
36
|
Chen Y, Godage I, Su H, Song A, Yu H. Stereotactic Systems for MRI-Guided Neurosurgeries: A State-of-the-Art Review. Ann Biomed Eng 2018; 47:335-353. [PMID: 30377898 DOI: 10.1007/s10439-018-02158-0] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2018] [Accepted: 10/17/2018] [Indexed: 10/28/2022]
Abstract
Recent technological developments in magnetic resonance imaging (MRI) and stereotactic techniques have significantly improved surgical outcomes. Despite the advantages offered by the conventional MRI-guided stereotactic neurosurgery, the robotic-assisted stereotactic approach has potential to further improve the safety and accuracy of neurosurgeries. This review aims to provide an update on the potential and continued growth of the MRI-guided stereotactic neurosurgical techniques by describing the state of the art in MR conditional stereotactic devices including manual and robotic-assisted. The paper also presents a detailed overview of MRI-guided stereotactic devices, MR conditional actuators and encoders used in MR conditional robotic-assisted stereotactic devices. The review concludes with several research challenges and future perspectives, including actuator and sensor technique, MR image guidance, and robot design issues.
Collapse
Affiliation(s)
- Yue Chen
- Department of Mechanical Engineering, University of Arkansas, Fayetteville, AR, USA.
| | - Isuru Godage
- School of Computing, DePaul University, Chicago, IL, USA
| | - Hao Su
- Department of Mechanical Engineering, City College of New York, New York, NY, USA
| | - Aiguo Song
- School of Instrument Science and Engineering, Southeast University, Nanjing, People's Republic of China
| | - Hong Yu
- Department of Neurological Surgery, Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
37
|
Moreira P, Patel N, Wartenberg M, Li G, Tuncali K, Heffter T, Burdette EC, Iordachita I, Fischer GS, Hata N, Tempany CM, Tokuda J. Evaluation of robot-assisted MRI-guided prostate biopsy: needle path analysis during clinical trials. Phys Med Biol 2018; 63:20NT02. [PMID: 30226214 PMCID: PMC6198326 DOI: 10.1088/1361-6560/aae214] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
While the interaction between a needle and the surrounding tissue is known to cause a significant targeting error in prostate biopsy leading to false-negative results, few studies have demonstrated how it impacts in the actual procedure. We performed a pilot study on robot-assisted MRI-guided prostate biopsy with an emphasis on the in-depth analysis of the needle-tissue interaction in vivo. The data were acquired during in-bore transperineal prostate biopsies in patients using a 4 degrees-of-freedom (DoF) MRI-compatible robot. The anatomical structures in the pelvic area and the needle path were reconstructed from MR images, and quantitatively analyzed. We analyzed each structure individually and also proposed a mathematical model to investigate the influence of those structures in the targeting error using the mixed-model regression. The median targeting error in 188 insertions (27 patients) was 6.3 mm. Both the individual anatomical structure analysis and the mixed-model analysis showed that the deviation resulted from the contact between the needle and the skin as the main source of error. On contrary, needle bending inside the tissue (expressed as needle curvature) did not vary among insertions with targeting errors above and below the average. The analysis indicated that insertions crossing the bulbospongiosus presented a targeting error lower than the average. The mixed-model analysis demonstrated that the distance between the needle guide and the patient skin, the deviation at the entry point, and the path length inside the pelvic diaphragm had a statistically significant contribution to the targeting error (p < 0.05). Our results indicate that the errors associated with the elastic contact between the needle and the skin were more prominent than the needle bending along the insertion. Our findings will help to improve the preoperative planning of transperineal prostate biopsies.
Collapse
Affiliation(s)
- Pedro Moreira
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Niravkumar Patel
- Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, MD, USA
| | - Marek Wartenberg
- Automation and Interventional Medicine Lab, Worcester Polytechnic Institute, Worcester, MA, USA
| | - Gang Li
- Automation and Interventional Medicine Lab, Worcester Polytechnic Institute, Worcester, MA,USA
| | - Kemal Tuncali
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA,USA
| | | | | | - Iulian Iordachita
- Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, MD, USA
| | - Gregory S. Fischer
- Automation and Interventional Medicine Lab, Worcester Polytechnic Institute, Worcester, MA, USA
| | - Nobuhiko Hata
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Clare M. Tempany
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Junichi Tokuda
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA,USA
| |
Collapse
|
38
|
Patel NA, Yan J, Levi D, Monfaredi R, Cleary K, Iordachita I. Body-Mounted Robot for Image-Guided Percutaneous Interventions: Mechanical Design and Preliminary Accuracy Evaluation. PROCEEDINGS OF THE ... IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS. IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS 2018; 2018:1443-1448. [PMID: 30997267 PMCID: PMC6463871 DOI: 10.1109/iros.2018.8593807] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
This paper presents a body-mounted, four degree-of-freedom (4-DOF) parallel mechanism robot for image-guided percutaneous interventions. The design of the robot is optimized to be light weight and compact such that it could be mounted to the patient body. It has a modular design that can be adopted for assisting various image-guided, needle-based percutaneous interventions such as arthrography, biopsy and brachytherapy seed placement. The robot mechanism and the control system are designed and manufactured with components compatible with imaging modalities including Magnetic Resonance Imaging (MRI) and Computed Tomography (CT). The current version of the robot presented in this paper is optimized for shoulder arthrography under MRI guidance; a Z-shaped fiducial frame is attached to the robot, providing accurate and repeatable robot registration with the MR scanner coordinate system. Here we present the mechanical design of the manipulator, robot kinematics, robot calibration procedure, and preliminary bench-top accuracy assessment. The bench-top accuracy evaluation of the robotic manipulator shows average translational error of 1.01 mm and 0.96 mm in X and Z axes, respectively, and average rotational error of 3.06 degrees and 2.07 degrees about the X and Z axes, respectively.
Collapse
Affiliation(s)
- Niravkumar A Patel
- N. Patel, J. Yan, D. Levi and I. Iordachita are with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, 3400 N. Charles Street, Baltimore, MD 21218. J. Yan is also with Harbin Institute of Technology, Harbin, 150000 China. [, , , ]
| | - Jiawen Yan
- N. Patel, J. Yan, D. Levi and I. Iordachita are with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, 3400 N. Charles Street, Baltimore, MD 21218. J. Yan is also with Harbin Institute of Technology, Harbin, 150000 China. [, , , ]
| | - David Levi
- N. Patel, J. Yan, D. Levi and I. Iordachita are with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, 3400 N. Charles Street, Baltimore, MD 21218. J. Yan is also with Harbin Institute of Technology, Harbin, 150000 China. [, , , ]
| | - Reza Monfaredi
- R. Monfaredi and K. Cleary are with Children/s National Health System, 111 Michigan Avenue, NW Washington, DC 20010 [, ]
| | - Kevin Cleary
- R. Monfaredi and K. Cleary are with Children/s National Health System, 111 Michigan Avenue, NW Washington, DC 20010 [, ]
| | - Iulian Iordachita
- N. Patel, J. Yan, D. Levi and I. Iordachita are with the Laboratory for Computational Sensing and Robotics, Johns Hopkins University, 3400 N. Charles Street, Baltimore, MD 21218. J. Yan is also with Harbin Institute of Technology, Harbin, 150000 China. [, , , ]
| |
Collapse
|
39
|
Guo Z, Leong MCW, Su H, Kwok KW, Chan DTM, Poon WS. Techniques for Stereotactic Neurosurgery: Beyond the Frame, Toward the Intraoperative Magnetic Resonance Imaging–Guided and Robot-Assisted Approaches. World Neurosurg 2018; 116:77-87. [DOI: 10.1016/j.wneu.2018.04.155] [Citation(s) in RCA: 31] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2018] [Revised: 04/20/2018] [Accepted: 04/21/2018] [Indexed: 11/16/2022]
|
40
|
Monfaredi R, Cleary K, Sharma K. MRI Robots for Needle-Based Interventions: Systems and Technology. Ann Biomed Eng 2018; 46:1479-1497. [PMID: 29922958 DOI: 10.1007/s10439-018-2075-x] [Citation(s) in RCA: 40] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2018] [Accepted: 06/11/2018] [Indexed: 01/13/2023]
Abstract
Magnetic resonance imaging (MRI) provides high-quality soft-tissue images of anatomical structures and radiation free imaging. The research community has focused on establishing new workflows, developing new technology, and creating robotic devices to change an MRI room from a solely diagnostic room to an interventional suite, where diagnosis and intervention can both be done in the same room. Closed bore MRI scanners provide limited access for interventional procedures using intraoperative imaging. MRI robots could improve access and procedure accuracy. Different research groups have focused on different technology aspects and anatomical structures. This paper presents the results of a systematic search of MRI robots for needle-based interventions. We report the most recent advances in the field, present relevant technologies, and discuss possible future advances. This survey shows that robotic-assisted MRI-guided prostate biopsy has received the most interest from the research community to date. Multiple successful clinical experiments have been reported in recent years that show great promise. However, in general the field of MRI robotic systems is still in the early stage. The continued development of these systems, along with partnerships with commercial vendors to bring this technology to market, is encouraged to create new and improved treatment opportunities for future patients.
Collapse
Affiliation(s)
- Reza Monfaredi
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Health System, 111 Michigan ave. NW, Washington, DC, 20010, USA.
| | - Kevin Cleary
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Health System, 111 Michigan ave. NW, Washington, DC, 20010, USA
| | - Karun Sharma
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Health System, 111 Michigan ave. NW, Washington, DC, 20010, USA.,Diagnostic Imaging and Radiology Department, Children's National Health System, 111 Michigan ave. NW, Washington, DC, 20010, USA
| |
Collapse
|
41
|
Automatic planning of needle placement for robot-assisted percutaneous procedures. Int J Comput Assist Radiol Surg 2018; 13:1429-1438. [PMID: 29671199 DOI: 10.1007/s11548-018-1754-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2018] [Accepted: 03/26/2018] [Indexed: 12/24/2022]
Abstract
PURPOSE Percutaneous procedures allow interventional radiologists to perform diagnoses or treatments guided by an imaging device, typically a computed tomography (CT) scanner with a high spatial resolution. To reduce exposure to radiations and improve accuracy, robotic assistance to needle insertion is considered in the case of X-ray guided procedures. We introduce a planning algorithm that computes a needle placement compatible with both the patient's anatomy and the accessibility of the robot within the scanner gantry. METHODS Our preoperative planning approach is based on inverse kinematics, fast collision detection, and bidirectional rapidly exploring random trees coupled with an efficient strategy of node addition. The algorithm computes the allowed needle entry zones over the patient's skin (accessibility map) from 3D models of the patient's anatomy, the environment (CT, bed), and the robot. The result includes the admissible robot joint path to target the prescribed internal point, through the entry point. A retrospective study was performed on 16 patients datasets in different conditions: without robot (WR) and with the robot on the left or the right side of the bed (RL/RR). RESULTS We provide an accessibility map ensuring a collision-free path of the robot and allowing for a needle placement compatible with the patient's anatomy. The result is obtained in an average time of about 1 min, even in difficult cases. The accessibility maps of RL and RR covered about a half of the surface of WR map in average, which offers a variety of options to insert the needle with the robot. We also measured the average distance between the needle and major obstacles such as the vessels and found that RL and RR produced needle placements almost as safe as WR. CONCLUSION The introduced planning method helped us prove that it is possible to use such a "general purpose" redundant manipulator equipped with a dedicated tool to perform percutaneous interventions in cluttered spaces like a CT gantry.
Collapse
|
42
|
Squires A, Oshinski JN, Boulis NM, Tse ZTH. SpinoBot: An MRI-Guided Needle Positioning System for Spinal Cellular Therapeutics. Ann Biomed Eng 2018; 46:475-487. [PMID: 29150766 PMCID: PMC7215142 DOI: 10.1007/s10439-017-1960-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2017] [Accepted: 11/10/2017] [Indexed: 12/14/2022]
Abstract
The neurodegenerative disease amyotrophic lateral sclerosis (ALS) results in the death of motor neurons in voluntary muscles. There are no cures for ALS and few available treatments. In studies with small animal models, injection of cellular therapeutics into the anterior horn of the spinal cord has been shown to inhibit the progression of ALS. It was hypothesized that spinal injection could be made faster and less invasive with the aid of a robot. The robotic system presented-SpinoBot-uses MRI guidance to position a needle for percutaneous injection into the spinal cord. With four degrees of freedom (DOF) provided by two translation stages and two rotational axes, SpinoBot proved capable of advanced targeting with a mean error of 1.12 mm and standard deviation of 0.97 mm in bench tests, and a mean error of 2.2 mm and standard deviation of 0.85 mm in swine cadaver tests. SpinoBot has shown less than 3% signal-to-noise ratio reduction in 3T MR imaging quality, demonstrating its compliance to the MRI environment. With the aid of SpinoBot, the length of the percutaneous injection procedure is reduced to less than 60 min with 10 min for each additional insertion. Although SpinoBot is designed for ALS treatment, it could potentially be used for other procedures that require precise access to the spine.
Collapse
Affiliation(s)
| | - John N Oshinski
- Radiology and Imaging Sciences, Emory University, Atlanta, GA, USA
- Biomedical Engineering, Georgia Institute of Technology & Emory University, Atlanta, GA, USA
| | - Nicholas M Boulis
- Neurosurgery, Emory University Hospital, Emory University School of Medicine, Atlanta, GA, USA
| | - Zion Tsz Ho Tse
- Engineering, The University of Georgia, Athens, GA, USA.
- Driftmier Engineering Center, 597 D.W. Brooks Dr, Annex Room 111, Athens, GA, 30602, USA.
| |
Collapse
|
43
|
Chen Y, Godage IS, Tse ZTH, Webster RJ, Barth EJ. Characterization and Control of a Pneumatic Motor for MR-conditional Robotic Applications. IEEE/ASME TRANSACTIONS ON MECHATRONICS : A JOINT PUBLICATION OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY AND THE ASME DYNAMIC SYSTEMS AND CONTROL DIVISION 2017; 22:2780-2789. [PMID: 31105420 PMCID: PMC6519483 DOI: 10.1109/tmech.2017.2767906] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
Magnetic Resonance (MR) guided interventional robots have recently been developed for a variety of surgeries, such as biopsy, ablation, and brachytherapy. The actuators and encoders that power and track such robots must be MR-conditional. In this paper, we propose an MR-conditional pneumatic motor with an integrated and custom-built fiber-optical encoder that provides powerful and accurate actuation. The motor is coupled with a modular plastic gearbox that provides a variety of gear ratio options so that the motor can be adapted to application requirements. With a 100:1 gear reduction at 0.55 MPa, the motor achieves 460 mNm stall torque and 370 rpm no-load speed, which leads to the peak output power of 6W. The motor has the bandwidth of approximately 1.1 Hz and 3.5 Hz when connected to 8 m and 0.2 m air hoses, respectively. The motor was tested in a 3T MRI scanner. No image artifact was observed and maximum signal to noise ratio (SNR) variation was less than 5%. Different from most of the existing MR-conditional pneumatic actuators, the proposed motor shape is more like the traditional electric motors, which offers more flexibility in the MR-conditional robot design.
Collapse
Affiliation(s)
- Yue Chen
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, 37212, USA
| | - Isuru S Godage
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, 37212, USA
| | - Zion Tsz Ho Tse
- College of Engineering, The University of Georgia, Athens, GA, 30605, USA
| | - Robert J Webster
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, 37212, USA
| | - Eric J Barth
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, 37212, USA
| |
Collapse
|
44
|
Moreira P, van de Steeg G, Krabben T, Zandman J, Hekman EEG, van der Heijden F, Borra R, Misra S. The MIRIAM Robot: A Novel Robotic System for MR-Guided Needle Insertion in the Prostate. ACTA ACUST UNITED AC 2017. [DOI: 10.1142/s2424905x17500064] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Early prostate cancer detection and treatment are of major importance to reduce mortality rate. magnetic resonance (MR) imaging provides images of the prostate where an early stage lesion can be visualized. The use of robotic systems for MR-guided interventions in the prostate allows us to improve the clinical outcomes of procedures such as biopsy and brachytherapy. This work presents a novel MR-conditional robot for prostate interventions. The minimally invasive robotics in an magnetic resonance imaging environment (MIRIAM) robot has 9 degrees-of-freedom (DoF) used to steer and fire a biopsy needle. The needle guide is positioned against the perineum by a 5 DoF parallel robot driven by piezoelectric motors. A 4 DoF needle driver inserts, rotates and fires the needle during the procedure. Piezoelectric motors are used to insert and rotate the needle, while pneumatic actuation is used to fire the needle. The MR-conditional design of the robot and the needle insertion controller are presented. MR compatibility tests using T2 imaging protocol are performed showing a SNR reduction of 25% when the robot is operational within the MR scanner. Experiments inserting a biopsy needle toward a physical target resulted in an average targeting error of 1.84[Formula: see text]mm. Our study presents a novel MR-conditional robot and demonstrated the ability to perform MR-guided needle-based interventions in soft-tissue phantoms. Moreover, the image distortion analysis indicates that no visible image deterioration is induced by the robot.
Collapse
Affiliation(s)
- Pedro Moreira
- Surgical Robotics Laboratory, Department of Biomechanical Engineering, University of Twente, The Netherlands
| | - Gert van de Steeg
- Surgical Robotics Laboratory, Department of Biomechanical Engineering, University of Twente, The Netherlands
| | | | | | - Edsko E. G. Hekman
- Surgical Robotics Laboratory, Department of Biomechanical Engineering, University of Twente, The Netherlands
| | | | - Ronald Borra
- Faculty of Medical Sciences, Department of Nuclear Medicine and Molecular Imaging, University of Groningen and University Medical Center Groningen, The Netherlands
- Medical Imaging Centre of Southwest Finland, Department of Diagnostic Radiology, Turku University Hospital, Turku, Finland
| | - Sarthak Misra
- Surgical Robotics Laboratory, Department of Biomechanical Engineering, University of Twente, The Netherlands
- Surgical Robotics Laboratory, Department of Biomedical Engineering, University of Groningen and University Medical Center Groningen, The Netherlands
| |
Collapse
|
45
|
Su H, Shang W, Li G, Patel N, Fischer GS. An MRI-Guided Telesurgery System Using a Fabry-Perot Interferometry Force Sensor and a Pneumatic Haptic Device. Ann Biomed Eng 2017; 45:1917-1928. [PMID: 28447178 PMCID: PMC5529224 DOI: 10.1007/s10439-017-1839-z] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2016] [Accepted: 04/20/2017] [Indexed: 12/23/2022]
Abstract
This paper presents a surgical master-slave teleoperation system for percutaneous interventional procedures under continuous magnetic resonance imaging (MRI) guidance. The slave robot consists of a piezoelectrically actuated 6-degree-of-freedom (DOF) robot for needle placement with an integrated fiber optic force sensor (1-DOF axial force measurement) using the Fabry-Perot interferometry (FPI) sensing principle; it is configured to operate inside the bore of the MRI scanner during imaging. By leveraging the advantages of pneumatic and piezoelectric actuation in force and position control respectively, we have designed a pneumatically actuated master robot (haptic device) with strain gauge based force sensing that is configured to operate the slave from within the scanner room during imaging. The slave robot follows the insertion motion of the haptic device while the haptic device displays the needle insertion force as measured by the FPI sensor. Image interference evaluation demonstrates that the telesurgery system presents a signal to noise ratio reduction of less than 17% and less than 1% geometric distortion during simultaneous robot motion and imaging. Teleoperated needle insertion and rotation experiments were performed to reach 10 targets in a soft tissue-mimicking phantom with 0.70 ± 0.35 mm Cartesian space error.
Collapse
Affiliation(s)
- Hao Su
- Wyss Institute for Biologically Inspired Engineering and the John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, 02138, USA.
| | - Weijian Shang
- Automation and Interventional Medicine Robotics Laboratory, Department of Mechanical Engineering, Worcester Polytechnic Institute, 100 Institute Road, Worcester, MA, 01609, USA
| | - Gang Li
- Automation and Interventional Medicine Robotics Laboratory, Department of Mechanical Engineering, Worcester Polytechnic Institute, 100 Institute Road, Worcester, MA, 01609, USA
| | - Niravkumar Patel
- Automation and Interventional Medicine Robotics Laboratory, Department of Mechanical Engineering, Worcester Polytechnic Institute, 100 Institute Road, Worcester, MA, 01609, USA
| | - Gregory S Fischer
- Automation and Interventional Medicine Robotics Laboratory, Department of Mechanical Engineering, Worcester Polytechnic Institute, 100 Institute Road, Worcester, MA, 01609, USA
| |
Collapse
|
46
|
Price KD, Sin VW, Mougenot C, Pichardo S, Looi T, Waspe AC, Drake JM. Design and validation of an MR-conditional robot for transcranial focused ultrasound surgery in infants. Med Phys 2017; 43:4983. [PMID: 27587029 DOI: 10.1118/1.4955174] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Current treatment of intraventricular hemorrhage (IVH) involves cerebral shunt placement or an invasive brain surgery. Magnetic resonance-guided focused ultrasound (MRgFUS) applied to the brains of pediatric patients presents an opportunity to treat IVH in a noninvasive manner, termed "incision-less surgery." Current clinical and research focused ultrasound systems lack the capability to perform neonatal transcranial surgeries due to either range of motion or dexterity requirements. A novel robotic system is proposed to position a focused ultrasound transducer accurately above the head of a neonatal patient inside an MRI machine to deliver the therapy. METHODS A clinical Philips Sonalleve MRgFUS system was expanded to perform transcranial treatment. A five degree-of-freedom MR-conditional robot was designed and manufactured using MR compatible materials. The robot electronics and control were integrated into existing Philips electronics and software interfaces. The user commands the position of the robot with a graphical user interface, and is presented with real-time MR imaging of the patient throughout the surgery. The robot is validated through a series of experiments that characterize accuracy, signal-to-noise ratio degeneration of an MR image as a result of the robot, MR imaging artifacts generated by the robot, and the robot's ability to operate in a representative surgical environment inside an MR machine. RESULTS Experimental results show the robot responds reliably within an MR environment, has achieved 0.59 ± 0.25 mm accuracy, does not produce severe MR-imaging artifacts, has a workspace providing sufficient coverage of a neonatal brain, and can manipulate a 5 kg payload. A full system demonstration shows these characteristics apply in an application environment. CONCLUSIONS This paper presents a comprehensive look at the process of designing and validating a new robot from concept to implementation for use in an MR environment. An MR conditional robot has been designed and manufactured to design specifications. The system has demonstrated its feasibility as a platform for MRgFUS interventions for neonatal patients. The success of the system in experimental trials suggests that it is ready to be used for validation of the transcranial intervention in animal studies.
Collapse
Affiliation(s)
- Karl D Price
- Centre for Image Guided Innovation and Therapeutic Intervention, The Hospital for Sick Children, Toronto, Ontario M5G 1X8, Canada and The Department of Mechanical Engineering, The University of Toronto, Toronto, Ontario M5S 3G8, Canada
| | - Vivian W Sin
- Centre for Image Guided Innovation and Therapeutic Intervention, The Hospital for Sick Children, Toronto, Ontario M5G 1X8, Canada
| | | | - Samuel Pichardo
- Electrical Engineering, Lakehead University, Thunder Bay, Ontario P7B 5E1, Canada
| | - Thomas Looi
- Centre for Image Guided Innovation and Therapeutic Intervention, The Hospital for Sick Children, Toronto, Ontario M5G 1X8, Canada and The Institute of Biomaterials and Biomedical Engineering, The University of Toronto, Toronto, Ontario M5G 3G9, Canada
| | - Adam C Waspe
- Centre for Image Guided Innovation and Therapeutic Intervention, The Hospital for Sick Children, Toronto, Ontario M5G 1X8, Canada and Department of Medical Imaging, The University of Toronto, Toronto, Ontario M5T 1W7, Canada
| | - James M Drake
- Centre for Image Guided Innovation and Therapeutic Intervention, The Hospital for Sick Children, Toronto, Ontario M5G 1X8, Canada; Department of Neurosurgery, The University of Toronto, Toronto, Ontario M5S 1A1, Canada; and The Institute of Biomaterials and Biomedical Engineering, The University of Toronto, Toronto, Ontario M5G 3G9, Canada
| |
Collapse
|
47
|
Franco E, Ristic M, Rea M, Gedroyc WMW. Robot-assistant for MRI-guided liver ablation: A pilot study. Med Phys 2017; 43:5347. [PMID: 27782696 DOI: 10.1118/1.4961986] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022] Open
Abstract
PURPOSE Percutaneous ablation under MRI-guidance allows treating otherwise inoperable liver tumors locally using a catheter probe. However, manually placing the probe is an error-prone and time consuming task that requires a considerable amount of training. The aim of this paper was to present a pneumatically actuated robotic instrument that can assist clinicians in MRI-guided percutaneous intervention of the liver and to assess its functionality in a clinical setting. The robot positions a needle-guide inside the MRI scanner bore and assists manual needle insertions outside the bore. METHODS The robot supports double oblique insertions that are particularly challenging for less experienced clinicians. Additionally, the system employs only standard imaging sequences and can therefore be used on different MRI scanners without requiring prior integration. The repeatability and the accuracy of the robot were evaluated with an optical tracking system. The functionality of the robot was assessed in an initial pilot study on two patients that underwent MRI-guided laser ablation of the liver. RESULTS The robot positioned the needle-guide in a repeatable manner with a mean error of 0.35 mm and a standard deviation of 0.32 mm. The mean position error corresponding to the needle tip, measured for an equivalent needle length of 195 mm over 25 fixed points, was 2.5 mm with a standard deviation of 1.2 mm. The pilot study confirmed that the robot does not interfere with the equipment used for MRI-guided laser ablation and does not visibly affect the MR images. The robot setup integrated seamlessly within the established clinical workflow. The robot-assisted procedure was successfully completed on two patients, one of which required a complex double oblique insertion. For both patients, the insertion depth and the tumor size were within the range reported for previous MRI-guided percutaneous interventions. A third patient initially enrolled in the pilot study and was considerably heavier than the others, preventing the use of the robot and requiring several freehand insertion attempts. CONCLUSIONS The robot repeatability and accuracy are appropriate for liver tumors normally treated with MRI-guided ablation. The results of the pilot study endorse the clinical use of the robot in its current form: the robot is fully functional and MRI-compatible in a clinical setting and is suitable for double-oblique needle insertions.
Collapse
Affiliation(s)
- Enrico Franco
- Mechanical Engineering Department, Imperial College London, London SW7 AZ, United Kingdom
| | - Mike Ristic
- Mechanical Engineering Department, Imperial College London, London SW7 AZ, United Kingdom
| | - Marc Rea
- Department of Radiology, Imperial College Healthcare NHS Trust, London W2 1NY, United Kingdom
| | - Wladyslaw M W Gedroyc
- Department of Radiology, Imperial College Healthcare NHS Trust, London W2 1NY, United Kingdom
| |
Collapse
|
48
|
Wartenberg M, Patel N, Fischer GS. Towards synergistic control of hands-on needle insertion with automated needle steering for MRI-guided prostate interventions. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2016:5116-5119. [PMID: 28269418 DOI: 10.1109/embc.2016.7591878] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
A significant hurdle of accurate needle tip placement in percutaneous needle-based prostate interventions is unmodeled needle deflection and tissue deformation during insertion. This paper introduces a robotic platform for developing synergistic, cooperatively controlled needle insertion algorithms decoupled from closed-loop image-guided needle steering. Shared control of the surgical workspace through human-robot synergy creates a balance between the accuracy of robotic autonomy while still providing ultimate control of the procedure to the physician. Validation tests were performed using camera-based image-guided feedback control of needle steering with cooperative hands-on needle insertion. Locations were targeted inside a transparent gelatin phantom with an average total error of 2.68 ± 0.34mm and in-plane error of 2.59 ± 0.30mm.
Collapse
|
49
|
Stoianovici D, Kim C, Petrisor D, Jun C, Lim S, Ball MW, Ross A, Macura KJ, Allaf M. MR Safe Robot, FDA Clearance, Safety and Feasibility Prostate Biopsy Clinical Trial. IEEE/ASME TRANSACTIONS ON MECHATRONICS : A JOINT PUBLICATION OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY AND THE ASME DYNAMIC SYSTEMS AND CONTROL DIVISION 2017; 22:115-126. [PMID: 28867930 PMCID: PMC5578622 DOI: 10.1109/tmech.2016.2618362] [Citation(s) in RCA: 49] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
Compatibility of mechatronic devices with the MR environment has been a very challenging engineering task. After over a decade of developments, we report the successful translation to clinical trials of our MR Safe robot technology. MrBot is a 6-degree-of-freedom, pneumatically actuated robot for transperineal prostate percutaneous access, built exclusively of electrically nonconductive and nonmagnetic materials. Its extensive pre-clinical tests have been previously reported. Here, we present the latest technology developments, an overview of the regulatory protocols, and technically related results of the clinical trial. The FDA has approved the MrBot for the biopsy trial, which was successfully performed in 5 patients. With no trajectory corrections, and no unsuccessful attempts to target a site, the robot achieved an MRI based needle targeting accuracy of 2.55 mm. To the best of our knowledge, this is the first robot approved by the FDA for the MR environment. The results confirm that it is possible to perform safe and accurate robotic manipulation in the MRI scanner, and the development of MR Safe robots is no longer a daunting technical challenge.
Collapse
Affiliation(s)
| | - Chunwoo Kim
- Urology Department, Johns Hopkins University Baltimore, MD
| | - Doru Petrisor
- Urology Department, Johns Hopkins University Baltimore, MD
| | - Changhan Jun
- Urology Department, Johns Hopkins University Baltimore, MD
| | - Sunghwan Lim
- Urology Department, Johns Hopkins University Baltimore, MD
| | - Mark W. Ball
- Urology Department, Johns Hopkins University Baltimore, MD
| | - Ashley Ross
- Urology Department, Johns Hopkins University Baltimore, MD
| | | | - Mohamad Allaf
- Urology Department, Johns Hopkins University Baltimore, MD
| |
Collapse
|
50
|
Ménard C, Pambrun JF, Kadoury S. The utilization of magnetic resonance imaging in the operating room. Brachytherapy 2017; 16:754-760. [PMID: 28139421 DOI: 10.1016/j.brachy.2016.12.007] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2016] [Revised: 12/12/2016] [Accepted: 12/12/2016] [Indexed: 11/26/2022]
Abstract
Online image guidance in the operating room using ultrasound imaging led to the resurgence of prostate brachytherapy in the 1980s. Here we describe the evolution of integrating MRI technology in the brachytherapy suite or operating room. Given the complexity, cost, and inherent safety issues associated with MRI system integration, first steps focused on the computational integration of images rather than systems. This approach has broad appeal given minimal infrastructure costs and efficiencies comparable with standard care workflows. However, many concerns remain regarding accuracy of registration through the course of a brachytherapy procedure. In selected academic institutions, MRI systems have been integrated in or near the brachytherapy suite in varied configurations to improve the precision and quality of treatments. Navigation toolsets specifically adapted to prostate brachytherapy are in development and are reviewed.
Collapse
Affiliation(s)
- C Ménard
- University of Montréal Hospital Research Centre (CRCHUM), Montréal, QC, Canada; TECHNA Institute, University of Toronto, Toronto, ON, Canada; Princess Margaret Cancer Center, Toronto, ON, Canada.
| | - J-F Pambrun
- University of Montréal Hospital Research Centre (CRCHUM), Montréal, QC, Canada; École polytechnique de Montréal, Montréal, QC, Canada
| | - S Kadoury
- University of Montréal Hospital Research Centre (CRCHUM), Montréal, QC, Canada; École polytechnique de Montréal, Montréal, QC, Canada
| |
Collapse
|