1
|
Bernardes MC, Moreira P, Mareschal L, Tempany C, Tuncali K, Hata N, Tokuda J. Data-driven adaptive needle insertion assist for transperineal prostate interventions. Phys Med Biol 2023; 68:10.1088/1361-6560/accefa. [PMID: 37080237 PMCID: PMC10249778 DOI: 10.1088/1361-6560/accefa] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Accepted: 04/20/2023] [Indexed: 04/22/2023]
Abstract
Objective.Clinical outcomes of transperineal prostate interventions, such as biopsy, thermal ablations, and brachytherapy, depend on accurate needle placement for effectiveness. However, the accurate placement of a long needle, typically 150-200 mm in length, is challenging due to needle deviation induced by needle-tissue interaction. While several approaches for needle trajectory correction have been studied, many of them do not translate well to practical applications due to the use of specialized needles not yet approved for clinical use, or to relying on needle-tissue models that need to be tailored to individual patients.Approach.In this paper, we present a robot-assisted collaborative needle insertion method that only requires an actuated passive needle guide and a conventional needle. The method is designed to assist a physician inserting a needle manually through a needle guide. If the needle is deviated from the intended path, actuators shifts the needle radially in order to steer the needle trajectory and compensate for needle deviation adaptively. The needle guide is controlled by a new data-driven algorithm which does not requirea prioriinformation about needle or tissue properties. The method was evaluated in experiments with bothin vitroandex vivophantoms.Main results.The experiments inex vivotissue reported a mean final placement error of 0.36 mm with a reduction of 96.25% of placement error when compared to insertions without the use of assistive correction.Significance.Presented results show that the proposed closed-loop formulation can be successfully used to correct needle deflection during collaborative manual insertion with potential to be easily translated into clinical application.
Collapse
Affiliation(s)
- Mariana C Bernardes
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States of America
| | - Pedro Moreira
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States of America
| | - Lisa Mareschal
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States of America
| | - Clare Tempany
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States of America
| | - Kemal Tuncali
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States of America
| | - Nobuhiko Hata
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States of America
| | - Junichi Tokuda
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States of America
| |
Collapse
|
2
|
Wu K, Li B, Zhang Y, Dai X. Review of research on path planning and control methods of flexible steerable needle puncture robot. Comput Assist Surg (Abingdon) 2022; 27:91-112. [PMID: 36052822 DOI: 10.1080/24699322.2021.2023647] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022] Open
Abstract
In the field of minimally invasive interventional therapy, the related research on the soft tissue puncture robot and its technology based on the flexible steerable needle as a research hot topic at present, and it has been developed rapidly in the past ten years. In order to better understand the development status of the flexible steerable needle puncture (FSNP) robot and provide reference for its design and improvement in subsequent research, it is necessary to introduce in two aspects of FSNP robot: the puncture path planning and the control methods. First, this article introduced the concept of the FSNP technology, and the necessity of the application of FSNP soft tissue robot in minimally invasive interventional surgery. Second, this article mainly introduced the principle of FSNP, the path planning of FSNP, the navigation and positioning control of the needle tip of the flexible steerable needle, the control method of FSNP system, and the controllable flexible needle. Finally, combined with the above analysis and introduction, it was pointed out that FSNP soft tissue robot and its related technology would be an important development direction in the field of minimally invasive interventional therapy in the future, and the current existing problems were pointed out. Meanwhile, the development trend of FSNP robot control technology was summarized and prospected.
Collapse
Affiliation(s)
- Kaiyu Wu
- Robotics & Its Engineering Research Center, Mechatronic engineering, Harbin University of Science and Technology, Harbin, China
| | - Bing Li
- Robotics & Its Engineering Research Center, Mechatronic engineering, Harbin University of Science and Technology, Harbin, China
| | - Yongde Zhang
- Robotics & Its Engineering Research Center, Mechatronic engineering, Harbin University of Science and Technology, Harbin, China
| | - Xuesong Dai
- Robotics & Its Engineering Research Center, Mechatronic engineering, Harbin University of Science and Technology, Harbin, China
| |
Collapse
|
3
|
Berger J, Unger M, Keller J, Reich CM, Neumuth T, Melzer A. Design and validation of a medical robotic device system to control two collaborative robots for ultrasound-guided needle insertions. Front Robot AI 2022; 9:875845. [PMID: 36246494 PMCID: PMC9554707 DOI: 10.3389/frobt.2022.875845] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Accepted: 08/31/2022] [Indexed: 11/13/2022] Open
Abstract
The percutaneous biopsy is a critical intervention for diagnosis and staging in cancer therapy. Robotic systems can improve the efficiency and outcome of such procedures while alleviating stress for physicians and patients. However, the high complexity of operation and the limited possibilities for robotic integration in the operating room (OR) decrease user acceptance and the number of deployed robots. Collaborative systems and standardized device communication may provide approaches to overcome named problems. Derived from the IEEE 11073 SDC standard terminology of medical device systems, we designed and validated a medical robotic device system (MERODES) to access and control a collaborative setup of two KUKA robots for ultrasound-guided needle insertions. The system is based on a novel standard for service-oriented device connectivity and utilizes collaborative principles to enhance user experience. Implementing separated workflow applications allows for a flexible system setup and configuration. The system was validated in three separate test scenarios to measure accuracies for 1) co-registration, 2) needle target planning in a water bath and 3) in an abdominal phantom. The co-registration accuracy averaged 0.94 ± 0.42 mm. The positioning errors ranged from 0.86 ± 0.42 to 1.19 ± 0.70 mm in the water bath setup and from 1.69 ± 0.92 to 1.96 ± 0.86 mm in the phantom. The presented results serve as a proof-of-concept and add to the current state of the art to alleviate system deployment and fast configuration for percutaneous robotic interventions.
Collapse
Affiliation(s)
- Johann Berger
- Innovation Center Computer Assisted Surgery (ICCAS), University of Leipzig, Leipzig, Germany
| | - Michael Unger
- Innovation Center Computer Assisted Surgery (ICCAS), University of Leipzig, Leipzig, Germany
| | - Johannes Keller
- Innovation Center Computer Assisted Surgery (ICCAS), University of Leipzig, Leipzig, Germany
| | - C. Martin Reich
- Innovation Center Computer Assisted Surgery (ICCAS), University of Leipzig, Leipzig, Germany
| | - Thomas Neumuth
- Innovation Center Computer Assisted Surgery (ICCAS), University of Leipzig, Leipzig, Germany
| | - Andreas Melzer
- Innovation Center Computer Assisted Surgery (ICCAS), University of Leipzig, Leipzig, Germany
- Institute for Medical Science and Technology (IMSaT), University Dundee, Dundee, Scotland
- *Correspondence: Andreas Melzer,
| |
Collapse
|
4
|
Barua R, Datta S, RoyChowdhury A, Datta P. Study of the surgical needle and biological soft tissue interaction phenomenon during insertion process for medical application: A Survey. Proc Inst Mech Eng H 2022; 236:1465-1477. [DOI: 10.1177/09544119221122024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
The insertion of the surgical needle in soft tissue has involved significant interest in the current time because of its purpose in minimally invasive surgery (MIS) and percutaneous events like biopsies, PCNL, and brachytherapy. This study represents a review of the existing condition of investigation on insertion of a surgical needle in biological living soft tissue material. As observes the issue from numerous phases, like, analysis of the cutting forces modeling (insertion), tissue material deformation, analysis of the needle deflection for the period of the needle insertion, and the robot-controlled insertion procedures. All analysis confirms that the total needle insertion force is the total of dissimilar forces spread sideways the shaft of the insertion needle for example cutting force, stiffness force, and frictional force. Various investigations have analyzed all these kinds of forces during the needle insertion process. The force data in several measures are applied for recognizing the biological tissue materials as the needle is penetrated or for path planning. The deflection of the needle during insertion and tissue material deformation is the main trouble for defined needle placing and efforts have been prepared to model them. Applying existing models numerous insertion methods are established that are discussed in this review.
Collapse
Affiliation(s)
- Ranjit Barua
- Indian Institute of Engineering Science and Technology, Howrah, West Bengal, India
| | - Sudipto Datta
- Indian Institute of Technology, Delhi, New Delhi, Delhi, India
| | - Amit RoyChowdhury
- Indian Institute of Engineering Science and Technology, Howrah, West Bengal, India
| | - Pallab Datta
- National Institute of Pharmaceutical Education and Research-Kolkata, Kolkata, West Bengal, India
| |
Collapse
|
5
|
Zhang W, Bao K, Zheng L, Cai L, Yan B, Yang R. A robotic puncture system with optical and mechanical feedback under respiratory motion. Int J Med Robot 2022; 18:e2403. [PMID: 35384266 DOI: 10.1002/rcs.2403] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2022] [Revised: 04/02/2022] [Accepted: 04/03/2022] [Indexed: 12/24/2022]
Abstract
Puncture robot can improve the accuracy and efficiency of puncture surgery, such as thoracoabdominal and liver puncture. However, as soft tissue is deformed and shifted under respiratory motion and during the puncture process, the needle is pulled, resulting in the needle's bending and deformation, which increases the risks and sufferings of the patient, a robotic puncture system with optical and mechanical feedback is necessary. Therefore, this paper proposes a multi-information sensing 'guide-clamp' end effector for puncture surgery to accurately detect the posture and force on the puncture needle in real time. And gravity bias method with trajectory planning and the compensational controlling model are also proposed to offset the interference of self-weight and achieve zero force following. This system is evaluated by the experiments of robot controlling and human tissue simulation and the results prove the excellent robustness of the system, which meet the clinical requirement.
Collapse
Affiliation(s)
- Wenlong Zhang
- School of Materials Science and Engineering, South China University of Technology, Guangzhou, China
| | - Kaiyang Bao
- School of Materials Science and Engineering, South China University of Technology, Guangzhou, China
| | - Lingxiang Zheng
- School of Materials Science and Engineering, South China University of Technology, Guangzhou, China
| | - Lijing Cai
- School of Materials Science and Engineering, South China University of Technology, Guangzhou, China
| | - Biao Yan
- School of Materials Science and Engineering, South China University of Technology, Guangzhou, China
| | - Rongqian Yang
- School of Electronic and Information Engineering, South China University of Technology, Guangzhou, China
| |
Collapse
|
6
|
Su H, Kwok KW, Cleary K, Iordachita I, Cavusoglu MC, Desai JP, Fischer GS. State of the Art and Future Opportunities in MRI-Guided Robot-Assisted Surgery and Interventions. PROCEEDINGS OF THE IEEE. INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS 2022; 110:968-992. [PMID: 35756185 PMCID: PMC9231642 DOI: 10.1109/jproc.2022.3169146] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/17/2023]
Abstract
Magnetic resonance imaging (MRI) can provide high-quality 3-D visualization of target anatomy, surrounding tissue, and instrumentation, but there are significant challenges in harnessing it for effectively guiding interventional procedures. Challenges include the strong static magnetic field, rapidly switching magnetic field gradients, high-power radio frequency pulses, sensitivity to electrical noise, and constrained space to operate within the bore of the scanner. MRI has a number of advantages over other medical imaging modalities, including no ionizing radiation, excellent soft-tissue contrast that allows for visualization of tumors and other features that are not readily visible by other modalities, true 3-D imaging capabilities, including the ability to image arbitrary scan plane geometry or perform volumetric imaging, and capability for multimodality sensing, including diffusion, dynamic contrast, blood flow, blood oxygenation, temperature, and tracking of biomarkers. The use of robotic assistants within the MRI bore, alongside the patient during imaging, enables intraoperative MR imaging (iMRI) to guide a surgical intervention in a closed-loop fashion that can include tracking of tissue deformation and target motion, localization of instrumentation, and monitoring of therapy delivery. With the ever-expanding clinical use of MRI, MRI-compatible robotic systems have been heralded as a new approach to assist interventional procedures to allow physicians to treat patients more accurately and effectively. Deploying robotic systems inside the bore synergizes the visual capability of MRI and the manipulation capability of robotic assistance, resulting in a closed-loop surgery architecture. This article details the challenges and history of robotic systems intended to operate in an MRI environment and outlines promising clinical applications and associated state-of-the-art MRI-compatible robotic systems and technology for making this possible.
Collapse
Affiliation(s)
- Hao Su
- Department of Mechanical and Aerospace Engineering, North Carolina State University, Raleigh, NC 27695 USA
| | - Ka-Wai Kwok
- Department of Mechanical Engineering, The University of Hong Kong, Hong Kong
| | - Kevin Cleary
- Children's National Health System, Washington, DC 20010 USA
| | - Iulian Iordachita
- Laboratory for Computational Sensing and Robotics (LCSR), Johns Hopkins University, Baltimore, MD 21218 USA
| | - M Cenk Cavusoglu
- Department of Electrical, Computer, and Systems Engineering, Case Western Reserve University, Cleveland, OH 44106 USA
| | - Jaydev P Desai
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, GA 30332 USA
| | - Gregory S Fischer
- Department of Robotics Engineering, Worcester Polytechnic Institute, Worcester, MA 01609 USA
| |
Collapse
|
7
|
Robust Deflected Path Planning Method for Superelastic Nitinol Coaxial Biopsy Needle: Application to an Automated Magnetic Resonance Image-Guided Breast Biopsy Robot. IEEE T ROBOT 2022. [DOI: 10.1109/tro.2021.3132837] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
8
|
Salman H, Akkar HA. An intelligent controller for ultrasound-based venipuncture through precise vein localization and stable needle insertion. APPLIED NANOSCIENCE 2021. [DOI: 10.1007/s13204-021-02058-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|
9
|
Wang Y, Fu Z, Zhao ZF, Shen Y, Zhang TF, Shi WY, Fei J, Chen GB. Experimental study of the optimum puncture pattern of robot-assisted needle insertion into hyperelastic materials. Proc Inst Mech Eng H 2020; 235:28-43. [PMID: 32873144 DOI: 10.1177/0954411920950904] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The robot-assisted insertion surgery plays a crucial role in biopsy and therapy. This study focuses on determining the optimum puncture pattern for robot-assisted insertion, aiming at the matching problem of needle insertion parameters, thereby to reduce the pain for patients and to improve the reachability to the lesion point. First, a 6-degrees of freedom (DOFs) Computed Tomography (CT)-guided surgical robotic system for minimally invasive percutaneous lung is developed and used to perform puncture experiments. The effects of four main insertion factors on the robotic puncture are verified by designing the orthogonal test, where the inserting object is the artificial skin-like specimen with high transparent property and a digital image processing method is used to analyze the needle tip deflection. Next, the various phases of puncture process are divided and analyzed in detail in view of the tissue deformation and puncture force. Then, short discussion on the comparison of puncture force with different effect factors for the same beveled needle is presented. The same pattern can be observed for all of the cases. Finally, based on the experimental data, the formulations of the puncture force and needle deflection which depends on Gauge size, insertion velocity, insertion angle, and insertion depth are developed using the multiple regression method, which can be used to get an optimum puncture pattern under the constrains of minimum peak force and minimum needle tip deflection. The developed models have the effectiveness and applicability on determining the optimum puncture pattern for one puncture event, and which can also provide insights useful for the setting of insertion parameters in clinical practice.
Collapse
Affiliation(s)
- Yao Wang
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| | - Zhuang Fu
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| | | | - Yun Shen
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| | - Tie-Feng Zhang
- Ruijin Hospital, Shanghai Jiao Tong University, Shanghai, China
| | - Wei-Yi Shi
- Ruijin Hospital, Shanghai Jiao Tong University, Shanghai, China
| | - Jian Fei
- Baoshan District Dachang Hospital, Shanghai, China
| | - Guang-Biao Chen
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
10
|
Dalag L, Fergus JK, Zangan SM. Lung and Abdominal Biopsies in the Age of Precision Medicine. Semin Intervent Radiol 2019; 36:255-263. [PMID: 31435134 DOI: 10.1055/s-0039-1693121] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
Abstract
Image-guided percutaneous needle biopsies (PNBs) are one of the most common procedures performed in radiology departments today. Rapid developments in precision medicine, which identifies molecular and genomic biomarkers in cancers, have ushered a new paradigm of oncologic workup and treatment. PNB has conventionally been used to establish a benign or malignant nature of a lesion during initial diagnosis or in suspected metastatic or recurrent disease. However, increasing amounts of tissue are being required to meet the demands of molecular pathologic analysis, which are now being sought at multiple time points during the course of the disease to guide targeted therapy. As primary providers of biopsy, radiologists must be proactive in these developments to improve diagnostic yield and tissue acquisition in PNB. Herein, we discuss the important and expanding role of PNB in the age of precision medicine and review the technical considerations of percutaneous lung and intra-abdominal biopsy. Finally, we examine promising state-of-the-art techniques in PNB that may safely increase tissue acquisition for optimal molecular pathologic analysis.
Collapse
Affiliation(s)
- Leonard Dalag
- Department of Radiology, University of Chicago, Chicago, Illinois
| | | | - Steven M Zangan
- Department of Radiology, University of Chicago, Chicago, Illinois
| |
Collapse
|
11
|
|