1
|
Duan Y, Ling J, Feng Z, Ye T, Sun T, Zhu Y. A Survey of Needle Steering Approaches in Minimally Invasive Surgery. Ann Biomed Eng 2024; 52:1492-1517. [PMID: 38530535 DOI: 10.1007/s10439-024-03494-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Accepted: 03/08/2024] [Indexed: 03/28/2024]
Abstract
In virtue of a curved insertion path inside tissues, needle steering techniques have revealed the potential with the assistance of medical robots and images. The superiority of this technique has been preliminarily verified with several maneuvers: target realignment, obstacle circumvention, and multi-target access. However, the momentum of needle steering approaches in the past decade leads to an open question-"How to choose an applicable needle steering approach for a specific clinical application?" This survey discusses this question in terms of design choices and clinical considerations, respectively. In view of design choices, this survey proposes a hierarchical taxonomy of current needle steering approaches. Needle steering approaches of different manipulations and designs are classified to systematically review the design choices and their influences on clinical treatments. In view of clinical consideration, this survey discusses the steerability and acceptability of the current needle steering approaches. On this basis, the pros and cons of the current needle steering approaches are weighed and their suitable applications are summarized. At last, this survey concluded with an outlook of the needle steering techniques, including the potential clinical applications and future developments in mechanical design.
Collapse
Affiliation(s)
- Yuzhou Duan
- College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, China
| | - Jie Ling
- College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, China.
| | - Zhao Feng
- School of Power and Mechanical Engineering, Wuhan University, Wuhan, 430072, China
- Wuhan University Shenzhen Research Institute, Shenzhen, 518057, China
| | - Tingting Ye
- Industrial and Systems Engineering Department, The Hong Kong Polytechnic University, Hong Kong SAR, 999077, China
| | - Tairen Sun
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Yuchuan Zhu
- College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, China
| |
Collapse
|
2
|
Fried I, Hoelscher J, Akulian JA, Pizer S, Alterovitz R. Landmark Based Bronchoscope Localization for Needle Insertion Under Respiratory Deformation. PROCEEDINGS OF THE ... IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS. IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS 2023; 2023:6593-6600. [PMID: 38947248 PMCID: PMC11214542 DOI: 10.1109/iros55552.2023.10342115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/02/2024]
Abstract
Bronchoscopy is currently the least invasive method for definitively diagnosing lung cancer, which kills more people in the United States than any other form of cancer. Successfully diagnosing suspicious lung nodules requires accurate localization of the bronchoscope relative to a planned biopsy site in the airways. This task is challenging because the lung deforms intraoperatively due to respiratory motion, the airways lack photometric features, and the anatomy's appearance is repetitive. In this paper, we introduce a real-time camera-based method for accurately localizing a bronchoscope with respect to a planned needle insertion pose. Our approach uses deep learning and accounts for deformations and overcomes limitations of global pose estimation by estimating pose relative to anatomical landmarks. Specifically, our learned model considers airway bifurcations along the airway wall as landmarks because they are distinct geometric features that do not vary significantly with respiratory motion. We evaluate our method in a simulated dataset of lungs undergoing respiratory motion. The results show that our method generalizes across patients and localizes the bronchoscope with accuracy sufficient to access the smallest clinically-relevant nodules across all levels of respiratory deformation, even in challenging distal airways. Our method could enable physicians to perform more accurate biopsies and serve as a key building block toward accurate autonomous robotic bronchoscopy.
Collapse
Affiliation(s)
- Inbar Fried
- I. Fried, J. Hoelscher, S. Pizer, and R. Alterovitz are with the Department of Computer Science, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
- I. Fried is also with the Medical Scientist Training Program, University of North Carolina School of Medicine, Chapel Hill, NC, 27599, USA
| | - Janine Hoelscher
- I. Fried, J. Hoelscher, S. Pizer, and R. Alterovitz are with the Department of Computer Science, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Jason A Akulian
- J. A. Akulian is with the Division of Pulmonary Diseases and Critical Care Medicine at the University of North Carolina at Chapel Hill, NC 27599, USA
| | - Stephen Pizer
- I. Fried, J. Hoelscher, S. Pizer, and R. Alterovitz are with the Department of Computer Science, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Ron Alterovitz
- I. Fried, J. Hoelscher, S. Pizer, and R. Alterovitz are with the Department of Computer Science, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| |
Collapse
|
3
|
Kuntz A, Emerson M, Ertop TE, Fried I, Fu M, Hoelscher J, Rox M, Akulian J, Gillaspie EA, Lee YZ, Maldonado F, Webster RJ, Alterovitz R. Autonomous medical needle steering in vivo. Sci Robot 2023; 8:eadf7614. [PMID: 37729421 PMCID: PMC11182607 DOI: 10.1126/scirobotics.adf7614] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2022] [Accepted: 08/21/2023] [Indexed: 09/22/2023]
Abstract
The use of needles to access sites within organs is fundamental to many interventional medical procedures both for diagnosis and treatment. Safely and accurately navigating a needle through living tissue to a target is currently often challenging or infeasible because of the presence of anatomical obstacles, high levels of uncertainty, and natural tissue motion. Medical robots capable of automating needle-based procedures have the potential to overcome these challenges and enable enhanced patient care and safety. However, autonomous navigation of a needle around obstacles to a predefined target in vivo has not been shown. Here, we introduce a medical robot that autonomously navigates a needle through living tissue around anatomical obstacles to a target in vivo. Our system leverages a laser-patterned highly flexible steerable needle capable of maneuvering along curvilinear trajectories. The autonomous robot accounts for anatomical obstacles, uncertainty in tissue/needle interaction, and respiratory motion using replanning, control, and safe insertion time windows. We applied the system to lung biopsy, which is critical for diagnosing lung cancer, the leading cause of cancer-related deaths in the United States. We demonstrated successful performance of our system in multiple in vivo porcine studies achieving targeting errors less than the radius of clinically relevant lung nodules. We also demonstrated that our approach offers greater accuracy compared with a standard manual bronchoscopy technique. Our results show the feasibility and advantage of deploying autonomous steerable needle robots in living tissue and how these systems can extend the current capabilities of physicians to further improve patient care.
Collapse
Affiliation(s)
- Alan Kuntz
- Kahlert School of Computing and Robotics Center, University of Utah; Salt Lake City, UT 84112, USA
| | - Maxwell Emerson
- Department of Mechanical Engineering, Vanderbilt University; Nashville, TN 37235, USA
| | - Tayfun Efe Ertop
- Department of Mechanical Engineering, Vanderbilt University; Nashville, TN 37235, USA
| | - Inbar Fried
- Department of Computer Science, University of North Carolina at Chapel Hill; Chapel Hill, NC 27599, USA
| | - Mengyu Fu
- Department of Computer Science, University of North Carolina at Chapel Hill; Chapel Hill, NC 27599, USA
| | - Janine Hoelscher
- Department of Computer Science, University of North Carolina at Chapel Hill; Chapel Hill, NC 27599, USA
| | - Margaret Rox
- Department of Mechanical Engineering, Vanderbilt University; Nashville, TN 37235, USA
| | - Jason Akulian
- Department of Medicine, Division of Pulmonary Diseases and Critical Care Medicine, University of North Carolina School of Medicine; Chapel Hill, NC 27599, USA
| | - Erin A. Gillaspie
- Department of Medicine and Thoracic Surgery, Vanderbilt University Medical Center; Nashville, TN 37232, USA
| | - Yueh Z. Lee
- Department of Radiology, University of North Carolina School of Medicine; Chapel Hill, NC 27599, USA
| | - Fabien Maldonado
- Department of Medicine and Thoracic Surgery, Vanderbilt University Medical Center; Nashville, TN 37232, USA
| | - Robert J. Webster
- Department of Mechanical Engineering, Vanderbilt University; Nashville, TN 37235, USA
| | - Ron Alterovitz
- Department of Computer Science, University of North Carolina at Chapel Hill; Chapel Hill, NC 27599, USA
| |
Collapse
|
4
|
Fu M, Solovey K, Salzman O, Alterovitz R. Resolution-Optimal Motion Planning for Steerable Needles. IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION : ICRA : [PROCEEDINGS]. IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION 2022; 2022:9652-9659. [PMID: 36337768 PMCID: PMC9629985 DOI: 10.1109/icra46639.2022.9811850] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Medical steerable needles can follow 3D curvilinear trajectories inside body tissue, enabling them to move around critical anatomical structures and precisely reach clinically significant targets in a minimally invasive way. Automating needle steering, with motion planning as a key component, has the potential to maximize the accuracy, precision, speed, and safety of steerable needle procedures. In this paper, we introduce the first resolution-optimal motion planner for steerable needles that offers excellent practical performance in terms of runtime while simultaneously providing strong theoretical guarantees on completeness and the global optimality of the motion plan in finite time. Compared to state-of-the-art steerable needle motion planners, simulation experiments on realistic scenarios of lung biopsy demonstrate that our proposed planner is faster in generating higher-quality plans while incorporating clinically relevant cost functions. This indicates that the theoretical guarantees of the proposed planner have a practical impact on the motion plan quality, which is valuable for computing motion plans that minimize patient trauma.
Collapse
Affiliation(s)
- Mengyu Fu
- Department of Computer Science, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Kiril Solovey
- Computer Science Department, Technion - Israel Institute of Technology, Israel
| | - Oren Salzman
- Computer Science Department, Technion - Israel Institute of Technology, Israel
| | - Ron Alterovitz
- Department of Computer Science, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| |
Collapse
|