Biopsy Needle System With a Steerable Concentric Tube and Online Monitoring of Electrical Resistivity and Insertion Forces

A Heuristically Accelerated Reinforcement Learning-Based Neurosurgical Path Planner

The steerable needle becomes appealing in the neurosurgery intervention procedure because of its flexibility to bypass critical regions inside the brain; with proper path planning, it can also minimize the potential damage by setting constraints and optimizing the insertion path. Recently, reinforcement learning (RL)-based path planning algorithm has shown promising results in neurosurgery, but because of the trial and error mechanism, it can be computationally expensive and insecure with low training efficiency. In this paper, we propose a heuristically accelerated deep Q network (DQN) algorithm to safely preoperatively plan a needle insertion path in a neurosurgical environment. Furthermore, a fuzzy inference system is integrated into the framework as a balance of the heuristic policy and the RL algorithm. Simulations are conducted to test the proposed method in comparison to the traditional greedy heuristic searching algorithm and DQN algorithms. Tests showed promising results of our algorithm in saving over 50 training episodes, calculating path lengths of 0.35 after normalization, which is 0.61 and 0.39 for DQN and traditional greedy heuristic searching algorithm, respectively. Moreover, the maximum curvature during planning is reduced to 0.046 from 0.139 mm-1 using the proposed algorithm compared to DQN.

Towards Autonomous Robotic Biopsy—Design, Modeling and Control of a Robot for Needle Insertion of a Commercial Full Core Biopsy Instrument

This paper presents the design, control, and experimental evaluation of a novel fully automated robotic-assisted system for the positioning and insertion of a commercial full core biopsy instrument under guidance by ultrasound imaging. The robotic system consisted of a novel 4 Degree of freedom (DOF) add-on robot for the positioning and insertion of the biopsy instrument that is attached to a UR5-based teleoperation system with 6 DOF. The robotic system incorporates the advantages of both freehand and probe-guided biopsy techniques. The proposed robotic system can be used as a slave robot in a teleoperation configuration or as an autonomous or semi-autonomous robot in the future. While the UR5 manipulator was controlled using a teleoperation scheme with force controller, a reinforcement learning based controller using the Deep Deterministic Policy Gradient (DDPG) algorithm was developed for the add-on robotic system. The dexterous workspace analysis of the add-on robotic system demonstrated that the system has a suitable workspace within the US image. Two sets of comprehensive experiments including four experiments were performed to evaluate the robotic system’s performance in terms of the biopsy instrument positioning, and the insertion of the needle inside the ultrasound plane. The experimental results showed the ability of the robotic system for in-plane needle insertion. The overall mean error of all four experiments in the tracking of the needle angle was 0.446°, and the resolution of the needle insertion was 0.002 mm.