Estimation of tool pose based on force-density correlation during robotic drilling

A Framework of State Estimation on Laminar Grinding Based on the CT Image-Force Model

It is a great challenge for a safe surgery to localize the cutting tip during laminar grinding. To address this problem, we develop a framework of state estimation based on the CT image-force model. For the proposed framework, the pre-operative CT image and intra-operative milling force signal work as source inputs. In the framework, a bone milling force prediction model is built, and the surgical planned paths can be transformed into the prediction sequences of milling force. The intra-operative milling force signal is segmented by the tumbling window algorithm. Then, the similarity between the prediction sequences and the segmented milling signal is derived by the dynamic time warping (DTW) algorithm. The derived similarity indicates the position of the cutting tip. Finally, to overcome influences of some factors, we used the random sample consensus (RANSAC). The code of the functional simulations has be opened.

Identification of milling status based on vibration signals using artificial intelligence in robot-assisted cervical laminectomy

BACKGROUND

With advances in science and technology, the application of artificial intelligence in medicine has significantly progressed. The purpose of this study is to explore whether the k-nearest neighbors (KNN) machine learning method can identify three milling states based on vibration signals: cancellous bone (CCB), ventral cortical bone (VCB), and penetration (PT) in robot-assisted cervical laminectomy.

METHODS

Cervical laminectomies were performed on the cervical segments of eight pigs using a robot. First, the bilateral dorsal cortical bone and part of the CCB were milled with a 5 mm blade and then the bilateral laminae were milled to penetration with a 2 mm blade. During the milling process using the 2 mm blade, the vibration signals were collected by the acceleration sensor, and the harmonic components were extracted using fast Fourier transform. The feature vectors were constructed with vibration signal amplitudes of 0.5, 1.0, and 1.5 kHz and the KNN was then trained by the features vector to predict the milling states.

RESULTS

The amplitudes of the vibration signals between VCB and PT were statistically different at 0.5, 1.0, and 1.5 kHz (P < 0.05), and the amplitudes of the vibration signals between CCB and VCB were significantly different at 0.5 and 1.5 kHz (P < 0.05). The KNN recognition success rates for the CCB, VCB, and PT were 92%, 98%, and 100%, respectively. A total of 6% and 2% of the CCB cases were identified as VCB and PT, respectively; 2% of VCB cases were identified as PT.

CONCLUSIONS

The KNN can distinguish different milling states of a high-speed bur in robot-assisted cervical laminectomy based on vibration signals. This method is feasible for improving the safety of posterior cervical decompression surgery.

Thermal and physical damage in skull base drilling using gas cooling modes: FEM simulation and experimental evaluation

BACKGROUND

Skull base drilling, as a high-risk process, is one of the most important techniques of skull base surgeries.

METHODS

The temperature, thrust force, and torque were calculated using finite element method (FEM) simulation under two conventional cooling models, and internal and external CO₂ cooling modes at four rotational speeds (1000-4000 rpm). The temperatures at the bottom and on the surface of the drilling site were measured experimentally using a thermometer and a thermographic camera, respectively. The results were then compared with FEM results.

RESULTS

The efficiency rates of CO₂ coolants in reducing the maximum temperature, thrust force, and torque were at least 5.0-11.2%, 16.5-33.8%, and 6.9-11.3% higher than conventional cooling modes, respectively. The experimental results indicated that, in contrast to the maximum temperature, temperature durability was 72.7-107.3% higher in the conventional cooling modes than the cooling modes with external CO₂ coolant systems. The cracks and surface defects were less in the CO₂ coolants than the other cooling modes. The maximum temperature after the second and third drillings increased by 17.7 and 26.8%, compared to the first drilling in the conventional cooling modes. On the other hand, the repeated drillings had no impact on the temperature in the CO₂ cooling modes.

CONCLUSION

Skull base drilling with a rotational speed of 2000 rpm in the cooling mode of an external CO₂ coolant, even for repeated drillings, can lead to a skull drilling process with minimum risk of drill bit breakage and thermal and physical damage.

A CT Image-Based Virtual Sensing Method to Estimate Bone Drilling Force for Surgery Robots

AbstractObjective: Understanding medical images like the human surgeon is a challenge for current surgical robots. It is still hard for surgical robots to achieve safe and stable operations with the help of priori information from preoperative images. We proposed a method to estimate drilling force information based on preoperative images, which can provide priori force information for surgical robots to perform bone drilling tasks.

METHODS

A visual sensing computing framework is proposed to obtain the 3D image information from the drill-tissue contact area in a one-dimensional signal format. Under this computing framework, a computed tomography (CT) image-weighted bone drilling mechanical model is built. The model considers both targets bone shape and material properties to predict the thrust force, torque, and radial force of a drilling process based on preoperative CT images.

RESULTS

The built model can respond to multiple bone drilling process factors, such as personalized surgery plans, varying tissue densities, uneven drilling surfaces, different drilling speeds, feed rates, and drill bit geometries. The minimum error of the predicted thrust force on bovine bones is 1.130.95 N, and the best normalized average prediction error on porcine bones is 0.070.08. Experiments in spinal pedicle screw placement surgery also show potential application abilities.

CONCLUSION

Our method predicts the bone drilling force well based on preoperative images, providing robots with more efficient preoperative information.

SIGNIFICANCE

This work offers a new perspective to study the interaction relationship between robot surgical instruments and tissues with the assistance of preoperative images.

Human-Inspired Haptic Perception and Control in Robot-Assisted Milling Surgery

Bone milling is one of the most widely used and high-risk procedures in various types of surgeries, and it is important to be noted that the experienced surgeon can perform such an operation safely. The objective of this article is to enhance the safety of the robot-assisted milling operation with the inspiration of human haptic perception. The emergence, coding and perception of the human haptic are introduced. Following this, a single axis accelerometer that measures the vibration of the surgical power tool is mounted in the robot arm, and the recorded acceleration signal is encoded as parallel stream of binary data. The data are subsequently inputted to the Hopfield network so as to identify the milling state. Inspired by human inference procedure, the fuzzy logic controller is introduced to control the robot to track the desired state when performing bone milling operations. A real-time implementation of the proposed method on a digital signal processing is also described. The experimental results in milling porcine spines prove that the robot accurately discriminates different milling states even when the additive noise is serious, and the safe motion control of the robot is also realized.

Robots and Tools for Remodeling Bone

The field of robotic surgery has progressed from small teams of researchers repurposing industrial robots, to a competitive and highly innovative subsection of the medical device industry. Surgical robots allow surgeons to perform tasks with greater ease, accuracy, or safety, and fall under one of four levels of autonomy; active, semi-active, passive, and remote manipulator. The increased accuracy afforded by surgical robots has allowed for cementless hip arthroplasty, improved postoperative alignment following knee arthroplasty, and reduced duration of intraoperative fluoroscopy among other benefits. Cutting of bone has historically used tools such as hand saws and drills, with other elaborate cutting tools now used routinely to remodel bone. Improvements in cutting accuracy and additional options for safety and monitoring during surgery give robotic surgeries some advantages over conventional techniques. This article aims to provide an overview of current robots and tools with a common target tissue of bone, proposes a new process for defining the level of autonomy for a surgical robot, and examines future directions in robotic surgery.

Robotic middle ear access for cochlear implantation: First in man

To demonstrate the feasibility of robotic middle ear access in a clinical setting, nine adult patients with severe-to-profound hearing loss indicated for cochlear implantation were included in this clinical trial. A keyhole access tunnel to the tympanic cavity and targeting the round window was planned based on preoperatively acquired computed tomography image data and robotically drilled to the level of the facial recess. Intraoperative imaging was performed to confirm sufficient distance of the drilling trajectory to relevant anatomy. Robotic drilling continued toward the round window. The cochlear access was manually created by the surgeon. Electrode arrays were inserted through the keyhole tunnel under microscopic supervision via a tympanomeatal flap. All patients were successfully implanted with a cochlear implant. In 9 of 9 patients the robotic drilling was planned and performed to the level of the facial recess. In 3 patients, the procedure was reverted to a conventional approach for safety reasons. No change in facial nerve function compared to baseline measurements was observed. Robotic keyhole access for cochlear implantation is feasible. Further improvements to workflow complexity, duration of surgery, and usability including safety assessments are required to enable wider adoption of the procedure.

Review on Otological Robotic Systems: Toward Microrobot-Assisted Cholesteatoma Surgery

Otologic surgical procedures over time have become minimally invasive due to the development of medicine, microtechniques, and robotics. This trend then provides an expected reduction in the patient's recovery time and improvement in the accuracy of diagnosis and treatment. One of the most challenging difficulties that such techniques face are precise control of the instrument and supply of an ergonomic system to the surgeon. The objective of this literature review is to present requirements and guidelines for a surgical robotic system dedicated to middle ear surgery. This review is particularly focused on cholesteatoma surgery (diagnosis and surgical tools), which is one of the most frequent pathologies that urge for an enhanced treatment. This review also presents the current robotic systems that are implemented for otologic applications.

Population Statistics Approach for Safety Assessment in Robotic Cochlear Implantation

HYPOTHESIS

Descriptive statistics with respect to patient anatomy and image guidance accuracy can be used to assess the effectiveness of any system for minimally invasive cochlear implantation, on both an individual patient and wider population level.

BACKGROUND

Minimally invasive cochlear implantation involves the drilling of a tunnel from the surface of the mastoid to cochlea, with the trajectory passing through the facial recess. The facial recess anatomy constrains the drilling path and places prohibitive accuracy requirements on the used system. Existing single thresholds are insufficient for assessing the effectiveness of these systems.

METHODS

A statistical model of the anatomical situation encountered during minimally invasive drilling of the mastoid for cochlear implantation was developed. A literature review was performed to determine the statistical distribution of facial recess width; these values were confirmed through facial recess measurements on computed tomography (CT) data. Based on the accuracy of a robotic system developed by the authors, the effect of variation of system accuracy, precision, and tunnel diameter examined with respect to the potential treatable portion of the population.

RESULTS

A facial recess diameter of 2.54 ± 0.51 mm (n = 74) was determined from a review of existing literature; subsequent measurements on CT data revealed a facial recess diameter of 2.54 ± 0.5 mm (n = 23). The developed model demonstrated the effects of varying accuracy on the treatable portion of the population.

CONCLUSIONS

The presented model allows the assessment of the applicability of a system on a wider population scale beyond examining only the system's ability to reach an arbitrary threshold accuracy.

Pre-operative Screening and Manual Drilling Strategies to Reduce the Risk of Thermal Injury During Minimally Invasive Cochlear Implantation Surgery

This article presents the development and experimental validation of a methodology to reduce the risk of thermal injury to the facial nerve during minimally invasive cochlear implantation surgery. The first step in this methodology is a pre-operative screening process, in which medical imaging is used to identify those patients that present a significant risk of developing high temperatures at the facial nerve during the drilling phase of the procedure. Such a risk is calculated based on the density of the bone along the drilling path and the thermal conductance between the drilling path and the nerve, and provides a criterion to exclude high-risk patients from receiving the minimally invasive procedure. The second component of the methodology is a drilling strategy for manually-guided drilling near the facial nerve. The strategy utilizes interval drilling and mechanical constraints to enable better control over the procedure and the resulting generation of heat. The approach is tested in fresh cadaver temporal bones using a thermal camera to monitor temperature near the facial nerve. Results indicate that pre-operative screening may successfully exclude high-risk patients and that the proposed drilling strategy enables safe drilling for low-to-moderate risk patients.

Real-Time Prediction of Temperature Elevation During Robotic Bone Drilling Using the Torque Signal

Bone drilling is a surgical procedure commonly required in many surgical fields, particularly orthopedics, dentistry and head and neck surgeries. While the long-term effects of thermal bone necrosis are unknown, the thermal damage to nerves in spinal or otolaryngological surgeries might lead to partial paralysis. Previous models to predict the temperature elevation have been suggested, but were not validated or have the disadvantages of computation time and complexity which does not allow real time predictions. Within this study, an analytical temperature prediction model is proposed which uses the torque signal of the drilling process to model the heat production of the drill bit. A simple Green's disk source function is used to solve the three dimensional heat equation along the drilling axis. Additionally, an extensive experimental study was carried out to validate the model. A custom CNC-setup with a load cell and a thermal camera was used to measure the axial drilling torque and force as well as temperature elevations. Bones with different sets of bone volume fraction were drilled with two drill bits ([Formula: see text]1.8 mm and [Formula: see text]2.5 mm) and repeated eight times. The model was calibrated with 5 of 40 measurements and successfully validated with the rest of the data ([Formula: see text]C). It was also found that the temperature elevation can be predicted using only the torque signal of the drilling process. In the future, the model could be used to monitor and control the drilling process of surgeries close to vulnerable structures.

Robotic cochlear implantation: surgical procedure and first clinical experience

CONCLUSION

A system for robotic cochlear implantation (rCI) has been developed and a corresponding surgical workflow has been described. The clinical feasibility was demonstrated through the conduction of a safe and effective rCI procedure.

OBJECTIVES

To define a clinical workflow for rCI and demonstrate its feasibility, safety, and effectiveness within a clinical setting.

METHOD

A clinical workflow for use of a previously described image guided surgical robot system for rCI was developed. Based on pre-operative images, a safe drilling tunnel targeting the round window was planned and drilled by the robotic system. Intra-operatively the drill path was assessed using imaging and sensor-based data to confirm the proximity of the facial nerve. Electrode array insertion was manually achieved under microscope visualization. Electrode array placement, structure preservation, and the accuracy of the drilling and of the safety mechanisms were assessed on post-operative CT images.

RESULTS

Robotic drilling was conducted with an accuracy of 0.2 mm and safety mechanisms predicted proximity of the nerves to within 0.1 mm. The approach resulted in a minimal mastoidectomy and minimal incisions. Manual electrode array insertion was successfully performed through the robotically drilled tunnel. The procedure was performed without complications, and all surrounding structures were preserved.

Instrument flight to the inner ear

Surgical robot systems can work beyond the limits of human perception, dexterity and scale making them inherently suitable for use in microsurgical procedures. However, despite extensive research, image-guided robotics applications for microsurgery have seen limited introduction into clinical care to date. Among others, challenges are geometric scale and haptic resolution at which the surgeon cannot sufficiently control a device outside the range of human faculties. Mechanisms are required to ascertain redundant control on process variables that ensure safety of the device, much like instrument-flight in avionics. Cochlear implantation surgery is a microsurgical procedure, in which specific tasks are at sub-millimetric scale and exceed reliable visuo-tactile feedback. Cochlear implantation is subject to intra- and inter-operative variations, leading to potentially inconsistent clinical and audiological outcomes for patients. The concept of robotic cochlear implantation aims to increase consistency of surgical outcomes such as preservation of residual hearing and reduce invasiveness of the procedure. We report successful image-guided, robotic CI in human. The robotic treatment model encompasses: computer-assisted surgery planning, precision stereotactic image-guidance, in-situ assessment of tissue properties and multipolar neuromonitoring (NM), all based on in vitro, in vivo and pilot data. The model is expandable to integrate additional robotic functionalities such as cochlear access and electrode insertion. Our results demonstrate the feasibility and possibilities of using robotic technology for microsurgery on the lateral skull base. It has the potential for benefit in other microsurgical domains for which there is no task-oriented, robotic technology available at present.

Cadaveric Testing of Robot-Assisted Access to the Internal Auditory Canal for Vestibular Schwannoma Removal

HYPOTHESIS

An image-guided robotic system can safely perform the bulk removal of bone during the translabyrinthine approach to vestibular schwannoma (VS).

BACKGROUND

The translabyrinthine approach to VS removal involves extensive manual milling in the temporal bone to gain access to the internal auditory canal (IAC) for tumor resection. This bone removal is time consuming and challenging due to the presence of vital anatomy (e.g., facial nerve) embedded within the temporal bone. A robotic system can use preoperative imaging and segmentations to guide a surgical drill to remove a prescribed volume of bone, thereby preserving the surgeon for the more delicate work of opening the IAC and resecting the tumor.

METHODS

Fresh human cadaver heads were used in the experiments. For each trial, the desired bone resection volume was planned on a preoperative computed tomography (CT) image, the steps in the proposed clinical workflow were undertaken, and the robot was programmed to mill the specified volume. A postoperative CT scan was acquired for evaluation of the accuracy of the milled cavity and examination of vital anatomy.

RESULTS

In all experimental trials, the facial nerve and chorda tympani were preserved. The root mean squared surface accuracy of the milled cavities ranged from 0.23 to 0.65 mm and the milling time ranged from 32.7 to 57.0 minute.

CONCLUSION

This work shows feasibility of using a robot-assisted approach for VS removal surgery. Further testing and system improvements are necessary to enable clinical translation of this technology.

Making Robots Mill Bone More Like Human Surgeons: Using Bone Density and Anatomic Information to Mill Safely and Efficiently

Surgeons and robots typically use different approaches for bone milling. Surgeons adjust their speed and tool incidence angle constantly, which enables them to efficiently mill porous bone. Surgeons also adjust milling parameters such as speed and depth of cut throughout the procedure based on proximity to sensitive structures like nerves and blood vessels. In this paper we use image-based bone density estimates and segmentations of vital anatomy to make a robot mill more like a surgeon and less like an industrial computer numeric controlled (CNC) milling machine. We produce patient-specific plans optimizing velocity and incidence angles for spherical cutting burrs. These plans are particularly useful in bones of variable density and porosity like the human temporal bone. They result in fast milling in non-critical areas, reducing overall procedure time, and lower forces near vital anatomy. We experimentally demonstrate the algorithm on temporal bone phantoms and show that it reduces mean forces near vital anatomy by 63% and peak forces by 50% in comparison to a CNC-type path, without adding time to the procedure.

Accuracy of linear drilling in temporal bone using drill press system for minimally invasive cochlear implantation

PURPOSE

A minimally invasive approach for cochlear implantation involves drilling a narrow linear path through the temporal bone from the skull surface directly to the cochlea for insertion of the electrode array without the need for an invasive mastoidectomy. Potential drill positioning errors must be accounted for to predict the effectiveness and safety of the procedure. The drilling accuracy of a system used for this procedure was evaluated in bone surrogate material under a range of clinically relevant parameters. Additional experiments were performed to isolate the error at various points along the path to better understand why deflections occur.

METHODS

An experimental setup to precisely position the drill press over a target was used. Custom bone surrogate test blocks were manufactured to resemble the mastoid region of the temporal bone. The drilling error was measured by creating divots in plastic sheets before and after drilling and using a microscope to localize the divots.

RESULTS

The drilling error was within the tolerance needed to avoid vital structures and ensure accurate placement of the electrode; however, some parameter sets yielded errors that may impact the effectiveness of the procedure when combined with other error sources. The error increases when the lateral stage of the path terminates in an air cell and when the guide bushings are positioned further from the skull surface. At contact points due to air cells along the trajectory, higher errors were found for impact angles of [Formula: see text] and higher as well as longer cantilevered drill lengths.

CONCLUSION

The results of these experiments can be used to define more accurate and safe drill trajectories for this minimally invasive surgical procedure.

An experimental evaluation of loads occurring during guided drilling for cochlear implantation

PURPOSE

During guided drilling for minimally invasive cochlear implantation and related applications, typically forces and torques act on the employed tool guides, which result from both the surgeon's interaction and the bone drilling process. Such loads propagate through the rigid mechanisms and result in deformations of compliant parts, which in turn affect the achievable accuracy. In this paper, the order of magnitude as well as the factors influencing such loads are studied experimentally to facilitate design and optimization of future drill guide prototypes.

METHODS

The experimental setup to evaluate the occurring loads comprises two six degree of freedom force/torque sensors: one mounted between a manually operated, linearly guided drill handpiece and one below the specimens into which the drilling is carried out. This setup is used to analyze the influences of drilling tool geometry, spindle speed as well as experience of the operator on the resulting loads.

RESULTS

The results reveal that using a spiral drill results in lower process loads compared with a surgical Lindemann mill. Moreover, in this study, an experienced surgeon applied lower interaction forces compared with untrained volunteers. The measured values further indicate that both the intraoperative handling of the bone-attached drill guide as well as the tool removal after completing the hole can be expected to cause temporary load peaks which exceed the values acquired during the drilling procedure itself.

CONCLUSIONS

The results obtained using the proposed experimental setup serve as realistic design criteria with respect to the development of future drill guide prototypes. Furthermore, the given values can be used to parameterize simulations for profound stiffness analyses of existing mechanisms.

Mechatronic feasibility of minimally invasive, atraumatic cochleostomy

Robotic assistance in the context of lateral skull base surgery, particularly during cochlear implantation procedures, has been the subject of considerable research over the last decade. The use of robotics during these procedures has the potential to provide significant benefits to the patient by reducing invasiveness when gaining access to the cochlea, as well as reducing intracochlear trauma when performing a cochleostomy. Presented herein is preliminary work on the combination of two robotic systems for reducing invasiveness and trauma in cochlear implantation procedures. A robotic system for minimally invasive inner ear access was combined with a smart drilling tool for robust and safe cochleostomy; evaluation was completed on a single human cadaver specimen. Access to the middle ear was successfully achieved through the facial recess without damage to surrounding anatomical structures; cochleostomy was completed at the planned position with the endosteum remaining intact after drilling as confirmed by microscope evaluation.

Preliminary Testing of a Compact, Bone-Attached Robot for Otologic Surgery

Otologic surgery often involves a mastoidectomy procedure, in which part of the temporal bone is milled away in order to visualize critical structures embedded in the bone and safely access the middle and inner ear. We propose to automate this portion of the surgery using a compact, bone-attached milling robot. A high level of accuracy is required to avoid damage to vital anatomy along the surgical path, most notably the facial nerve, making this procedure well-suited for robotic intervention. In this study, several of the design considerations are discussed and a robot design and prototype are presented. The prototype is a 4 degrees-of-freedom robot similar to a four-axis milling machine that mounts to the patient's skull. A positioning frame, containing fiducial markers and attachment points for the robot, is rigidly attached to the skull of the patient, and a CT scan is acquired. The target bone volume is manually segmented in the CT by the surgeon and automatically converted to a milling path and robot trajectory. The robot is then attached to the positioning frame and is used to drill the desired volume. The accuracy of the entire system (image processing, planning, robot) was evaluated at several critical locations within or near the target bone volume with a mean free space accuracy result of 0.50 mm or less at all points. A milling test in a phantom material was then performed to evaluate the surgical workflow. The resulting milled volume did not violate any critical structures.