Haptic Feedback in Needle Insertion Modeling and Simulation

Visuo-Haptic VR and AR Guidance for Dental Nerve Block Education

The inferior alveolar nerve block (IANB) is a dental anesthetic injection that is critical to the performance of many dental procedures. Dental students typically learn to administer an IANB through videos and practice on silicone molds and, in many dental schools, on other students. This causes significant stress for both the students and their early patients. To reduce discomfort and improve clinical outcomes, we created an anatomically informed virtual reality headset-based educational system for the IANB. It combines a layered 3D anatomical model, dynamic visual guidance for syringe position and orientation, and active force feedback to emulate syringe interaction with tissue. A companion mobile augmented reality application allows students to step through a visualization of the procedure on a phone or tablet. We conducted a user study to determine the advantages of preclinical training with our IANB simulator. We found that in comparison to dental students who were exposed only to traditional supplementary study materials, dental students who used our IANB simulator were more confident administering their first clinical injections, had less need for syringe readjustments, and had greater success in numbing patients.

TransVFS: A spatio-temporal local-global transformer for vision-based force sensing during ultrasound-guided prostate biopsy

Robot-assisted prostate biopsy is a new technology to diagnose prostate cancer, but its safety is influenced by the inability of robots to sense the tool-tissue interaction force accurately during biopsy. Recently, vision based force sensing (VFS) provides a potential solution to this issue by utilizing image sequences to infer the interaction force. However, the existing mainstream VFS methods cannot realize the accurate force sensing due to the adoption of convolutional or recurrent neural network to learn deformation from the optical images and some of these methods are not efficient especially when the recurrent convolutional operations are involved. This paper has presented a Transformer based VFS (TransVFS) method by leveraging ultrasound volume sequences acquired during prostate biopsy. The TransVFS method uses a spatio-temporal local-global Transformer to capture the local image details and the global dependency simultaneously to learn prostate deformations for force estimation. Distinctively, our method explores both the spatial and temporal attention mechanisms for image feature learning, thereby addressing the influence of the low ultrasound image resolution and the unclear prostate boundary on the accurate force estimation. Meanwhile, the two efficient local-global attention modules are introduced to reduce 4D spatio-temporal computation burden by utilizing the factorized spatio-temporal processing strategy, thereby facilitating the fast force estimation. Experiments on prostate phantom and beagle dogs show that our method significantly outperforms existing VFS methods and other spatio-temporal Transformer models. The TransVFS method surpasses the most competitive compared method ResNet3dGRU by providing the mean absolute errors of force estimation, i.e., 70.4 ± 60.0 millinewton (mN) vs 123.7 ± 95.6 mN, on the transabdominal ultrasound dataset of dogs.

Real needle for minimal invasive procedures training using motion sensors and optical flow

Minimally invasive percutaneous insertion procedures are widely used techniques in medicine. Their success is highly dependent on the skills of the practitioner. This paper presents a haptic simulator for training in these procedures, whose key component is a real percutaneous insertion needle with a sensory system incorporated to track its 3D location at every instant. By means of the proposed embedded vision system, the attitude (spatial orientation) and depth of insertion of a real needle are estimated. The proposal is founded on a novel depth estimation procedure based on optical flow techniques, complemented by sensory fusion techniques with the attitude calculated with data from an Inertial Measurement Unit (IMU) sensor. This procedure allows estimating the needle attitude with an accuracy of tenths of a degree and the displacement with an accuracy of millimeters. The computational algorithm runs on an embedded computer with real-time constraints for tracking the movement of a real needle. This haptic needle location data is used to reproduce the movement of a virtual needle within a simulation app. As a fundamental result, an ergonomic and realistic training simulator has been successfully constructed for healthcare professionals to acquire the mental model and motor skills necessary to practice percutaneous procedures successfully.

Cognitive models for mentally visualizing a sharp instrument in a blind procedure

Purpose

Our objective was to understand the cognitive strategies used by surgeons to mentally visualize navigation of a surgical instrument through blind space.

Methods

We conducted semi-structured interviews with 15 expert and novice surgeons following simulated retropubic trocar passage on 3D-printed models of pelvises segmented from preop MRIs. Midurethral sling surgery involves blind passage of a trocar among the urethra, bladder, iliac vessels, and bowel while relying primarily on haptic feedback from the suprapubic bone (SPB) for guidance. Our conceptual foundation was based on Lahav's study on blind people's mental mapping of spaces using haptic cues. Participants detailed how they mentally pictured the trocar's location relative to vital anatomy. We coded all responses and used constant comparative analysis to generate themes, confirmed with member checking.

Results

Expert and novice participants utilized multiple cognitive strategies combined with haptic feedback to accomplish safe trocar passage. Some used a step-by-step route strategy, visualizing sequential 2D axial images of anatomy adjacent to the SPB. Others used a map strategy, forming global 3D pictures. Although these mental pictures vanished when they were "lost," a safe zone could be reestablished by touching the SPB. Experts were more likely to relate their body position to the trocar path and rely on minor variations in resistance. Novices were more inclined toward backtracking of the trocar.

Conclusions

Our findings may be extended to any blind surgical procedure. Teaching visualization strategies and incorporating tactile feedback can be used intraoperatively to help learners navigate their instrument safely around vital organs.

A study on modeling the deflection of surgical needle during insertion into multilayer tissues

The use of subcutaneous and percutaneous needle and catheter insertions is standard in modern clinical practice. However, a common issue with bevel tip surgical needles is their tendency to deflect, causing them to miss the intended target inside the tissue. This study aims to understand the interaction between the needle and soft tissue and develop a model to predict the deflection of a bevel tip needle during insertion into multi-layered soft tissues. The study examined the mechanics of needle-tissue interaction and modeled the forces involved during insertion. The force model includes cutting force, deformation force, and friction between the needle and tissue. There was an 8%-23% difference between the total analytical and experimental force measurements. A modified Euler-Bernoulli beam elastic foundation theory was used to create an analytical model to predict the needle tip deflection in soft tissue. To validate the results, the analytical deflection model was then compared to the deflection from needle insertion experiments on multi-layered phantom tissues, showing a 9%-21% error between the two. While there is a slight discrepancy between the analytical and experimental results, the study shows that the proposed model can accurately predict needle tip deflection during insertion.

How friction and adhesion affect the mechanics of deep penetration in soft solids

The mechanics of puncture and soft solid penetration is commonly explored with the assumption of frictionless contact between the needle (penetrator) and the specimen. This leads to the hypothesis of a constant penetration force. Experimental observations, however, report a linear increment of penetration force with needle tip depth. This force increment is due to friction and adhesion, and this paper provides its correlation with the properties of the cut material. Specifically, the force-depth slope depends on the rigidity and toughness of the soft material, the radius of the penetrator and the interfacial properties (friction and adhesion) between the two. We observe that adhesion prevails at relatively low toughness, while friction is dominant at high toughness. Finally, we compare our results with experiments and observe good agreement. Our model provides a valuable tool to predict the evolution of penetration force with depth and to measure the friction and adhesion characteristics at the needle-specimen interface from puncture experiments.

Study of the surgical needle and biological soft tissue interaction phenomenon during insertion process for medical application: A Survey

The insertion of the surgical needle in soft tissue has involved significant interest in the current time because of its purpose in minimally invasive surgery (MIS) and percutaneous events like biopsies, PCNL, and brachytherapy. This study represents a review of the existing condition of investigation on insertion of a surgical needle in biological living soft tissue material. As observes the issue from numerous phases, like, analysis of the cutting forces modeling (insertion), tissue material deformation, analysis of the needle deflection for the period of the needle insertion, and the robot-controlled insertion procedures. All analysis confirms that the total needle insertion force is the total of dissimilar forces spread sideways the shaft of the insertion needle for example cutting force, stiffness force, and frictional force. Various investigations have analyzed all these kinds of forces during the needle insertion process. The force data in several measures are applied for recognizing the biological tissue materials as the needle is penetrated or for path planning. The deflection of the needle during insertion and tissue material deformation is the main trouble for defined needle placing and efforts have been prepared to model them. Applying existing models numerous insertion methods are established that are discussed in this review.

Study of needle punctures into soft tissue through audio and force sensing: can audio be a simple alternative for needle guidance?

PURPOSE

Percutaneous needle insertion is one of the most common minimally invasive procedures. The clinician's experience and medical imaging support are essential to the procedure's safety. However, imaging comes with inaccuracies due to artifacts, and therefore sensor-based solutions were proposed to improve accuracy. However, sensors are usually embedded in the needle tip, leading to design limitations. A novel concept was proposed for capturing tip-tissue interaction information through audio sensing, showing promising results for needle guidance. This work demonstrates that this audio approach can provide important puncture information by comparing audio and force signal dynamics during insertion.

METHODS

An experimental setup for inserting a needle into soft tissue was prepared. Audio and force signals were synchronously recorded at four different insertion velocities, and a dataset of 200 recordings was acquired. Indicators related to different aspects of the force and audio were compared through signal-to-signal and event-to-event correlation analysis.

RESULTS

High signal-to-signal correlations between force and audio indicators regardless of the insertion velocity were obtained. The force curvature indicator obtained the best correlation performances to audio with more than [Formula: see text] of the correlations higher than 0.6. The event-to-event correlation analysis shows that a puncture event in the force is generally identifiable in audio and that their intensities firmly related.

CONCLUSIONS

Audio contains valuable information for monitoring needle tip/tissue interaction. Significant dynamics obtained from a well-known sensor as force can also be extracted from audio, regardless of insertion velocities.

Psychomotor skills development for Veress needle placement using a virtual reality and haptics-based simulator

Purpose

Veress needle (VN) insertion, if not correctly performed, could cause severe injuries to intra-abdominal organs and vessels. Therefore, cognitive and psychomotor skills training is needed. Virtual reality (VR) and haptic technologies have the potential to offer realistic simulations.

Methods

We developed a novel VR and haptic surgical simulator for VN insertion to teach trainees how to correctly puncture the abdominal wall, experiencing realistic tactile sensations throughout the simulation. The simulator allows for both procedural and realistic training. We released two different versions: the first using the OpenHaptics\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$^{\text {TM}}$$\end{document}TM (OH) Toolkit and the second exploiting CHAI3D. We evaluated the learning effect using different performance indexes (time to perform the procedure, error in insertion angle, number of undesired contacts with organs) in an insertion task for both experienced urologists and students.

Results

A general improvement of the chosen performance indexes was registered in the second repetition of the task for both groups. From the questionnaires, the simulator leveraging OH provides the trainee with a more precise haptic feedback, whereas the one exploiting CHAI3D allows them to perform the procedure more easily thanks to the better visualization of the virtual environment. The results proved that the participants appreciated both implementations, and the System Usability Scale (SUS) test resulted in a “good” usability.

Conclusion

The haptics-based and VR simulator has shown the potential to be an important resource for the basic urological training in obtaining the pneumoperitoneum and improving the acquisition of the necessary psychomotor skills, allowing for extended and more effective training without compromising patient safety.

Analysis of Surgical Forces Required to Gain Access Using a Probe for Minimally Invasive Spine Surgery via Cadaveric-Based Experiments Towards Use in Training Simulators

INTRODUCTION

Virtual Reality haptic-based surgical simulators for training purposes have recently been receiving increased traction within the medical field. However, its future adoption is contingent on the accuracy and reliability of the haptic feedback.

GOAL

This study describes and analyzes the implementation of a set of haptic-tailored experiments to extract the force feedback of a medical probe used in minimally invasive spinal lumbar interbody fusion surgeries.

METHODS

Experiments to extract linear, lateral and rotational insertion, relaxation and extraction of the tool within the spinal muscles, intervertebral discs and lumbar nerve on two cadaveric torsos were conducted.

RESULTS

Notably, mean force-displacement and torque-angular displacement curves describing the different tool-tissue responses were reported with a maximum force of 6.87 (±1.79) N at 40 mm in the muscle and an initial rupture force through the Annulus Fibrosis of 20.550 (±7.841) N at 6.441 mm in the L₄/L₅ disc.

CONCLUSION

The analysis showed that increasing the velocity of the probe slightly reduced and delayed depth of the muscle punctures but significantly lowered the force reduction due to relaxation. Decreasing probe depth resulted with a reduction to the force relaxation drop. However, varying the puncturing angle of attack resulted with a significant effect on increasing force intensities. Finally, not resecting the thoracolumbar fascia prior to puncturing the muscle resulted with a significant increase in the force intensities.

SIGNIFICANCE

These results present a complete characterization of the input required for probe access for spinal surgeries to provide an accurate haptic response in training simulators.