Electromagnetic tracking in medicine--a review of technology, validation, and applications

Ultrasound and x-ray imageable poloxamer-based hydrogel for loco-regional therapy delivery in the liver

Intratumoral injections have the potential for enhanced cancer treatment efficacy while reducing costs and systemic exposure. However, intratumoral drug injections can result in substantial off-target leakage and are invisible under standard imaging modalities like ultrasound (US) and x-ray. A thermosensitive poloxamer-based gel for drug delivery was developed that is visible using x-ray imaging (computed tomography (CT), cone beam CT, fluoroscopy), as well as using US by means of integrating perfluorobutane-filled microbubbles (MBs). MBs content was optimized using tissue mimicking phantoms and ex vivo bovine livers. Gel formulations less than 1% MBs provided gel depositions that were clearly identifiable on US and distinguishable from tissue background and with minimal acoustic artifacts. The cross-sectional areas of gel depositions obtained with US and CT imaging were similar in studies using ex vivo bovine liver and postmortem in situ swine liver. The gel formulation enhanced multimodal image-guided navigation, enabling fusion of ultrasound and x-ray/CT imaging, which may enhance targeting, definition of spatial delivery, and overlap of tumor and gel. Although speculative, such a paradigm for intratumoral drug delivery might streamline clinical workflows, reduce radiation exposure by reliance on US, and boost the precision and accuracy of drug delivery targeting during procedures. Imageable gels may also provide enhanced temporal and spatial control of intratumoral conformal drug delivery.

Design and navigation method of a soft robot for single-port transvesical radical prostatectomy

PURPOSE

Currently, the rigid instruments used for laparoscopic radical resection of prostate cancer not only have the risk of damage to tissues, blood vessels, and nerves, but their limited freedom will also cause surgical blind areas. Soft robots are expected to solve these issues due to inherent flexibility, compliance, and safe interaction with tissues and organs. In addition, to achieve high surgical accuracy and provide precise guidance for surgeons, the navigation method should be studied for the soft robot.

METHODS

A soft robot system for single-port transvesical radical prostatectomy (STRP) is developed, and a navigation method combining fiber Bragg gratings and electromagnetic tracking is proposed for the soft robot. To validate the soft robot design and the effectiveness of the navigation method, different groups of experiments are conducted.

RESULTS

The proposed navigation method can achieve accurate location and shape sensing of the soft manipulator. The experiments show that the maximum tip sensing error is 2.691 mm, which is 5.38 % of the robot length for static configurations, and that the average tip sensing error is 1.966 mm, which corresponds to 3.93 % of the robot length for dynamic scenarios. Additionally, phantom tests demonstrate that the designed soft robot can enter the prostate through navigation guidance in a master-slave control mode and cover the entire prostate space.

CONCLUSIONS

The designed soft robot system, due to its soft structure, good flexibility, and accurate navigation, is expected to improve surgical safety and precision, thereby exhibiting significant potential for STRP.

Wearable technology in vascular surgery: Current applications and future perspectives

The COVID-19 pandemic exposed the vulnerabilities of global health care systems, underscoring the need for innovative solutions to meet the demands of an aging population, workforce shortages, and rising physician burnout. In recent years, wearable technology has helped segue various medical specialties into the digital era, yet its adoption in vascular surgery remains limited. This article explores the applications of wearable devices in vascular surgery and explores their potential outlets, such as enhancing primary and secondary prevention, optimizing perioperative care, and supporting surgical training. The integration of artificial intelligence and machine learning with wearable technology further expands its applications, enabling predictive analytics, personalized care, and remote monitoring. Despite the promising prospects, challenges such as regulatory complexities, data security, and interoperability must be addressed. As the digital health movement unfolds, wearable technology could play a pivotal role in reshaping vascular surgery while offering cost-effective, accessible, and patient-centered care.

Optimal configurations of an electromagnetic tracking system for 3D ultrasound imaging of pediatric hips - A phantom study

Tracking the position and orientation of a two-dimensional (2D) ultrasound scanner to reconstruct a 3D volume is common, and its accuracy is important. In this study, a specific miniaturized electromagnetic (EM) tracking system was selected and integrated with a 2D ultrasound scanner, which was aimed to capture hip displacement in children with cerebral palsy. The objective of this study was to determine the optimum configuration, including the distance between the EM source and sensor, to provide maximum accuracy. The scanning volume was aimed to be 320 mm × 320 mm × 76 mm. The accuracy of the EM tracking was evaluated by comparing its tracking with those from a motion capture camera system. A static experiment showed that a warm-up time of 20 min was needed. The EM system provided the highest precision of 0.07 mm and 0.01° when the distance between the EM source and sensor was 0.65 m. Within the testing volume, the maximum position and rotational errors were 2.31 mm and 1.48°, respectively. The maximum error of measuring hip displacement on the 3D hip phantom study was 4 %. Based on the test results, the tested EM system was suitable for 3D ultrasound imaging of pediatric hips to assess hip displacement when optimal configuration was used.

Distortion-Free Magnetic Tracking of Metal Instruments in Image-Guided Interventions

Electromagnetic tracking (EMT) can benefit image-guided interventions in cases where line of sight is unavailable. However, EMT can suffer from electromagnetic distortion in the presence of metal instruments. Metal instruments are widely used in laparoscopic surgery, ENT surgery, arthroscopy and many other clinical applications. In this work, we investigate the feasibility of tracking such metal instruments by placing the inductive sensor within the instrument shaft. We propose a magnetostatic model of the field within the instrument, and verify the results experimentally for frequencies from 6 kHz to 60 kHz. The impact of the instrument's dimensions, conductivity and transmitting field frequency is quantified for ranges representative of typical metal instruments used in image-guided interventions. We then performed tracking using the open-source Anser EMT system and quantify the error caused by the presence of the rod as a function of the frequency of the eight emitting coils for the system. The work clearly demonstrates why smaller tool diameters (less than 8 mm) are less susceptible to distortion, as well as identifying optimal frequencies (1 kHz to 2 kHz) for transmitter design to minimise for distortion in larger instruments.

Freehand 3D Ultrasound Imaging Based on Probe-mounted Vision and IMU System

OBJECTIVES

Freehand three-dimensional (3D) ultrasound (US) is of great significance for clinical diagnosis and treatment, it is often achieved with the aid of external devices (optical and/or electromagnetic, etc.) that monitor the location and orientation of the US probe. However, this external monitoring is often impacted by imaging environment such as optical occlusions and/or electromagnetic (EM) interference.

METHODS

To address the above issues, we integrated a binocular camera and an inertial measurement unit (IMU) on a US probe. Subsequently, we built a tight coupling model utilizing the unscented Kalman algorithm based on Lie groups (UKF-LG), combining vision and inertial information to infer the probe's movement, through which the position and orientation of the US image frame are calculated. Finally, the volume data was reconstructed with the voxel-based hole-filling method.

RESULTS

The experiments including calibration experiments, tracking performance evaluation, phantom scans, and real scenarios scans have been conducted. The results show that the proposed system achieved the accumulated frame position error of 3.78 mm and the orientation error of 0.36° and reconstructed 3D US images with high quality in both phantom and real scenarios.

CONCLUSIONS

The proposed method has been demonstrated to enhance the robustness and effectiveness of freehand 3D US. Follow-up research will focus on improving the accuracy and stability of multi-sensor fusion to make the system more practical in clinical environments.

Design consideration on integration of mechanical intravascular ultrasound and electromagnetic tracking sensor for intravascular reconstruction

PURPOSE

Considering vessel deformation, endovascular navigation requires intraoperative geometric information. Mechanical intravascular ultrasound (IVUS) with an electromagnetic (EM) sensor can be used to reconstruct blood vessels with thin diameter. However, the integration design should be evaluated based on the factors affecting the reconstruction error.

METHODS

The interference between the mechanical IVUS and EM sensor was measured in different relative positions. Two designs of the integrated catheter were evaluated by measuring the reconstruction errors using a rigid vascular phantom.

RESULTS

When the distance from the EM sensor to the field generator was 75 mm, the interference from mechanical IVUS to an EM sensor was negligible, with position and rotation errors less than 0.1 mm and 0.6°, respectively. The reconstructed vessel model for proximal IVUS transducer had a smooth surface but an inaccurate shape at large curvature of the vascular phantom. When the distance to the field generator was 175 mm, the error increased significantly.

CONCLUSION

Placing the IVUS transducer on the proximal side of the EM sensor is superior in terms of interference reduction but inferior in terms of mechanical stability compared to a distal transducer. The distal side is preferred due to better mechanical stability during catheter manipulation at larger curvature. With this configuration, surface reconstruction errors less than 1.7 mm (with RMS 0.57 mm) were achieved when the distance to the field generator was less than 175 mm.

Medical Microrobots

Scientists around the world have long aimed to produce miniature robots that can be controlled inside the human body to aid doctors in identifying and treating diseases. Such microrobots hold the potential to access hard-to-reach areas of the body through the natural lumina. Wireless access has the potential to overcome drawbacks of systemic therapy, as well as to enable completely new minimally invasive procedures. The aim of this review is fourfold: first, to provide a collection of valuable anatomical and physiological information on the target working environments together with engineering tools for the design of medical microrobots; second, to provide a comprehensive updated survey of the technological state of the art in relevant classes of medical microrobots; third, to analyze currently available tracking and closed-loop control strategies compatible with the in-body environment; and fourth, to explore the challenges still in place, to steer and inspire future research.

Miniaturized electromagnetic tracking enables efficient ultrasound-navigated needle insertions

Ultrasound (US) has gained popularity as a guidance modality for percutaneous needle insertions because it is widely available and non-ionizing. However, coordinating scanning and needle insertion still requires significant experience. Current assistance solutions utilize optical or electromagnetic tracking (EMT) technology directly integrated into the US device or probe. This results in specialized devices or introduces additional hardware, limiting the ergonomics of both the scanning and insertion process. We developed the first ultrasound (US) navigation solution designed to be used as a non-permanent accessory for existing US devices while maintaining the ergonomics during the scanning process. A miniaturized EMT source is reversibly attached to the US probe, temporarily creating a combined modality that provides real-time anatomical imaging and instrument tracking at the same time. Studies performed with 11 clinical operators show that the proposed navigation solution can guide needle insertions with a targeting accuracy of about 5 mm, which is comparable to existing approaches and unaffected by repeated attachment and detachment of the miniaturized tracking solution. The assistance proved particularly helpful for non-expert users and needle insertions performed outside of the US plane. The small size and reversible attachability of the proposed navigation solution promises streamlined integration into the clinical workflow and widespread access to US navigated punctures.

Color VISION for improved ultrasound visualization of brachytherapy needles

BACKGROUND

High dose rate brachytherapy is commonly used in the treatment of prostate cancer. Treatment planning is often performed under transrectal ultrasound (US) guidance, but brachytherapy needles can be challenging to digitize due to the presence of poor US conspicuity and imaging artifacts. The plan accuracy and quality, however, are dependent on the proper visualization of the needles with millimeter accuracy.

PURPOSE

This work describes a technique for generating a color overlay of needle locations atop the grayscale US image. Prototype devices were developed to produce vibrations in the brachytherapy needles that generate a high contrast color Doppler (CD) signal that highlights the needle locations with superior contrast and reduced artifacts. Denoted by the acronym color VISION (Vibrationally Induced Shimmering for Identifying an Object's Nature), the technology has the potential to improve applicator conspicuity and facilitate automated applicator digitization.

METHODS

Three prototype vibrational devices with frequencies between 200-450 Hz were designed in-house and evaluated with needle implants in a phantom and cadaveric male pelvis using: (1) an actuator attached to the front of a prostate needle template; (2) an actuator attached to the top of the needle template; and (3) a hand-held actuator with a stylet, inserted directly into a needle's inner lumen. Acquired images were postprocessed in MATLAB to evaluate the potential for automated digitization.

RESULTS

All prototype devices produced localized shimmering in implanted brachytherapy needles in both the axial and sagittal planes. The template mounted actuators provided better vibrational coupling and ease of operation than the stylet prototype. The Michelson contrast, or visibility, of the shimmering CD signal was 100% compared with ≤40% for B-mode imaging of a single needle. Proof-of-principle for automated applicator digitization using only the CD signal was demonstrated.

CONCLUSIONS

The color VISION prototype devices successfully coupled mechanical vibrations into brachytherapy needles to generate US CD shimmering and accurately highlight brachytherapy needle locations. The high contrast and natively registered signal are promising for future work to automate the needle digitization and provide a real-time visual overlay of the applicator on the B-mode US image.

Implementing an electromagnetic tracking navigation system improves the precision of endoscopic transgastric necrosectomy in an ex vivo model

Endoscopic transgastric necrosectomy is crucial in the management of complications resulting from necrotizing pancreatitis. However, both real-time and visual-spatial information is lacking during the procedure, thereby jeopardizing a precise positioning of the endoscope. We conducted a proof-of-concept study with the aim of overcoming these technical difficulties. For this purpose, a three-dimensional (3D) phantom of a stomach and pancreatic necroses was 3D-printed based on spatial information from individual patient CT scans and subsequently integrated into a silicone torso. An electromagnetic (EM) sensor was adjusted inside the endoscope´s working channel. A software interface enabled real time visualization. The accuracy of this novel assistant system was tested ex vivo by four experienced interventional endoscopists who were supposed to reach seven targets inside the phantom in six different experimental runs of simulated endoscopic transgastric necrosectomy. Supported by endoscopic camera view combined with real-time 3D visualization, all endoscopists reached the targets with a targeting error ranging between 2.6 and 6.5 mm in a maximum of eight minutes. In summary, the EM tracking system might increase efficacy and safety of endoscopic transgastric necrosectomy at the experimental level by enhancing visualization. Yet, a broader feasibility study and further technical improvements are mandatory before aiming at implementation into clinical setting.

A comprehensive quality assurance protocol for electromagnetic tracking in brachytherapy

BACKGROUND

Electromagnetic tracking (EMT) systems have proven to be a valuable source of information regarding the location and geometry of applicators in patients undergoing brachytherapy (BT). As an important element of an enhanced and individualized pre-treatment verification, EMT can play a pivotal role in detecting treatment errors and uncertainties to increase patient safety.

PURPOSE

The purpose of this study is two-fold: to design, develop and test a dedicated measurement protocol for the use of EMT-enabled afterloaders in BT and to collect and compare the data acquired from three different radiation oncology centers in different clinical environments.

METHODS

A novel quality assurance (QA) phantom composed of a scaffold with supports to fix the field generator, different BT applicators, and reference sensors (sensor verification tools) was used to assess the precision (jitter error) and accuracy (relative distance errors and target registration error) of the EMT sensor integrated into an afterloader prototype. Measurements were repeated in different environments where EMT measurements are likely to be performed, namely an electromagnetically clean laboratory, a BT suite, an operating room, and, if available, a CT suite and an MRI suite dedicated to BT.

RESULTS

The mean positional jitter was consistently under 0.1 mm across all measurement points, with a slight trend of increased jitter at greater distances from the field generator. The mean variability of sensor positioning in the tested tandem and ring gynecological applicator was also below 0.1 mm. The tracking accuracy close to the center of the measurement volume was higher than at its edges. The relative distance error at the center was 0.2-0.3 mm with maximum values reaching 1.2-1.8 mm, but up to 5.5 mm for measurement points close to the edges. In general, similar accuracy results were obtained in the clinical environments and in all investigated institutions (median distance error 0.1-0.4 mm, maximum error 1.0-2.0 mm), however, errors were found to be larger in the CT suite (median distance error up to 1.0 mm, maximum error up to 3.6 mm).

CONCLUSION

The presented quality assessment protocol for EMT systems in BT has demonstrated that EMT offers a high-accuracy determination of the applicator/implant geometry even in clinical environments. In addition to that, it has provided valuable insights into the performance of EMT-enabled afterloaders across different radiation oncology centers.

Surgical Navigation in the Anterior Skull Base Using 3-Dimensional Endoscopy and Surface Reconstruction

Importance

Image guidance is an important adjunct for endoscopic sinus and skull base surgery. However, current systems require bulky external tracking equipment, and their use can interrupt efficient surgical workflow.

Objective

To evaluate a trackerless surgical navigation system using 3-dimensional (3D) endoscopy and simultaneous localization and mapping (SLAM) algorithms in the anterior skull base.

Design, Setting, and Participants

This interventional deceased donor cohort study and retrospective clinical case study was conducted at a tertiary academic medical center with human deceased donor specimens and a patient with anterior skull base pathology.

Exposures

Participants underwent endoscopic endonasal transsphenoidal dissection and surface model reconstruction from stereoscopic video with registration to volumetric models segmented from computed tomography (CT) and magnetic resonance imaging.

Main Outcomes and Measures

To assess the fidelity of surface model reconstruction and accuracy of surgical navigation and surface-CT model coregistration, 3 metrics were calculated: reconstruction error, registration error, and localization error.

Results

In deceased donor models (n = 9), high-fidelity surface models of the posterior wall of the sphenoid sinus were reconstructed from stereoscopic video and coregistered to corresponding volumetric CT models. The mean (SD; range) reconstruction, registration, and localization errors were 0.60 (0.24; 0.36-0.93), 1.11 (0.49; 0.71-1.56) and 1.01 (0.17; 0.78-1.25) mm, respectively. In a clinical case study of a patient who underwent a 3D endoscopic endonasal transsphenoidal resection of a tubercular meningioma, a high-fidelity surface model of the posterior wall of the sphenoid was reconstructed from intraoperative stereoscopic video and coregistered to a volumetric preoperative fused CT magnetic resonance imaging model with a root-mean-square error of 1.38 mm.

Conclusions and Relevance

The results of this study suggest that SLAM algorithm-based endoscopic endonasal surgery navigation is a novel, accurate, and trackerless approach to surgical navigation that uses 3D endoscopy and SLAM-based algorithms in lieu of conventional optical or electromagnetic tracking. While multiple challenges remain before clinical readiness, a SLAM algorithm-based endoscopic endonasal surgery navigation system has the potential to improve surgical efficiency, economy of motion, and safety.

Accuracy of an electromagnetic tracking enabled afterloader based on the automated registration with CT phantom images

BACKGROUND

Electromagnetic tracking (EMT) has been researched for brachytherapy applications, showing a great potential for automating implant reconstruction, and overcoming image-based limitations such as contrast and spatial resolution. One of the challenges of this technology is that it does not intrinsically share the same reference frame as the patient's medical imaging.

PURPOSE

To present a novel phantom that can be used for a comprehensive quality assurance (QA) program of brachytherapy EMT systems and use this phantom to validate a novel applicator-based registration method of EMT and image reference frames for gynecological (GYN) interstitial brachytherapy.

MATERIALS AND METHODS

Eleven 6F-catheters (20 cm long), one 6F round tip catheter (29.4 cm long) and a tandem and ring gynecological applicator (Elekta, CT/MR 60°, 40 mm long tandem, 30 mm diameter ring) were placed in a rigid custom-made phantom (Elekta Brachytherapy, Veenendaal, The Netherlands) to reconstruct their geometry using a five-degree of freedom EMT sensor attached to an afterloader's check cable. All EMT reconstructions were done in three different environments: disturbance free (no metal nearby), computed tomography (CT)-on-rails brachytherapy suite and magnetic resonance imaging (MRI) brachytherapy suite. Implants were placed parallel to a magnetic field generatorand were reconstructed using two different acquisition methods: step-and-record and continuous motion. In all cases, the acquisition is performed at a rate of approximately 40 Hz. A CT scan of the phantom inside a water cube was obtained. In the treatment planning system (TPS), all catheters in the CT images were manually reconstructed and the applicator reconstruction was achieved by manually placing its solid 3D model, found in the applicator library of the TPS. The Iterative Closest Point and the Coherent Point Drift algorithms were used, initialized with four known points, to register both EMT and CT scan reference frames using corresponding points from the EMT and CT based reconstructions of the phantom, following three approaches: one gynecological applicator, four interstitial catheters inside four calibration plates having an S-shaped path, and four 5 mm diameter ceramic marbles found in each of the four calibration plates. Once registered, the registration error (perpendicular distance) was computed.

RESULTS

The absolute median deviation from the expected value for EMT measurements in the disturbance free environment, CT-on-rails brachytherapy suite, and MRI-brachytherapy suite are 0.41, 0.23, and 0.31 mm, respectively, while for the CT scan it is 0.18 mm. These values significantly lie below the sensor's expected accuracy of 0.70 mm (p < 0.001), suggesting that the environment did not have a significant impact on the measurements, given that care is taken in the immediate surroundings. In all three environments, the two acquisitions and three registration approaches have mean and median registration errors that lie at or below 1 mm, which is lower than the clinical acceptable threshold of 2 mm.

CONCLUSIONS

The novel phantom allowed to successfully evaluate the accuracy of EMT-based reconstructions of catheters and a GYN tandem and ring applicator in different clinical environments. A registration method based only on the applicator geometry, reconstructed withan EMT sensor and the TPS solid applicator library, was validated and shows clinically acceptable accuracy, comparable to CT-based reconstruction but within a few minutes. Since the applicator is also visible in MRI, this method could potentially be used in clinics in an EMT-MR interstitial GYN brachytherapy workflow.

The influence of the da Vinci surgical robot on electromagnetic tracking in a clinical environment

Robot-assisted surgery is increasingly used in surgery for cancer. Reduced overview and loss of anatomical orientation are challenges that might be solved with image-guided surgical navigation using electromagnetic tracking (EMT). However, the robot's presence may distort the electromagnetic field, affecting EMT accuracy. The aim of this study was to evaluate the robot's influence on EMT accuracy. For this purpose, two different electromagnetic field generators were used inside a clinical surgical environment: a table top field generator (TTFG) and a planar field generator (PFG). The position and orientation of sensors within the electromagnetic field were measured using an accurate in-house developed 3D board. Baseline accuracy was measured without the robot, followed by stepwise introduction of potential distortion sources (robot and robotic instruments). The absolute accuracy was determined within the entire 3D board and in the clinical working volume. For the baseline setup, median errors in the entire tracking volume within the 3D board were 0.9 mm and 0.3° (TTFG), and 1.1 mm and 0.4° (PFG). Adding the robot and instruments did not affect the TTFG's position accuracy (p = 0.60), while the PFG's accuracies decreased to 1.5 mm and 0.7° (p < 0.001). For both field generators, when adding robot and instruments, accuracies inside the clinical working volume were higher compared to the entire tracking 3D board volume, 0.7 mm and 0.3° (TTFG), and 1.1 mm and 0.7° (PFG). Introduction of a surgical robot and robotic instruments shows limited distortion of the EMT field, allowing sufficient accuracy for surgical navigation in robotic procedures.

US-guided EM tracked system for HDR brachytherapy: A first in-men randomized study for whole prostate treatment

PURPOSE

An electromagnetic tracking device (EMT) has been integrated in an HDR 3D ultrasound guidance system for prostate HDR. The aim of this study was to compare the efficiency of HDR workflows with and without EM tracking.

METHODS AND MATERIALS

A total of 58 patients with a 15 Gy HDR prostate boost were randomized in two arms and two operation room (OR) procedures using: (1) the EMT investigational device, and (2) the Oncentra prostate system (OCP). OR times were compared for both techniques.

RESULTS

The overall procedure median time was about 20% shorter for EMT (63 min) compared to OCP (79 min). The US acquisition and contouring was longer for OCP compared to EMT (23 min vs. 16 min). The catheter reconstruction's median times were 23 min and 13 min for OCP and EMT respectively. For the automatic reconstruction with EMT, 62% of cases required no or few manual corrections. Using the EM technology in an OR environment was challenging. In some cases, interferences or the stiffness of the stylet introduced errors in the reconstruction of catheters. The last step was the dosimetry with median times of 11 min (OCP) and 15.5 min (EMT). Finally, it was observed that there was no learning curve associated with the introduction of this new technology.

CONCLUSIONS

The EMT device offers an efficient solution for automatic catheter reconstruction for HDR prostate while reducing the possibility of mis-reconstructed catheters caused by issues of visualization in the US images. Because of that, the overall OR times was shorter when using the EMT system.

Enhancing electromagnetic tracking accuracy in medical applications using pre-trained witness sensor distortion models

PURPOSE

Electromagnetic tracking (EMT) accuracy is affected by the presence of surrounding metallic materials. In this work, we propose measuring the magnetic field's variation due to distortion at a witness position to localise the instrument causing distortion based on a pre-trained model and without additional sensors attached to it.

METHODS

Two experiments were performed to demonstrate possible applications of the technique proposed. In the first case, the distortion introduced by an ultrasound (US) probe was characterised and subsequently used to track the probe position on a line. In the second application, the measurement was used to estimate the distance of an interventional fluoroscopy C-arm machine and apply the correct compensation model.

RESULTS

Tracking of the US probe using the proposed method was demonstrated with millimetric accuracy. The distortion created by the C-arm caused errors in the order of centimetres, which were reduced to 1.52 mm RMS after compensation.

CONCLUSIONS

The distortion profile associated with medical equipment was pre-characterised and used in applications such as object tracking and error compensation map selection. In the current study, the movement was limited to one degree of freedom (1 DOF) and simple analytical functions were used to model the magnetic distortion. Future work will explore advanced AI models to extend the method to 6 DOF tracking using multiple witness sensors.

Effectiveness of a vision-based handle trajectory monitoring system in studying robotic suture operation

Data on surgical robots are not openly accessible, limiting further study of the operation trajectory of surgeons' hands. Therefore, a trajectory monitoring system should be developed to examine objective indicators reflecting the characteristic parameters of operations. 20 robotic experts and 20 first-year residents without robotic experience were included in this study. A dry-lab suture task was used to acquire relevant hand performance data. Novices completed training on the simulator and then performed the task, while the expert team completed the task after warm-up. Stitching errors were measured using a visual recognition method. Videos of operations were obtained using the camera array mounted on the robot, and the hand trajectory of the surgeons was reconstructed. The stitching accuracy, robotic control parameters, balance and dexterity parameters, and operation efficiency parameters were compared. Experts had smaller center distance (p < 0.001) and larger proximal distance between the hands (p < 0.001) compared with novices. The path and volume ratios between the left and right hands of novices were larger than those of experts (both p < 0.001) and the total volume of the operation range of experts was smaller (p < 0.001). The surgeon trajectory optical monitoring system is an effective and non-subjective method to distinguish skill differences. This demonstrates the potential of pan-platform use to evaluate task completion and help surgeons improve their robotic learning curve.

Performance assessment of surgical tracking systems based on statistical process control and longitudinal QA

A system for performance assessment and quality assurance (QA) of surgical trackers is reported based on principles of geometric accuracy and statistical process control (SPC) for routine longitudinal testing. A simple QA test phantom was designed, where the number and distribution of registration fiducials was determined drawing from analytical models for target registration error (TRE). A tracker testbed was configured with open-source software for measurement of a TRE-based accuracy metric ε and Jitter (J ). Six trackers were tested: 2 electromagnetic (EM - Aurora); and 4 infrared (IR - 1 Spectra, 1 Vega, and 2 Vicra) - all NDI (Waterloo, ON). Phase I SPC analysis of Shewhart mean (x ¯ ) and standard deviation (s ) determined system control limits. Phase II involved weekly QA of each system for up to 32 weeks and identified Pass, Note, Alert, and Failure action rules. The process permitted QA in <1 min. Phase I control limits were established for all trackers: EM trackers exhibited higher upper control limits than IR trackers in ε (EM: x ¯ ε   ∼ 2.8-3.3 mm, IR: x ¯ ε   ∼ 1.6-2.0 mm) and Jitter (EM: x ¯ jitter   ∼ 0.30-0.33 mm, IR: x ¯ jitter   ∼ 0.08-0.10 mm), and older trackers showed evidence of degradation - e.g. higher Jitter for the older Vicra (p-value < .05). Phase II longitudinal tests yielded 676 outcomes in which a total of 4 Failures were noted - 3 resolved by intervention (metal interference for EM trackers) - and 1 owing to restrictive control limits for a new system (Vega). Weekly tests also yielded 40 Notes and 16 Alerts - each spontaneously resolved in subsequent monitoring.

A scintillation dosimeter with real-time positional tracking information for in vivo dosimetry error detection in HDR brachytherapy

PURPOSE

To evaluate the performance of an electromagnetic (EM)-tracked scintillation dosimeter in detecting source positional errors of IVD in HDR brachytherapy treatment.

MATERIALS AND METHODS

Two different scintillator dosimeter prototypes were coupled to 5 degrees-of-freedom (DOF) EM sensors read by an Aurora V3 system. The scintillators used were a 0.3 × 0.4 × 0.4 mm3 ZnSe:O and a BCF-60 plastic scintillator of 0.5 mm diameter and 2.0 mm in length (Saint-Gobain Crystals). The sensors were placed at the dosimeter's tip at 20.0 mm from the scintillator. The EM sampling rate was 40/s while the scintillator signal was sampled at 100 000/s using two photomultiplier tubes from Hamamatsu (series H10722) connected to a data acquisition board. A high-pass filter and a low-pass filter were used to separate the light signal into two different channels. All measurements were performed with an afterloader unit (Flexitron-Elekta AB, Sweden) in full-scattered (TG43) conditions. EM tracking was further used to provide distance/angle-dependent energy correction for the ZnSe:O inorganic scintillator. For the error detection part, lateral shifts of 0.5 to 3 mm were induced by moving the source away from its planned position. Indexer length (longitudinal) errors between 0.5 to 10 mm were also introduced. The measured dose rate difference was converted to a shift distance, with and without using the positional information from the EM sensor.

RESULTS

The inorganic scintillator had both a signal-to-noise-ratio (SNR) and signal-to-background-ratio (SBR) close to 70 times higher than those of the plastic scintillator. The mean absolute difference from the dose measurement to the dose calculated with TG-43U1 was 1.5% ±0.7%. The mean absolute error for BCF-60 detector was 1.7%± 1.2 % $\pm 1.2\%$ when compared to TG-43 calculations formalism. With the inorganic scintillator and EM tracking, a maximum area under the curve (AUC) gain of 24.0% was obtained for a 0.5-mm lateral shift when using the EMT data with the ZnSe:O. Lower AUC gains were obtained for a 3-mm lateral shifts with both scintillators. For the plastic scintillator, the highest gain from using EM tracking information occurred for a 0.5-mm lateral shift at 20 mm from the source. The maximal gain (17.4%) for longitudinal errors was found at the smallest shifts (0.5 mm).

CONCLUSIONS

This work demonstrates that integrating EM tracking to in vivo scintillation dosimeters enables the detection of smaller shifts, by decreasing the dosimeter positioning uncertainty. It also serves to perform position-dependent energy correction for the inorganic scintillator,providing better SNR and SBR, allowing detection of errors at greater distances from the source.

A Novel Spatial Position Prediction Navigation System Makes Surgery More Accurate

During intravascular interventional surgery, the 3D surgical navigation system can provide doctors with 3D spatial information of the vascular lumen, reducing the impact of missing dimension caused by digital subtraction angiography (DSA) guidance and further improving the success rate of surgeries. Nevertheless, this task often comes with the challenge of complex registration problems due to vessel deformation caused by respiratory motion and high requirements for the surgical environment because of the dependence on external electromagnetic sensors. This article proposes a novel 3D spatial predictive positioning navigation (SPPN) technique to predict the real-time tip position of surgical instruments. In the first stage, we propose a trajectory prediction algorithm integrated with instrumental morphological constraints to generate the initial trajectory. Then, a novel hybrid physical model is designed to estimate the trajectory's energy and mechanics. In the second stage, a point cloud clustering algorithm applies multi-information fusion to generate the maximum probability endpoint cloud. Then, an energy-weighted probability density function is introduced using statistical analysis to achieve the prediction of the 3D spatial location of instrument endpoints. Extensive experiments are conducted on 3D-printed human artery and vein models based on a high-precision electromagnetic tracking system. Experimental results demonstrate the outstanding performance of our method, reaching 98.2% of the achievement ratio and less than 3 mm of the average positioning accuracy. This work is the first 3D surgical navigation algorithm that entirely relies on vascular interventional robot sensors, effectively improving the accuracy of interventional surgery and making it more accessible for primary surgeons.

The CathPilot: Performance Validation and Preclinical Safety and Feasibility Assessment

OBJECTIVES

Peripheral endovascular revascularization procedures often fail due to technical limitations of guidewire support, steering, and visualization. The novel CathPilot catheter aims to address these challenges. This study assesses the safety and feasibility of the CathPilot and compares its performance to conventional catheters for peripheral vascular interventions.

METHODS

The study compared the CathPilot to non-steerable and steerable catheters. The success rates and access times for a relevant target inside a tortuous vessel phantom model were assessed. The reachable workspace within the vessel and the guidewire's force delivery capabilities were also evaluated. To validate the technology, chronic total occlusion tissue samples were used ex vivo to compare crossing success rates with conventional catheters. Finally, in vivo experiments in a porcine aorta were conducted to evaluate safety and feasibility.

RESULTS

The success rates for reaching the set targets were 31%, 69%, and 100% with the non-steerable catheter, the steerable catheter, and the CathPilot, respectively. CathPilot had a significantly larger reachable workspace, and allowed for up to four times higher force delivery and pushability. In crossing of chronic total occlusion samples, the CathPilot achieved a success rate of 83% and 100%, for fresh and fixed lesions respectively, which was also significantly higher than conventional catheters. The device was fully functional in the in vivo study, and there were no signs of coagulation or damage to the vessel wall.

CONCLUSION

This study shows the safety and feasibility of the CathPilot system and its potential to reduce failure and complication rates in peripheral vascular interventions. The novel catheter outperformed conventional catheters in all defined metrics. This technology can potentially improve the success rate and outcome of peripheral endovascular revascularization procedures.

An improved camera model for oblique-viewing laparoscopes: high reprojection accuracy independent of telescope rotation

Objective. Oblique-viewing laparoscopes are popular in laparoscopic surgeries where the target anatomy is located in narrow areas. Their viewing direction can be shifted by telescope rotation without changing the laparoscope pose. This rotation also changes laparoscope camera parameters that are estimated by camera calibration to be able to reproject an anatomical model onto the laparoscopic view, creating augmented reality (AR). The aim of this study was to develop a camera model that accounts for these changes, achieving high reprojection accuracy for any telescope rotation.Approach. Camera parameters were acquired by calibrations encompassing a wide telescope rotation range. For those parameters showing periodic changes upon rotation, interpolation models were created and used to establish an updatable camera model. With this model, corner points of a tracked checkerboard were reprojected onto the checkerboard laparoscopic images, at random rotation angles. Root-mean-square reprojection errors (RMSEs) were calculated between the reprojected and imaged corner points.Main results. Reprojection RMSEs were low and approximately independent on telescope rotation angle, over a wide rotation range of 320°. The mean reprojection RMSE was 2.8±0.7 pixels for a conventional laparoscope and 3.6±0.7 pixels for a chip-on-the-tip (COTT) laparoscope, corresponding to 0.3±0.1 mm and 0.4±0.1 mm in world coordinates respectively. Worst-case reprojection errors were about 9 pixels (0.8 mm) for both laparoscopes.Significance. The camera model developed in this study improves on existing models for oblique-viewing laparoscopes because it provides high reprojection accuracy independent of the telescope rotation angle and is applicable for conventional and chip-on-a-tip oblique-viewing laparoscopes. The work presented here is an important step towards creating accurate AR in image-guided interventions where oblique-viewing laparoscopes are used while simultaneously providing the surgeon the flexibility to rotate the telescope to any desired rotation angle.Acronyms. CC: camera coordinates; CCToolbox: camera calibration toolbox; COTT: chip-on-the-tip; CS: camera sensor; DD: decentering distortion; FL: focal length; OTS: optical tracking system; PP: principal point; RD: radial distortion; SI: supplementary information;tHE:hand-eye translation component.

Localization of reference points in electromagnetic tracking data and their application for treatment error detection in interstitial breast brachytherapy

BACKGROUND

Electromagnetic tracking (EMT) is a promising technology that holds great potential to advance patient-specific pre-treatment verification in interstitial brachytherapy (iBT). It allows easy determination of the implant geometry without line-of-sight restrictions and without dose exposure to the patient. What it cannot provide, however, is a link to anatomical landmarks, such as the exit points of catheters or needles on the skin surface. These landmarks are required for the registration of EMT data with other imaging modalities and for the detection of treatment errors such as incorrect indexer lengths, and catheter or needle shifts.

PURPOSE

To develop an easily applicable method to detect reference points in the positional data of the trajectory of an EMT sensor, specifically the exit points of catheters in breast iBT, and to apply the approach to pre-treatment error detection.

METHODS

Small metal objects were attached to catheter fixation buttons that rest against the breast surface to intentionally induce a local, spatially limited perturbation of the magnetic field on which the working principle of EMT relies. This perturbation can be sensed by the EMT sensor as it passes by, allowing it to localize the metal object and thus the catheter exit point. For the proof-of-concept, different small metal objects (magnets, washers, and bushes) and EMT sensor drive speeds were used to find the optimal parameters. The approach was then applied to treatment error detection and validated in-vitro on a phantom. Lastly, the in-vivo feasibility of the approach was tested on a patient cohort of four patients to assess the impact on the clinical workflow.

RESULTS

All investigated metal objects were able to measurably perturb the magnetic field, which resulted in missing sensor readings, that is two data gaps, one for the sensor moving towards the tip end and one when retracting from there. The size of the resulting data gaps varied depending on the choice of gap points used for calculation of the gap size; it was found that the start points of the gaps in both directions showed the smallest variability. The median size of data gaps was ⩽8 mm for all tested materials and sensor drive speeds. The variability of the determined object position was ⩽0.5 mm at a speed of 1.0 cm/s and ⩽0.7 mm at 2.5 cm/s, with an increase up to 2.3 mm at 5.0 cm/s. The in-vitro validation of the error detection yielded a 100% detection rate for catheter shifts of ≥2.2 mm. All simulated wrong indexer lengths were correctly identified. The in-vivo feasibility assessment showed that the metal objects did not interfere with the routine clinical workflow.

CONCLUSIONS

The developed approach was able to successfully detect reference points in EMT data, which can be used for registration to other imaging modalities, but also for treatment error detection. It can thus advance the automation of patient-specific, pre-treatment quality assurance in iBT.

A novel approach to wireless electromagnetic tracking using frequency modulation radio communication

PURPOSE

Electromagnetic tracking (EMT) is beneficial in image-guided interventions to reduce the use of ionising radiation-based imaging techniques. Enabling wirelessly tracked sensors will increase the usability of these systems for catheter tracking and patient registration systems. This work introduces a novel method of wirelessly transmitting sensor data using a frequency modulation (FM) radio.

METHODS

The proposed technique was tested using the open-source Anser EMT system. An electromagnetic sensor was connected in parallel to an FM transmitter prototype and wired directly to the Anser system for comparison. The performance of the FM transmitter was evaluated on a grid of 125 test points using an optical tracking system as a gold standard.

RESULTS

An average position accuracy of 1.61 ± 0.68 mm and angular rotation accuracy of 0.04° for the FM transmitted sensor signal was obtained over a 30 cm × 30 cm × 30 cm volume, in comparison with the 1.14 ± 0.80 mm, 0.04° accuracy previously reported for the Anser system. The FM transmitted sensor signal had an average resolved position precision of 0.95 mm while the directly wired signal was found to have an average precision of 1.09 mm. A very low frequency (∼ 5 mHz) oscillation in the wirelessly transmitted signal was observed and compensated for by performing a dynamic scaling of the magnetic field model used for solving the sensor pose.

CONCLUSIONS

We demonstrate that FM transmission of an electromagnetic sensor signal can be used to achieve similar tracking performance to a wired sensor. FM transmission for wireless EMT is a viable alternative to digital sampling and transmission over Bluetooth. Future work will create an integrated wireless sensor node using FM communication that is compatible with existing EMT systems.

Estimating follow-up CTs from geometric deformations of catheter implants in interstitial breast brachytherapy: A feasibility study using electromagnetic tracking

BACKGROUND

Electromagnetic tracking (EMT) systems have been shown to provide valuable information on the geometry of catheter implants in breast cancer patients undergoing interstitial brachytherapy (iBT). In the context of an extended patient-specific, pre-treatment verification, EMT can play a key role in determining the potential need and, if applicable, the appropriate time for treatment adaptation. To detect dosimetric shortcomings the relative position between catheters, and target volume and critical structures must be known. Since EMT cannot provide the anatomical context and standard imaging techniques such as cone-beam CT are not yet available in most brachytherapy suites, it is not possible to detect anatomic changes on a daily or fraction basis, so the need for adaptive planning cannot be identified.

PURPOSE

The aim of this feasibility study is to develop and evaluate a technique capable of estimating follow-up CTs at any time based on the initial treatment planning CT (PCT) and surrogate information about changes of the implant geometry from an EMT system.

METHODS

A deformation vector field is calculated from two different implant reconstructions acquired in treatment position through EMT, the first immediately after the PCT and the second at another time point during the course of treatment. The calculation is based on discrete displacement vectors of pairs of control and target points. These are extrapolated by means of different radial basis functions in order to cover the entire CT volume. The adequate parameters for the calculation of the deformation field were identified. By warping the PCT according to the deformation field, one obtains an estimated CT (ECT) that reflects the geometric changes. For the proof of concept, ECTs were computed for the time point of the clinical follow-up CT (FCT) that is embedded in the treatment workflow after the fourth fraction.

RESULTS

ECT and clinical FCTs of 20 patients were compared to each other quantitatively in terms of absolute Hounsfield unit differences in the planning target volume (PTV) and in a convex hull (CH) enclosing the catheters. The median differences were 31.2  and 29.5 HU for the CH and the PTV, respectively.

CONCLUSION

The proposed ECT approach was able to approximate the "anatomy of the day" and therefore, in principle, allows a dosimetric appraisal of the treatment plan quality before each fraction. In this way, it can contribute to a more detailed patient-specific quality assurance in iBT of the breast and help to identify the timing for a potential treatment adaptation.

Inertial Measurement Unit-Assisted Ultrasonic Tracking System for Ultrasound Probe Localization

Ultrasonic tracking is a promising technique in indoor object localization. However, limited success has been reported in dynamic orientational and positional ultrasonic tracking for ultrasound (US) probes due to its instability and relatively low accuracy. This article aims at developing an inertial measurement unit (IMU)-assisted ultrasonic tracking system that enables a high accuracy positional and orientational localization. The system was designed with the acoustic pressure field simulation of the transmitter, receiver configuration, position-variant error simulation, and sensor fusion. The prototype was tested in a tracking volume required in typical obstetric sonography within the typical operation speed ranges (slow mode and fast mode) of US probe movement. The performance in two different speed ranges was evaluated against a commercial optical tracking device. The results show that the proposed IMU-assisted US tracking system achieved centimeter-level positional tracking accuracy with the mean absolute error (MAE) of 12 mm and the MAE of orientational tracking was less than 1°. The results indicate the possibility of implementing the IMU-assisted ultrasonic tracking system in US probe localization.

Design and Fabrication of a Fiber Bragg Grating Shape Sensor for Shape Reconstruction of a Continuum Manipulator

Continuum dexterous manipulators (CDMs) are suitable for performing tasks in a constrained environment due to their high dexterity and maneuverability. Despite the inherent advantages of CDMs in minimally invasive surgery, real-time control of CDMs' shape during nonconstant curvature bending is still challenging. This study presents a novel approach for the design and fabrication of a large deflection fiber Bragg grating (FBG) shape sensor embedded within the lumens inside the walls of a CDM with a large instrument channel. The shape sensor consisted of two fibers, each with three FBG nodes. A shape-sensing model was introduced to reconstruct the centerline of the CDM based on FBG wavelengths. Different experiments, including shape sensor tests and CDM shape reconstruction tests, were conducted to assess the overall accuracy of the shape-sensing. The FBG sensor evaluation results revealed the linear curvature-wavelength relationship with the large curvature detection of 0.045 mm and a high wavelength shift of up to 5.50 nm at a 90° bending angle in both the bending directions. The CDM's shape reconstruction experiments in a free environment demonstrated the shape-tracking accuracy of 0.216 ± 0.126 mm for positive/negative deflections. Also, the CDM shape reconstruction error for three cases of bending with obstacles was observed to be 0.436 ± 0.370 mm for the proximal case, 0.485 ± 0.418 mm for the middle case, and 0.312 ± 0.261 mm for the distal case. This study indicates the adequate performance of the FBG sensor and the effectiveness of the model for tracking the shape of the large-deflection CDM with nonconstant-curvature bending for minimally invasive orthopedic applications.

Miniature magneto-mechanical resonators for wireless tracking and sensing

Sensor miniaturization enables applications such as minimally invasive medical procedures or patient monitoring by providing process feedback in situ. Ideally, miniature sensors should be wireless, inexpensive, and allow for remote detection over sufficient distance by an affordable detection system. We analyze the signal strength of wireless sensors theoretically and derive a simple design of high-signal resonant magneto-mechanical sensors featuring volumes below 1 cubic millimeter. As examples, we demonstrate real-time tracking of position and attitude of a flying bee, navigation of a biopsy needle, tracking of a free-flowing marker, and sensing of pressure and temperature, all in unshielded environments. The achieved sensor size, measurement accuracy, and workspace of ~25 centimeters show the potential for a low-cost wireless tracking and sensing platform for medical and nonmedical applications.

3D Visualisation of Navigation Catheters for Endovascular Procedures Using a 3D Hub and Fiber Optic RealShape Technology: Phantom Study Results

Objective

Fiber Optic RealShape (FORS) is a new technology that visualises the full three dimensional (3D) shape of guidewires using an optical fibre embedded in the device. Co-registering FORS guidewires with anatomical images, such as a digital subtraction angiography (DSA), provides anatomical context for navigating these devices during endovascular procedures. The objective of this study was to demonstrate the feasibility and usability of visualising compatible conventional navigation catheters, together with the FORS guidewire, in phantom with a new 3D Hub technology and to understand potential clinical benefits.

Methods

The accuracy of localising the 3D Hub and catheter in relation to the FORS guidewire, was evaluated using a translation stage test setup and a retrospective analysis of prior clinical data. Catheter visualisation accuracy and navigation success was assessed in a phantom study where 15 interventionists navigated devices to three pre-defined targets in an abdominal aortic phantom using an Xray or computed tomography angiography (CTA) roadmap. Additionally, the interventionists were surveyed about the usability and potential benefits of the 3D Hub.

Results

The location of the 3D Hub and catheter along the FORS guidewire was detected correctly 96.59% of the time. During the phantom study, all 15 interventionists successfully reached the target locations 100% of the time and the error in catheter visualisation was 0.69 mm. The interventionists agreed or strongly agreed that the 3D Hub was easy to use and the greatest potential clinical benefit over FORS is in offering interventionists choice over which catheter they used.

Conclusion

This set of studies has shown that FORS guided catheter visualisation, enabled by a 3D Hub, is accurate and easy to use in a phantom setting. Further evaluation is needed to understand the benefits and limitations of the 3D Hub technology during endovascular procedures.

HEX: a safe research framework for hybrid EMT X-ray navigation

PURPOSE

Navigating with continuous X-ray provides visual guidance, but exposes both surgeon and patient to ionizing radiation, which is associated with serious health risks. Interleaving fluoro snapshots with electromagnetic tracking (EMT) potentially minimizes radiation.

METHODS

We propose hybrid EMT + X-ray (HEX), a research framework for navigation with an emphasis on safe experimentation. HEX is based on several hardware and software components that are orchestrated to allow for safe and efficient data acquisition.

RESULTS

In our study, hybrid navigation reduces radiation by [Formula: see text] with cubic, and by [Formula: see text] with linear error compensation while achieving submillimeter accuracy. Training points for compensation can be reduced by half while keeping a similar accuracy-radiation trade-off.

CONCLUSION

The HEX framework allows to safely and efficiently evaluate the hybrid navigation approach in simulated procedures. Complementing intraoperative X-ray with EMT significantly reduces radiation in the OR, increasing the safety of patients and surgeons.

Tracking and evaluating motion skills in laparoscopy with inertial sensors

BACKGROUND

Analysis of surgical instrument motion is applicable in surgical skill assessment and monitoring of the learning progress in laparoscopy. Current commercial instrument tracking technology (optical or electromagnetic) has specific limitations and is expensive. Therefore, in this study, we apply inexpensive, off-the-shelf inertial sensors to track laparoscopic instruments in a training scenario.

METHODS

We calibrated two laparoscopic instruments to the inertial sensor and investigated its accuracy on a 3D-printed phantom. In a user study during a one-week laparoscopy training course with medical students and physicians, we then documented and compared the training effect in laparoscopic tasks on a commercially available laparoscopy trainer (Laparo Analytic, Laparo Medical Simulators, Wilcza, Poland) and the newly developed tracking setup.

RESULTS

Eighteen participants (twelve medical students and six physicians) participated in the study. The student subgroup showed significantly poorer results for the count of swings (CS) and count of rotations (CR) at the beginning of the training compared to the physician subgroup (p = 0.012 and p = 0.042). After training, the student subgroup showed significant improvements in the rotatory angle sum, CS, and CR (p = 0.025, p = 0.004 and p = 0.024). After training, there were no significant differences between medical students and physicians. There was a strong correlation between the measured learning success (LS) from the data of our inertial measurement unit system (LS_IMU) and the Laparo Analytic (LS_Lap) (Pearson's r = 0.79).

CONCLUSION

In the current study, we observed a good and valid performance of inertial measurement units as a possible tool for instrument tracking and surgical skill assessment. Moreover, we conclude that the sensor can meaningfully examine the learning progress of medical students in an ex-vivo setting.

On electromagnetic head digitization in MEG and EEG

In MEG and EEG studies, the accuracy of the head digitization impacts the co-registration between functional and structural data. The co-registration is one of the major factors that affect the spatial accuracy in MEG/EEG source imaging. Precisely digitized head-surface (scalp) points do not only improve the co-registration but can also deform a template MRI. Such an individualized-template MRI can be used for conductivity modeling in MEG/EEG source imaging if the individual's structural MRI is unavailable. Electromagnetic tracking (EMT) systems (particularly Fastrak, Polhemus Inc., Colchester, VT, USA) have been the most common solution for digitization in MEG and EEG. However, they may occasionally suffer from ambient electromagnetic interference which makes it challenging to achieve (sub-)millimeter digitization accuracy. The current study-(i) evaluated the performance of the Fastrak EMT system under different conditions in MEG/EEG digitization, and (ii) explores the usability of two alternative EMT systems (Aurora, NDI, Waterloo, ON, Canada; Fastrak with a short-range transmitter) for digitization. Tracking fluctuation, digitization accuracy, and robustness of the systems were evaluated in several test cases using test frames and human head models. The performance of the two alternative systems was compared against the Fastrak system. The results showed that the Fastrak system is accurate and robust for MEG/EEG digitization if the recommended operating conditions are met. The Fastrak with the short-range transmitter shows comparatively higher digitization error if digitization is not carried out very close to the transmitter. The study also evinces that the Aurora system can be used for MEG/EEG digitization within a constrained range; however, some modifications would be required to make the system a practical and easy-to-use digitizer. Its real-time error estimation feature can potentially improve digitization accuracy.

Stomach Geometry Reconstruction Using Serosal Transmitting Coils and Magnetic Source Localization

OBJECTIVE

Bioelectric slow waves (SWs) are a key regulator of gastrointestinal motility, and disordered SW activity has been linked to motility disorders. There is currently a lack of practical options for the acquisition of the 3D stomach geometry during research studies when medical imaging is challenging. Accurately recording the geometry of the stomach and co-registering electrode and sensor positions would provide context for in-vivo studies and aid the development of non-invasive methods of gastric SW assessment.

METHODS

A stomach geometry reconstruction method based on the localization of transmitting coils placed on the gastric serosa was developed. The positions and orientations of the coils, which represented boundary points and surface-normal vectors, were estimated using a magnetic source localization algorithm. Coil localization results were then used to generate surface models. The reconstruction method was evaluated against four 3D-printed anatomically realistic human stomach models and applied in a proof of concept in-vivo pig study.

RESULTS

Over ten repeated reconstructions, average Hausdorff distance and average surface-normal vector error values were 4.7 ±0.2 mm and 18.7 ±0.7° for the whole stomach, and 3.6 ±0.2 mm and 14.6 ±0.6° for the corpus. Furthermore, mean intra-array localization error was 1.4 ±1.1 mm for the benchtop experiment and 1.7 ±1.6 mm in-vivo.

CONCLUSION AND SIGNIFICANCE

Results demonstrated that the proposed reconstruction method is accurate and feasible. The stomach models generated by this method, when co-registered with electrode and sensor positions, could enable the investigation and validation of novel inverse analysis techniques.

Location-aware ingestible microdevices for wireless monitoring of gastrointestinal dynamics

Localization and tracking of ingestible microdevices in the gastrointestinal (GI) tract is valuable for the diagnosis and treatment of GI disorders. Such systems require a large field-of-view of tracking, high spatiotemporal resolution, wirelessly operated microdevices and a non-obstructive field generator that is safe to use in practical settings. However, the capabilities of current systems remain limited. Here, we report three dimensional (3D) localization and tracking of wireless ingestible microdevices in the GI tract of large animals in real time and with millimetre-scale resolution. This is achieved by generating 3D magnetic field gradients in the GI field-of-view using high-efficiency planar electromagnetic coils that encode each spatial point with a distinct magnetic field magnitude. The field magnitude is measured and transmitted by the miniaturized, low-power and wireless microdevices to decode their location as they travel through the GI tract. This system could be useful for quantitative assessment of the GI transit-time, precision targeting of therapeutic interventions and minimally invasive procedures.

Visualization, registration and tracking techniques for augmented reality guided surgery: a review

Augmented reality (AR) surgical navigation has developed rapidly in recent years. This paper reviews and analyzes the visualization, registration, and tracking techniques used in AR surgical navigation systems, as well as the application of these AR systems in different surgical fields. The types of AR visualization are divided into two categories ofin situvisualization and nonin situvisualization. The rendering contents of AR visualization are various. The registration methods include manual registration, point-based registration, surface registration, marker-based registration, and calibration-based registration. The tracking methods consist of self-localization, tracking with integrated cameras, external tracking, and hybrid tracking. Moreover, we describe the applications of AR in surgical fields. However, most AR applications were evaluated through model experiments and animal experiments, and there are relatively few clinical experiments, indicating that the current AR navigation methods are still in the early stage of development. Finally, we summarize the contributions and challenges of AR in the surgical fields, as well as the future development trend. Despite the fact that AR-guided surgery has not yet reached clinical maturity, we believe that if the current development trend continues, it will soon reveal its clinical utility.

Calibrated analytical model for magnetic localization of wireless capsule endoscope based on onboard sensing

Wireless capsule endoscopes (WCEs) are pill-sized camera-embedded devices that can provide visualization of the gastrointestinal (GI) tract by capturing and transmitting images to an external receiver. Determination of the exact location of the WCE is crucial for the accurate navigation of the WCE through external guidance, tracking of the GI abnormality, and the treatment of the detected disease. Despite the enormous progress in the real-time tracking of the WCE, a well-calibrated analytical model is still missing for the accurate localization of WCEs by the measurements from different onboard sensing units. In this paper, a well-calibrated analytical model for the magnetic localization of the WCE was established by optimizing the magnetic moment in the magnetic dipole model. The Jacobian-based iterative method was employed to solve the position of the WCE. An error model was established and experimentally verified for the analysis and prediction of the localization errors caused by inaccurate measurements from the magnetic field sensor. The assessment of the real-time localization of the WCE was performed via experimental trials using an external permanent magnet (EPM) mounted on a robotic manipulator and a WCE equipped with a 3-axis magnetic field sensor and an inertial measurement unit (IMU). The localization errors were measured under different translational and rotational motion modes and working spaces. The results showed that the selection of workspace (distance relative to the EPM) could lead to different positioning errors. The proposed magnetic localization method holds great potential for the real-time localization of WCEs when performing complex motions during GI diagnosis.

A pilot study on an electromagnetic tracking system using tunneling magnetoresistance (TMR) sensors applicable to a 4F catheter (1.4 mm in diameter)

PURPOSE

Tracking the position and orientation of a 4F catheter ([Formula: see text] 1.4 mm) is required in superselective intra-arterial chemotherapy (SSIAC). Tunneling magnetoresistance (TMR) sensors, which measure magnetic fields, are promising candidates because the size of the TMR sensor can be less than a few tenths of a millimeter. The purpose of this paper is to prove the feasibility of an EMT system utilizing TMR sensors as magnetometers.

METHODS

Three 1-axis TMR sensors (0.3 mm × 0.3 mm) were packaged on a flexible printed circuit board (PCB) together with an amplifier chip. The PCB was integrated into a 4F catheter. Six field generator coils driven by alternating current (AC) at different frequencies were used. Magnetic field measurement errors were evaluated to assess the effect of electromotive force (EMF) on TMR-based sensing by changing the coils' driving frequencies. The tracking error was also evaluated. As a result, the feasibility of catheter navigation utilizing the EMT system was demonstrated.

RESULTS

There was a positive correlation between the frequency and the magnetic field measurement error using the TMR sensor (R² = 0.999). With magnetic field frequencies less than 603 Hz, the average position and orientation estimation error were 10.1 mm and 2.3 degree, respectively. Under ideal conditions, the average estimation error values were 0.9 mm and 0.3 degree, respectively.

CONCLUSION

The position and orientation errors varied with frequency owing to the induced electromotive force. We should consider the effect of electromotive force on TMR sensor assemblies caused by alternating magnetic fields. An EMT system using TMR sensors was validated, although room for further improvement was identified.

Computational Imaging to Compensate for Soft-Tissue Deformations in Image-Guided Breast Conserving Surgery

OBJECTIVE

During breast conserving surgery (BCS), magnetic resonance (MR) images aligned to accurately display intraoperative lesion locations can offer improved understanding of tumor extent and position relative to breast anatomy. Unfortunately, even under consistent supine conditions, soft tissue deformation compromises image-to-physical alignment and results in positional errors.

METHODS

A finite element inverse modeling technique has been developed to nonrigidly register preoperative supine MR imaging data to the surgical scene for improved localization accuracy during surgery. Registration is driven using sparse data compatible with acquisition during BCS, including corresponding surface fiducials, sparse chest wall contours, and the intra-fiducial skin surface. Deformation predictions were evaluated at surface fiducial locations and subsurface tissue features that were expertly identified and tracked. Among n = 7 different human subjects, an average of 22 ± 3 distributed subsurface targets were analyzed in each breast volume.

RESULTS

The average target registration error (TRE) decreased significantly when comparing rigid registration to this nonrigid approach (10.4 ± 2.3 mm vs 6.3 ± 1.4 mm TRE, respectively). When including a single subsurface feature as additional input data, the TRE significantly improved further (4.2 ± 1.0 mm TRE), and in a region of interest within 15 mm of a mock biopsy clip TRE was 3.9 ± 0.9 mm.

CONCLUSION

These results demonstrate accurate breast deformation estimates based on sparse-data-driven model predictions.

SIGNIFICANCE

The data suggest that a computational imaging approach can account for image-to-surgery shape changes to enhance surgical guidance during BCS.

Automating implant reconstruction in interstitial brachytherapy of the breast: A hybrid approach combining electromagnetic tracking and image segmentation

BACKGROUND AND PURPOSE

To develop a method for automatic reconstruction of catheter implants in interstitial brachytherapy (iBT) of the breast by means of electromagnetic tracking (EMT) with the goal of making treatment planning as time-effective and accurate as possible.

MATERIALS AND METHODS

The implant geometry of 64 patients was recorded using an afterloader prototype with EMT functionality immediately after the planning CT. EMT data were transferred to the CT image space by rigidly registering the catheter fixation buttons as landmarks. To further improve reconstruction accuracy, the EMT reconstruction points were used as starting points to define small regions of interest (ROI) in the CT image. Within these ROIs, the catheter track was segmented in the CT using image processing operations such as thresholding and blob detection, thus refining the reconstruction. The perpendicular distance between the refined EMT implant reconstruction points and the manually reconstructed catheters by an experienced treatment planner was calculated as a measure of their geometric agreement.

RESULTS

Geometrically, the refined EMT based implant reconstruction shows excellent agreement with the manual reconstruction. The median distance across all patients is 0.25 mm and the 95th percentile is 1 mm. Refinement takes approximately 0.5 s per reconstruction point and typically does not exceed 3 min per implant at no user interaction.

CONCLUSION

The refined EMT based implant reconstruction proved to be extremely accurate and fast compared to manual reconstruction. The presented procedure can in principle be easily transferred to clinical routine and therefore has enormous potential to provide significant time savings in iBT treatment planning whilst improving reconstruction accuracy.

Image-guided Raman spectroscopy navigation system to improve transperineal prostate cancer detection. Part 2: in-vivo tumor-targeting using a classification model combining spectral and MRI-radiomics features

SIGNIFICANCE

The diagnosis and treatment of prostate cancer (PCa) are limited by a lack of intraoperative information to accurately target tumors with needles for biopsy and brachytherapy. An innovative image-guidance technique using optical devices could improve the diagnostic yield of biopsy and efficacy of radiotherapy.

AIM

To evaluate the performance of multimodal PCa detection using biomolecular features from in-situ Raman spectroscopy (RS) combined with image-based (radiomics) features from multiparametric magnetic resonance images (mpMRI).

APPROACH

In a prospective pilot clinical study, 18 patients were recruited and underwent high-dose-rate brachytherapy. Multimodality image fusion (preoperative mpMRI with intraoperative transrectal ultrasound) combined with electromagnetic tracking was used to navigate an RS needle in the prostate prior to brachytherapy. This resulting dataset consisted of Raman spectra and co-located radiomics features from mpMRI. Feature selection was performed with the constraint that no more than 10 features were retained overall from a combination of inelastic scattering spectra and radiomics. These features were used to train support vector machine classifiers for PCa detection based on leave-one-patient-out cross-validation.

RESULTS

RS along with biopsy samples were acquired from 47 sites along the insertion trajectory of the fiber-optics needle: 26 were confirmed as benign or grade group = 1, and 21 as grade group &gt;1, according to histopathological reports. The combination of the fingerprint region of the RS and radiomics showed an accuracy of 83% (sensitivity = 81 % and a specificity = 85 % ), outperforming by more than 9% models trained with either spectroscopic or mpMRI data alone. An optimal number of features was identified between 6 and 8 features, which have good potential for discriminating grade group ≥1 / grade group &lt;1 (accuracy = 87 % ) or grade group &gt;1 / grade group ≤1 (accuracy = 91 % ).

CONCLUSIONS

In-situ Raman spectroscopy combined with mpMRI radiomics features can lead to highly accurate PCa detection for improved in-vivo targeting of biopsy sample collection and radiotherapy seed placement.

Bioengineering, augmented reality, and robotic surgery in vascular surgery: A literature review

Biomedical engineering integrates a variety of applied sciences with life sciences to improve human health and reduce the invasiveness of surgical procedures. Technological advances, achieved through biomedical engineering, have contributed to significant improvements in the field of vascular and endovascular surgery. This paper aims to review the most cutting-edge technologies of the last decade involving the use of augmented reality devices and robotic systems in vascular surgery, highlighting benefits and limitations. Accordingly, two distinct literature surveys were conducted through the PubMed database: the first review provides a comprehensive assessment of augmented reality technologies, including the different techniques available for the visualization of virtual content (11 papers revised); the second review collects studies with bioengineering content that highlight the research trend in robotic vascular surgery, excluding works focused only on the clinical use of commercially available robotic systems (15 papers revised). Technological flow is constant and further advances in imaging techniques and hardware components will inevitably bring new tools for a clinical translation of innovative therapeutic strategies in vascular surgery.

3D localization from 2D X-ray projection

PURPOSE

Most cardiology procedures are guided using X-ray (XR) fluoroscopy. However, the projective nature of the XR fluoroscopy does not allow for true depth perception as required for safe and efficient intervention guidance in structural heart diseases. For improving guidance, different methods have been proposed often being radiation-intensive, time-consuming, or expensive. We propose a simple 3D localization method based on a single monoplane XR projection using a co-registered centerline model.

METHODS

The method is based on 3D anatomic surface models and corresponding centerlines generated from preprocedural imaging. After initial co-registration, 2D working points identified in monoplane XR projections are localized in 3D by minimizing the angle between the projection lines of the centerline points and the working points. The accuracy and reliability of the located 3D positions were assessed in 3D using phantom data and in patient data projected to 2D obtained during placement of embolic protection system in interventional procedures.

RESULTS

With the proposed methods, 2D working points identified in monoplane XR could be successfully located in the 3D phantom and in the patient-specific 3D anatomy. Accuracy in the phantom (3D) resulted in 1.6 mm (± 0.8 mm) on average, and 2.7 mm (± 1.3 mm) on average in the patient data (2D).

CONCLUSION

The use of co-registered centerline models allows reliable and accurate 3D localization of devices from a single monoplane XR projection during placement of the embolic protection system in TAVR. The extension to different vascular interventions and combination with automatic methods for device detection and registration might be promising.

Intraoperative compensation of magnetic field distortions for fluoroscopic and electromagnetic hybrid navigation

Purpose

Hybrid navigation is a promising technique which combines the benefits of optical or electromagnetic tracking (EMT) and fluoroscopy imaging. Unfortunately, the fluoroscopy system is a source of metallic distortion for the EMT system. In this work, we present a new method for intraoperative calibration and real-time compensation of dynamic field distortions. The method was tested in the presence of a fluoroscopy C-arm, and sub-millimetre errors were obtained after distortion correction.

Methods

A hybrid navigation scenario was created by combining the open-source electromagnetic tracking system Anser EMT and a commercial fluoroscopy C-arm. The electromagnetic field generator was placed directly on top of the X-ray collimator, which introduced significant field distortion. Magnetic sensors were placed at known positions to capture the magnetic distortion, and virtual magnetic dipole sources were used to model the distortion magnetic field. The accuracy of the compensated EMT model was tested on a grid of test points.

Results

Error reduction was demonstrated from 12.01 to 0.35 mm and from 25.03 to 0.49 mm, for horizontal and vertical sensor orientations, respectively, over a volume of 16 × 16 × 6 cm. It is proposed that such sub-millimetre tracking errors meet the needs of most endoscopic navigation tasks.

Conclusions

We describe a method to model a magnetic field in real time, based on redundant electromagnetic field measurements, and we apply it to compensate for the distortion introduced by a fluoroscopy C-arm. The main limitation of the approach is the requirement for a high number of sensors, with possible occlusion of the operative space. Solutions might come from miniaturisation and wireless sensing.

Snake Robots for Surgical Applications: A Review

Although substantial advancements have been achieved in robot-assisted surgery, the blueprint to existing snake robotics predominantly focuses on the preliminary structural design, control, and human–robot interfaces, with features which have not been particularly explored in the literature. This paper aims to conduct a review of planning and operation concepts of hyper-redundant serpentine robots for surgical use, as well as any future challenges and solutions for better manipulation. Current researchers in the field of the manufacture and navigation of snake robots have faced issues, such as a low dexterity of the end-effectors around delicate organs, state estimation and the lack of depth perception on two-dimensional screens. A wide range of robots have been analysed, such as the i²Snake robot, inspiring the use of force and position feedback, visual servoing and augmented reality (AR). We present the types of actuation methods, robot kinematics, dynamics, sensing, and prospects of AR integration in snake robots, whilst addressing their shortcomings to facilitate the surgeon’s task. For a smoother gait control, validation and optimization algorithms such as deep learning databases are examined to mitigate redundancy in module linkage backlash and accidental self-collision. In essence, we aim to provide an outlook on robot configurations during motion by enhancing their material compositions within anatomical biocompatibility standards.

Dynamical electromagnetic actuation system for microscale manipulation

Electromagnetic actuation systems (EMA) have excelled themselves in microscale manipulation. Yet, the fastened structure of the current systems tethers the controlled workspace. In this paper, a new electromagnetic actuation principle is investigated. The actuator structure consists of a pair of coaxially movable electromagnets integrated to a robotic manipulator. The pair induces a coaxial homogeneous magnetic field or gradient to control the magnitude of the magnetic torque or force by changing the distance between the electromagnets asymmetrically. The robotic manipulator, on the other hand, transports the pair at five degrees of freedom to manipulate a microrobot in 3D space by closed-loop control with integrated vision feedback system. Numerical analyses are performed to investigate the induced electromagnetic field at the symmetrical/asymmetrical configuration of the coaxial pair. Accordingly, a correlation between the magnitude of the magnetic force and the asymmetric distance is obtained for flexible force control. A proof of concept prototype is constructed to validate the proposed actuation principle and evaluate its performance experimentally. The experimental results verify the numerical analysis and show the system applicability of inducing controlled forces on a micro-object in 2D and 3D workspaces at a velocity range of 65 to 157 $\mu$ m/s. Moreover, micromanipulation on a helical route is also demonstrated with an absolute error mean from the reference path of 191 $\mu$ m.