A comprehensive quality assurance protocol for electromagnetic tracking in brachytherapy

BACKGROUND

Electromagnetic tracking (EMT) systems have proven to be a valuable source of information regarding the location and geometry of applicators in patients undergoing brachytherapy (BT). As an important element of an enhanced and individualized pre-treatment verification, EMT can play a pivotal role in detecting treatment errors and uncertainties to increase patient safety.

PURPOSE

The purpose of this study is two-fold: to design, develop and test a dedicated measurement protocol for the use of EMT-enabled afterloaders in BT and to collect and compare the data acquired from three different radiation oncology centers in different clinical environments.

METHODS

A novel quality assurance (QA) phantom composed of a scaffold with supports to fix the field generator, different BT applicators, and reference sensors (sensor verification tools) was used to assess the precision (jitter error) and accuracy (relative distance errors and target registration error) of the EMT sensor integrated into an afterloader prototype. Measurements were repeated in different environments where EMT measurements are likely to be performed, namely an electromagnetically clean laboratory, a BT suite, an operating room, and, if available, a CT suite and an MRI suite dedicated to BT.

RESULTS

The mean positional jitter was consistently under 0.1 mm across all measurement points, with a slight trend of increased jitter at greater distances from the field generator. The mean variability of sensor positioning in the tested tandem and ring gynecological applicator was also below 0.1 mm. The tracking accuracy close to the center of the measurement volume was higher than at its edges. The relative distance error at the center was 0.2-0.3 mm with maximum values reaching 1.2-1.8 mm, but up to 5.5 mm for measurement points close to the edges. In general, similar accuracy results were obtained in the clinical environments and in all investigated institutions (median distance error 0.1-0.4 mm, maximum error 1.0-2.0 mm), however, errors were found to be larger in the CT suite (median distance error up to 1.0 mm, maximum error up to 3.6 mm).

CONCLUSION

The presented quality assessment protocol for EMT systems in BT has demonstrated that EMT offers a high-accuracy determination of the applicator/implant geometry even in clinical environments. In addition to that, it has provided valuable insights into the performance of EMT-enabled afterloaders across different radiation oncology centers.

Accuracy of an electromagnetic tracking enabled afterloader based on the automated registration with CT phantom images

BACKGROUND

Electromagnetic tracking (EMT) has been researched for brachytherapy applications, showing a great potential for automating implant reconstruction, and overcoming image-based limitations such as contrast and spatial resolution. One of the challenges of this technology is that it does not intrinsically share the same reference frame as the patient's medical imaging.

PURPOSE

To present a novel phantom that can be used for a comprehensive quality assurance (QA) program of brachytherapy EMT systems and use this phantom to validate a novel applicator-based registration method of EMT and image reference frames for gynecological (GYN) interstitial brachytherapy.

MATERIALS AND METHODS

Eleven 6F-catheters (20 cm long), one 6F round tip catheter (29.4 cm long) and a tandem and ring gynecological applicator (Elekta, CT/MR 60°, 40 mm long tandem, 30 mm diameter ring) were placed in a rigid custom-made phantom (Elekta Brachytherapy, Veenendaal, The Netherlands) to reconstruct their geometry using a five-degree of freedom EMT sensor attached to an afterloader's check cable. All EMT reconstructions were done in three different environments: disturbance free (no metal nearby), computed tomography (CT)-on-rails brachytherapy suite and magnetic resonance imaging (MRI) brachytherapy suite. Implants were placed parallel to a magnetic field generatorand were reconstructed using two different acquisition methods: step-and-record and continuous motion. In all cases, the acquisition is performed at a rate of approximately 40 Hz. A CT scan of the phantom inside a water cube was obtained. In the treatment planning system (TPS), all catheters in the CT images were manually reconstructed and the applicator reconstruction was achieved by manually placing its solid 3D model, found in the applicator library of the TPS. The Iterative Closest Point and the Coherent Point Drift algorithms were used, initialized with four known points, to register both EMT and CT scan reference frames using corresponding points from the EMT and CT based reconstructions of the phantom, following three approaches: one gynecological applicator, four interstitial catheters inside four calibration plates having an S-shaped path, and four 5 mm diameter ceramic marbles found in each of the four calibration plates. Once registered, the registration error (perpendicular distance) was computed.

RESULTS

The absolute median deviation from the expected value for EMT measurements in the disturbance free environment, CT-on-rails brachytherapy suite, and MRI-brachytherapy suite are 0.41, 0.23, and 0.31 mm, respectively, while for the CT scan it is 0.18 mm. These values significantly lie below the sensor's expected accuracy of 0.70 mm (p < 0.001), suggesting that the environment did not have a significant impact on the measurements, given that care is taken in the immediate surroundings. In all three environments, the two acquisitions and three registration approaches have mean and median registration errors that lie at or below 1 mm, which is lower than the clinical acceptable threshold of 2 mm.

CONCLUSIONS

The novel phantom allowed to successfully evaluate the accuracy of EMT-based reconstructions of catheters and a GYN tandem and ring applicator in different clinical environments. A registration method based only on the applicator geometry, reconstructed withan EMT sensor and the TPS solid applicator library, was validated and shows clinically acceptable accuracy, comparable to CT-based reconstruction but within a few minutes. Since the applicator is also visible in MRI, this method could potentially be used in clinics in an EMT-MR interstitial GYN brachytherapy workflow.

Endovascular navigation in patients: vessel-based registration of electromagnetic tracking to preoperative images

Electromagnetic tracking of instruments combined with preoperative images can supplement fluoroscopy for guiding endovascular aortic repair (EVAR). The aim of this study was to evaluate the in-vivo accuracy of a vessel-based registration algorithm for matching electromagnetically tracked positions of an endovascular instrument to preoperative computed tomography angiography. Five patients undergoing elective EVAR were included, and a clinically available semi-automatic 3D-3D registration algorithm, based on similarity measures computed over the entire image, was used for reference. Accuracy was reported as target registration error (TRE) evaluated in manually selected anatomic landmarks on bony structures, placed close to the volume-of-interest. The median TRE was 8.2 mm (range: 7.1 mm to 16.1 mm) for the vessel-based registration algorithm, compared to 2.2 mm (range: 1.8 mm to 3.7 mm) for the reference algorithm. This illustrates that registration based on intraoperative electromagnetic tracking is feasible, but the accuracy must be improved before clinical use.

A scintillation dosimeter with real-time positional tracking information for in vivo dosimetry error detection in HDR brachytherapy

PURPOSE

To evaluate the performance of an electromagnetic (EM)-tracked scintillation dosimeter in detecting source positional errors of IVD in HDR brachytherapy treatment.

MATERIALS AND METHODS

Two different scintillator dosimeter prototypes were coupled to 5 degrees-of-freedom (DOF) EM sensors read by an Aurora V3 system. The scintillators used were a 0.3 × 0.4 × 0.4 mm3 ZnSe:O and a BCF-60 plastic scintillator of 0.5 mm diameter and 2.0 mm in length (Saint-Gobain Crystals). The sensors were placed at the dosimeter's tip at 20.0 mm from the scintillator. The EM sampling rate was 40/s while the scintillator signal was sampled at 100 000/s using two photomultiplier tubes from Hamamatsu (series H10722) connected to a data acquisition board. A high-pass filter and a low-pass filter were used to separate the light signal into two different channels. All measurements were performed with an afterloader unit (Flexitron-Elekta AB, Sweden) in full-scattered (TG43) conditions. EM tracking was further used to provide distance/angle-dependent energy correction for the ZnSe:O inorganic scintillator. For the error detection part, lateral shifts of 0.5 to 3 mm were induced by moving the source away from its planned position. Indexer length (longitudinal) errors between 0.5 to 10 mm were also introduced. The measured dose rate difference was converted to a shift distance, with and without using the positional information from the EM sensor.

RESULTS

The inorganic scintillator had both a signal-to-noise-ratio (SNR) and signal-to-background-ratio (SBR) close to 70 times higher than those of the plastic scintillator. The mean absolute difference from the dose measurement to the dose calculated with TG-43U1 was 1.5% ±0.7%. The mean absolute error for BCF-60 detector was 1.7%± 1.2 % $\pm 1.2\%$ when compared to TG-43 calculations formalism. With the inorganic scintillator and EM tracking, a maximum area under the curve (AUC) gain of 24.0% was obtained for a 0.5-mm lateral shift when using the EMT data with the ZnSe:O. Lower AUC gains were obtained for a 3-mm lateral shifts with both scintillators. For the plastic scintillator, the highest gain from using EM tracking information occurred for a 0.5-mm lateral shift at 20 mm from the source. The maximal gain (17.4%) for longitudinal errors was found at the smallest shifts (0.5 mm).

CONCLUSIONS

This work demonstrates that integrating EM tracking to in vivo scintillation dosimeters enables the detection of smaller shifts, by decreasing the dosimeter positioning uncertainty. It also serves to perform position-dependent energy correction for the inorganic scintillator,providing better SNR and SBR, allowing detection of errors at greater distances from the source.

ArthroNavi framework: stereo endoscope-guided instrument localization for arthroscopic minimally invasive surgeries

Significance

As an example of a minimally invasive arthroscopic surgical procedure, arthroscopic osteochondral autograft transplantation (OAT) is a common option for repairing focal cartilage defects in the knee joints. Arthroscopic OAT offers considerable benefits to patients, such as less post-operative pain and shorter hospital stays. However, performing OAT arthroscopically is an extremely demanding task because the osteochondral graft harvester must remain perpendicular to the cartilage surface to avoid differences in angulation.

Aim

We present a practical ArthroNavi framework for instrument pose localization by combining a self-developed stereo endoscopy with electromagnetic computation, which equips surgeons with surgical navigation assistance that eases the operational constraints of arthroscopic OAT surgery.

Approach

A prototype of a stereo endoscope specifically fit for a texture-less scene is introduced extensively. Then, the proposed framework employs the semi-global matching algorithm integrating the matching cubes method for real-time processing of the 3D point cloud. To address issues regarding initialization and occlusion, a displaying method based on patient tracking coordinates is proposed for intra-operative robust navigation. A geometrical constraint method that utilizes the 3D point cloud is used to compute a pose for the instrument. Finally, a hemisphere tabulation method is presented for pose accuracy evaluation.

Results

Experimental results show that our endoscope achieves 3D shape measurement with an accuracy of < 730    μ m . The mean error of pose localization is 15.4 deg (range of 10.3 deg to 21.3 deg; standard deviation of 3.08 deg) in our ArthroNavi method, which is within the same order of magnitude as that achieved by experienced surgeons using a freehand technique.

Conclusions

The effectiveness of the proposed ArthroNavi has been validated on a phantom femur. The potential contribution of this framework may provide a new computer-aided option for arthroscopic OAT surgery.

Localization of reference points in electromagnetic tracking data and their application for treatment error detection in interstitial breast brachytherapy

BACKGROUND

Electromagnetic tracking (EMT) is a promising technology that holds great potential to advance patient-specific pre-treatment verification in interstitial brachytherapy (iBT). It allows easy determination of the implant geometry without line-of-sight restrictions and without dose exposure to the patient. What it cannot provide, however, is a link to anatomical landmarks, such as the exit points of catheters or needles on the skin surface. These landmarks are required for the registration of EMT data with other imaging modalities and for the detection of treatment errors such as incorrect indexer lengths, and catheter or needle shifts.

PURPOSE

To develop an easily applicable method to detect reference points in the positional data of the trajectory of an EMT sensor, specifically the exit points of catheters in breast iBT, and to apply the approach to pre-treatment error detection.

METHODS

Small metal objects were attached to catheter fixation buttons that rest against the breast surface to intentionally induce a local, spatially limited perturbation of the magnetic field on which the working principle of EMT relies. This perturbation can be sensed by the EMT sensor as it passes by, allowing it to localize the metal object and thus the catheter exit point. For the proof-of-concept, different small metal objects (magnets, washers, and bushes) and EMT sensor drive speeds were used to find the optimal parameters. The approach was then applied to treatment error detection and validated in-vitro on a phantom. Lastly, the in-vivo feasibility of the approach was tested on a patient cohort of four patients to assess the impact on the clinical workflow.

RESULTS

All investigated metal objects were able to measurably perturb the magnetic field, which resulted in missing sensor readings, that is two data gaps, one for the sensor moving towards the tip end and one when retracting from there. The size of the resulting data gaps varied depending on the choice of gap points used for calculation of the gap size; it was found that the start points of the gaps in both directions showed the smallest variability. The median size of data gaps was ⩽8 mm for all tested materials and sensor drive speeds. The variability of the determined object position was ⩽0.5 mm at a speed of 1.0 cm/s and ⩽0.7 mm at 2.5 cm/s, with an increase up to 2.3 mm at 5.0 cm/s. The in-vitro validation of the error detection yielded a 100% detection rate for catheter shifts of ≥2.2 mm. All simulated wrong indexer lengths were correctly identified. The in-vivo feasibility assessment showed that the metal objects did not interfere with the routine clinical workflow.

CONCLUSIONS

The developed approach was able to successfully detect reference points in EMT data, which can be used for registration to other imaging modalities, but also for treatment error detection. It can thus advance the automation of patient-specific, pre-treatment quality assurance in iBT.

Estimating follow-up CTs from geometric deformations of catheter implants in interstitial breast brachytherapy: A feasibility study using electromagnetic tracking

BACKGROUND

Electromagnetic tracking (EMT) systems have been shown to provide valuable information on the geometry of catheter implants in breast cancer patients undergoing interstitial brachytherapy (iBT). In the context of an extended patient-specific, pre-treatment verification, EMT can play a key role in determining the potential need and, if applicable, the appropriate time for treatment adaptation. To detect dosimetric shortcomings the relative position between catheters, and target volume and critical structures must be known. Since EMT cannot provide the anatomical context and standard imaging techniques such as cone-beam CT are not yet available in most brachytherapy suites, it is not possible to detect anatomic changes on a daily or fraction basis, so the need for adaptive planning cannot be identified.

PURPOSE

The aim of this feasibility study is to develop and evaluate a technique capable of estimating follow-up CTs at any time based on the initial treatment planning CT (PCT) and surrogate information about changes of the implant geometry from an EMT system.

METHODS

A deformation vector field is calculated from two different implant reconstructions acquired in treatment position through EMT, the first immediately after the PCT and the second at another time point during the course of treatment. The calculation is based on discrete displacement vectors of pairs of control and target points. These are extrapolated by means of different radial basis functions in order to cover the entire CT volume. The adequate parameters for the calculation of the deformation field were identified. By warping the PCT according to the deformation field, one obtains an estimated CT (ECT) that reflects the geometric changes. For the proof of concept, ECTs were computed for the time point of the clinical follow-up CT (FCT) that is embedded in the treatment workflow after the fourth fraction.

RESULTS

ECT and clinical FCTs of 20 patients were compared to each other quantitatively in terms of absolute Hounsfield unit differences in the planning target volume (PTV) and in a convex hull (CH) enclosing the catheters. The median differences were 31.2  and 29.5 HU for the CH and the PTV, respectively.

CONCLUSION

The proposed ECT approach was able to approximate the "anatomy of the day" and therefore, in principle, allows a dosimetric appraisal of the treatment plan quality before each fraction. In this way, it can contribute to a more detailed patient-specific quality assurance in iBT of the breast and help to identify the timing for a potential treatment adaptation.

Implementation of the Calypso system: a commissioning experience

Background

The aim of this study was to describe the clinical implementation of the Calypso system with its potential impact on the treatment delivery.

Materials and methods

The influence of the electromagnetic array was investigated on the kilovoltage cone beam computed tomography (kV-CBCT) image quality using the CATPHAN 504 CBCT images. Then, the QFix kVue Calypso couch top and the array attenuation, and their dosimetric influence on the Volumetric modulated arc therapy (VMAT) treatments of prostate was evaluated.

Results

Regarding the image quality, a significant increase of noise (p < 0.01) was detected with the array in place, resulting in a significant decrease in signal noise ratio (SNR) (p < 0.01). No difference in absolute contrast was observed. Finally, there was a significant decrease in contrast noise ratio (CNR) (p < 0.01) even if the deviation was only of 2.5%. For the dosimetric evaluation, the maximum attenuation of the couch was 12.02% and 13.19% for X6 and X6 flattening filter free (FFF), respectively (configuration of rails out). Besides, the mean attenuation of the array was 1.15% and 1.67% for X6 and X6 FFF, respectively. For the VMAT treatment plans, the mean dose was reduced by 0.61% for X6 and by 0.31% for X6 FFF beams when using the electromagnetic array.

Conclusions

The Calypso system does not affect significantly the kV-CBCT image quality and the VMAT plan dose distribution.

Recent Advances in Tracking Devices for Biomedical Ultrasound Imaging Applications

With the rapid advancement of tracking technologies, the applications of tracking systems in ultrasound imaging have expanded across a wide range of fields. In this review article, we discuss the basic tracking principles, system components, performance analyses, as well as the main sources of error for popular tracking technologies that are utilized in ultrasound imaging. In light of the growing demand for object tracking, this article explores both the potential and challenges associated with different tracking technologies applied to various ultrasound imaging applications, including freehand 3D ultrasound imaging, ultrasound image fusion, ultrasound-guided intervention and treatment. Recent development in tracking technology has led to increased accuracy and intuitiveness of ultrasound imaging and navigation with less reliance on operator skills, thereby benefiting the medical diagnosis and treatment. Although commercially available tracking systems are capable of achieving sub-millimeter resolution for positional tracking and sub-degree resolution for orientational tracking, such systems are subject to a number of disadvantages, including high costs and time-consuming calibration procedures. While some emerging tracking technologies are still in the research stage, their potentials have been demonstrated in terms of the compactness, light weight, and easy integration with existing standard or portable ultrasound machines.

Characterization of the Workspace and Limits of Operation of Laser Treatments for Vascular Lesions of the Lower Limbs

The increase of the aging population brings numerous challenges to health and aesthetic segments. Here, the use of laser therapy for dermatology is expected to increase since it allows for non-invasive and infection-free treatments. However, existing laser devices require doctors' manually handling and visually inspecting the skin. As such, the treatment outcome is dependent on the user's expertise, which frequently results in ineffective treatments and side effects. This study aims to determine the workspace and limits of operation of laser treatments for vascular lesions of the lower limbs. The results of this study can be used to develop a robotic-guided technology to help address the aforementioned problems. Specifically, workspace and limits of operation were studied in eight vascular laser treatments. For it, an electromagnetic tracking system was used to collect the real-time positioning of the laser during the treatments. The computed average workspace length, height, and width were 0.84 ± 0.15, 0.41 ± 0.06, and 0.78 ± 0.16 m, respectively. This corresponds to an average volume of treatment of 0.277 ± 0.093 m³. The average treatment time was 23.2 ± 10.2 min, with an average laser orientation of 40.6 ± 5.6 degrees. Additionally, the average velocities of 0.124 ± 0.103 m/s and 31.5 + 25.4 deg/s were measured. This knowledge characterizes the vascular laser treatment workspace and limits of operation, which may ease the understanding for future robotic system development.

Femoral derotation osteotomy-Does intraoperative electromagnetic tracking reflect the dynamic outcome?

Femoral derotation osteotomy (FDO) is a well-established procedure for the correction of internal rotation gait in children with cerebral palsy. Various studies have demonstrated good results for FDO both in short-term and long-term evaluation with some describing recurrence and over- or under-corrections. The present study evaluates the use of an objective intraoperative derotation measurement through electromagnetic tracking. We report the static and dynamic results of 11 cases with internal rotation gait (8 male, 3 female, mean age 22.2 years), that underwent FDO with intraoperative electromagnetic tracking and conventional goniometric measurement of the correction. The dynamic and static changes were assessed through three-dimensional gait analysis after a mean of 12 months after surgery and rotational imaging preoperative and after a mean of eleven days postoperatively. Mean hip rotation in stance significantly decreased from 20.9° (SD 5.9) to 5.8° (SD 4.7°) after FDO. The mean amount of derotation quantified by electromagnetic tracking was 23.2° (16.5°-28.8°) and 25.1° (20.0°-33.0°) for goniometric measurement. Both measurement modalities showed small differences to rotational imaging (electromagnetic bone tracking [EMT]: 0.72°; goniometer: 1.19°) but a large deviation when compared to three-dimensional gait analysis (EMT: 8.5°, goniometer: 9.1°). In comparison to the static changes and EMT measurement, the dynamic changes measured during 3-D-gait analysis reflected only 66% of the actual derotation performed during surgery. Although electromagnetic tracking allows a precise intraoperative assessment of the derotation during FDO, the amount of intraoperative correction is not reflected in the improvements in three-dimensional gait analysis.

Influence and compensation of patient motion in electromagnetic tracking based quality assurance in interstitial brachytherapy of the breast

PURPOSE

Electromagnetic tracking (EMT) is a versatile and viable technique for various quality assurance (QA) tasks in interstitial brachytherapy (iBT). As the duration of EMT measurements in iBT is on the order of minutes, they can be strongly affected by patient motion, especially breathing, which gives rise to motion artefacts. Since the centrepiece of EMT related QA in iBT is to assess the geometry of the iBT implant or applicator, the absence of adequate motion compensation techniques could impede the use of EMT for QA purposes. A common way to compensate for this is to reference the data to either external or internal reference sensors (ERS, IRS) which are fixated on the patient's body or inside the applicator and therefore move with the patient. The purpose of the presented study is to provide a quantitative and in-depth analysis on the use of reference sensors for motion compensation.

METHODS

First, the need for adequate motion compensation is identified both qualitatively and quantitatively using a phantom subjected to simulated breathing motion. An evaluation routine is developed to assess the influence of motion compensation using reference sensors on the acquired EMT data. The evaluation metric is based on the observed displacement of the EMT sensor from its mean position while dwelling at a dwell position (DP) for a dwell time of 1 s. After that the routine is applied to a cohort of 54 breast cancer patients treated with iBT and the quality of an ERS based compensation approach is assessed. In a subgroup of four patients, an IRS is inserted into the iBT implant and IRS based compensation is compared to the ERS based approach. Moreover, a correlation analysis of the ERS and IRS approach is performed, also including respiratory signals derived from the trajectories of the different reference sensors.

RESULTS

It was found that motion compensation with ERS effectively reduced the mean sensor displacement per DP to median values as low as 0.11 mm in both phantom and patient measurements, which is below the precision of the EMT system (0.48 mm). Compensation using the IRS yielded comparable results and was as good as compensation with ERS. The results obtained from both approaches showed a strong correlation. Also the respiratory signals calculated from the different reference sensors were well correlated in most cases.

CONCLUSION

These results indicate that motion compensation with ERS can effectively remove motion artefacts in EMT data. While compensation with an IRS leads to comparable results, the IRS occupies one catheter whose geometry hence cannot be assessed. The use of ERS has proven to be both effective and practical in clinical routine. This article is protected by copyright. All rights reserved.

A method for measuring in vivo finger kinematics using electromagnetic tracking

Accurate in vivo measurement of finger joint kinematics is important for evaluation of treatment methods, implant designs, and for the development and validation of computer models of the hand. The main objective of this project was to develop a standardized finger kinematic measurement system employing electromagnetic (EM) tracking to measure in vivo finger motion pathways. A landmark digitization protocol was developed and used in vivo, in a biomechanical study using EM trackers secured to the finger segments. In vivo results for finger flexion/extension showed no significant differences between EM and goniometer results, 5°±3°; p = 0.735.

Surgical navigation for challenging recurrent or pretreated intra-abdominal and pelvic soft tissue sarcomas

BACKGROUND

This study assessed whether electromagnetic navigation can be of added value during resection of recurrent or post-therapy intra-abdominal/pelvic soft tissue sarcomas (STS) in challenging locations.

MATERIALS AND METHODS

Patients were included in a prospective navigation study. A pre-operatively 3D roadmap was made and tracked using electromagnetic reference markers. During the operation, an electromagnetic pointer was used for the localization of the tumor/critical anatomical structures. The primary endpoint was feasibility, secondary outcomes were safety and usability.

RESULTS

Nine patients with a total of 12 tumors were included, 7 patients with locally recurrent sarcoma. Three patients received neoadjuvant radiotherapy and three other patients received neoadjuvant systemic treatment. The median tumor size was 4.6 cm (2.4-10.4). The majority of distances from tumor to critical anatomical structures was <0.5 cm. The tumors were localized using the navigation system without technical or safety issues. Despite the challenging nature of these resections, 89% were R0 resections, with a median blood loss of 100 ml (20-1050) and one incident of vascular damage. Based on the survey, surgeons stated navigation resulted in shorter surgery time and made the resections easier.

CONCLUSION

Electromagnetic navigation facilitates resections of challenging lower intra-abdominal/pelvic STS and might be of added value.

Performance of an enhanced afterloader with electromagnetic tracking capabilities for channel reconstruction and error detection

PURPOSE

To assess catheter reconstruction and error detection performance of an afterloader (Elekta Brachytherapy, Veenendaal, The Netherlands) equipped with electromagnetic (EM) tracking capabilities.

MATERIALS/METHODS

The Flexitron research unit used was equipped with a special check cable integrating an EM sensor (NDI Aurora V3) that enables tracking and reconstruction capability. The reconstructions of a 24-cm long catheter were performed using two methods: continuous fixed-speed check cable backward stepping (at 1, 2.5, 5, 10, 25 and 50 cm/s) and stepping through each dwell position every 1 mm. The ability of the system to differentiate between two closely located (parallel) catheters was investigated by connecting catheters to the afterloader and moving it from its axis with an increment of 1 mm. A robotic arm (Meca500, Mecademic, Montreal) with an accuracy of 0.01 mm was used to move the catheter between each reconstruction. Reconstructions were obtained with a locally weighted scatterplot smoothing algorithm. To quantify the reconstruction accuracy, distances between two catheters were computed along the reconstruction track with a 5 mm step. The reconstructions of curve catheter paths were assessed through parallel and perpendicular phantom configuration to the EM field generator. Indexer length and lateral errors were simulated and a ROC analysis was made.

RESULTS

Using a 50 cm/s check cable speed does not allow for accurate reconstructions. A slower check cable speed results in better reconstruction performance and smaller standard deviations. At 1 cm/s, a catheter can be shifted laterally down to 1 mm and all paths can be uniquely identified. The optimum operating distance from the field generator (50 to 300 mm) resulted in a lower absolute mean deviation from the expected value (0.2 ± 0.1 mm) versus being positioned on the edge of the electromagnetic sensitive detection volume (0.6 ±0.3 mm). The reconstructions of curved catheters with a check cable speed under 5 cm/s gave a 0.8 mm ±0.3 mm error, or better. All indexer and lateral shifts of 1 mm were detected with a check cable speed of 2.5 cm/s or lower.

CONCLUSIONS

The EM-equipped Flexitron afterloader is able to track and reconstruct catheters with high accuracy. A speed under 5 cm/s is recommended for straight and curved catheter reconstructions. It allows catheter identification down to 1 mm inter-catheter distance shift. The check cable can also be used to detect common shift errors.

Visual-electromagnetic system: A novel fusion-based monocular localization, reconstruction, and measurement for flexible ureteroscopy

BACKGROUND

During flexible ureteroscopy (FURS), surgeons may lose orientation due to intrarenal structural similarities and complex shape of the pyelocaliceal cavity. Decision-making required after initially misjudging stone size will also increase the operative time and risk of severe complications.

METHODS

A intraoperative navigation system based on electromagnetic tracking (EMT) and simultaneous localization and mapping (SLAM) was proposed to track the tip of the ureteroscope and reconstruct a dense intrarenal three-dimensional (3D) map. Furthermore, the contour lines of stones were segmented to measure the size.

RESULTS

Our system was evaluated on a kidney phantom, achieving an absolute trajectory accuracy root mean square error (RMSE) of 0.6 mm. The median error of the longitudinal and transversal measurements was 0.061 and 0.074 mm, respectively. The in vivo experiment also demonstrated the effectiveness.

CONCLUSION

The proposed system worked effectively in tracking and measurement. Further, this system can be extended to other surgical applications involving cavities, branches and intelligent robotic surgery.

A Radiolucent Electromagnetic Tracking System for Use with Intraoperative X-ray Imaging

In recent times, the use of electromagnetic tracking for navigation in surgery has quickly become a vital tool in minimally invasive surgery. In many procedures, electromagnetic tracking is used in tandem with X-ray technology to track a variety of tools and instruments. Most commercially available EM tracking systems can cause X-ray artifacts and attenuation due to their construction and the metals that form them. In this work, we provide a novel solution to this problem by creating a new radiolucent electromagnetic navigation system that has minimal impact on -ray imaging systems. This is a continuation of our previous work where we showed the development of the Anser open-source electromagnetic tracking system. Typical electromagnetic tracking systems operate by generating low frequency magnetic fields from coils that are located near the patient. These coils are typically made from copper, steel, and other dense radiopaque materials. In this work, we explore the use of low density aluminum to create these coils and we demonstrate that the effect on X-ray images is significantly reduced as a result of these novel changes in the materials used. The resulting field generator is shown to give at least a 60% reduction in the X-ray attenuation in comparison to our earlier designs. We verify that the system accuracy of approximately 1.5 mm RMS error is maintained with this change in design.

Planar Body-Mounted Sensors for Electromagnetic Tracking

Electromagnetic tracking is a safe, reliable, and cost-effective method to track medical instruments in image-guided surgical navigation. However, patient motion and magnetic field distortions heavily impact the accuracy of tracked position and orientation. The use of redundant magnetic sensors can help to map and mitigate for patient movements and magnetic field distortions within the tracking region. We propose a planar inductive sensor design, printed on PCB and embedded into medical patches. The main advantage is the high repeatability and the cost benefit of using mass PCB manufacturing processes. The article presents new operative formulas for electromagnetic tracking of planar coils on the centimetre scale. The full magnetic analytical model is based on the mutual inductance between coils which can be approximated as being composed by straight conductive filaments. The full model is used to perform accurate system simulations and to assess the accuracy of faster simplified magnetic models, which are necessary to achieve real-time tracking in medical applications.

Hybrid electromagnetic-ArUco tracking of laparoscopic ultrasound transducer in laparoscopic video

Purpose: The purpose of this work was to develop a new method of tracking a laparoscopic ultrasound (LUS) transducer in laparoscopic video by combining the hardware [e.g., electromagnetic (EM)] and the computer vision-based (e.g., ArUco) tracking methods. Approach: We developed a special tracking mount for the imaging tip of the LUS transducer. The mount incorporated an EM sensor and an ArUco pattern registered to it. The hybrid method used ArUco tracking for ArUco-success frames (i.e., frames where ArUco succeeds in detecting the pattern) and used corrected EM tracking for the ArUco-failure frames. The corrected EM tracking result was obtained by applying correction matrices to the original EM tracking result. The correction matrices were calculated in previous ArUco-success frames by comparing the ArUco result and the original EM tracking result. Results: We performed phantom and animal studies to evaluate the performance of our hybrid tracking method. The corrected EM tracking results showed significant improvements over the original EM tracking results. In the animal study, 59.2% frames were ArUco-success frames. For the ArUco-failure frames, mean reprojection errors for the original EM tracking method and for the corrected EM tracking method were 30.8 pixel and 10.3 pixel, respectively. Conclusions: The new hybrid method is more reliable than using ArUco tracking alone and more accurate and practical than using EM tracking alone for tracking the LUS transducer in the laparoscope camera image. The proposed method has the potential to significantly improve tracking performance for LUS-based augmented reality applications.

Feasibility study of navigated endoscopy for the placement of high dose rate brachytherapy applicators in the esophagus and lung

PURPOSE

To evaluate the electromagnetic (EM) tracking of endoscopes and applicators as a method of positioning a high dose rate (HDR) luminal applicator.

METHOD

An anatomical phantom consisting of a rigid trachea and flexible esophagus was used to compare applicator placement measurements using EM tracking vs the traditional method using two-dimensional (2D) fluoroscopy and surface skin markers. The phantom included a tumor in the esophagus and several pairs of optically visible points inside the lumen that were used to simulate proximal and distal ends of tumors of varying lengths. The esophagus tumor and lung points were visible on a computed tomography (CT) image of the phantom, which was used as ground truth for the measurements. The EM tracking system was registered to the CT image using fiducial markers. A flexible endoscope was tracked using the EM system and the locations of the proximal and distal ends of the tumor identified and this position recorded. An EM-tracked applicator was then inserted and positioned relative to the tumor markings. The applicator path was mapped using the EM tracking. The gross tumor length (GTL) and the distance between the first dwell position and distal edge of tumor (offset) were measured using the EM tracking and 2D fluoroscopy methods and compared to the same measurements on the CT image.

RESULTS

The errors in GTL using EM tracking were on average -0.5 ± 1.7 mm and 0.7 ± 3.6 mm for esophagus and lung measurements, similar to errors measured using the 2D fluoroscopy method of -0.9 ± 1.2 mm and 3.4 ± 4.4 mm. Offset measurements were slightly larger while using EM tracking relative to the fluoroscopy method but these were not statistically significant.

CONCLUSIONS

Electromagnetic tracking for placement of lumen applicators is feasible and accurate. Tracking of the endoscope that is used to identify the proximal and distal ends of the tumor and of the applicator during insertion generates accurate three-dimensional measurements of the applicator path, GTL and offset. Guiding the placement of intraluminal applicators using EM navigation is potentially attractive for cases with complex insertions, such as those with nonlinear paths or multiple applicator insertions.

Weakly supervised segmentation for real-time surgical tool tracking

Surgical tool tracking has a variety of applications in different surgical scenarios. Electromagnetic (EM) tracking can be utilised for tool tracking, but the accuracy is often limited by magnetic interference. Vision-based methods have also been suggested; however, tracking robustness is limited by specular reflection, occlusions, and blurriness observed in the endoscopic image. Recently, deep learning-based methods have shown competitive performance on segmentation and tracking of surgical tools. The main bottleneck of these methods lies in acquiring a sufficient amount of pixel-wise, annotated training data, which demands substantial labour costs. To tackle this issue, the authors propose a weakly supervised method for surgical tool segmentation and tracking based on hybrid sensor systems. They first generate semantic labellings using EM tracking and laparoscopic image processing concurrently. They then train a light-weight deep segmentation network to obtain a binary segmentation mask that enables tool tracking. To the authors' knowledge, the proposed method is the first to integrate EM tracking and laparoscopic image processing for generation of training labels. They demonstrate that their framework achieves accurate, automatic tool segmentation (i.e. without any manual labelling of the surgical tool to be tracked) and robust tool tracking in laparoscopic image sequences.

A novel electromagnetic tracking system for surgery navigation

OBJECTIVE

This paper proposes the development of a novel electromagnetic tracking system for navigation surgery. Main objective is to provide a system able to operate in a wide tracking volume to make easier and efficient the surgical procedures by assuring high measurement accuracy.

METHODS

A new field generator consisting in five transmitting coils excited with Frequency Division Multiplexing technique has been developed. Attention is devoted to designing and arrangement of the coils to assure high sensitivity, system scalability and a homogeneous magnetic field inside working volume. A suitable technique based on Look-Up-Table is applied for sensor position calculation and an anthropomorphic robot is used for table calibration.

RESULTS

Experimental tests highlight a good repeatability of the measurement data and a negligible noise influence for the proposed system. The obtained tracking volume is wider with respect to the commercial tracking device used in surgical applications and seem promising.

CONCLUSION

The main characteristic of the developed system consists of: scalable and modular configuration of Field Generator, high measured sensitivity due to the increased number of transmitting coils with respect to the classical configuration and large tracking volume. The development of the proposed magnetic tracking systems with high accuracy and wide working volume allows to promote broader utilization of advantaged techniques in surgery procedures for both improving the effectiveness and decreasing the invasiveness of medical interventions.

Technical Note: A comparison of point set registration methods for electromagnetic tracking

PURPOSE

High dose rate brachytherapy applies intense and destructive radiation. A treatment plan defines radiation source dwell positions to avoid irradiating healthy tissue. The study discusses methods to quantify any positional changes of source locations along the various treatment sessions.

METHODS

Electromagnetic tracking (EMT) localizes the radiation source during the treatment sessions. But in each session the relative position of the patient relative to the filed generator is changed. Hence, the measured dwell point sets need to be registered onto each other to render them comparable. Two point set registration techniques are compared: a probabilistic method called coherent point drift (CPD) and a multidimensional scaling (MDS) technique.

RESULTS

Both enable using EMT without external registration and achieve very similar results with respect to dwell position determination of the radiation source. Still MDS achieves smaller grand average deviations (CPD-rPSR: MD = 2.55 mm, MDS-PSR: MD = 2.15 mm) between subsequent dwell position determinations, which also show less variance (CPD-rPSR: IQR = 4 mm, MDS-PSR: IQR = 3 mm). Furthermore, MDS is not based on approximations and does not need an iterative procedure to track sensor positions inside the implanted catheters.

CONCLUSION

Although both methods achieve similar results, MDS is to be preferred over rigid CPD while nonrigid CPD is unsuitable as it does not preserve topology.

Polhemus EM tracked Micro Sensor for CT-guided interventions

PURPOSE

Electromagnetic (EM) tracking is a key technology in image-guided therapy. A new EM Micro Sensor was presented by Polhemus Inc.; it is the first to enable localization of medical instruments through their trackers. Different field generators (FGs) are available by Polhemus, one being almost as small as a sugar cube. As accuracy and robustness of tracking are known challenges to using EM trackers in clinical environments, the goal of this study was a standardized assessment of the Micro Sensor in both a laboratory (lab) and a computed tomography (CT) environment.

METHODS

The Micro Sensor was assessed by means of Hummel et al.'s standardized protocol; it was assessed in conjunction with a Polhemus Liberty tracker and three FGs - with edge lengths of 1 (TX1), 2 (TX2), and 4 (TX4) inches. Precision as well as positional and rotational accuracy were determined in a lab and a CT suite. Distortions by four different metallic cylinders and tracking of two typical medical instruments - a hypodermic needle and a flexible endoscope - were also tested.

RESULTS

A jitter of 0.02 mm or less was found for all FGs in the different environments, except for the TX2 FG for which no valid data could be obtained in the CT. Errors of 5 cm distance measurements were 0.6 mm or less for all FGs in the lab. While the distance errors of the TX1 FG were only slightly increased up to 1.6 mm in the CT, those of the TX4 FG were found to be up to around 10% of the measured distance (5.4 mm on average). The mean orientation error was found to be 0.9^° /0.5^° /0.1^° for the TX4/TX2/TX1 FG in the lab. In the CT environment, rotation errors were in the same range: less than 1.2^° /0.1^° for the TX4/TX1 FG. Deviation under the presence of metallic cylinders stayed below 1 mm in most cases. Precision and orientational accuracy do not seem to be affected by instrument tracking and stayed in the same range as for the other measurements whereas distance errors were slightly increased up to 1.7 mm.

CONCLUSION

This study shows that accurate tracking of medical instruments is possible with the new Micro Sensor; it demonstrated a jitter of 0.01 mm or less, position errors below 2 mm, and rotation errors of less than 0.3^° . As with other EM trackers, errors increase when large tracking volumes with ranges of up to 50 cm are required in clinical environments. For smaller tracking volumes with ranges of up to 15 cm, a high accuracy and robustness was found. This is interesting especially for the TX1 FG which can easily be placed in close vicinity to the region of interest.

Peripheral tumour targeting using open-source virtual bronchoscopy with electromagnetic tracking: a multi-user pre-clinical study

Objectives: The goal was to demonstrate the utility of open-source tracking and visualisation tools in the targeting of lung cancer.Material and methods: The study demonstrates the first deployment of the Anser electromagnetic (EM) tracking system with the CustusX image-guided interventional research platform to navigate using an endobronchial catheter to injected tumour targets. Live animal investigations validated the deployment and targeting of peripheral tumour models using an innovative tumour marking routine.Results: Novel tumour model deployment was successfully achieved at all eight target sites across two live animal investigations without pneumothorax. Virtual bronchoscopy with tracking successfully guided the tracked catheter to 2-12 mm from the target tumour site. Deployment of a novel marker was achieved at all eight sites providing a reliable measure of targeting accuracy. Targeting accuracy within 10 mm was achieved in 7/8 sites and in all cases, the virtual target distance at marker deployment was within the range subsequently measured with x-ray.Conclusions: Endobronchial targeting of peripheral airway targets is feasible using existing open-source technology. Notwithstanding the shortcomings of current commercial platforms, technological improvements in EM tracking and registration accuracy fostered by open-source technology may provide the impetus for widespread clinical uptake of electromagnetic navigation in bronchoscopy.

Electromagnetic tracking in image-guided laparoscopic surgery: Comparison with optical tracking and feasibility study of a combined laparoscope and laparoscopic ultrasound system

PURPOSE

In image-guided laparoscopy, optical tracking is commonly employed, but electromagnetic (EM) systems have been proposed in the literature. In this paper, we provide a thorough comparison of EM and optical tracking systems for use in image-guided laparoscopic surgery and a feasibility study of a combined, EM-tracked laparoscope and laparoscopic ultrasound (LUS) image guidance system.

METHODS

We first assess the tracking accuracy of a laparoscope with two optical trackers tracking retroreflective markers mounted on the shaft and an EM tracker with the sensor embedded at the proximal end, using a standard evaluation plate. We then use a stylus to test the precision of position measurement and accuracy of distance measurement of the trackers. Finally, we assess the accuracy of an image guidance system comprised of an EM-tracked laparoscope and an EM-tracked LUS probe.

RESULTS

In the experiment using a standard evaluation plate, the two optical trackers show less jitter in position and orientation measurement than the EM tracker. Also, the optical trackers demonstrate better consistency of orientation measurement within the test volume. However, their accuracy of measuring relative positions decreases significantly with longer distances whereas the EM tracker's performance is stable; at 50 mm distance, the RMS errors for the two optical trackers are 0.210 and 0.233 mm, respectively, and it is 0.214 mm for the EM tracker; at 250 mm distance, the RMS errors for the two optical trackers become 1.031 and 1.178 mm, respectively, while it is 0.367 mm for the EM tracker. In the experiment using the stylus, the two optical trackers have RMS errors of 1.278 and 1.555 mm in localizing the stylus tip, and it is 1.117 mm for the EM tracker. Our prototype of a combined, EM-tracked laparoscope and LUS system using representative calibration methods showed a RMS point localization error of 3.0 mm for the laparoscope and 1.3 mm for the LUS probe, the lager error of the former being predominantly due to the triangulation error when using a narrow-baseline stereo laparoscope.

CONCLUSIONS

The errors incurred by optical trackers, due to the lever-arm effect and variation in tracking accuracy in the depth direction, would make EM-tracked solutions preferable if the EM sensor is placed at the proximal end of the laparoscope.

Distorter Characterisation Using Mutual Inductance in Electromagnetic Tracking

Electromagnetic tracking (EMT) is playing an increasingly important role in surgical navigation, medical robotics and virtual reality development as a positional and orientation reference. Though EMT is not restricted by line-of-sight requirements, measurement errors caused by magnetic distortions in the environment remain the technology's principal shortcoming. The characterisation, reduction and compensation of these errors is a broadly researched topic, with many developed techniques relying on auxiliary tracking hardware including redundant sensor arrays, optical and inertial tracking systems. This paper describes a novel method of detecting static magnetic distortions using only the magnetic field transmitting array. An existing transmitter design is modified to enable simultaneous transmission and reception of the generated magnetic field. A mutual inductance model is developed for this transmitter design in which deviations from control measurements indicate the location, magnitude and material of the field distorter to an approximate degree. While not directly compensating for errors, this work enables users of EMT systems to optimise placement of the magnetic transmitter by characterising a distorter's effect within the tracking volume without the use of additional hardware. The discrimination capabilities of this method may also allow researchers to apply material-specific compensation techniques to minimise position error in the clinical setting.

Choledochoscopic Examination of a 3-Dimensional Printing Model Using Augmented Reality Techniques: A Preliminary Proof of Concept Study

BACKGROUND

We applied augmented reality (AR) techniques to flexible choledochoscopy examinations.

METHODS

Enhanced computed tomography data of a patient with intrahepatic and extrahepatic biliary duct dilatation were collected to generate a hollow, 3-dimensional (3D) model of the biliary tree by 3D printing. The 3D printed model was placed in an opaque box. An electromagnetic (EM) sensor was internally installed in the choledochoscope instrument channel for tracking its movements through the passages of the 3D printed model, and an AR navigation platform was built using image overlay display. The porta hepatis was used as the reference marker with rigid image registration. The trajectories of the choledochoscope and the EM sensor were observed and recorded using the operator interface of the choledochoscope.

RESULTS

Training choledochoscopy was performed on the 3D printed model. The choledochoscope was guided into the left and right hepatic ducts, the right anterior hepatic duct, the bile ducts of segment 8, the hepatic duct in subsegment 8, the right posterior hepatic duct, and the left and the right bile ducts of the caudate lobe. Although stability in tracking was less than ideal, the virtual choledochoscope images and EM sensor tracking were effective for navigation.

CONCLUSIONS

AR techniques can be used to assist navigation in choledochoscopy examinations in bile duct models. Further research is needed to determine its benefits in clinical settings.

Correlation between intrafractional motion and dosimetric changes for prostate IMRT: Comparison of different adaptive strategies

Purpose

To retrospectively analyze and estimate the dosimetric benefit of online and offline motion mitigation strategies for prostate IMRT.

Methods

Intrafractional motion data of 21 prostate patients receiving intensity‐modulated radiotherapy was acquired with an electromagnetic tracking system. Target trajectories of 734 fractions were analyzed per delivered multileaf‐collimator segment in five motion metrics: three‐dimensional displacement, distance from beam axis (DistToBeam), and three orthogonal components. Time‐resolved dose calculations have been performed by shifting the target according to the sampled motion for the following scenarios: without adaptation, online‐repositioning with a minimum threshold of 3 mm, and an offline approach using a modified field order applying horizontal before vertical beams. Change of D95 (targets) or V65 (organs at risk) relative to the static case, that is, ΔD95 or ΔV65, was extracted per fraction in percent. Correlation coefficients (CC) between the motion metrics and the dose metrics were extracted. Mean of patient‐wise CC was used to evaluate the correlation of motion metric and dosimetric changes. Mean and standard deviation of the patient‐wise correlation slopes (in %/mm) were extracted.

Results

For ΔD95 of the prostate, mean DistToBeam per fraction showed the highest correlation for all scenarios with a relative change of −0.6 ± 0.7%/mm without adaptation and −0.4 ± 0.5%/mm for the repositioning and field order strategies. For ΔV65 of the bladder and the rectum, superior–inferior and posterior–anterior motion components per fraction showed the highest correlation, respectively. The slope of bladder (rectum) was 14.6 ± 5.8 (15.1 ± 6.9) %/mm without adaptation, 14.0 ± 4.9 (14.5 ± 7.4) %/mm for repositioning with 3 mm, and 10.6 ± 2.5 (8.1 ± 4.6) %/mm for the field order approach.

Conclusions

The correlation slope is a valuable concept to estimate dosimetric deviations from static plan quality directly based on the observed motion. For the prostate, both mitigation strategies showed comparable benefit. For organs at risk, the field order approach showed less sensitive response regarding motion and reduced interpatient variation.

EM-enhanced US-based seed detection for prostate brachytherapy

PURPOSE

Intraoperative dosimetry in low-dose-rate (LDR) permanent prostate brachytherapy requires accurate localization of the implanted seeds with respect to the prostate anatomy. Transrectal Ultrasound (TRUS) imaging, which is the main imaging modality used during the procedure, is not sufficiently robust for accurate seed localization. We present a method for integration of electromagnetic (EM) tracking into LDR prostate brachytherapy procedure by fusing it with TRUS imaging for seed localization.

METHOD

Experiments were conducted on five tissue mimicking phantoms in a controlled environment. The seeds were implanted into each phantom using an EM-tracked needle, which allowed recording of seed drop locations. After each needle, we reconstructed a 3D ultrasound (US) volume by compounding a series of 2D US images acquired during retraction of an EM-tracked TRUS probe. Then, a difference image was generated by nonrigid registration and subtraction of two consecutive US volumes. A US-only seed detection method was used to detect seed candidates in the difference volume, based on the signature of the seeds. Finally, the EM-based positions of the seeds were used to detect the false positives of the US-based seed detection method and also to estimate the positions of the missing seeds. After the conclusion of the seed implant process, we acquired a CT image. The ground truth for seed locations was obtained by localizing the seeds in the CT image and registering them to the US coordinate system.

RESULTS

Compared to the ground truth, the US-only detection algorithm achieved a localization error mean of 1.7 mm with a detection rate of 85%. By contrast, the EM-only seed localization method achieved a localization error mean of 3.7 mm with a detection rate of 100%. By fusing EM-tracking information with US imaging, we achieved a localization error mean of 1.8 mm while maintaining a 100% detection rate without any false positives.

CONCLUSIONS

Fusion of EM-tracking and US imaging for prostate brachytherapy can combine high localization accuracy of US-based seed detection with the robustness and high detection rate of EM-based seed localization. Our phantom experiments serve as a proof of concept to demonstrate the potential value of integrating EM-tracking into LDR prostate brachytherapy.

Probabilistic visual and electromagnetic data fusion for robust drift-free sequential mosaicking: application to fetoscopy

The most effective treatment for twin-to-twin transfusion syndrome is laser photocoagulation of the shared vascular anastomoses in the placenta. Vascular connections are extremely challenging to locate due to their caliber and the reduced field-of-view of the fetoscope. Therefore, mosaicking techniques are beneficial to expand the scene, facilitate navigation, and allow vessel photocoagulation decision-making. Local vision-based mosaicking algorithms inherently drift over time due to the use of pairwise transformations. We propose the use of an electromagnetic tracker (EMT) sensor mounted at the tip of the fetoscope to obtain camera pose measurements, which we incorporate into a probabilistic framework with frame-to-frame visual information to achieve globally consistent sequential mosaics. We parametrize the problem in terms of plane and camera poses constrained by EMT measurements to enforce global consistency while leveraging pairwise image relationships in a sequential fashion through the use of local bundle adjustment. We show that our approach is drift-free and performs similarly to state-of-the-art global alignment techniques like bundle adjustment albeit with much less computational burden. Additionally, we propose a version of bundle adjustment that uses EMT information. We demonstrate the robustness to EMT noise and loss of visual information and evaluate mosaics for synthetic, phantom-based and ex vivo datasets.

Real-time probe tracking using EM-optical sensor for MRI-guided cryoablation

BACKGROUND

A method of real-time, accurate probe tracking at the entrance of the MRI bore is developed, which, fused with pre-procedural MR images, will enable clinicians to perform cryoablation efficiently in a large workspace with image guidance.

METHODS

Electromagnetic (EM) tracking coupled with optical tracking is used to track the probe. EM tracking is achieved with an MRI-safe EM sensor working under the scanner's magnetic field to compensate the line-of-sight issue of optical tracking. Unscented Kalman filter-based probe tracking is developed to smooth the EM sensor measurements when occlusion occurs and to improve the tracking accuracy by fusing the measurements of two sensors.

RESULTS

Experiments with a spine phantom show that the mean targeting errors using the EM sensor alone and using the proposed method are 2.21 mm and 1.80 mm, respectively.

CONCLUSION

The proposed method achieves more accurate probe tracking than using an EM sensor alone at the MRI scanner entrance.

Robotically assisted ureteroscopy for kidney exploration

Ureteroscopy is a minimally invasive procedure for diagnosis and treatment of a wide range of urinary tract pathologies. It is most commonly performed in the diagnostic work-up of hematuria and the diagnosis and treatment of upper urinary tract malignancies and calculi. Ergonomic and visualization challenges as well as radiation exposure are limitations to conventional ureteroscopy. For example, for diagnostic tumor inspection, the urologist has to maneuver the ureteroscope through each of the 6 to 12 calyces in the kidney under fluoroscopy to ensure complete surveillance. Therefore, we have been developing a robotic system to "power drive" a flexible fiber-optic ureteroscope with 3D tip tracking and pre-operative image overlay. Our goal is to provide the urologist precise control of the ureteroscope tip with less radiation exposure. Our prototype system allows control of the three degrees of freedom of the ureteroscope via brushless motors and a joystick interface. The robot provides a steady platform for controlling the ureteroscope. Furthermore, the robot design facilitates a quick "snap-in" of the ureteroscope, thus allowing the ureteroscope to be mounted midway through the procedure. We have completed the mechanical system and the controlling software and begun evaluation using a kidney phantom. We put MRI-compatible fiducials on the phantom and obtained MR images. We registered these images with the robot using an electromagnetic tracking system and paired-point registration. The system is described and initial evaluation results are given in this paper.

Electromagnetic tracking for treatment verification in interstitial brachytherapy

Electromagnetic tracking (EMT) is used in several medical fields to determine the position and orientation of dedicated sensors, e.g., attached to surgical tools. Recently, EMT has been introduced to brachytherapy for implant reconstruction and error detection. The manuscript briefly summarizes the main issues of EMT and error detection in brachytherapy. The potential and complementarity of EMT as treatment verification technology will be discussed in relation to in vivo dosimetry and imaging.

Laparoscopic stereoscopic augmented reality: toward a clinically viable electromagnetic tracking solution

The purpose of this work was to develop a clinically viable laparoscopic augmented reality (AR) system employing stereoscopic (3-D) vision, laparoscopic ultrasound (LUS), and electromagnetic (EM) tracking to achieve image registration. We investigated clinically feasible solutions to mount the EM sensors on the 3-D laparoscope and the LUS probe. This led to a solution of integrating an externally attached EM sensor near the imaging tip of the LUS probe, only slightly increasing the overall diameter of the probe. Likewise, a solution for mounting an EM sensor on the handle of the 3-D laparoscope was proposed. The spatial image-to-video registration accuracy of the AR system was measured to be [Formula: see text] and [Formula: see text] for the left- and right-eye channels, respectively. The AR system contributed 58-ms latency to stereoscopic visualization. We further performed an animal experiment to demonstrate the use of the system as a visualization approach for laparoscopic procedures. In conclusion, we have developed an integrated, compact, and EM tracking-based stereoscopic AR visualization system, which has the potential for clinical use. The system has been demonstrated to achieve clinically acceptable accuracy and latency. This work is a critical step toward clinical translation of AR visualization for laparoscopic procedures.

Performance and suitability assessment of a real-time 3D electromagnetic needle tracking system for interstitial brachytherapy

PURPOSE

Accurate insertion and overall needle positioning are key requirements for effective brachytherapy treatments. This work aims at demonstrating the accuracy performance and the suitability of the Aurora(®) V1 Planar Field Generator (PFG) electromagnetic tracking system (EMTS) for real-time treatment assistance in interstitial brachytherapy procedures.

MATERIAL AND METHODS

The system's performance was characterized in two distinct studies. First, in an environment free of EM disturbance, the boundaries of the detection volume of the EMTS were characterized and a tracking error analysis was performed. Secondly, a distortion analysis was conducted as a means of assessing the tracking accuracy performance of the system in the presence of potential EM disturbance generated by the proximity of standard brachytherapy components.

RESULTS

The tracking accuracy experiments showed that positional errors were typically 2 ± 1 mm in a zone restricted to the first 30 cm of the detection volume. However, at the edges of the detection volume, sensor position errors of up to 16 mm were recorded. On the other hand, orientation errors remained low at ± 2° for most of the measurements. The EM distortion analysis showed that the presence of typical brachytherapy components in vicinity of the EMTS had little influence on tracking accuracy. Position errors of less than 1 mm were recorded with all components except with a metallic arm support, which induced a mean absolute error of approximately 1.4 mm when located 10 cm away from the needle sensor.

CONCLUSIONS

The Aurora(®) V1 PFG EMTS possesses a great potential for real-time treatment assistance in general interstitial brachytherapy. In view of our experimental results, we however recommend that the needle axis remains as parallel as possible to the generator surface during treatment and that the tracking zone be restricted to the first 30 cm from the generator surface.

Review of advanced catheter technologies in radiation oncology brachytherapy procedures

The development of new catheter and applicator technologies in recent years has significantly improved treatment accuracy, efficiency, and outcomes in brachytherapy. In this paper, we review these advances, focusing on the performance of catheter imaging and reconstruction techniques in brachytherapy procedures using magnetic resonance images and electromagnetic tracking. The accuracy of catheter reconstruction, imaging artifacts, and other notable properties of plastic and titanium applicators in gynecologic treatments are reviewed. The accuracy, noise performance, and limitations of electromagnetic tracking for catheter reconstruction are discussed. Several newly developed applicators for accelerated partial breast irradiation and gynecologic treatments are also reviewed. New hypofractionated high dose rate treatment schemes in prostate cancer and accelerated partial breast irradiation are presented.

Simultaneous localization and calibration for electromagnetic tracking systems

BACKGROUND

In clinical environments, field distortion can cause significant electromagnetic tracking errors. Therefore, dynamic calibration of electromagnetic tracking systems is essential to compensate for measurement errors.

METHODS

It is proposed to integrate the motion model of the tracked instrument with redundant EM sensor observations and to apply a simultaneous localization and mapping algorithm in order to accurately estimate the pose of the instrument and create a map of the field distortion in real-time. Experiments were conducted in the presence of ferromagnetic and electrically-conductive field distorting objects and results compared with those of a conventional sensor fusion approach.

RESULTS

The proposed method reduced the tracking error from 3.94±1.61 mm to 1.82±0.62 mm in the presence of steel, and from 0.31±0.22 mm to 0.11±0.14 mm in the presence of aluminum.

CONCLUSIONS

With reduced tracking error and independence from external tracking devices or pre-operative calibrations, the approach is promising for reliable EM navigation in various clinical procedures. Copyright © 2015 John Wiley & Sons, Ltd.

CT-guided liver biopsy with electromagnetic tracking: results from a single-center prospective randomized controlled trial

OBJECTIVE

The purpose of this study is to evaluate the effectiveness of electromagnetic tracking in assisting CT-guided liver biopsies.

MATERIALS AND METHODS

This was a single-center prospective randomized controlled trial comparing nonfluoroscopic CT-guided liver biopsy using an advance-and-scan technique with and without electromagnetic tracking. Fifty patients with a liver lesion referred for biopsy (women, 52%; mean age, 59.7 years; mean lesion size, 3.6 cm) were enrolled in the study and were randomly assigned to either arm. The primary and secondary objectives were to assess and quantify differences in the number of intraprocedural scans, cumulative effective radiation dose, number of needle manipulations, and procedure time from skin-stick to the target lesion with and without assistance.

RESULTS

Electromagnetic tracking significantly decreased the number of scans, effective radiation dose, number of manipulations per procedure, and time from skin-stick to the target lesion. The ratio of the number of scans (electromagnetic tracking to control) was 0.55 (95% CI, 0.42-0.73; p<0.0001). The mean difference in effective radiation dose (electromagnetic tracking-control) was -4.7 mSv (95% CI, -7.01 to -2.44 mSv; p=0.0001), and the median difference was -5.1 mSv (95% CI, -7.01 to -3.56 mSv; p<0.0001). The ratio of the number of manipulations (electromagnetic tracking to control) was 0.36 (95% CI, 0.24-0.54; p<0.0001). The mean difference for the time from skin-stick to the target lesion was -247.6 seconds (95% CI, -394.34 to -100.83 seconds; p=0.0014) and the median difference was -253.0 seconds (95% CI, -325.00 to -124.00 seconds; p=0.0001).

CONCLUSION

Electromagnetic tracking assistance has the potential to decrease the number of intraprocedural CT scans and needle manipulations and to reduce patient radiation dose during CT-guided liver biopsy.

Image fusion during vascular and nonvascular image-guided procedures

Image fusion may be useful in any procedure where previous imaging such as positron emission tomography, magnetic resonance imaging, or contrast-enhanced computed tomography (CT) defines information that is referenced to the procedural imaging, to the needle or catheter, or to an ultrasound transducer. Fusion of prior and intraoperative imaging provides real-time feedback on tumor location or margin, metabolic activity, device location, or vessel location. Multimodality image fusion in interventional radiology was initially introduced for biopsies and ablations, especially for lesions only seen on arterial phase CT, magnetic resonance imaging, or positron emission tomography/CT but has more recently been applied to other vascular and nonvascular procedures. Two different types of platforms are commonly used for image fusion and navigation: (1) electromagnetic tracking and (2) cone-beam CT. Both technologies would be reviewed as well as their strengths and weaknesses, indications, when to use one vs the other, tips and guidance to streamline use, and early evidence defining clinical benefits of these rapidly evolving, commercially available and emerging techniques.

EM-Navigated Catheter Placement for Gynecologic Brachytherapy: An Accuracy Study

Gynecologic malignancies, including cervical, endometrial, ovarian, vaginal and vulvar cancers, cause significant mortality in women worldwide. The standard care for many primary and recurrent gynecologic cancers consists of chemoradiation followed by brachytherapy. In high dose rate (HDR) brachytherapy, intracavitary applicators and/or interstitial needles are placed directly inside the cancerous tissue so as to provide catheters to deliver high doses of radiation. Although technology for the navigation of catheters and needles is well developed for procedures such as prostate biopsy, brain biopsy, and cardiac ablation, it is notably lacking for gynecologic HDR brachytherapy. Using a benchtop study that closely mimics the clinical interstitial gynecologic brachytherapy procedure, we developed a method for evaluating the accuracy of image-guided catheter placement. Future bedside translation of this technology offers the potential benefit of maximizing tumor coverage during catheter placement while avoiding damage to the adjacent organs, for example bladder, rectum and bowel. In the study, two independent experiments were performed on a phantom model to evaluate the targeting accuracy of an electromagnetic (EM) tracking system. The procedure was carried out using a laptop computer (2.1GHz Intel Core i7 computer, 8GB RAM, Windows 7 64-bit), an EM Aurora tracking system with a 1.3mm diameter 6 DOF sensor, and 6F (2 mm) brachytherapy catheters inserted through a Syed-Neblett applicator. The 3D Slicer and PLUS open source software were used to develop the system. The mean of the targeting error was less than 2.9mm, which is comparable to the targeting errors in commercial clinical navigation systems.

Collecting system percutaneous access using real-time tracking sensors: first pig model in vivo experience

PURPOSE

Precise needle puncture of the renal collecting system is an essential but challenging step for successful percutaneous nephrolithotomy. We evaluated the efficiency of a new real-time electromagnetic tracking system for in vivo kidney puncture.

MATERIALS AND METHODS

Six anesthetized female pigs underwent ureterorenoscopy to place a catheter with an electromagnetic tracking sensor into the desired puncture site and ascertain puncture success. A tracked needle with a similar electromagnetic tracking sensor was subsequently navigated into the sensor in the catheter. Four punctures were performed by each of 2 surgeons in each pig, including 1 each in the kidney, middle ureter, and right and left sides. Outcome measurements were the number of attempts and the time needed to evaluate the virtual trajectory and perform percutaneous puncture.

RESULTS

A total of 24 punctures were easily performed without complication. Surgeons required more time to evaluate the trajectory during ureteral than kidney puncture (median 15 seconds, range 14 to 18 vs 13, range 11 to 16, p=0.1). Median renal and ureteral puncture time was 19 (range 14 to 45) and 51 seconds (range 45 to 67), respectively (p=0.003). Two attempts were needed to achieve a successful ureteral puncture. The technique requires the presence of a renal stone for testing.

CONCLUSIONS

The proposed electromagnetic tracking solution for renal collecting system puncture proved to be highly accurate, simple and quick. This method might represent a paradigm shift in percutaneous kidney access techniques.

Enabling 3D Ultrasound Procedure Guidance through Enhanced Visualization

Real-time 3D ultrasound (3DUS) imaging offers improved spatial orientation information relative to 2D ultrasound. However, in order to improve its efficacy in guiding minimally invasive intra-cardiac procedures where real-time visual feedback of an instrument tip location is crucial, 3DUS volume visualization alone is inadequate. This paper presents a set of enhanced visualization functionalities that are able to track the tip of an instrument in slice views at real-time. User study with in vitro porcine heart indicates a speedup of over 30% in task completion time.

Real-time sonography with electromagnetic tracking navigation for biopsy of a hepatic neoplasm seen only on arterial phase computed tomography

This case illustrates the ability of electromagnetic tracking navigation to localize difficult targets in real time during biopsy or ablation of lesions that are only transiently apparent on arterial phase computed tomography and may be unapparent on sonography. Readily available technology enabling multimodality registration to sonography allows for the use of positron emission tomographic, magnetic resonance imaging, and computed tomographic information during sonographically guided procedures and examinations.

Electromagnetic tracking in the clinical environment

When choosing an electromagnetic tracking system (EMTS) for image-guided procedures several factors must be taken into consideration. Among others these include the system's refresh rate, the number of sensors that need to be tracked, the size of the navigated region, the system interaction with the environment, whether the sensors can be embedded into the tools and provide the desired transformation data, and tracking accuracy and robustness. To date, the only factors that have been studied extensively are the accuracy and the susceptibility of EMTSs to distortions caused by ferromagnetic materials. In this paper the authors shift the focus from analysis of system accuracy and stability to the broader set of factors influencing the utility of EMTS in the clinical environment. The authors provide an analysis based on all of the factors specified above, as assessed in three clinical environments. They evaluate two commercial tracking systems, the Aurora system from Northern Digital Inc., and the 3D Guidance system with three different field generators from Ascension Technology Corp. The authors show that these systems are applicable to specific procedures and specific environments, but that currently, no single system configuration provides a comprehensive solution across procedures and environments.

Electromagnetic tracking for abdominal interventions in computer aided surgery

Electromagnetic tracking has great potential for assisting physicians in precision placement of instruments during minimally invasive interventions in the abdomen, since electromagnetic tracking is not limited by the line-of-sight restrictions of optical tracking. A new generation of electromagnetic tracking has recently become available, with sensors small enough to be included in the tips of instruments. To fully exploit the potential of this technology, our research group has been developing a computer aided, image-guided system that uses electromagnetic tracking for visualization of the internal anatomy during abdominal interventions. As registration is a critical component in developing an accurate image-guided system, we present three registration techniques: 1) enhanced paired-point registration (time-stamp match registration and dynamic registration); 2) orientation-based registration; and 3) needle shape-based registration. Respiration compensation is another important issue, particularly in the abdomen, where respiratory motion can make precise targeting difficult. To address this problem, we propose reference tracking and affine transformation methods. Finally, we present our prototype navigation system, which integrates the registration, segmentation, path-planning and navigation functions to provide real-time image guidance in the clinical environment. The methods presented here have been tested with a respiratory phantom specially designed by our group and in swine animal studies under approved protocols. Based on these tests, we conclude that our system can provide quick and accurate localization of tracked instruments in abdominal interventions, and that it offers a user-friendly display for the physician.

Automatic virtual transducer locating system to assist in interpreting ultrasound imaging

Bodymarkers are used to label the location and orientation of the transducer during ultrasound examination. We attempt to evaluate the usefulness of a new system that indicates transducer location over that of the conventional bodymarker. The proposed system uses an electromagnetic tracking device to track the three-dimensional (3-D) position and orientation of a small electromagnetic receiver attached to the ultrasound transducer relative to a transmitter placed under the bed. The new bodymarker is displayed as a 3-D graphic model. The physique of the examinee is calibrated by representing five locations on the body on the original bodymarker. To evaluate the accuracy of the system visually, we compared the transducer position indicated in the new bodymarker and the actual transducer position in four abdominal sections. Actual and displayed position and orientation closely agreed in all cases, and the transducer position indicator in the bodymarker display moved smoothly. Automatic transducer locator on the virtual 3-D bodymarker accurately indicated its position and orientation. This system is useful and convenient in clinical examinations.