An electromagnetic “Tracker-in-Table” configuration for X-ray fluoroscopy and cone-beam CT-guided surgery

Source-detector trajectory optimization in cone-beam computed tomography: a comprehensive review on today’s state-of-the-art

Cone-beam computed tomography (CBCT) imaging is becoming increasingly important for a wide range of applications such as image-guided surgery, image-guided radiation therapy as well as diagnostic imaging such as breast and orthopaedic imaging. The potential benefits of non-circular source-detector trajectories was recognized in early work to improve the completeness of CBCT sampling and extend the field of view (FOV). Another important feature of interventional imaging is that prior knowledge of patient anatomy such as a preoperative CBCT or prior CT is commonly available. This provides the opportunity to integrate such prior information into the image acquisition process by customized CBCT source-detector trajectories. Such customized trajectories can be designed in order to optimize task-specific imaging performance, providing intervention or patient-specific imaging settings. The recently developed robotic CBCT C-arms as well as novel multi-source CBCT imaging systems with additional degrees of freedom provide the possibility to largely expand the scanning geometries beyond the conventional circular source-detector trajectory. This recent development has inspired the research community to innovate enhanced image quality by modifying image geometry, as opposed to hardware or algorithms. The recently proposed techniques in this field facilitate image quality improvement, FOV extension, radiation dose reduction, metal artifact reduction as well as 3D imaging under kinematic constraints. Because of the great practical value and the increasing importance of CBCT imaging in image-guided therapy for clinical and preclinical applications as well as in industry, this paper focuses on the review and discussion of the available literature in the CBCT trajectory optimization field. To the best of our knowledge, this paper is the first study that provides an exhaustive literature review regarding customized CBCT algorithms and tries to update the community with the clarification of in-depth information on the current progress and future trends.

Preclinical evaluation of a prototype freehand drill video guidance system for orthopedic surgery

Purpose: Internal fixation of pelvic fractures is a challenging task requiring the placement of instrumentation within complex three-dimensional bone corridors, typically guided by fluoroscopy. We report a system for two- and three-dimensional guidance using a drill-mounted video camera and fiducial markers with evaluation in first preclinical studies. Approach: The system uses a camera affixed to a surgical drill and multimodality (optical and radio-opaque) markers for real-time trajectory visualization in fluoroscopy and/or CT. Improvements to a previously reported prototype include hardware components (mount, camera, and fiducials) and software (including a system for detecting marker perturbation) to address practical requirements necessary for translation to clinical studies. Phantom and cadaver experiments were performed to quantify the accuracy of video-fluoroscopy and video-CT registration, the ability to detect marker perturbation, and the conformance in placing guidewires along realistic pelvic trajectories. The performance was evaluated in terms of geometric accuracy and conformance within bone corridors. Results: The studies demonstrated successful guidewire delivery in a cadaver, with a median entry point error of 1.00 mm (1.56 mm IQR) and median angular error of 1.94 deg (1.23 deg IQR). Such accuracy was sufficient to guide K-wire placement through five of the six trajectories investigated with a strong level of conformance within bone corridors. The sixth case demonstrated a cortical breach due to extrema in the registration error. The system was able to detect marker perturbations and alert the user to potential registration issues. Feasible workflows were identified for orthopedic-trauma scenarios involving emergent cases (with no preoperative imaging) or cases with preoperative CT. Conclusions: A prototype system for guidewire placement was developed providing guidance that is potentially compatible with orthopedic-trauma workflow. First preclinical (cadaver) studies demonstrated accurate guidance of K-wire placement in pelvic bone corridors and the ability to automatically detect perturbations that degrade registration accuracy. The preclinical prototype demonstrated performance and utility supporting translation to clinical studies.

Drill-mounted video guidance for orthopaedic trauma surgery

Purpose: Percutaneous fracture fixation is a challenging procedure that requires accurate interpretation of fluoroscopic images to insert guidewires through narrow bone corridors. We present a guidance system with a video camera mounted onboard the surgical drill to achieve real-time augmentation of the drill trajectory in fluoroscopy and/or CT. Approach: The camera was mounted on the drill and calibrated with respect to the drill axis. Markers identifiable in both video and fluoroscopy are placed about the surgical field and co-registered by feature correspondences. If available, a preoperative CT can also be co-registered by 3D-2D image registration. Real-time guidance is achieved by virtual overlay of the registered drill axis on fluoroscopy or in CT. Performance was evaluated in terms of target registration error (TRE), conformance within clinically relevant pelvic bone corridors, and runtime. Results: Registration of the drill axis to fluoroscopy demonstrated median TRE of 0.9 mm and 2.0 deg when solved with two views (e.g., anteroposterior and lateral) and five markers visible in both video and fluoroscopy-more than sufficient to provide Kirschner wire (K-wire) conformance within common pelvic bone corridors. Registration accuracy was reduced when solved with a single fluoroscopic view ( TRE = 3.4    mm and 2.7 deg) but was also sufficient for K-wire conformance within pelvic bone corridors. Registration was robust with as few as four markers visible within the field of view. Runtime of the initial implementation allowed fluoroscopy overlay and/or 3D CT navigation with freehand manipulation of the drill up to 10    frames / s . Conclusions: A drill-mounted video guidance system was developed to assist with K-wire placement. Overall workflow is compatible with fluoroscopically guided orthopaedic trauma surgery and does not require markers to be placed in preoperative CT. The initial prototype demonstrates accuracy and runtime that could improve the accuracy of K-wire placement, motivating future work for translation to clinical studies.

A visual odometry base-tracking system for intraoperative C-arm guidance

PURPOSE

C-arms are portable X-ray devices used to generate radiographic images in orthopedic surgical procedures. Evidence suggests that scouting images, which are used to aid in C-arm positioning, result in increased operation time and excess radiation exposure. C-arms are also primarily used qualitatively to view images, with limited quantitative functionality. Various techniques have been proposed to improve positioning, reduce radiation exposure, and provide quantitative measuring tools, all of which require accurate C-arm position tracking. While external stereo camera systems can be used for this purpose, they are typically considered too obtrusive. This paper therefore presents the development and verification of a low-profile, real-time C-arm base-tracking system using computer vision techniques.

METHODS

The proposed tracking system, called OPTIX (On-board Position Tracking for Intraoperative X-rays), uses a single downward-facing camera mounted to the base of a C-arm. Relative motion tracking and absolute position recovery algorithms were implemented to track motion using the visual texture in operating room floors. The accuracy of the system was evaluated in a simulated operating room mounted on a real C-arm.

RESULTS

The relative tracking algorithm measured relative translation position changes with errors of less than 0.75% of the total distance travelled, and orientation with errors below 5% of the cumulative rotation. With an error-correction step incorporated, OPTIX achieved C-arm repositioning with translation errors of less than [Formula: see text]  mm and rotation errors of less than [Formula: see text]. A display based on the OPTIX measurements enabled consistent C-arm repositioning within 5 mm of a previously stored reference position.

CONCLUSION

The system achieved clinically relevant accuracies and could result in a reduced need for scout images when re-acquiring a previous position. We believe that, if implemented in an operating room, OPTIX has the potential to reduce both operating time and harmful radiation exposure to patients and surgical staff.

Polhemus EM tracked Micro Sensor for CT-guided interventions

PURPOSE

Electromagnetic (EM) tracking is a key technology in image-guided therapy. A new EM Micro Sensor was presented by Polhemus Inc.; it is the first to enable localization of medical instruments through their trackers. Different field generators (FGs) are available by Polhemus, one being almost as small as a sugar cube. As accuracy and robustness of tracking are known challenges to using EM trackers in clinical environments, the goal of this study was a standardized assessment of the Micro Sensor in both a laboratory (lab) and a computed tomography (CT) environment.

METHODS

The Micro Sensor was assessed by means of Hummel et al.'s standardized protocol; it was assessed in conjunction with a Polhemus Liberty tracker and three FGs - with edge lengths of 1 (TX1), 2 (TX2), and 4 (TX4) inches. Precision as well as positional and rotational accuracy were determined in a lab and a CT suite. Distortions by four different metallic cylinders and tracking of two typical medical instruments - a hypodermic needle and a flexible endoscope - were also tested.

RESULTS

A jitter of 0.02 mm or less was found for all FGs in the different environments, except for the TX2 FG for which no valid data could be obtained in the CT. Errors of 5 cm distance measurements were 0.6 mm or less for all FGs in the lab. While the distance errors of the TX1 FG were only slightly increased up to 1.6 mm in the CT, those of the TX4 FG were found to be up to around 10% of the measured distance (5.4 mm on average). The mean orientation error was found to be 0.9^° /0.5^° /0.1^° for the TX4/TX2/TX1 FG in the lab. In the CT environment, rotation errors were in the same range: less than 1.2^° /0.1^° for the TX4/TX1 FG. Deviation under the presence of metallic cylinders stayed below 1 mm in most cases. Precision and orientational accuracy do not seem to be affected by instrument tracking and stayed in the same range as for the other measurements whereas distance errors were slightly increased up to 1.7 mm.

CONCLUSION

This study shows that accurate tracking of medical instruments is possible with the new Micro Sensor; it demonstrated a jitter of 0.01 mm or less, position errors below 2 mm, and rotation errors of less than 0.3^° . As with other EM trackers, errors increase when large tracking volumes with ranges of up to 50 cm are required in clinical environments. For smaller tracking volumes with ranges of up to 15 cm, a high accuracy and robustness was found. This is interesting especially for the TX1 FG which can easily be placed in close vicinity to the region of interest.

A concept for electromagnetic navigated targeting of liver tumors using an angiographic approach

BACKGROUND

The benefits of using navigation technology for percutaneous local ablation of selected hepatocellular carcinoma (HCC) have been shown. Due to additional efforts in the procedural workflow, barriers to introducing navigation systems on a broad clinical level remain high. In this work, initial steps toward a novel concept for simple and precise targeting of HCC are evaluated.

MATERIAL AND METHODS

The proposed technique is based on an angiographic approach using an intrahepatic electromagnetic (EM) reference, for consecutive percutaneous navigated positioning of ablation probes. We evaluated the environmental influence of the angiography suite on EM tracking accuracy, the measurement of a 3 D offset from two 2 D fluoroscopy images, and the accuracy and efficiency of the proposed approach in a porcine liver model.

RESULTS

The C-arm had a major influence on EM tracking accuracy, with an error up to 3.8 mm. The methodology applied for measurement of a 3 D offset from 2 D fluoroscopy images was confirmed to be feasible with a mean error of 0.76 mm. In the porcine liver model experiment, the overall target positioning error (TPE) was 2.0 mm and time for navigated targeting was 17.9 seconds, when using a tracked ablation probe.

CONCLUSIONS

The initial methodology of the proposed technique was confirmed to be feasible, introducing a novel concept for simple and precise navigated targeting of HCC.

Planning, guidance, and quality assurance of pelvic screw placement using deformable image registration

Percutaneous pelvic screw placement is challenging due to narrow bone corridors surrounded by vulnerable structures and difficult visual interpretation of complex anatomical shapes in 2D x-ray projection images. To address these challenges, a system for planning, guidance, and quality assurance (QA) is presented, providing functionality analogous to surgical navigation, but based on robust 3D-2D image registration techniques using fluoroscopy images already acquired in routine workflow. Two novel aspects of the system are investigated: automatic planning of pelvic screw trajectories and the ability to account for deformation of surgical devices (K-wire deflection). Atlas-based registration is used to calculate a patient-specific plan of screw trajectories in preoperative CT. 3D-2D registration aligns the patient to CT within the projective geometry of intraoperative fluoroscopy. Deformable known-component registration (dKC-Reg) localizes the surgical device, and the combination of plan and device location is used to provide guidance and QA. A leave-one-out analysis evaluated the accuracy of automatic planning, and a cadaver experiment compared the accuracy of dKC-Reg to rigid approaches (e.g. optical tracking). Surgical plans conformed within the bone cortex by 3-4 mm for the narrowest corridor (superior pubic ramus) and  >5 mm for the widest corridor (tear drop). The dKC-Reg algorithm localized the K-wire tip within 1.1 mm and 1.4° and was consistently more accurate than rigid-body tracking (errors up to 9 mm). The system was shown to automatically compute reliable screw trajectories and accurately localize deformed surgical devices (K-wires). Such capability could improve guidance and QA in orthopaedic surgery, where workflow is impeded by manual planning, conventional tool trackers add complexity and cost, rigid tool assumptions are often inaccurate, and qualitative interpretation of complex anatomy from 2D projections is prone to trial-and-error with extended fluoroscopy time.

Computer assistance in femoral derotation osteotomy: a bottom-up approach

Severe gait abnormalities in patients with cerebral palsy are often treated by correction osteotomy. The established procedure of femoral derotation osteotomy (FDO) has proven effective to realign femur anteversion. Nevertheless, studies have revealed that therapy outcome is subject to substantial inter-patient variability and systematic loss of correction. Our previous work suggests that practical limitations in FDO may significantly contribute to this effect. In this work, we propose a novel computer assisted measurement system to support FDO with objective measurement (desired accuracy: ∼ ± 3°) and continuous monitoring of derotation. A prototype system based on the clinically emerging electromagnetic tracking technology is demonstrated which incorporates technical and operational considerations to enable continuous measurement in OR conditions while preserving the conventional workflow without disruptions. In phantom studies, the achieved measurement accuracy (standard error $\cong\pm 1.6{}^{\circ})$ proved high potential and may hugely benefit the quality of surgical execution. Currently, the prototype system is assessed under OR conditions in an in-vivo study with CP patients. Early experience shows high appreciation among surgeons and good potential for future application.

Flexible robotics with electromagnetic tracking improves safety and efficiency during in vitro endovascular navigation

OBJECTIVE

One limitation of the use of robotic catheters is the lack of real-time three-dimensional (3D) localization and position updating: they are still navigated based on two-dimensional (2D) X-ray fluoroscopic projection images. Our goal was to evaluate whether incorporating an electromagnetic (EM) sensor on a robotic catheter tip could improve endovascular navigation.

METHODS

Six users were tasked to navigate using a robotic catheter with incorporated EM sensors in an aortic aneurysm phantom. All users cannulated two anatomic targets (left renal artery and posterior "gate") using four visualization modes: (1) standard fluoroscopy mode (control), (2) 2D fluoroscopy mode showing real-time virtual catheter orientation from EM tracking, (3) 3D model of the phantom with anteroposterior and endoluminal view, and (4) 3D model with anteroposterior and lateral view. Standard X-ray fluoroscopy was always available. Cannulation and fluoroscopy times were noted for every mode. 3D positions of the EM tip sensor were recorded at 4 Hz to establish kinematic metrics.

RESULTS

The EM sensor-incorporated catheter navigated as expected according to all users. The success rate for cannulation was 100%. For the posterior gate target, mean cannulation times in minutes:seconds were 8:12, 4:19, 4:29, and 3:09, respectively, for modes 1, 2, 3 and 4 (P = .013), and mean fluoroscopy times were 274, 20, 29, and 2 seconds, respectively (P = .001). 3D path lengths, spectral arc length, root mean dimensionless jerk, and number of submovements were significantly improved when EM tracking was used (P < .05), showing higher quality of catheter movement with EM navigation.

CONCLUSIONS

The EM tracked robotic catheter allowed better real-time 3D orientation, facilitating navigation, with a reduction in cannulation and fluoroscopy times and improvement of motion consistency and efficiency.

Electromagnetic tracking in medicine--a review of technology, validation, and applications

Object tracking is a key enabling technology in the context of computer-assisted medical interventions. Allowing the continuous localization of medical instruments and patient anatomy, it is a prerequisite for providing instrument guidance to subsurface anatomical structures. The only widely used technique that enables real-time tracking of small objects without line-of-sight restrictions is electromagnetic (EM) tracking. While EM tracking has been the subject of many research efforts, clinical applications have been slow to emerge. The aim of this review paper is therefore to provide insight into the future potential and limitations of EM tracking for medical use. We describe the basic working principles of EM tracking systems, list the main sources of error, and summarize the published studies on tracking accuracy, precision and robustness along with the corresponding validation protocols proposed. State-of-the-art approaches to error compensation are also reviewed in depth. Finally, an overview of the clinical applications addressed with EM tracking is given. Throughout the paper, we report not only on scientific progress, but also provide a review on commercial systems. Given the continuous debate on the applicability of EM tracking in medicine, this paper provides a timely overview of the state-of-the-art in the field.

Robust methods for automatic image-to-world registration in cone-beam CT interventional guidance

PURPOSE

Real-time surgical navigation relies on accurate image-to-world registration to align the coordinate systems of the image and patient. Conventional manual registration can present a workflow bottleneck and is prone to manual error and intraoperator variability. This work reports alternative means of automatic image-to-world registration, each method involving an automatic registration marker (ARM) used in conjunction with C-arm cone-beam CT (CBCT). The first involves a Known-Model registration method in which the ARM is a predefined tool, and the second is a Free-Form method in which the ARM is freely configurable.

METHODS

Studies were performed using a prototype C-arm for CBCT and a surgical tracking system. A simple ARM was designed with markers comprising a tungsten sphere within infrared reflectors to permit detection of markers in both x-ray projections and by an infrared tracker. The Known-Model method exercised a predefined specification of the ARM in combination with 3D-2D registration to estimate the transformation that yields the optimal match between forward projection of the ARM and the measured projection images. The Free-Form method localizes markers individually in projection data by a robust Hough transform approach extended from previous work, backprojected to 3D image coordinates based on C-arm geometric calibration. Image-domain point sets were transformed to world coordinates by rigid-body point-based registration. The robustness and registration accuracy of each method was tested in comparison to manual registration across a range of body sites (head, thorax, and abdomen) of interest in CBCT-guided surgery, including cases with interventional tools in the radiographic scene.

RESULTS

The automatic methods exhibited similar target registration error (TRE) and were comparable or superior to manual registration for placement of the ARM within ∼200 mm of C-arm isocenter. Marker localization in projection data was robust across all anatomical sites, including challenging scenarios involving the presence of interventional tools. The reprojection error of marker localization was independent of the distance of the ARM from isocenter, and the overall TRE was dominated by the configuration of individual fiducials and distance from the target as predicted by theory. The median TRE increased with greater ARM-to-isocenter distance (e.g., for the Free-Form method, TRE increasing from 0.78 mm to 2.04 mm at distances of ∼75 mm and 370 mm, respectively). The median TRE within ∼200 mm distance was consistently lower than that of the manual method (TRE = 0.82 mm). Registration performance was independent of anatomical site (head, thorax, and abdomen). The Free-Form method demonstrated a statistically significant improvement (p = 0.0044) in reproducibility compared to manual registration (0.22 mm versus 0.30 mm, respectively).

CONCLUSIONS

Automatic image-to-world registration methods demonstrate the potential for improved accuracy, reproducibility, and workflow in CBCT-guided procedures. A Free-Form method was shown to exhibit robustness against anatomical site, with comparable or improved TRE compared to manual registration. It was also comparable or superior in performance to a Known-Model method in which the ARM configuration is specified as a predefined tool, thereby allowing configuration of fiducials on the fly or attachment to the patient.

Emerging technologies for image guidance and device navigation in interventional radiology

Recent developments in image-guidance and device navigation, along with emerging robotic technologies, are rapidly transforming the landscape of interventional radiology (IR). Future state-of-the-art IR procedures may include real-time three-dimensional imaging that is capable of visualizing the target organ, interventional tools, and surrounding anatomy with high spatial and temporal resolution. Remote device actuation is becoming a reality with the introduction of novel magnetic-field enabled instruments and remote robotic steering systems. Robots offer several degrees of freedom and unprecedented accuracy, stability, and dexterity during device navigation, propulsion, and actuation. Optimization of tracking and navigation of interventional tools inside the human body will be critical in converting IR suites into the minimally invasive operating theaters of the future with increased safety and unsurpassed therapeutic efficacy. In the not too distant future, individual image guidance modalities and device tracking methods could merge into autonomous, multimodality, multiparametric platforms that offer real-time data of anatomy, morphology, function, and metabolism along with on-the-fly computational modeling and remote robotic actuation. The authors provide a concise overview of the latest developments in image guidance and device navigation, while critically envisioning what the future might hold for 2020 IR procedures.