Real-time 3D position reconstruction of guidewire for monoplane X-ray

Topology observing 3D device reconstruction from continuous-sweep limited angle fluoroscopy

BACKGROUND

Minimally invasive procedures usually require navigating a microcatheter and guidewire through endoluminal structures such as blood vessels and airways to sites of the disease. For numerous clinical applications, two-dimensional (2D) fluoroscopy is the primary modality used for real-time image guidance during navigation. However, 2D imaging can pose challenges for navigation in complex structures. Real-time 3D visualization of devices within the anatomic context could provide considerable benefits for these procedures. Continuous-sweep limited angle (CLA) fluoroscopy has recently been proposed to provide a compromise between conventional rotational 3D acquisitions and real-time fluoroscopy.

PURPOSE

The purpose of this work was to develop and evaluate a noniterative 3D device reconstruction approach for CLA fluoroscopy acquisitions, which takes into account endoluminal topology to avoid impossible paths between disconnected branches.

METHODS

The algorithm relies on a static 3D roadmap (RM) of vessels or airways, which may be generated from conventional cone beam CT (CBCT) acquisitions prior to navigation. The RM is converted to a graph representation describing its topology. During catheter navigation, the device is segmented from the live 2D projection images using a deep learning approach from which the centerlines are extracted. Rays from the focal spot to detector pixels representing 2D device points are identified and intersections with the RM are computed. Based on the RM graph, a subset of line segments is selected as candidates to exclude device paths through disconnected branches of the RM. Depth localization for each point along the device is then performed by finding the point closest to the previous 3D reconstruction along the candidate segments. This process is repeated as the projection angle changes for each CLA image frame. The approach was evaluated in a phantom study in which a catheter and guidewire were navigated along five pathways within a complex vessel phantom. The result was compared to static cCBCT acquisitions of the device in the final position.

RESULTS

The average root mean squared 3D distance between CLA reconstruction and reference centerline was1.87 ± 0.30 $1.87 \pm 0.30$ mm. The Euclidean distance at the device tip was2.92 ± 2.35 $2.92 \pm 2.35$ mm. The correct pathway was identified during reconstruction in100 % $100\%$ of frames (n = 1475 $n=1475$ ). The percentage of 3D device points reconstructed inside the 3D roadmap was91.83 ± 2.52 % $91.83 \pm 2.52\%$ with an average distance of0.62 ± 0.30 $0.62 \pm 0.30$ mm between the device points outside the roadmap and the nearest point within the roadmap.

CONCLUSIONS

This study demonstrates the feasibility of reconstructing curvilinear devices such as catheters and guidewires during endoluminal procedures including intravascular and transbronchial interventions using a noniterative reconstruction approach for CLA fluoroscopy. This approach could improve device navigation in cases where the structure of vessels or airways is complex and includes overlapping branches.

3D localization from 2D X-ray projection

PURPOSE

Most cardiology procedures are guided using X-ray (XR) fluoroscopy. However, the projective nature of the XR fluoroscopy does not allow for true depth perception as required for safe and efficient intervention guidance in structural heart diseases. For improving guidance, different methods have been proposed often being radiation-intensive, time-consuming, or expensive. We propose a simple 3D localization method based on a single monoplane XR projection using a co-registered centerline model.

METHODS

The method is based on 3D anatomic surface models and corresponding centerlines generated from preprocedural imaging. After initial co-registration, 2D working points identified in monoplane XR projections are localized in 3D by minimizing the angle between the projection lines of the centerline points and the working points. The accuracy and reliability of the located 3D positions were assessed in 3D using phantom data and in patient data projected to 2D obtained during placement of embolic protection system in interventional procedures.

RESULTS

With the proposed methods, 2D working points identified in monoplane XR could be successfully located in the 3D phantom and in the patient-specific 3D anatomy. Accuracy in the phantom (3D) resulted in 1.6 mm (± 0.8 mm) on average, and 2.7 mm (± 1.3 mm) on average in the patient data (2D).

CONCLUSION

The use of co-registered centerline models allows reliable and accurate 3D localization of devices from a single monoplane XR projection during placement of the embolic protection system in TAVR. The extension to different vascular interventions and combination with automatic methods for device detection and registration might be promising.

Laser-Generated Leaky Acoustic Wave Imaging for Interventional Guidewire Guidance

Ultrasound (US) is widely used to visualize both tissue and the positions of surgical instruments in real time during surgery. Previously we proposed a new method to exploit US imaging and laser-generated leaky acoustic waves (LAWs) for needle visualization. Although successful, that method only detects the position of a needle tip, with the location of the entire needle deduced from knowing that the needle is straight. The purpose of the current study was to develop a beamforming-based method for the direct visualization of objects. The approach can be applied to objects with arbitrary shapes, such as the guidewires that are commonly used in interventional guidance. With this method, illumination by a short laser pulse generates photoacoustic waves at the top of the guidewire that propagate down its metal surface. These waves then leak into the surrounding tissue, which can be detected by a US array transducer. The time of flight consists of two parts: 1) the propagation time of the guided waves on the guidewire and 2) the propagation time of the US that leaks into the tissue. In principle, an image of the guidewire can be formed based on array beamforming by taking the propagation time on the metal into consideration. Furthermore, we introduced directional filtering and a matched filter to compress the dispersion signal associated with long propagation times. The results showed that guidewires could be detected at depths of at least 70 mm. The maximum detectable angle was 56.3°. LAW imaging with a 1268-mm-long guidewire was also demonstrated. The proposed method has considerable potential in new clinical applications.

Constrained stochastic state estimation of deformable 1D objects: Application to single-view 3D reconstruction of catheters with radio-opaque markers

Minimally invasive fluoroscopy-based procedures are the gold standard for diagnosis and treatment of various pathologies of the cardiovascular system. This kind of procedures imply for the clinicians to infer the 3D shape of the device from 2D images, which is known to be an ill-posed problem. In this paper we present a method to reconstruct the 3D shape of the interventional device, with the aim of improving the navigation. The method combines a physics-based simulation with non-linear Bayesian filter. Whereas the physics-based model provides a prediction of the shape of the device navigating within the blood vessels (taking into account non-linear interactions between the catheter and the surrounding anatomy), an Unscented Kalman Filter is used to correct the navigation model using 2D image features as external observations. The proposed framework has been evaluated on both synthetic and real data, under different model parameterizations, filter parameters tuning and external observations data-sets. Comparing the reconstructed 3D shape with a known ground truth, for the synthetic data-set, we obtained average values for 3D Hausdorff Distance of 0.81±0.53mm, for the 3D mean distance at the segment of 0.37±0.17mm and an average 3D tip error of 0.24±0.13mm. For the real data-set,we obtained an average 3D Hausdorff distance of 1.74±0.77mm, a average 3D mean distance at the distal segment of 0.91±0.14mm, an average 3D error on the tip of 0.53±0.09mm. These results show the ability of our method to retrieve the 3D shape of the device, under a variety of filter parameterizations and challenging conditions: uncertainties on model parameterization, ambiguous views and non-linear complex phenomena such as stick and slip motions.

Simultaneous reconstruction of multiple stiff wires from a single X-ray projection for endovascular aortic repair

PURPOSE

Endovascular repair of aortic aneurysms (EVAR) can be supported by fusing pre- and intraoperative data to allow for improved navigation and to reduce the amount of contrast agent needed during the intervention. However, stiff wires and delivery devices can deform the vasculature severely, which reduces the accuracy of the fusion. Knowledge about the 3D position of the inserted instruments can help to transfer these deformations to the preoperative information.

METHOD

We propose a method to simultaneously reconstruct the stiff wires in both iliac arteries based on only a single monoplane acquisition, thereby avoiding interference with the clinical workflow. In the available X-ray projection, the 2D course of the wire is extracted. Then, a virtual second view of each wire orthogonal to the real projection is estimated using the preoperative vessel anatomy from a computed tomography angiography as prior information. Based on the real and virtual 2D wire courses, the wires can then be reconstructed in 3D using epipolar geometry.

RESULTS

We achieve a mean modified Hausdorff distance of 4.2 mm between the estimated 3D position and the true wire course for the contralateral side and 4.5 mm for the ipsilateral side.

CONCLUSION

The accuracy and speed of the proposed method allow for use in an intraoperative setting of deformation correction for EVAR.

4D interventional device reconstruction from biplane fluoroscopy

PURPOSE

Biplane angiography systems provide time resolved 2D fluoroscopic images from two different angles, which can be used for the positioning of interventional devices such as guidewires and catheters. The purpose of this work is to provide a novel algorithm framework, which allows the 3D reconstruction of these curvilinear devices from the 2D projection images for each time frame. This would allow creating virtual projection images from arbitrary view angles without changing the position of the gantries, as well as virtual endoscopic 3D renderings.

METHODS

The first frame of each time sequence is registered to and subtracted from the following frame using an elastic grid registration technique. The images are then preprocessed by a noise reduction algorithm using directional adaptive filter kernels and a ridgeness filter that emphasizes curvilinear structures. A threshold based segmentation of the device is then performed, followed by a flux driven topology preserving thinning algorithm to extract the segments of the device centerline. The exact device path is determined using Dijkstra's algorithm to minimize the curvature and distance between adjacent segments as well as the difference to the device path of the previous frame. The 3D device centerline is then reconstructed using epipolar geometry.

RESULTS

The accuracy of the reconstruction was measured in a vascular head phantom as well as in a cadaver head and a canine study. The device reconstructions are compared to rotational 3D acquisitions. In the phantom experiments, an average device tip accuracy of 0.35 ± 0.09 mm, a Hausdorff distance of 0.65 ± 0.32 mm, and a mean device distance of 0.54 ± 0.33 mm were achieved. In the cadaver head and canine experiments, the device tip was reconstructed with an average accuracy of 0.26 ± 0.20 mm, a Hausdorff distance of 0.62 ± 0.08 mm, and a mean device distance of 0.41 ± 0.08 mm. Additionally, retrospective reconstruction results of real patient data are presented.

CONCLUSIONS

The presented algorithm is a novel approach for the time resolved 3D reconstruction of interventional devices from biplane fluoroscopic images, thus allowing the creation of virtual projection images from arbitrary view angles as well as virtual endoscopic 3D renderings. Availability of this technique would enhance the ability to accurately position devices in minimally invasive endovascular procedures.