Robust and Realtime Large Deformation Ultrasound Registration Using End-to-End Differentiable Displacement Optimisation

Image registration for temporal ultrasound sequences can be very beneficial for image-guided diagnostics and interventions. Cooperative human-machine systems that enable seamless assistance for both inexperienced and expert users during ultrasound examinations rely on robust, realtime motion estimation. Yet rapid and irregular motion patterns, varying image contrast and domain shifts in imaging devices pose a severe challenge to conventional realtime registration approaches. While learning-based registration networks have the promise of abstracting relevant features and delivering very fast inference times, they come at the potential risk of limited generalisation and robustness for unseen data; in particular, when trained with limited supervision. In this work, we demonstrate that these issues can be overcome by using end-to-end differentiable displacement optimisation. Our method involves a trainable feature backbone, a correlation layer that evaluates a large range of displacement options simultaneously and a differentiable regularisation module that ensures smooth and plausible deformation. In extensive experiments on public and private ultrasound datasets with very sparse ground truth annotation the method showed better generalisation abilities and overall accuracy than a VoxelMorph network with the same feature backbone, while being two times faster at inference.

Meta-Learning Initializations for Interactive Medical Image Registration

We present a meta-learning framework for interactive medical image registration. Our proposed framework comprises three components: a learning-based medical image registration algorithm, a form of user interaction that refines registration at inference, and a meta-learning protocol that learns a rapidly adaptable network initialization. This paper describes a specific algorithm that implements the registration, interaction and meta-learning protocol for our exemplar clinical application: registration of magnetic resonance (MR) imaging to interactively acquired, sparsely-sampled transrectal ultrasound (TRUS) images. Our approach obtains comparable registration error (4.26 mm) to the best-performing non-interactive learning-based 3D-to-3D method (3.97 mm) while requiring only a fraction of the data, and occurring in real-time during acquisition. Applying sparsely sampled data to non-interactive methods yields higher registration errors (6.26 mm), demonstrating the effectiveness of interactive MR-TRUS registration, which may be applied intraoperatively given the real-time nature of the adaptation process.

Real-time denoising of ultrasound images based on deep learning

Ultrasound images are widespread in medical diagnosis for muscle-skeletal, cardiac, and obstetrical diseases, due to the efficiency and non-invasiveness of the acquisition methodology. However, ultrasound acquisition introduces noise in the signal, which corrupts the resulting image and affects further processing steps, e.g. segmentation and quantitative analysis. We define a novel deep learning framework for the real-time denoising of ultrasound images. Firstly, we compare state-of-the-art methods for denoising (e.g. spectral, low-rank methods) and select WNNM (Weighted Nuclear Norm Minimisation) as the best denoising in terms of accuracy, preservation of anatomical features, and edge enhancement. Then, we propose a tuned version of WNNM (tuned-WNNM) that improves the quality of the denoised images and extends its applicability to ultrasound images. Through a deep learning framework, the tuned-WNNM qualitatively and quantitatively replicates WNNM results in real-time. Finally, our approach is general in terms of its building blocks and parameters of the deep learning and high-performance computing framework; in fact, we can select different denoising algorithms and deep learning architectures.

Real-time multimodal image registration with partial intraoperative point-set data

We present Free Point Transformer (FPT) - a deep neural network architecture for non-rigid point-set registration. Consisting of two modules, a global feature extraction module and a point transformation module, FPT does not assume explicit constraints based on point vicinity, thereby overcoming a common requirement of previous learning-based point-set registration methods. FPT is designed to accept unordered and unstructured point-sets with a variable number of points and uses a "model-free" approach without heuristic constraints. Training FPT is flexible and involves minimizing an intuitive unsupervised loss function, but supervised, semi-supervised, and partially- or weakly-supervised training are also supported. This flexibility makes FPT amenable to multimodal image registration problems where the ground-truth deformations are difficult or impossible to measure. In this paper, we demonstrate the application of FPT to non-rigid registration of prostate magnetic resonance (MR) imaging and sparsely-sampled transrectal ultrasound (TRUS) images. The registration errors were 4.71 mm and 4.81 mm for complete TRUS imaging and sparsely-sampled TRUS imaging, respectively. The results indicate superior accuracy to the alternative rigid and non-rigid registration algorithms tested and substantially lower computation time. The rapid inference possible with FPT makes it particularly suitable for applications where real-time registration is beneficial.

The Feasibility of Haar Feature-Based Endoscopic Ultrasound Probe Tracking for Implanting Hydrogel Spacer in Radiation Therapy for Pancreatic Cancer

Purpose

We proposed a Haar feature-based method for tracking endoscopic ultrasound (EUS) probe in diagnostic computed tomography (CT) and Magnetic Resonance Imaging (MRI) scans for guiding hydrogel injection without external tracking hardware. This study aimed to assess the feasibility of implementing our method with phantom and patient images.

Materials and Methods

Our methods included the pre-simulation section and Haar features extraction steps. Firstly, the simulated EUS set was generated based on anatomic information of interpolated CT/MRI images. Secondly, the efficient Haar features were extracted from simulated EUS images to create a Haar feature dictionary. The relative EUS probe position was estimated by searching the best matched Haar feature vector of the dictionary with Haar feature vector of target EUS images. The utilization of this method was validated using EUS phantom and patient CT/MRI images.

Results

In the phantom experiment, we showed that our Haar feature-based EUS probe tracking method can find the best matched simulated EUS image from a simulated EUS dictionary which includes 123 simulated images. The errors of all four target points between the real EUS image and the best matched EUS images were within 1 mm. In the patient CT/MRI scans, the best matched simulated EUS image was selected by our method accurately, thereby confirming the probe location. However, when applying our method in MRI images, our method is not always robust due to the low image resolution.

Conclusions

Our Haar feature-based method is capable to find the best matched simulated EUS image from the dictionary. We demonstrated the feasibility of our method for tracking EUS probe without external tracking hardware, thereby guiding the hydrogel injection between the head of the pancreas and duodenum.

An Approach for Live Motion Correction for TRUS-MR Prostate Fusion Biopsy using Deep Learning

TRUS-MR fusion guided biopsy highly depends on the quality of alignment between pre-operative Magnetic Resonance (MR) image and live trans-rectal ultrasound (TRUS) image during biopsy. Lot of factors influence the alignment of prostate during the biopsy like rigid motion due to patient movement and deformation of the prostate due to probe pressure. For MR-TRUS alignment during live procedure, the efficiency of the algorithm and accuracy plays an important role. In this paper, we have designed a comprehensive framework for fusion based biopsy using an end-to-end deep learning network for performing both rigid and deformation correction. Both rigid and deformation correction in one single network helps in reducing the computation time required for live TRUS-MR alignment. We have used 6500 images from 34 subjects for conducting this study. Our proposed registration pipeline provides Target Registration Error (TRE) of 2.51 mm after rigid and deformation correction on unseen patient dataset. In addition, with a total computation time of 70ms, we are able to achieve a rendering rate of 14 frames per second (FPS) that makes our network well suited for live procedures.Clinical Relevance- It is shown in the literature that systematic biopsy is the standard method for biopsy sampling in prostate that has high false negative rates. TRUS-MR fusion guided biopsy reduces the false negative rate of the sampling in prostate biopsy. Therefore, a live TRUS-MR fusion framework is helpful for prostate biopsy clinical procedures.

Comparison of Accuracies between Real-Time Nonrigid and Rigid Registration in the MRI-US Fusion Biopsy of the Prostate

Magnetic resonance imaging (MRI) is increasingly important in the detection and localization of prostate cancer. Regarding suspicious lesions on MRI, a targeted biopsy using MRI fused with ultrasound (US) is widely used. To achieve a successful targeted biopsy, a precise registration between MRI and US is essential. The purpose of our study was to show any decrease in errors using a real-time nonrigid registration technique for prostate biopsy. Nineteen patients with suspected prostate cancer were prospectively enrolled in this study. Registration accuracy was calculated by the measuring distance of corresponding points by rigid and nonrigid registration between MRI and US, and compared for rigid and nonrigid registration methods. Overall cancer detection rates were also evaluated by patient and by core. Prostate volume was measured automatically from MRI and manually from US, and compared to each other. Mean distances between the corresponding points in MRI and US were 5.32 ± 2.61 mm for rigid registration and 2.11 ± 1.37 mm for nonrigid registration (p < 0.05). Cancer was diagnosed in 11 of 19 patients (57.9%), and in 67 of 266 biopsy cores (25.2%). There was no significant difference in prostate-volume measurement between the automatic and manual methods (p = 0.89). In conclusion, nonrigid registration reduces targeting errors.

Towards real-time free-hand biopsy navigation

PURPOSE

Performing a transrectal ultrasound (TRUS) prostate biopsy is at the heart of the current prostate cancer detection procedure. With today's two-dimensional (2D) live ultrasound (US) imaging equipment, this task remains complex due to the poor visibility of cancerous tissue on TRUS images and the limited anatomical context available in the 2D TRUS plane. This paper presents a rigid 2D/3DUS registration method for navigated prostate biopsy. This allows continuous localization of the biopsy trajectory during the procedure.

METHODS

We proposed an organ-based approach to achieve real-time rigid registration without the need for any probe localization device. The registration method combines image similarity and geometric proximity of detected features. Additions to our previous work include a multi-level approach and the use of a rejection rate favouring the best matches. Their aim is to increase the accuracy and time performances. These modifications and their in-depth evaluation on real clinical cases and comparison to this previous work are described. We performed static and dynamic evaluations along biopsy trajectories on a very large amount of data acquired under uncontrolled routine conditions. The computed transforms are compared to a ground truth obtained either from corresponding manually detected fiducials or from an already evaluated registration method.

RESULTS

All results show that the current method outperforms its previous version, both in terms of accuracy (the average error reported here is 12 to 17% smaller depending on the experiment) and processing time (from 20 to 60 times faster compared to the previous implementation). The dynamic registration experiment demonstrates that the method can be successfully used for continuous tracking of the biopsy location w.r.t the prostate at a rate that varies between 5 and 15 Hz.

CONCLUSIONS

This work shows that on the fly 2D/3DUS registration can be performed very efficiently on biopsy trajectories. This allows us to plan further improvements in prostate navigation and a clinical transfer.

MRI-targeted prostate biopsy: the next step forward!

Aim

For decades, the gold standard technique for diagnosing prostate cancer was the 10 to 12 core systematic transrectal or transperineal biopsy, under ultrasound guidance. Over the past years, an increased rate of false negative results and detection of clinically insignificant prostate cancer has been noted, resulting into overdiagnosis and overtreatment. The purpose of the current study was to evaluate the changes in diagnosis and management of prostate cancer brought by MRI-targeted prostate biopsy.

Methods

A critical review of literature was carried out using the Medline database through a PubMed search, 37 studies meeting the inclusion criteria: prospective studies published in the past 8 years with at least 100 patients per study, which used multiparametric magnetic resonance imaging as guidance for targeted biopsies.

Results

In-Bore MRI targeted biopsy and Fusion targeted biopsy outperform standard systematic biopsy both in terms of overall and clinically significant prostate cancer detection, and ensure a lower detection rate of insignificant prostate cancer, with fewer cores needed. In-Bore MRI targeted biopsy performs better than Fusion biopsy especially in cases of apical lesions.

Conclusion

Targeted biopsy is an emerging and developing technique which offers the needed improvements in diagnosing clinically significant prostate cancer and lowers the incidence of insignificant ones, providing a more accurate selection of the patients for active surveillance and focal therapies.

Geometrically variable three-dimensional ultrasound for mechanically assisted image-guided therapy of focal liver cancer tumors

PURPOSE

Image-guided focal ablation procedures are first-line therapy options in the treatment of liver cancer tumors that provide advantageous reductions in patient recovery times and complication rates relative to open surgery. However, extensive physician training is required and image guidance variabilities during freehand therapy applicator placement limit the sufficiency of ablation volumes and the overall potential of these procedures. We propose the use of three-dimensional ultrasound (3D US) to provide guidance and localization of therapy applicators, augmenting current ablation therapies without the need for specialized procedure suites. We have developed a novel scanning mechanism for geometrically variable 3D US images, a mechanical tracking system, and a needle applicator insertion workflow using a custom needle applicator guide for targeted image-guided procedures.

METHODS

A three-motor scanner was designed to use any commercially available US probe to generate accurate, consistent, and geometrically variable 3D US images. The designed scanner was mounted on a counterbalanced stabilizing and mechanical tracking system for determining the US probe orientation, which was assessed using optical tracking. Further exploiting the utility of the motorized scanner, an image-guidance workflow was developed that moved the probe to any identified target within an acquired 3D US image. The complete 3D US guidance system was used to perform mock targeted interventional procedures on a phantom by selecting a target in a 3D US image, navigating to the target, and performing needle insertion using a custom 3D-printed needle applicator guide. Registered postinsertion 3D US images and cone-beam computed tomography (CBCT) images were used to evaluate tip targeting errors when using the motors, tracking system, or mixed navigation approaches. Two 3D US image geometries were investigated to assess the accuracy of a small-footprint tilt approach and a large field-of-view hybrid approach for a total of 48 targeted needle insertions. 3D US image quality was evaluated in a healthy volunteer and compared to a commercially available matrix array US probe.

RESULTS

A mean positioning error of 1.85 ± 1.33 mm was observed when performing compound joint manipulations with the mechanical tracking system. A combined approach for navigation that incorporated the motorized movement and the in-plane tracking system corrections performed the best with a mean tip error of 3.77 ± 2.27 mm and 4.27 ± 2.47 mm based on 3D US and CBCT images, respectively. No significant differences were observed between hybrid and tilt image acquisition geometries with all mean registration errors ≤1.2 mm. 3D US volunteer images resulted in clear reconstruction of clinically relevant anatomy.

CONCLUSIONS

A mechanically tracked system with geometrically variable 3D US provides a utility that enables enhanced applicator guidance, placement verification, and improved clinical workflow during focal liver tumor ablation procedures. Evaluations of the tracking accuracy, targeting capabilities, and clinical imaging feasibility of the proposed 3D US system, provided evidence for clinical translation. This system could provide a workflow for improving applicator placement and reducing local cancer recurrence during interventional procedures treating liver cancer and has the potential to be expanded to other abdominal interventions and procedures.

Deformable registration of 3D ultrasound volumes using automatic landmark generation

US image registration is an important task e.g. in Computer Aided Surgery. Due to tissue deformation occurring between pre-operative and interventional images often deformable registration is necessary. We present a registration method focused on surface structures (i.e. saliencies) of soft tissues like organ capsules or vessels. The main concept follows the idea of representative landmarks (so called leading points). These landmarks represent saliencies in each image in a certain region of interest. The determination of deformation was based on a geometric model assuming that saliencies could locally be described by planes. These planes were calculated from the landmarks using two dimensional linear regression. Once corresponding regions in both images were found, a displacement vector field representing the local deformation was computed. Finally, the deformed image was warped to match the pre-operative image. For error calculation we used a phantom representing the urinary bladder and the prostate. The phantom could be deformed to mimic tissue deformation. Error calculation was done using corresponding landmarks in both images. The resulting target registration error of this procedure amounted to 1.63 mm. With respect to patient data a full deformable registration was performed on two 3D-US images of the abdomen. The resulting mean distance error was 2.10 ± 0.66 mm compared to an error of 2.75 ± 0.57 mm from a simple rigid registration. A two-sided paired t-test showed a p-value < 0.001. We conclude that the method improves the results of the rigid registration considerably. Provided an appropriate choice of the filter there are many possible fields of applications.

Controversies in MR targeted biopsy: alone or combined, cognitive versus software-based fusion, transrectal versus transperineal approach?

PURPOSE

To review the evidence addressing current controversies around prostate biopsy. Specific questions explored were (1) mpMRI targeted (TgBx) alone versus combined with systematic (SBx) biopsy; (2) cognitive versus software-based targeted biopsy; (3) transrectal or transperineal route (TP).

METHODS

We performed a literature search of peer-reviewed English language articles using PubMed and the words "prostate" AND "biopsy". Web search was implemented by manual search.

RESULTS

Prostate mpMRI is revolutionizing prostate cancer (PCa) diagnosis, and TgBx improves the detection of clinically significant (cs) PCa compared to SBx alone. The utility of combining SBx-TgBx is variable, but in non-expert centres the two should be combined to overcome learning curve-limitations. Whether SBx should be maintained in expert centres depends on what rate of missed cancer the urological community and patients are prone to accept; this has implications for insignificant cancer diagnosis as well. TgBx may be more precise using a software-based-approach despite cognitive TgBx proved non-inferior in some studies, and may be used for large accessible lesions. TP-biopsies are feasible in an in-office setting. Avoidance of the rectum and accessibility of virtually all prostate areas are attractive features. However, this has to be balanced with local setting and resources implications. Ongoing trials will shed light on unsolved issues.

CONCLUSION

The prostate biopsy strategy should be tailored to local expertise, needs and resources availability. Targeted biopsy enhance the ratio between cs and insignificant cancer diagnosis, although some csPCa might be missed. Software-based TgBx are likely to be more precise, especially for new users, although the additional cost might be not justified in all cases. TPBx have ideal attributes for performing TgBx and avoiding infection, although this has resources implications.

Real-time, image-based slice-to-volume registration for ultrasound-guided spinal intervention

Real-time fusion of magnetic resonance (MR) and ultrasound (US) images could facilitate safe and accurate needle placement in spinal interventions. We develop an entirely image-based registration method (independent of or complementary to surgical trackers) that includes an efficient US probe pose initialization algorithm. The registration enables the simultaneous display of 2D ultrasound image slices relative to 3D pre-procedure MR images for navigation. A dictionary-based 3D-2D pose initialization algorithm was developed in which likely probe positions are predefined in a dictionary with feature encoding by Haar wavelet filters. Feature vectors representing the 2D US image are computed by scaling and translating multiple Haar basis filters to capture scale, location, and relative intensity patterns of distinct anatomical features. Following pose initialization, fast 3D-2D registration was performed by optimizing normalized cross-correlation between intra- and pre-procedure images using Powell's method. Experiments were performed using a lumbar puncture phantom and a fresh cadaver specimen presenting realistic image quality in spinal US imaging. Accuracy was quantified by comparing registration transforms to ground truth motion imparted by a computer-controlled motion system and calculating target registration error (TRE) in anatomical landmarks. Initialization using a 315-length feature vector yielded median translation accuracy of 2.7 mm (3.4 mm interquartile range, IQR) in the phantom and 2.1 mm (2.5 mm IQR) in the cadaver. By comparison, storing the entire image set in the dictionary and optimizing correlation yielded a comparable median accuracy of 2.1 mm (2.8 mm IQR) in the phantom and 2.9 mm (3.5 mm IQR) in the cadaver. However, the dictionary-based method reduced memory requirements by 47×  compared to storing the entire image set. The overall 3D error after registration measured using 3D landmarks was 3.2 mm (1.8 mm IQR) mm in the phantom and 3.0 mm (2.3 mm IQR) mm in the cadaver. The system was implemented in a 3D Slicer interface to facilitate translation to clinical studies. Haar feature based initialization provided accuracy and robustness at a level that was sufficient for real-time registration using an entirely image-based method for ultrasound navigation. Such an approach could improve the accuracy and safety of spinal interventions in broad utilization, since it is entirely software-based and can operate free from the cost and workflow requirements of surgical trackers.

Robust 2-D-3-D Registration Optimization for Motion Compensation During 3-D TRUS-Guided Biopsy Using Learned Prostate Motion Data

In magnetic resonance (MR)-targeted, 3-D transrectal ultrasound (TRUS)-guided biopsy, prostate motion during the procedure increases the needle targeting error and limits the ability to accurately sample MR-suspicious tumor volumes. The robustness of the 2-D-3-D registration methods for prostate motion compensation is impacted by local optima in the search space. In this paper, we analyzed the prostate motion characteristics and investigated methods to incorporate such knowledge into the registration optimization framework to improve robustness against local optima. Rigid motion of the prostate was analyzed adopting a mixture-of-Gaussian (MoG) model using 3-D TRUS images acquired at bilateral sextant probe positions with a mechanically assisted biopsy system. The learned motion characteristics were incorporated into Powell's direction set method by devising multiple initial search positions and initial search directions. Experiments were performed on data sets acquired during clinical biopsy procedures, and registration error was evaluated using target registration error (TRE) and converged image similarity metric values after optimization. After incorporating the learned initialization positions and directions in Powell's method, 2-D-3-D registration to compensate for motion during prostate biopsy was performed with rms ± std TRE of 2.33 ± 1.09 mm with ~3 s mean execution time per registration. This was an improvement over 3.12 ± 1.70 mm observed in Powell's standard approach. For the data acquired under clinical protocols, the converged image similarity metric value improved in ≥8% of the registrations whereas it degraded only ≤1% of the registrations. The reported improvements in optimization indicate useful advancements in robustness to ensure smooth clinical integration of a registration solution for motion compensation that facilitates accurate sampling of the smallest clinically significant tumors.

Real-time registration of 3D to 2D ultrasound images for image-guided prostate biopsy

PURPOSE

During image-guided prostate biopsy, needles are targeted at tissues that are suspicious of cancer to obtain specimen for histological examination. Unfortunately, patient motion causes targeting errors when using an MR-transrectal ultrasound (TRUS) fusion approach to augment the conventional biopsy procedure. This study aims to develop an automatic motion correction algorithm approaching the frame rate of an ultrasound system to be used in fusion-based prostate biopsy systems. Two modes of operation have been investigated for the clinical implementation of the algorithm: motion compensation using a single user initiated correction performed prior to biopsy, and real-time continuous motion compensation performed automatically as a background process.

METHODS

Retrospective 2D and 3D TRUS patient images acquired prior to biopsy gun firing were registered using an intensity-based algorithm utilizing normalized cross-correlation and Powell's method for optimization. 2D and 3D images were downsampled and cropped to estimate the optimal amount of image information that would perform registrations quickly and accurately. The optimal search order during optimization was also analyzed to avoid local optima in the search space. Error in the algorithm was computed using target registration errors (TREs) from manually identified homologous fiducials in a clinical patient dataset. The algorithm was evaluated for real-time performance using the two different modes of clinical implementations by way of user initiated and continuous motion compensation methods on a tissue mimicking prostate phantom.

RESULTS

After implementation in a TRUS-guided system with an image downsampling factor of 4, the proposed approach resulted in a mean ± std TRE and computation time of 1.6 ± 0.6 mm and 57 ± 20 ms respectively. The user initiated mode performed registrations with in-plane, out-of-plane, and roll motions computation times of 108 ± 38 ms, 60 ± 23 ms, and 89 ± 27 ms, respectively, and corresponding registration errors of 0.4 ± 0.3 mm, 0.2 ± 0.4 mm, and 0.8 ± 0.5°. The continuous method performed registration significantly faster (P < 0.05) than the user initiated method, with observed computation times of 35 ± 8 ms, 43 ± 16 ms, and 27 ± 5 ms for in-plane, out-of-plane, and roll motions, respectively, and corresponding registration errors of 0.2 ± 0.3 mm, 0.7 ± 0.4 mm, and 0.8 ± 1.0°.

CONCLUSIONS

The presented method encourages real-time implementation of motion compensation algorithms in prostate biopsy with clinically acceptable registration errors. Continuous motion compensation demonstrated registration accuracy with submillimeter and subdegree error, while performing < 50 ms computation times. Image registration technique approaching the frame rate of an ultrasound system offers a key advantage to be smoothly integrated to the clinical workflow. In addition, this technique could be used further for a variety of image-guided interventional procedures to treat and diagnose patients by improving targeting accuracy.

Direct magnetic resonance imaging-guided biopsy of the prostate: lessons learned in establishing a regional referral center

MRI-targeted biopsy of the prostate appears to have the potential to reduce the high rates of underdiagnosis and overdiagnosis associated with the current diagnostic standard of transrectal ultrasound guided systematic biopsy. Direct or "in bore" MRI-guided biopsy is one of the three methods for MRI-targeted core needle sampling of suspicious, generally Pi-RADS 4 or 5, foci within the prostate, and our early experience suggests the approach demonstrates substantial utility and promise in the care of patients with prostate cancer. We performed direct MRI-guided biopsies in 50 patients within 19 months of establishing the first referral center for this service in our region. Our preliminary results indicate the service can be easily grown due to unmet demand, primarily in patients with a negative traditional systematic biopsy but with a concerning focus at MRI (30 of 50; 60%). Other applications include evaluation of patients who are on active surveillance (n=14; ten upgraded to higher Gleason score at MRI-guided biopsy), who are biopsy naïve (n=5; all positive at MRI-guided biopsy), or post focal therapy (n=1; positive for recurrent tumor at MRI-guided biopsy). With careful patient selection and technique, we have achieved a favorable overall positive biopsy rate of 73% (37 of 50), with 84% (31 of 37) positive biopsies demonstrating Gleason score 7 or greater disease. Large multicenter comparative trials will be required to determine the relative accuracy and appropriate utilization of direct MRI guided biopsy in the care pathway of patients with known or suspected prostate cancer.

Comparison of prostate MRI-3D transrectal ultrasound fusion biopsy for first-time and repeat biopsy patients with previous atypical small acinar proliferation

INTRODUCTION

This study evaluates the clinical benefit of magnetic resonance-transrectal ultrasound (MR-TRUS) fusion biopsy over systematic biopsy between first-time and repeat prostate biopsy patients with prior atypical small acinar proliferation (ASAP).

MATERIALS

100 patients were enrolled in a single-centre prospective cohort study: 50 for first biopsy, 50 for repeat biopsy with prior ASAP. Multiparameteric magnetic resonance imaging (MP-MRI) and standard 12-core ultrasound biopsy (Std-Bx) were performed on all patients. Targeted biopsy using MRI-TRUS fusion (Fn-Bx) was performed f suspicious lesions were identified on the pre-biopsy MP-MRI. Classification of clinically significant disease was assessed independently for the Std-Bx vs. Fn-Bx cores to compare the two approaches.

RESULTS

Adenocarcinoma was detected in 49/100 patients (26 first biopsy, 23 ASAP biopsy), with 25 having significant disease (17 first, 8 ASAP). Fn-Bx demonstrated significantly higher per-core cancer detection rates, cancer involvement, and Gleason scores for first-time and ASAP patients. However, Fn-Bx was significantly more likely to detect significant cancer missed on Std-Bx for ASAP patients than first-time biopsy patients. The addition of Fn-Bx to Std-Bx for ASAP patients had a 166.7% relative risk reduction for missing Gleason ≥ 3 + 4 disease (number needed to image with MP-MRI=10 patients) compared to 6.3% for first biopsy (number to image=50 patients). Negative predictive value of MP-MRI for negative biopsy was 79% for first-time and 100% for ASAP patients, with median followup of 32.1 ± 15.5 months.

CONCLUSIONS

MR-TRUS Fn-Bx has a greater clinical impact for repeat biopsy patients with prior ASAP than biopsy-naïve patients by detecting more significant cancers that are missed on Std-Bx.

3D-2D ultrasound feature-based registration for navigated prostate biopsy: a feasibility study

The aim of this paper is to describe a 3D-2D ultrasound feature-based registration method for navigated prostate biopsy and its first results obtained on patient data. A system combining a low-cost tracking system and a 3D-2D registration algorithm was designed. The proposed 3D-2D registration method combines geometric and image-based distances. After extracting features from ultrasound images, 3D and 2D features within a defined distance are matched using an intensity-based function. The results are encouraging and show acceptable errors with simulated transforms applied on ultrasound volumes from real patients.

Statistical Biomechanical Surface Registration: Application to MR-TRUS Fusion for Prostate Interventions

A common challenge when performing surface-based registration of images is ensuring that the surfaces accurately represent consistent anatomical boundaries. Image segmentation may be difficult in some regions due to either poor contrast, low slice resolution, or tissue ambiguities. To address this, we present a novel non-rigid surface registration method designed to register two partial surfaces, capable of ignoring regions where the anatomical boundary is unclear. Our probabilistic approach incorporates prior geometric information in the form of a statistical shape model (SSM), and physical knowledge in the form of a finite element model (FEM). We validate results in the context of prostate interventions by registering pre-operative magnetic resonance imaging (MRI) to 3D transrectal ultrasound (TRUS). We show that both the geometric and physical priors significantly decrease net target registration error (TRE), leading to TREs of 2.35 ± 0.81 mm and 2.81 ± 0.66 mm when applied to full and partial surfaces, respectively. We investigate robustness in response to errors in segmentation, varying levels of missing data, and adjusting the tunable parameters. Results demonstrate that the proposed surface registration method is an efficient, robust, and effective solution for fusing data from multiple modalities.

Prostate cancer detection on transrectal ultrasonography-guided random biopsy despite negative real-time magnetic resonance imaging/ultrasonography fusion-guided targeted biopsy: reasons for targeted biopsy failure

OBJECTIVE

To examine the value of additional transrectal ultrasonography (TRUS)-guided random biopsy (RB) in patients with negative magnetic resonance imaging (MRI)/ultrasonography (US) fusion-guided targeted biopsy (TB) and to identify possible reasons for TB failure.

PATIENTS AND METHODS

We conducted a subgroup analysis of 61 men with prostate cancer (PCa) detected by 10-core RB but with a negative TB, from a cohort of 408 men with suspicious multiparametric magnetic resonance imaging (mpMRI) between January 2012 and January 2015. A consensus re-reading of mpMRI results (using Prostate Imaging Reporting and Data System [PI-RADS] versions 1 and 2) for each suspicious lesion was performed, with the image reader blinded to the biopsy results, followed by an unblinded anatomical correlation of the lesion on mpMRI to the biopsy result. The potential reasons for TB failure were estimated for each lesion. We defined clinically significant PCa according to the Epstein criteria and stratified patients into risk groups according to the European Association of Urology guidelines.

RESULTS

Our analysis showed that RB detected significant PCa in 64% of patients (39/61) and intermediate-/high-risk PCa in 57% of patients (35/61). The initial mpMRI reading identified 90 suspicious lesions in the cohort. Blinded consensus re-reading of the mpMRI led to PI-RADS score downgrading of 45 lesions (50%) and upgrading of 13 lesions (14%); thus, negative TB could be explained by falsely high initial PI-RADS scores for 32 lesions (34%) and sampling of the target lesion by RB in the corresponding anatomical site for 36 out of 90 lesions (40%) in 35 of 61 patients (57%). Sampling of the target lesion by RB was most likely for lesions with PI-RADS scores of 4/5 and Gleason scores (GS) of ≥7. A total of 70 PCa lesions (67% with GS 6) in 44 patients (72%) were sampled from prostatic sites with no abnormalities on mpMRI.

CONCLUSION

In cases of TB failure, RB still detected a high rate of significant PCa. The main reason for a negative TB was a TB error, compensated for by positive sampling of the target lesion by the additional RB, and the second reason for TB failure was a falsely high initial PI-RADS score. The challenges that arise for both MRI diagnostics and prostate lesion sampling are evident in our data and support the integration of RB into the TB workflow.

Three-dimensional nonrigid landmark-based magnetic resonance to transrectal ultrasound registration for image-guided prostate biopsy

Registration of three-dimensional (3-D) magnetic resonance (MR) to 3-D transrectal ultrasound (TRUS) prostate images is an important step in the planning and guidance of 3-D TRUS guided prostate biopsy. In order to accurately and efficiently perform the registration, a nonrigid landmark-based registration method is required to account for the different deformations of the prostate when using these two modalities. We describe a nonrigid landmark-based method for registration of 3-D TRUS to MR prostate images. The landmark-based registration method first makes use of an initial rigid registration of 3-D MR to 3-D TRUS images using six manually placed approximately corresponding landmarks in each image. Following manual initialization, the two prostate surfaces are segmented from 3-D MR and TRUS images and then nonrigidly registered using the following steps: (1) rotationally reslicing corresponding segmented prostate surfaces from both 3-D MR and TRUS images around a specified axis, (2) an approach to find point correspondences on the surfaces of the segmented surfaces, and (3) deformation of the surface of the prostate in the MR image to match the surface of the prostate in the 3-D TRUS image and the interior using a thin-plate spline algorithm. The registration accuracy was evaluated using 17 patient prostate MR and 3-D TRUS images by measuring the target registration error (TRE). Experimental results showed that the proposed method yielded an overall mean TRE of [Formula: see text] for the rigid registration and [Formula: see text] for the nonrigid registration, which is favorably comparable to a clinical requirement for an error of less than 2.5 mm. A landmark-based nonrigid 3-D MR-TRUS registration approach is proposed, which takes into account the correspondences on the prostate surface, inside the prostate, as well as the centroid of the prostate. Experimental results indicate that the proposed method yields clinically sufficient accuracy.

Three-Dimensional Nonrigid MR-TRUS Registration Using Dual Optimization

In this study, we proposed an efficient nonrigid magnetic resonance (MR) to transrectal ultrasound (TRUS) deformable registration method in order to improve the accuracy of targeting suspicious regions during a three dimensional (3-D) TRUS guided prostate biopsy. The proposed deformable registration approach employs the multi-channel modality independent neighborhood descriptor (MIND) as the local similarity feature across the two modalities of MR and TRUS, and a novel and efficient duality-based convex optimization-based algorithmic scheme was introduced to extract the deformations and align the two MIND descriptors. The registration accuracy was evaluated using 20 patient images by calculating the TRE using manually identified corresponding intrinsic fiducials in the whole gland and peripheral zone. Additional performance metrics [Dice similarity coefficient (DSC), mean absolute surface distance (MAD), and maximum absolute surface distance (MAXD)] were also calculated by comparing the MR and TRUS manually segmented prostate surfaces in the registered images. Experimental results showed that the proposed method yielded an overall median TRE of 1.76 mm. The results obtained in terms of DSC showed an average of 80.8±7.8% for the apex of the prostate, 92.0±3.4% for the mid-gland, 81.7±6.4% for the base and 85.7±4.7% for the whole gland. The surface distance calculations showed an overall average of 1.84±0.52 mm for MAD and 6.90±2.07 mm for MAXD.

Evaluation of MRI-TRUS fusion versus cognitive registration accuracy for MRI-targeted, TRUS-guided prostate biopsy

OBJECTIVE

The purpose of this article is to compare transrectal ultrasound (TRUS) biopsy accuracies of operators with different levels of prostate MRI experience using cognitive registration versus MRI-TRUS fusion to assess the preferred method of TRUS prostate biopsy for MRI-identified lesions. SUBJECTS AND METHODS; One hundred patients from a prospective prostate MRI-TRUS fusion biopsy study were reviewed to identify all patients with clinically significant prostate adenocarcinoma (PCA) detected on MRI-targeted biopsy. Twenty-five PCA tumors were incorporated into a validated TRUS prostate biopsy simulator. Three prostate biopsy experts, each with different levels of experience in prostate MRI and MRI-TRUS fusion biopsy, performed a total of 225 simulated targeted biopsies on the MRI lesions as well as regional biopsy targets. Simulated biopsies performed using cognitive registration with 2D TRUS and 3D TRUS were compared with biopsies performed under MRI-TRUS fusion.

RESULTS

Two-dimensional and 3D TRUS sampled only 48% and 45% of clinically significant PCA MRI lesions, respectively, compared with 100% with MRI-TRUS fusion. Lesion sampling accuracy did not statistically significantly vary according to operator experience or tumor volume. MRI-TRUS fusion-naïve operators showed consistent errors in targeting of the apex, midgland, and anterior targets, suggesting that there is biased error in cognitive registration. The MRI-TRUS fusion expert correctly targeted the prostate apex; however, his midgland and anterior mistargeting was similar to that of the less-experienced operators.

CONCLUSION

MRI-targeted TRUS-guided prostate biopsy using cognitive registration appears to be inferior to MRI-TRUS fusion, with fewer than 50% of clinically significant PCA lesions successfully sampled. No statistically significant difference in biopsy accuracy was seen according to operator experience with prostate MRI or MRI-TRUS fusion.

Magnetic resonance imaging-targeted, 3D transrectal ultrasound-guided fusion biopsy for prostate cancer: Quantifying the impact of needle delivery error on diagnosis

PURPOSE

Magnetic resonance imaging (MRI)-targeted, 3D transrectal ultrasound (TRUS)-guided "fusion" prostate biopsy intends to reduce the ∼23% false negative rate of clinical two-dimensional TRUS-guided sextant biopsy. Although it has been reported to double the positive yield, MRI-targeted biopsies continue to yield false negatives. Therefore, the authors propose to investigate how biopsy system needle delivery error affects the probability of sampling each tumor, by accounting for uncertainties due to guidance system error, image registration error, and irregular tumor shapes.

METHODS

T2-weighted, dynamic contrast-enhanced T1-weighted, and diffusion-weighted prostate MRI and 3D TRUS images were obtained from 49 patients. A radiologist and radiology resident contoured 81 suspicious regions, yielding 3D tumor surfaces that were registered to the 3D TRUS images using an iterative closest point prostate surface-based method to yield 3D binary images of the suspicious regions in the TRUS context. The probabilityP of obtaining a sample of tumor tissue in one biopsy core was calculated by integrating a 3D Gaussian distribution over each suspicious region domain. Next, the authors performed an exhaustive search to determine the maximum root mean squared error (RMSE, in mm) of a biopsy system that gives P ≥ 95% for each tumor sample, and then repeated this procedure for equal-volume spheres corresponding to each tumor sample. Finally, the authors investigated the effect of probe-axis-direction error on measured tumor burden by studying the relationship between the error and estimated percentage of core involvement.

RESULTS

Given a 3.5 mm RMSE for contemporary fusion biopsy systems,P ≥ 95% for 21 out of 81 tumors. The authors determined that for a biopsy system with 3.5 mm RMSE, one cannot expect to sample tumors of approximately 1 cm(3) or smaller with 95% probability with only one biopsy core. The predicted maximum RMSE giving P ≥ 95% for each tumor was consistently greater when using spherical tumor shapes as opposed to no shape assumption. However, an assumption of spherical tumor shape for RMSE = 3.5 mm led to a mean overestimation of tumor sampling probabilities of 3%, implying that assuming spherical tumor shape may be reasonable for many prostate tumors. The authors also determined that a biopsy system would need to have a RMS needle delivery error of no more than 1.6 mm in order to sample 95% of tumors with one core. The authors' experiments also indicated that the effect of axial-direction error on the measured tumor burden was mitigated by the 18 mm core length at 3.5 mm RMSE.

CONCLUSIONS

For biopsy systems with RMSE ≥ 3.5 mm, more than one biopsy core must be taken from the majority of tumors to achieveP ≥ 95%. These observations support the authors' perspective that some tumors of clinically significant sizes may require more than one biopsy attempt in order to be sampled during the first biopsy session. This motivates the authors' ongoing development of an approach to optimize biopsy plans with the aim of achieving a desired probability of obtaining a sample from each tumor, while minimizing the number of biopsies. Optimized planning of within-tumor targets for MRI-3D TRUS fusion biopsy could support earlier diagnosis of prostate cancer while it remains localized to the gland and curable.

A Domain Constrained Deformable (DoCD) Model for Co-registration of Pre- and Post-Radiated Prostate MRI

External beam radiation treatment (EBRT) is a popular method for treating prostate cancer (CaP) involving destroying tumor cells with ionizing radiation. Following EBRT, biochemical failure has been linked with disease recurrence. However, there is a need for methods for evaluating early treatment related changes to allow for an early intervention in case of incomplete disease response. One method for looking at treatment evaluation is to detect changes in MRI markers on a voxel-by-voxel basis following treatment. Changes in MRI markers may be correlated with disease recurrence and complete or partial response. In order to facilitate voxel-by-voxel imaging related treatment changes, and also to evaluate morphologic changes in the gland post treatment, the pre- and post-radiated MRI must first be brought into spatial alignment via image registration. However, EBRT induces changes in the prostate volume and distortion to the internal anatomy of the prostate following radiation treatment. The internal substructures of the prostate, the central gland (CG) and peripheral zone (PZ), may respond to radiation differently, and their resulting shapes may change drastically. Biomechanical models of the prostate that have been previously proposed tend to focus on how external forces affect the surface of the prostate (not the internals), and assume that the prostate is a volume-preserving entity. In this work we present DoCD, a biomechanical model for automatically registering pre-, post-EBRT MRI with the aim of expressly modeling the (1) changes in volume, and (2) changes to the CG and PZ. DoCD was applied to a cohort of 30 patients and achieved a root mean square error of 2.994 mm, which was statistically significantly better a traditional biomechanical model which did not consider changes to the internal anatomy of the prostate (mean of 5.071 mm).

Mechatronic system for in-bore MRI-guided insertion of needles to the prostate: An in vivo needle guidance accuracy study

BACKGROUND

To present our experiences in initial clinical evaluation of a novel mechatronic system for in-bore guidance of needles to the prostate for MRI-guided prostate interventions in 10 patients. We report accuracy of this device in the context of focal laser ablation therapy for localized prostate cancer.

METHODS

An MRI-compatible needle guidance device was developed for transperineal prostate interventions. Ten patients underwent MRI-guided focal laser ablation therapy with device-mediated laser fiber delivery. We recorded needle guidance error and needle delivery time.

RESULTS

A total of 37 needle insertions were evaluated. Median needle guidance error was 3.5 mm (interquartile range, 2.1-5.4 mm), and median needle delivery time was 9 min (interquartile range, 6.5-12 min).

CONCLUSION

This system provides a reliable method of accurately aligning needle guides for in-bore transperineal needle delivery to the prostate.

Robotic ultrasound and needle guidance for prostate cancer management: review of the contemporary literature

PURPOSE OF REVIEW

To present the recent advances in needle guidance and robotic ultrasound technology which are used for prostate cancer (PCa) diagnosis and management.

RECENT FINDINGS

Prostate biopsy technology has remained relatively unchanged. Improved needle localization and precision would allow for better management of this common disease. Robotic ultrasound and needle guidance is one strategy to improve needle localization and diagnostic accuracy of PCa. This review focuses on the recent advances in robotic ultrasound and needle guidance technologies, and their potential impact on PCa diagnosis and management.

SUMMARY

The use of robotic ultrasound and robotic-assisted needle guidance has the potential to improve PCa diagnosis and management.

Improving 2D-3D registration optimization using learned prostate motion data

Prostate motion due to transrectal ultrasound (TRUS) probe pressure and patient movement causes target misalignments during 3D TRUS-guided biopsy. Several solutions have been proposed to perform 2D-3D registration for motion compensation. To improve registration accuracy and robustness, we developed and evaluated a registration algorithm whose optimization is based on learned prostate motion characteristics relative to different tracked probe positions and prostate sizes. We performed a principal component analysis of previously observed motions and utilized the principal directions to initialize Powell's direction set method during optimization. Compared with the standard initialization, our approach improved target registration error to 2.53 +/- 1.25 mm after registration. Multiple initializations along the major principal directions improved the robustness of the method at the cost of additional execution time of 1.5 s. With a total execution time of 3.2 s to perform motion compensation, this method is amenable to useful integration into a clinical 3D guided prostate biopsy workflow.

Robust 3D-2D image registration: application to spine interventions and vertebral labeling in the presence of anatomical deformation

We present a framework for robustly estimating registration between a 3D volume image and a 2D projection image and evaluate its precision and robustness in spine interventions for vertebral localization in the presence of anatomical deformation. The framework employs a normalized gradient information similarity metric and multi-start covariance matrix adaptation evolution strategy optimization with local-restarts, which provided improved robustness against deformation and content mismatch. The parallelized implementation allowed orders-of-magnitude acceleration in computation time and improved the robustness of registration via multi-start global optimization. Experiments involved a cadaver specimen and two CT datasets (supine and prone) and 36 C-arm fluoroscopy images acquired with the specimen in four positions (supine, prone, supine with lordosis, prone with kyphosis), three regions (thoracic, abdominal, and lumbar), and three levels of geometric magnification (1.7, 2.0, 2.4). Registration accuracy was evaluated in terms of projection distance error (PDE) between the estimated and true target points in the projection image, including 14 400 random trials (200 trials on the 72 registration scenarios) with initialization error up to ±200 mm and ±10°. The resulting median PDE was better than 0.1 mm in all cases, depending somewhat on the resolution of input CT and fluoroscopy images. The cadaver experiments illustrated the tradeoff between robustness and computation time, yielding a success rate of 99.993% in vertebral labeling (with 'success' defined as PDE <5 mm) using 1,718 664 ± 96 582 function evaluations computed in 54.0 ± 3.5 s on a mid-range GPU (nVidia, GeForce GTX690). Parameters yielding a faster search (e.g., fewer multi-starts) reduced robustness under conditions of large deformation and poor initialization (99.535% success for the same data registered in 13.1 s), but given good initialization (e.g., ±5 mm, assuming a robust initial run) the same registration could be solved with 99.993% success in 6.3 s. The ability to register CT to fluoroscopy in a manner robust to patient deformation could be valuable in applications such as radiation therapy, interventional radiology, and an assistant to target localization (e.g., vertebral labeling) in image-guided spine surgery.