Semi-automatic segmentation for prostate interventions

Impact of Relative Volume Difference Between Magnetic Resonance Imaging and Three-dimensional Transrectal Ultrasound Segmentation on Clinically Significant Prostate Cancer Detection in Fusion Magnetic Resonance Imaging-targeted Biopsy

BACKGROUND

Segmentation of three-dimensional (3D) transrectal ultrasound (TRUS) images is known to be challenging, and the clinician often lacks a reliable and easy-to-use indicator to assess its accuracy during the fusion magnetic resonance imaging (MRI)-targeted prostate biopsy procedure.

OBJECTIVE

To assess the effect of the relative volume difference between 3D-TRUS and MRI segmentation on the outcome of a targeted biopsy.

DESIGN, SETTING, AND PARTICIPANTS

All adult males who underwent an MRI-targeted prostate biopsy for clinically suspected prostate cancer between February 2012 and July 2021 were consecutively included.

INTERVENTION

All patients underwent a fusion MRI-targeted prostate biopsy with a Koelis device.

OUTCOME MEASUREMENTS AND STATISTICAL ANALYSIS

Three-dimensional TRUS and MRI prostate volumes were calculated using 3D prostate models issued from the segmentations. The primary outcome was the relative segmentation volume difference (SVD) between transrectal ultrasound and MRI divided by the MRI volume (SVD = MRI volume - TRUS volume/MRI volume) and its correlation with clinically significant prostate cancer (eg, International Society of Urological Pathology [ISUP] ≥2) positiveness on targeted biopsy cores.

RESULTS AND LIMITATIONS

Overall, 1721 patients underwent a targeted biopsy resulting in a total of 5593 targeted cores. The median relative SVD was significantly lower in patients diagnosed with clinically significant prostate cancer than in those with ISUP 0-1: (6.7% [interquartile range {IQR} -2.7, 13.6] vs 8.0% [IQR 3.3, 16.4], p < 0.01). A multivariate regression analysis showed that a relative SVD of >10% of the MRI volume was associated with a lower detection rate of clinically significant prostate cancer (odds ratio = 0.74 [95% confidence interval: 0.55-0.98]; p = 0.038).

CONCLUSIONS

A relative SVD of >10% of the MRI segmented volume was associated with a lower detection rate of clinically significant prostate cancer on targeted biopsy cores. The relative SVD can be used as a per-procedure quality indicator of 3D-TRUS segmentation.

PATIENT SUMMARY

A discrepancy of ≥10% between segmented magnetic resonance imaging and transrectal ultrasound volume is associated with a reduced ability to detect significant prostate cancer on targeted biopsy cores.

Increasing the efficiency of cone-beam CT based delta-radiomics using automated contours to predict radiotherapy-related toxicities in prostate cancer

Extracting longitudinal image quantitative data, known as delta-radiomics, has the potential to capture changes in a patient's anatomy throughout the course of radiation treatment for prostate cancer. Some of the major challenges of delta-radiomics studies are contouring the structures for individual fractions and accruing patients' data in an efficient manner. The manual contouring process is often time consuming and would limit the efficiency of accruing larger sample sizes for future studies. The problem is amplified because the contours are often made by highly trained radiation oncologists with limited time to dedicate to research studies of this nature. This work compares the use of automated prostate contours generated using a deformable image-based algorithm to make predictive models of genitourinary and changes in total international prostate symptom score in comparison to manually contours for a cohort of fifty patients. Area under the curve of manual and automated models were compared using the Delong test. This study demonstrated that the delta-radiomics models were similar for both automated and manual delta-radiomics models.

Whole Spine Segmentation Using Object Detection and Semantic Segmentation

OBJECTIVE

Virtual and augmented reality have enjoyed increased attention in spine surgery. Preoperative planning, pedicle screw placement, and surgical training are among the most studied use cases. Identifying osseous structures is a key aspect of navigating a 3-dimensional virtual reconstruction. To automate the otherwise time-consuming process of labeling vertebrae on each slice individually, we propose a fully automated pipeline that automates segmentation on computed tomography (CT) and which can form the basis for further virtual or augmented reality application and radiomic analysis.

METHODS

Based on a large public dataset of annotated vertebral CT scans, we first trained a YOLOv8m (You-Only-Look-Once algorithm, Version 8 and size medium) to detect each vertebra individually. On the then cropped images, a 2D-U-Net was developed and externally validated on 2 different public datasets.

RESULTS

Two hundred fourteen CT scans (cervical, thoracic, or lumbar spine) were used for model training, and 40 scans were used for external validation. Vertebra recognition achieved a mAP50 (mean average precision with Jaccard threshold of 0.5) of over 0.84, and the segmentation algorithm attained a mean Dice score of 0.75 ± 0.14 at internal, 0.77 ± 0.12 and 0.82 ± 0.14 at external validation, respectively.

CONCLUSION

We propose a 2-stage approach consisting of single vertebra labeling by an object detection algorithm followed by semantic segmentation. In our externally validated pilot study, we demonstrate robust performance for our object detection network in identifying individual vertebrae, as well as for our segmentation model in precisely delineating the bony structures.

A Fusion Biopsy Framework for Prostate Cancer Based on Deformable Superellipses and nnU-Net

In prostate cancer, fusion biopsy, which couples magnetic resonance imaging (MRI) with transrectal ultrasound (TRUS), poses the basis for targeted biopsy by allowing the comparison of information coming from both imaging modalities at the same time. Compared with the standard clinical procedure, it provides a less invasive option for the patients and increases the likelihood of sampling cancerous tissue regions for the subsequent pathology analyses. As a prerequisite to image fusion, segmentation must be achieved from both MRI and TRUS domains. The automatic contour delineation of the prostate gland from TRUS images is a challenging task due to several factors including unclear boundaries, speckle noise, and the variety of prostate anatomical shapes. Automatic methodologies, such as those based on deep learning, require a huge quantity of training data to achieve satisfactory results. In this paper, the authors propose a novel optimization formulation to find the best superellipse, a deformable model that can accurately represent the prostate shape. The advantage of the proposed approach is that it does not require extensive annotations, and can be used independently of the specific transducer employed during prostate biopsies. Moreover, in order to show the clinical applicability of the method, this study also presents a module for the automatic segmentation of the prostate gland from MRI, exploiting the nnU-Net framework. Lastly, segmented contours from both imaging domains are fused with a customized registration algorithm in order to create a tool that can help the physician to perform a targeted prostate biopsy by interacting with the graphical user interface.

Autonomous Prostate Segmentation in 2D B-Mode Ultrasound Images

Prostate brachytherapy is a treatment for prostate cancer; during the planning of the procedure, ultrasound images of the prostate are taken. The prostate must be segmented out in each of the ultrasound images, and to assist with the procedure, an autonomous prostate segmentation algorithm is proposed. The prostate contouring system presented here is based on a novel superpixel algorithm, whereby pixels in the ultrasound image are grouped into superpixel regions that are optimized based on statistical similarity measures, so that the various structures within the ultrasound image can be differentiated. An active shape prostate contour model is developed and then used to delineate the prostate within the image based on the superpixel regions. Before segmentation, this contour model was fit to a series of point-based clinician-segmented prostate contours exported from conventional prostate brachytherapy planning software to develop a statistical model of the shape of the prostate. The algorithm was evaluated on nine sets of in vivo prostate ultrasound images and compared with manually segmented contours from a clinician, where the algorithm had an average volume difference of 4.49 mL or 10.89%.

Automatic zonal segmentation of the prostate from 2D and 3D T2-weighted MRI and evaluation for clinical use

Purpose: An accurate zonal segmentation of the prostate is required for prostate cancer (PCa) management with MRI. Approach: The aim of this work is to present UFNet, a deep learning-based method for automatic zonal segmentation of the prostate from T2-weighted (T2w) MRI. It takes into account the image anisotropy, includes both spatial and channelwise attention mechanisms and uses loss functions to enforce prostate partition. The method was applied on a private multicentric three-dimensional T2w MRI dataset and on the public two-dimensional T2w MRI dataset ProstateX. To assess the model performance, the structures segmented by the algorithm on the private dataset were compared with those obtained by seven radiologists of various experience levels. Results: On the private dataset, we obtained a Dice score (DSC) of 93.90 ± 2.85 for the whole gland (WG), 91.00 ± 4.34 for the transition zone (TZ), and 79.08 ± 7.08 for the peripheral zone (PZ). Results were significantly better than other compared networks' ( p - value < 0.05 ). On ProstateX, we obtained a DSC of 90.90 ± 2.94 for WG, 86.84 ± 4.33 for TZ, and 78.40 ± 7.31 for PZ. These results are similar to state-of-the art results and, on the private dataset, are coherent with those obtained by radiologists. Zonal locations and sectorial positions of lesions annotated by radiologists were also preserved. Conclusions: Deep learning-based methods can provide an accurate zonal segmentation of the prostate leading to a consistent zonal location and sectorial position of lesions, and therefore can be used as a helping tool for PCa diagnosis.

Prostate volume prediction on MRI: tools, accuracy and variability

OBJECTIVE

A reliable estimation of prostate volume (PV) is essential to prostate cancer management. The objective of our multi-rater study was to compare intra- and inter-rater variability of PV from manual planimetry and ellipsoid formulas.

METHODS

Forty treatment-naive patients who underwent prostate MRI were selected from a local database. PV and corresponding PSA density (PSAd) were estimated on 3D T2-weighted MRI (3 T) by 7 independent radiologists using the traditional ellipsoid formula (TEF), the newer biproximate ellipsoid formula (BPEF), and the manual planimetry method (MPM) used as ground truth. Intra- and inter-rater variability was calculated using the mixed model-based intraclass correlation coefficient (ICC).

RESULTS

Mean volumes were 67.00 (± 36.61), 66.07 (± 35.03), and 64.77 (± 38.27) cm³ with the TEF, BPEF, and MPM methods, respectively. Both TEF and BPEF overestimated PV relative to MPM, with the former presenting significant differences (+ 1.91 cm³, IQ = [- 0.33 cm³, 5.07 cm³], p val = 0.03). Both intra- (ICC > 0.90) and inter-rater (ICC > 0.90) reproducibility were excellent. MPM had the highest inter-rater reproducibility (ICC = 0.999). Inter-rater PV variation led to discrepancies in classification according to the clinical criterion of PSAd > 0.15 ng/mL for 2 patients (5%), 7 patients (17.5%), and 9 patients (22.5%) when using MPM, TEF, and BPEF, respectively.

CONCLUSION

PV measurements using ellipsoid formulas and MPM are highly reproducible. MPM is a robust method for PV assessment and PSAd calculation, with the lowest variability. TEF showed a high degree of concordance with MPM but a slight overestimation of PV. Precise anatomic landmarks as defined with the BPEF led to a more accurate PV estimation, but also to a higher variability.

KEY POINTS

• Manual planimetry used for prostate volume estimation is robust and reproducible, with the lowest variability between readers. • Ellipsoid formulas are accurate and reproducible but with higher variability between readers. • The traditional ellipsoid formula tends to overestimate prostate volume.

Centre-specific autonomous treatment plans for prostate brachytherapy using cGANs

PURPOSE

In low-dose-rate prostate brachytherapy (LDR-PB), treatment planning is the process of determining the arrangement of implantable radioactive sources that radiates the prostate while sparing healthy surrounding tissues. Currently, these plans are prepared manually by experts incorporating the centre's planning style and guidelines. In this article, we develop a novel framework that can learn a centre's planning strategy and automatically reproduce rapid clinically acceptable plans.

METHODS

The proposed framework is based on conditional generative adversarial networks that learn our centre's planning style using a pool of 931 historical LDR-PB planning data. Two additional losses that help constrain prohibited needle patterns and produce similar-looking plans are also proposed. Once trained, this model generates an initial distribution of needles which is passed to a planner. The planner then initializes the sources based on the predicted needles and uses a simulated annealing algorithm to optimize their locations further.

RESULTS

Quantitative analysis was carried out on 170 cases which showed the generated plans having similar dosimetry to that of the manual plans but with significantly lower planning durations. Indeed, on the test cases, the clinical target volumes achieving [Formula: see text] of the prescribed dose for the generated plans was on average [Formula: see text] ([Formula: see text] for manual plans) with an average planning time of [Formula: see text] min ([Formula: see text] min for manual plans). Further qualitative analysis was conducted by an expert planner who accepted [Formula: see text] of the plans with some changes ([Formula: see text] requiring minor changes & [Formula: see text] requiring major changes).

CONCLUSION

The proposed framework demonstrated the ability to rapidly generate quality treatment plans that not only fulfil the dosimetric requirements but also takes into account the centre's planning style. Adoption of such a framework would save significant amount of time and resources spent on every patient; boosting the overall operational efficiency of this treatment.

Prostate brachytherapy intraoperative dosimetry using a combination of radiographic seed localization with a C-arm and deformed ultrasound prostate contours

PURPOSE

The purpose of the study was to assess the feasibility of performing intraoperative dosimetry for permanent prostate brachytherapy by combining transrectal ultrasound (TRUS) and fluoroscopy/cone beam CT [CBCT] images and accounting for the effect of prostate deformation.

METHODS AND MATERIALS

13 patients underwent TRUS and multiview two-dimensional fluoroscopic imaging partway through the implant, as well as repeat fluoroscopic imaging with the TRUS probe inserted and retracted, and finally three-dimensional CBCT imaging at the end of the implant. The locations of all the implanted seeds were obtained from the fluoroscopy/CBCT images and were registered to prostate contours delineated on the TRUS images based on a common subset of seeds identified on both image sets. Prostate contours were also deformed, using a finite-element model, to take into account the effect of the TRUS probe pressure. Prostate dosimetry parameters were obtained for fluoroscopic and CBCT-dosimetry approaches and compared with the standard-of-care Day-0 postimplant CT dosimetry.

RESULTS

High linear correlation (R² > 0.8) was observed in the measured values of prostate D_90%, V_100%, and V_150%, between the two intraoperative dosimetry approaches. The prostate D_90% and V_100% obtained from intraoperative dosimetry methods were in agreement with the postimplant CT dosimetry. Only the prostate V_150% was on average 4.1% (p-value <0.05) higher in the CBCT-dosimetry approach and 6.7% (p-value <0.05) higher in postimplant CT dosimetry compared with the fluoroscopic dosimetry approach. Deformation of the prostate by the ultrasound probe appeared to have a minimal effect on prostate dosimetry.

CONCLUSIONS

The results of this study have shown that both of the proposed dosimetric evaluation approaches have potential for real-time intraoperative dosimetry.

Reducing the Hausdorff Distance in Medical Image Segmentation With Convolutional Neural Networks

The Hausdorff Distance (HD) is widely used in evaluating medical image segmentation methods. However, the existing segmentation methods do not attempt to reduce HD directly. In this paper, we present novel loss functions for training convolutional neural network (CNN)-based segmentation methods with the goal of reducing HD directly. We propose three methods to estimate HD from the segmentation probability map produced by a CNN. One method makes use of the distance transform of the segmentation boundary. Another method is based on applying morphological erosion on the difference between the true and estimated segmentation maps. The third method works by applying circular/spherical convolution kernels of different radii on the segmentation probability maps. Based on these three methods for estimating HD, we suggest three loss functions that can be used for training to reduce HD. We use these loss functions to train CNNs for segmentation of the prostate, liver, and pancreas in ultrasound, magnetic resonance, and computed tomography images and compare the results with commonly-used loss functions. Our results show that the proposed loss functions can lead to approximately 18-45% reduction in HD without degrading other segmentation performance criteria such as the Dice similarity coefficient. The proposed loss functions can be used for training medical image segmentation methods in order to reduce the large segmentation errors.

Accurate and robust deep learning-based segmentation of the prostate clinical target volume in ultrasound images

The goal of this work was to develop a method for accurate and robust automatic segmentation of the prostate clinical target volume in transrectal ultrasound (TRUS) images for brachytherapy. These images can be difficult to segment because of weak or insufficient landmarks or strong artifacts. We devise a method, based on convolutional neural networks (CNNs), that produces accurate segmentations on easy and difficult images alike. We propose two strategies to achieve improved segmentation accuracy on difficult images. First, for CNN training we adopt an adaptive sampling strategy, whereby the training process is encouraged to pay more attention to images that are difficult to segment. Secondly, we train a CNN ensemble and use the disagreement among this ensemble to identify uncertain segmentations and to estimate a segmentation uncertainty map. We improve uncertain segmentations by utilizing the prior shape information in the form of a statistical shape model. Our method achieves Hausdorff distance of 2.7 ± 2.3 mm and Dice score of 93.9 ± 3.5%. Comparisons with several competing methods show that our method achieves significantly better results and reduces the likelihood of committing large segmentation errors. Furthermore, our experiments show that our approach to estimating segmentation uncertainty is better than or on par with recent methods for estimation of prediction uncertainty in deep learning models. Our study demonstrates that estimation of model uncertainty and use of prior shape information can significantly improve the performance of CNN-based medical image segmentation methods, especially on difficult images.

Ultrasound prostate segmentation based on multidirectional deeply supervised V-Net

PURPOSE

Transrectal ultrasound (TRUS) is a versatile and real-time imaging modality that is commonly used in image-guided prostate cancer interventions (e.g., biopsy and brachytherapy). Accurate segmentation of the prostate is key to biopsy needle placement, brachytherapy treatment planning, and motion management. Manual segmentation during these interventions is time-consuming and subject to inter- and intraobserver variation. To address these drawbacks, we aimed to develop a deep learning-based method which integrates deep supervision into a three-dimensional (3D) patch-based V-Net for prostate segmentation.

METHODS AND MATERIALS

We developed a multidirectional deep-learning-based method to automatically segment the prostate for ultrasound-guided radiation therapy. A 3D supervision mechanism is integrated into the V-Net stages to deal with the optimization difficulties when training a deep network with limited training data. We combine a binary cross-entropy (BCE) loss and a batch-based Dice loss into the stage-wise hybrid loss function for a deep supervision training. During the segmentation stage, the patches are extracted from the newly acquired ultrasound image as the input of the well-trained network and the well-trained network adaptively labels the prostate tissue. The final segmented prostate volume is reconstructed using patch fusion and further refined through a contour refinement processing.

RESULTS

Forty-four patients' TRUS images were used to test our segmentation method. Our segmentation results were compared with the manually segmented contours (ground truth). The mean prostate volume Dice similarity coefficient (DSC), Hausdorff distance (HD), mean surface distance (MSD), and residual mean surface distance (RMSD) were 0.92 ± 0.03, 3.94 ± 1.55, 0.60 ± 0.23, and 0.90 ± 0.38 mm, respectively.

CONCLUSION

We developed a novel deeply supervised deep learning-based approach with reliable contour refinement to automatically segment the TRUS prostate, demonstrated its clinical feasibility, and validated its accuracy compared to manual segmentation. The proposed technique could be a useful tool for diagnostic and therapeutic applications in prostate cancer.

Prostate zonal segmentation in 1.5T and 3T T2W MRI using a convolutional neural network

Zonal segmentation of the prostate gland using magnetic resonance imaging (MRI) is clinically important for prostate cancer (PCa) diagnosis and image-guided treatments. A two-dimensional convolutional neural network (CNN) based on the U-net architecture was evaluated for segmentation of the central gland (CG) and peripheral zone (PZ) using a dataset of 40 patients (34 PCa positive and 6 PCa negative) scanned on two different MRI scanners (1.5T GE and 3T Siemens). Images were cropped around the prostate gland to exclude surrounding tissues, resampled to 0.5 × 0.5 × 0.5    mm   voxels and z -score normalized before being propagated through the CNN. Performance was evaluated using the Dice similarity coefficient (DSC) and mean absolute distance (MAD) in a fivefold cross-validation setup. Overall performance showed DSC of 0.794 and 0.692, and MADs of 3.349 and 2.993 for CG and PZ, respectively. Dividing the gland into apex, mid, and base showed higher DSC for the midgland compared to apex and base for both CG and PZ. We found no significant difference in DSC between the two scanners. A larger dataset, preferably with multivendor scanners, is necessary for validation of the proposed algorithm; however, our results are promising and have clinical potential.

Evaluation of tumor coverage after MR-guided prostate focal laser ablation therapy

PURPOSE

Prostate cancer is the most common noncutaneous cancer among men in the USA. Focal laser thermal ablation (FLA) has the potential to control small tumors while preserving urinary and erectile function by leaving the neurovascular bundles and urethral sphincters intact. Accurate needle guidance is critical to the success of FLA. Multiparametric magnetic resonance images (mpMRI) can be used to identify targets, guide needles, and assess treatment outcomes. In this study, we evaluated the location of ablation zones relative to targeted lesions in 23 patients who underwent FLA therapy in a phase II trial. The ablation zone margins and unablated tumor volume were measured to determine whether complete coverage of each tumor was achieved, which would be considered a clinically successful ablation.

METHODS

Preoperative mpMRI was acquired for each patient 2-3 months preceding the procedure and the prostate and lesion(s) were manually contoured on 3 T T2-weighted axial images. The prostate and ablation zone(s) were also manually contoured on postablation 1.5 T T1-weighted contrast-enhanced axial images acquired immediately after the procedure intraoperatively. The lesion surface was nonrigidly registered to the postablation image using an initial affine registration followed by nonrigid thin-plate spline registration of the prostate surfaces. The margins between the registered lesion and ablation zone were calculated using a uniform spherical distribution of rays, and the volume of intersection was also calculated. Each prostate was contoured five times to determine the segmentation variability and its effect on intersection of the lesion and ablation zone.

RESULTS

Our study showed that the boundaries of the segmented tumor and ablation zone were close. Of the 23 lesions that were analyzed, 11 were completely covered by the ablation zone and 12 were partially covered. A shift of 1.0, 2.0, and 2.6 mm would result in 19, 21, and all tumors completely covered by the ablation zone, respectively. The median unablated tumor volume across all tumors was 0.1  mm 3 with an IQR of 3.7  mm 3 , which was 0.2% of the median tumor volume (46.5  mm 3 with an IQR of 46.3  mm 3 ). The median extension of the tumors beyond the ablation zone, in cases which were partially ablated, was 0.9 mm (IQR of 1.3 mm), with the furthest tumor extending 2.6 mm.

CONCLUSION

In all cases, the boundary of the tumor was close to the boundary of the ablation zone, and in some cases, the boundary of the ablation zone did not completely enclose the tumor. Our results suggest that some of the ablations were not clinically successful and that there is a need for more accurate needle tracking and guidance methods. Limitations of the study include errors in the registration and segmentation methods used as well as different voxel sizes and contrast between the registered T2 and T1 MRI sequences and asymmetric swelling of the prostate postprocedurally.

Postediting prostate magnetic resonance imaging segmentation consistency and operator time using manual and computer-assisted segmentation: multiobserver study

Prostate segmentation on T2w MRI is important for several diagnostic and therapeutic procedures for prostate cancer. Manual segmentation is time-consuming, labor-intensive, and subject to high interobserver variability. This study investigated the suitability of computer-assisted segmentation algorithms for clinical translation, based on measurements of interoperator variability and measurements of the editing time required to yield clinically acceptable segmentations. A multioperator pilot study was performed under three pre- and postediting conditions: manual, semiautomatic, and automatic segmentation. We recorded the required editing time for each segmentation and measured the editing magnitude based on five different spatial metrics. We recorded average editing times of 213, 328, and 393 s for manual, semiautomatic, and automatic segmentation respectively, while an average fully manual segmentation time of 564 s was recorded. The reduced measured postediting interoperator variability of semiautomatic and automatic segmentations compared to the manual approach indicates the potential of computer-assisted segmentation for generating a clinically acceptable segmentation faster with higher consistency. The lack of strong correlation between editing time and the values of typically used error metrics ([Formula: see text]) implies that the necessary postsegmentation editing time needs to be measured directly in order to evaluate an algorithm's suitability for clinical translation.

Geometric systematic prostate biopsy

OBJECTIVE

The common sextant prostate biopsy schema lacks a three-dimensional (3D) geometric definition. The study objective was to determine the influence of the geometric distribution of the cores on the detection probability of prostate cancer (PCa).

METHODS

The detection probability of significant (>0.5 cm³) and insignificant (<0.2 cm³) tumors was quantified based on a novel 3D capsule model of the biopsy sample. The geometric distribution of the cores was optimized to maximize the probability of detecting significant cancer for various prostate sizes (20-100cm³), number of biopsy cores (6-40 cores) and biopsy core lengths (14-40 mm) for transrectal and transperineal biopsies.

RESULTS

The detection of significant cancer can be improved by geometric optimization. With the current sextant biopsy, up to 20% of tumors may be missed at biopsy in a 20 cm³ prostate due to the schema. Higher number and longer biopsy cores are required to sample with an equal detection probability in larger prostates. Higher number of cores increases both significant and insignificant tumor detection probability, but predominantly increases the detection of insignificant tumors.

CONCLUSION

The study demonstrates mathematically that the geometric biopsy schema plays an important clinical role, and that increasing the number of biopsy cores is not necessarily helpful.

Learning-Based Multi-Label Segmentation of Transrectal Ultrasound Images for Prostate Brachytherapy

Low-dose-rate prostate brachytherapy treatment takes place by implantation of small radioactive seeds in and sometimes adjacent to the prostate gland. A patient specific target anatomy for seed placement is usually determined by contouring a set of collected transrectal ultrasound images prior to implantation. Standard-of-care in prostate brachytherapy is to delineate the clinical target anatomy, which closely follows the real prostate boundary. Subsequently, the boundary is dilated with respect to the clinical guidelines to determine a planning target volume. Manual contouring of these two anatomical targets is a tedious task with relatively high observer variability. In this work, we aim to reduce the segmentation variability and planning time by proposing an efficient learning-based multi-label segmentation algorithm. We incorporate a sparse representation approach in our methodology to learn a dictionary of sparse joint elements consisting of images, and clinical and planning target volume segmentation. The generated dictionary inherently captures the relationships among elements, which also incorporates the institutional clinical guidelines. The proposed multi-label segmentation method is evaluated on a dataset of 590 brachytherapy treatment records by 5-fold cross validation. We show clinically acceptable instantaneous segmentation results for both target volumes.

Statistical Biomechanical Surface Registration: Application to MR-TRUS Fusion for Prostate Interventions

A common challenge when performing surface-based registration of images is ensuring that the surfaces accurately represent consistent anatomical boundaries. Image segmentation may be difficult in some regions due to either poor contrast, low slice resolution, or tissue ambiguities. To address this, we present a novel non-rigid surface registration method designed to register two partial surfaces, capable of ignoring regions where the anatomical boundary is unclear. Our probabilistic approach incorporates prior geometric information in the form of a statistical shape model (SSM), and physical knowledge in the form of a finite element model (FEM). We validate results in the context of prostate interventions by registering pre-operative magnetic resonance imaging (MRI) to 3D transrectal ultrasound (TRUS). We show that both the geometric and physical priors significantly decrease net target registration error (TRE), leading to TREs of 2.35 ± 0.81 mm and 2.81 ± 0.66 mm when applied to full and partial surfaces, respectively. We investigate robustness in response to errors in segmentation, varying levels of missing data, and adjusting the tunable parameters. Results demonstrate that the proposed surface registration method is an efficient, robust, and effective solution for fusing data from multiple modalities.

Prostate contours delineation using interactive directional active contours model and parametric shape prior model

Prostate contours delineation on Magnetic Resonance (MR) images is a challenging and important task in medical imaging with applications of guiding biopsy, surgery and therapy. While a fully automated method is highly desired for this application, it can be a very difficult task due to the structure and surrounding tissues of the prostate gland. Traditional active contours-based delineation algorithms are typically quite successful for piecewise constant images. Nevertheless, when MR images have diffuse edges or multiple similar objects (e.g. bladder close to prostate) within close proximity, such approaches have proven to be unsuccessful. In order to mitigate these problems, we proposed a new framework for bi-stage contours delineation algorithm based on directional active contours (DAC) incorporating prior knowledge of the prostate shape. We first explicitly addressed the prostate contour delineation problem based on fast globally DAC that incorporates both statistical and parametric shape prior model. In doing so, we were able to exploit the global aspects of contour delineation problem by incorporating a user feedback in contours delineation process where it is shown that only a small amount of user input can sometimes resolve ambiguous scenarios raised by DAC. In addition, once the prostate contours have been delineated, a cost functional is designed to incorporate both user feedback interaction and the parametric shape prior model. Using data from publicly available prostate MR datasets, which includes several challenging clinical datasets, we highlighted the effectiveness and the capability of the proposed algorithm. Besides, the algorithm has been compared with several state-of-the-art methods.

Three-dimensional nonrigid landmark-based magnetic resonance to transrectal ultrasound registration for image-guided prostate biopsy

Registration of three-dimensional (3-D) magnetic resonance (MR) to 3-D transrectal ultrasound (TRUS) prostate images is an important step in the planning and guidance of 3-D TRUS guided prostate biopsy. In order to accurately and efficiently perform the registration, a nonrigid landmark-based registration method is required to account for the different deformations of the prostate when using these two modalities. We describe a nonrigid landmark-based method for registration of 3-D TRUS to MR prostate images. The landmark-based registration method first makes use of an initial rigid registration of 3-D MR to 3-D TRUS images using six manually placed approximately corresponding landmarks in each image. Following manual initialization, the two prostate surfaces are segmented from 3-D MR and TRUS images and then nonrigidly registered using the following steps: (1) rotationally reslicing corresponding segmented prostate surfaces from both 3-D MR and TRUS images around a specified axis, (2) an approach to find point correspondences on the surfaces of the segmented surfaces, and (3) deformation of the surface of the prostate in the MR image to match the surface of the prostate in the 3-D TRUS image and the interior using a thin-plate spline algorithm. The registration accuracy was evaluated using 17 patient prostate MR and 3-D TRUS images by measuring the target registration error (TRE). Experimental results showed that the proposed method yielded an overall mean TRE of [Formula: see text] for the rigid registration and [Formula: see text] for the nonrigid registration, which is favorably comparable to a clinical requirement for an error of less than 2.5 mm. A landmark-based nonrigid 3-D MR-TRUS registration approach is proposed, which takes into account the correspondences on the prostate surface, inside the prostate, as well as the centroid of the prostate. Experimental results indicate that the proposed method yields clinically sufficient accuracy.

Three-Dimensional Nonrigid MR-TRUS Registration Using Dual Optimization

In this study, we proposed an efficient nonrigid magnetic resonance (MR) to transrectal ultrasound (TRUS) deformable registration method in order to improve the accuracy of targeting suspicious regions during a three dimensional (3-D) TRUS guided prostate biopsy. The proposed deformable registration approach employs the multi-channel modality independent neighborhood descriptor (MIND) as the local similarity feature across the two modalities of MR and TRUS, and a novel and efficient duality-based convex optimization-based algorithmic scheme was introduced to extract the deformations and align the two MIND descriptors. The registration accuracy was evaluated using 20 patient images by calculating the TRE using manually identified corresponding intrinsic fiducials in the whole gland and peripheral zone. Additional performance metrics [Dice similarity coefficient (DSC), mean absolute surface distance (MAD), and maximum absolute surface distance (MAXD)] were also calculated by comparing the MR and TRUS manually segmented prostate surfaces in the registered images. Experimental results showed that the proposed method yielded an overall median TRE of 1.76 mm. The results obtained in terms of DSC showed an average of 80.8±7.8% for the apex of the prostate, 92.0±3.4% for the mid-gland, 81.7±6.4% for the base and 85.7±4.7% for the whole gland. The surface distance calculations showed an overall average of 1.84±0.52 mm for MAD and 6.90±2.07 mm for MAXD.

A multi-atlas-based segmentation framework for prostate brachytherapy

Low-dose-rate brachytherapy is a radiation treatment method for localized prostate cancer. The standard of care for this treatment procedure is to acquire transrectal ultrasound images of the prostate in order to devise a plan to deliver sufficient radiation dose to the cancerous tissue. Brachytherapy planning involves delineation of contours in these images, which closely follow the prostate boundary, i.e., clinical target volume. This process is currently performed either manually or semi-automatically, which requires user interaction for landmark initialization. In this paper, we propose a multi-atlas fusion framework to automatically delineate the clinical target volume in ultrasound images. A dataset of a priori segmented ultrasound images, i.e., atlases, is registered to a target image. We introduce a pairwise atlas agreement factor that combines an image-similarity metric and similarity between a priori segmented contours. This factor is used in an atlas selection algorithm to prune the dataset before combining the atlas contours to produce a consensus segmentation. We evaluate the proposed segmentation approach on a set of 280 transrectal prostate volume studies. The proposed method produces segmentation results that are within the range of observer variability when compared to a semi-automatic segmentation technique that is routinely used in our cancer clinic.

Segmentation of tumor ultrasound image in HIFU therapy based on texture and boundary encoding

It is crucial in high intensity focused ultrasound (HIFU) therapy to detect the tumor precisely with less manual intervention for enhancing the therapy efficiency. Ultrasound image segmentation becomes a difficult task due to signal attenuation, speckle effect and shadows. This paper presents an unsupervised approach based on texture and boundary encoding customized for ultrasound image segmentation in HIFU therapy. The approach oversegments the ultrasound image into some small regions, which are merged by using the principle of minimum description length (MDL) afterwards. Small regions belonging to the same tumor are clustered as they preserve similar texture features. The mergence is completed by obtaining the shortest coding length from encoding textures and boundaries of these regions in the clustering process. The tumor region is finally selected from merged regions by a proposed algorithm without manual interaction. The performance of the method is tested on 50 uterine fibroid ultrasound images from HIFU guiding transducers. The segmentations are compared with manual delineations to verify its feasibility. The quantitative evaluation with HIFU images shows that the mean true positive of the approach is 93.53%, the mean false positive is 4.06%, the mean similarity is 89.92%, the mean norm Hausdorff distance is 3.62% and the mean norm maximum average distance is 0.57%. The experiments validate that the proposed method can achieve favorable segmentation without manual initialization and effectively handle the poor quality of the ultrasound guidance image in HIFU therapy, which indicates that the approach is applicable in HIFU therapy.

Interactive Prostate Shape Reconstruction from 3D TRUS Images

This paper presents a two-step, semi-automated method for reconstructing a three-dimensional (3D) shape of the prostate from a 3D transrectal ultrasound (TRUS) image. While the method has been developed for prostate ultrasound imaging, it can potentially be applicable to any other organ of the body and other imaging modalities. The proposed method takes as input a 3D TRUS image and generates a watertight 3D surface model of the prostate. In the first step, the system lets the user visualize and navigate through the input volumetric image by displaying cross sectional views oriented in arbitrary directions. The user then draws partial/full contours on selected cross sectional views. In the second step, the method automatically generates a watertight 3D surface of the prostate by fitting a deformable spherical template to the set of user-specified contours. Since the method allows the user to select the best cross-sectional directions and draw only clearly recognizable partial or full contours, the user can avoid time-consuming and inaccurate guesswork on where prostate contours are located. By avoiding the usage of noisy, incomprehensible portions of the TRUS image, the proposed method yields more accurate prostate shapes than conventional methods that demand complete cross-sectional contours selected manually, or automatically using an image processing tool. Our experiments confirmed that a 3D watertight surface of the prostate can be generated within five minutes even from a volumetric image with a high level of speckles and shadow noises.

An automatic multi-atlas segmentation of the prostate in transrectal ultrasound images using pairwise atlas shape similarity

Delineation of the prostate from transrectal ultrasound images is a necessary step in several computer-assisted clinical interventions, such as low dose rate brachytherapy. Current approaches to user segmentation require user intervention and therefore it is subject to user errors. It is desirable to have a fully automatic segmentation for improved segmentation consistency and speed. In this paper, we propose a multi-atlas fusion framework to automatically segment prostate transrectal ultrasound images. The framework initially registers a dataset of a priori segmented ultrasound images to a target image. Subsequently, it uses the pairwise similarity of registered prostate shapes, which is independent of the image-similarity metric optimized during the registration process, to prune the dataset prior to the fusion and consensus segmentation step. A leave-one-out cross-validation of the proposed framework on a dataset of 50 transrectal ultrasound volumes obtained from patients undergoing brachytherapy treatment shows that the proposed is clinically robust, accurate and reproducible.

A semiautomatic tool for prostate segmentation in radiotherapy treatment planning

BACKGROUND

Delineation of the target volume is a time-consuming task in radiotherapy treatment planning, yet essential for a successful treatment of cancers such as prostate cancer. To facilitate the delineation procedure, the paper proposes an intuitive approach for 3D modeling of the prostate by slice-wise best fitting ellipses.

METHODS

The proposed estimate is initialized by the definition of a few control points in a new patient. The method is not restricted to particular image modalities but assumes a smooth shape with elliptic cross sections of the object. A training data set of 23 patients was used to calculate a prior shape model. The mean shape model was evaluated based on the manual contour of 10 test patients. The patient records of training and test data are based on axial T1-weighted 3D fast-field echo (FFE) sequences. The manual contours were considered as the reference model. Volume overlap (Vo), accuracy (Ac) (both ratio, range 0-1, optimal value 1) and Hausdorff distance (HD) (mm, optimal value 0) were calculated as evaluation parameters.

RESULTS

The median and median absolute deviation (MAD) between manual delineation and deformed mean best fitting ellipses (MBFE) was Vo (0.9 ± 0.02), Ac (0.81 ± 0.03) and HD (4.05 ± 1.3)mm and between manual delineation and best fitting ellipses (BFE) was Vo (0.96 ± 0.01), Ac (0.92 ± 0.01) and HD (1.6 ± 0.27)mm. Additional results show a moderate improvement of the MBFE results after Monte Carlo Markov Chain (MCMC) method.

CONCLUSIONS

The results emphasize the potential of the proposed method of modeling the prostate by best fitting ellipses. It shows the robustness and reproducibility of the model. A small sample test on 8 patients suggest possible time saving using the model.

Automated prostate segmentation in whole-body MRI scans for epidemiological studies

The whole prostatic volume (PV) is an important indicator for benign prostate hyperplasia. Correlating the PV with other clinical parameters in a population-based prospective cohort study (SHIP-2) requires valid prostate segmentation in a large number of whole-body MRI scans. The axial proton density fast spin echo fat saturated sequence is used for prostate screening in SHIP-2. Our automated segmentation method is based on support vector machines (SVM). We used three-dimensional neighborhood information to build classification vectors from automatically generated features and randomly selected 16 MR examinations for validation. The Hausdorff distance reached a mean value of 5.048 ± 2.413, and a mean value of 5.613 ± 2.897 compared to manual segmentation by observers A and B. The comparison between volume measurement of SVM-based segmentation and manual segmentation of observers A and B depicts a strong correlation resulting in Spearman's rank correlation coefficients (ρ) of 0.936 and 0.859, respectively. Our automated methodology based on SVM for prostate segmentation can segment the prostate in WBI scans with good segmentation quality and has considerable potential for integration in epidemiological studies.

Efficient convex optimization approach to 3D non-rigid MR-TRUS registration

In this study, we propose an efficient non-rigid MR-TRUS deformable registration method to improve the accuracy of targeting suspicious locations during a 3D ultrasound (US) guided prostate biopsy. The proposed deformable registration approach employs the multi-channel modality independent neighbourhood descriptor (MIND) as the local similarity feature across the two modalities of MR and TRUS, and a novel and efficient duality-based convex optimization based algorithmic scheme is introduced to extract the deformations which align the two MIND descriptors. The registration accuracy was evaluated using 10 patient images by measuring the TRE of manually identified corresponding intrinsic fiducials in the whole gland and peripheral zone, and performance metrics (DSC, MAD and MAXD) for the apex, mid-gland and base of the prostate were also calculated by comparing two manually segmented prostate surfaces in the registered 3D MR and TRUS images. Experimental results show that the proposed method yielded an overall mean TRE of 1.74 mm, which is favorably comparable to a clinical requirement for an error of less than 2.5 mm.

Fusion of ultrasound B-mode and vibro-elastography images for automatic 3D segmentation of the prostate

Prostate segmentation in B-mode images is a challenging task even when done manually by experts. In this paper we propose a 3D automatic prostate segmentation algorithm which makes use of information from both ultrasound B-mode and vibro-elastography data.We exploit the high contrast to noise ratio of vibro-elastography images of the prostate, in addition to the commonly used B-mode images, to implement a 2D Active Shape Model (ASM)-based segmentation algorithm on the midgland image. The prostate model is deformed by a combination of two measures: the gray level similarity and the continuity of the prostate edge in both image types. The automatically obtained mid-gland contour is then used to initialize a 3D segmentation algorithm which models the prostate as a tapered and warped ellipsoid. Vibro-elastography images are used in addition to ultrasound images to improve boundary detection.We report a Dice similarity coefficient of 0.87±0.07 and 0.87±0.08 comparing the 2D automatic contours with manual contours of two observers on 61 images. For 11 cases, a whole gland volume error of 10.2±2.2% and 13.5±4.1% and whole gland volume difference of -7.2±9.1% and -13.3±12.6% between 3D automatic and manual surfaces of two observers is obtained. This is the first validated work showing the fusion of B-mode and vibro-elastography data for automatic 3D segmentation of the prostate.

A survey of prostate segmentation methodologies in ultrasound, magnetic resonance and computed tomography images

Prostate segmentation is a challenging task, and the challenges significantly differ from one imaging modality to another. Low contrast, speckle, micro-calcifications and imaging artifacts like shadow poses serious challenges to accurate prostate segmentation in transrectal ultrasound (TRUS) images. However in magnetic resonance (MR) images, superior soft tissue contrast highlights large variability in shape, size and texture information inside the prostate. In contrast poor soft tissue contrast between prostate and surrounding tissues in computed tomography (CT) images pose a challenge in accurate prostate segmentation. This article reviews the methods developed for prostate gland segmentation TRUS, MR and CT images, the three primary imaging modalities that aids prostate cancer diagnosis and treatment. The objective of this work is to study the key similarities and differences among the different methods, highlighting their strengths and weaknesses in order to assist in the choice of an appropriate segmentation methodology. We define a new taxonomy for prostate segmentation strategies that allows first to group the algorithms and then to point out the main advantages and drawbacks of each strategy. We provide a comprehensive description of the existing methods in all TRUS, MR and CT modalities, highlighting their key-points and features. Finally, a discussion on choosing the most appropriate segmentation strategy for a given imaging modality is provided. A quantitative comparison of the results as reported in literature is also presented.

Seed localization in ultrasound and registration to C-arm fluoroscopy using matched needle tracks for prostate brachytherapy

We propose a novel fiducial-free approach for the registration of C-arm fluoroscopy to 3-D ultrasound images of prostate brachytherapy implants to enable dosimetry. The approach involves the reliable detection of a subset of radioactive seeds from 3-D ultrasound, and the use of needle tracks in both ultrasound and fluoroscopy for registration. Seed detection in ultrasound is achieved through template matching in 3-D radio frequency ultrasound signals, followed by thresholding and spatial filtering. The resulting subset of seeds is registered to the complete reconstruction of the brachytherapy implant from multiple C-arm fluoroscopy views. To compensate for the deformation caused by the ultrasound probe, simulated warping is applied to the seed cloud from fluoroscopy. The magnitude of the applied warping is optimized within the registration process. The registration is performed in two stages. First, the needle track projections from fluoroscopy and ultrasound are matched. Only the seeds in the matched needles are then used as fiducials for point-based registration. We report results from a physical phantom with a realistic implant (average postregistration seed distance of 1.6 ± 1.2 mm) and from five clinical patient datasets (average error: 2.8 ± 1.5 mm over 128 detected seeds). We conclude that it is feasible to use RF ultrasound data, template matching, and spatial filtering to detect a reliable subset of brachytherapy seeds from ultrasound to enable registration to fluoroscopy for dosimetry.