An ITK implementation of a physics-based non-rigid registration method for brain deformation in image-guided neurosurgery

Comparison of physics-based deformable registration methods for image-guided neurosurgery

This paper compares three finite element-based methods used in a physics-based non-rigid registration approach and reports on the progress made over the last 15 years. Large brain shifts caused by brain tumor removal affect registration accuracy by creating point and element outliers. A combination of approximation- and geometry-based point and element outlier rejection improves the rigid registration error by 2.5 mm and meets the real-time constraints (4 min). In addition, the paper raises several questions and presents two open problems for the robust estimation and improvement of registration error in the presence of outliers due to sparse, noisy, and incomplete data. It concludes with preliminary results on leveraging Quantum Computing, a promising new technology for computationally intensive problems like Feature Detection and Block Matching in addition to finite element solver; all three account for 75% of computing time in deformable registration.

Quantitative Validation of the Correlation Between Optimized Pyramidal Tract Delineation After Brain Shift Compensation and Direct Electrical Subcortical Stimulation During Brain Tumor Surgery

It remains unclear whether tractography of pyramidal tracts is correlated with the intraoperative direct electrical subcortical stimulation (DESS), and brain shift further complicates the issue. The objective of this research is to quantitatively verify the correlation between optimized tractography (OT) of pyramidal tracts after brain shift compensation and DESS during brain tumor surgery. OT was performed for 20 patients with lesions in proximity to the pyramidal tracts based on preoperative diffusion-weighted magnetic resonance imaging. During surgery, tumor resection was guided by DESS. A total of 168 positive stimulation points and their corresponding stimulation intensity thresholds were recorded. Using the brain shift compensation algorithm based on hierarchical B-spline grids combined with a Gaussian resolution pyramid, we warped the preoperative pyramidal tract models and used receiver operating characteristic (ROC) curves to investigate the reliability of our brain shift compensation method based on anatomic landmarks. Additionally, the minimum distance between the DESS points and warped OT (wOT) model was measured and correlated with DESS intensity threshold. Brain shift compensation was achieved in all cases, and the area under the ROC curve was 0.96 in the registration accuracy analysis. The minimum distance between the DESS points and the wOT model was found to have a significantly high correlation with the DESS stimulation intensity threshold (r = 0.87, P < 0.001), with a linear regression coefficient of 0.96. Our OT method can provide comprehensive and accurate visualization of the pyramidal tracts for neurosurgical navigation and was quantitatively verified by intraoperative DESS after brain shift compensation.

Real-Time Dynamic Data Driven Deformable Registration for Image-Guided Neurosurgery: Computational Aspects

Current neurosurgical procedures utilize medical images of various modalities to enable the precise location of tumors and critical brain structures to plan accurate brain tumor resection. The difficulty of using preoperative images during the surgery is caused by the intra-operative deformation of the brain tissue (brain shift), which introduces discrepancies concerning the preoperative configuration. Intra-operative imaging allows tracking such deformations but cannot fully substitute for the quality of the pre-operative data. Dynamic Data Driven Deformable Non-Rigid Registration (D4NRR) is a complex and time-consuming image processing operation that allows the dynamic adjustment of the pre-operative image data to account for intra-operative brain shift during the surgery. This paper summarizes the computational aspects of a specific adaptive numerical approximation method and its variations for registering brain MRIs. It outlines its evolution over the last 15 years and identifies new directions for the computational aspects of the technique.

Adaptive Physics-Based Non-Rigid Registration for Immersive Image-Guided Neuronavigation Systems

Objective: In image-guided neurosurgery, co-registered preoperative anatomical, functional, and diffusion tensor imaging can be used to facilitate a safe resection of brain tumors in eloquent areas of the brain. However, the brain deforms during surgery, particularly in the presence of tumor resection. Non-Rigid Registration (NRR) of the preoperative image data can be used to create a registered image that captures the deformation in the intraoperative image while maintaining the quality of the preoperative image. Using clinical data, this paper reports the results of a comparison of the accuracy and performance among several non-rigid registration methods for handling brain deformation. A new adaptive method that automatically removes mesh elements in the area of the resected tumor, thereby handling deformation in the presence of resection is presented. To improve the user experience, we also present a new way of using mixed reality with ultrasound, MRI, and CT.

Materials and methods: This study focuses on 30 glioma surgeries performed at two different hospitals, many of which involved the resection of significant tumor volumes. An Adaptive Physics-Based Non-Rigid Registration method (A-PBNRR) registers preoperative and intraoperative MRI for each patient. The results are compared with three other readily available registration methods: a rigid registration implemented in 3D Slicer v4.4.0; a B-Spline non-rigid registration implemented in 3D Slicer v4.4.0; and PBNRR implemented in ITKv4.7.0, upon which A-PBNRR was based. Three measures were employed to facilitate a comprehensive evaluation of the registration accuracy: (i) visual assessment, (ii) a Hausdorff Distance-based metric, and (iii) a landmark-based approach using anatomical points identified by a neurosurgeon.

Results: The A-PBNRR using multi-tissue mesh adaptation improved the accuracy of deformable registration by more than five times compared to rigid and traditional physics based non-rigid registration, and four times compared to B-Spline interpolation methods which are part of ITK and 3D Slicer. Performance analysis showed that A-PBNRR could be applied, on average, in <2 min, achieving desirable speed for use in a clinical setting.

Conclusions: The A-PBNRR method performed significantly better than other readily available registration methods at modeling deformation in the presence of resection. Both the registration accuracy and performance proved sufficient to be of clinical value in the operating room. A-PBNRR, coupled with the mixed reality system, presents a powerful and affordable solution compared to current neuronavigation systems.

Age Prediction Based on Brain MRI Image: A Survey

Human age prediction is an interesting and applicable issue in different fields. It can be based on various criteria such as face image, DNA methylation, chest plate radiographs, knee radiographs, dental images and etc. Most of the age prediction researches have mainly been based on images. Since the image processing and Machine Learning (ML) techniques have grown up, the investigations were led to use them in age prediction problem. The implementations would be used in different fields, especially in medical applications. Brain Age Estimation (BAE) has attracted more attention in recent years and it would be so helpful in early diagnosis of some neurodegenerative diseases such as Alzheimer, Parkinson, Huntington, etc. BAE is performed on Magnetic Resonance Imaging (MRI) images to compute the brain ages. Studies based on brain MRI shows that there is a relation between accelerated aging and accelerated brain atrophy. This refers to the effects of neurodegenerative diseases on brain structure while making the whole of it older. This paper reviews and summarizes the main approaches for age prediction based on brain MRI images including preprocessing methods, useful tools used in different research works and the estimation algorithms. We categorize the BAE methods based on two factors, first the way of processing MRI images, which includes pixel-based, surface-based, or voxel-based methods and second, the generation of ML algorithms that includes traditional or Deep Learning (DL) methods. The modern techniques as DL methods help MRI based age prediction to get results that are more accurate. In recent years, more precise and statistical ML approaches have been utilized with the help of related tools for simplifying computations and getting accurate results. Pros and cons of each research and the challenges in each work are expressed and some guidelines and deliberations for future research are suggested.

Integrated datasets of normalized brain with functional localization using intra-operative electrical stimulation

PURPOSE

The purpose of this study was to transform brain mapping data into a digitized intra-operative MRI and integrated brain function dataset for predictive glioma surgery considering tumor resection volume, as well as the intra-operative and postoperative complication rates.

METHODS

Brain function data were transformed into digitized localizations on a normalized brain using a modified electric stimulus probe after brain mapping. This normalized brain image with functional information was then projected onto individual patient's brain images including predictive brain function data.

RESULTS

Log data were successfully acquired using a medical device integrated into intra-operative MR images, and digitized brain function was converted to a normalized brain data format in 13 cases. For the electrical stimulation positions in which patients showed speech arrest (SA), speech impairment (SI), motor and sensory responses during cortical mapping processes in awake craniotomy, the data were tagged, and the testing task and electric current for the stimulus were recorded. There were 13 SA, 7 SI, 8 motor and 4 sensory responses (32 responses) in total. After evaluation of transformation accuracy in 3 subjects, the first transformation from intra- to pre-operative MRI using non-rigid registration was calculated as 2.6 ± 1.5 and 2.1 ± 0.9 mm, examining neighboring sulci on the electro-stimulator position and the cortex surface near each tumor, respectively; the second transformation from pre-operative to normalized brain was 1.7 ± 0.8 and 1.4 ± 0.5 mm, respectively, representing acceptable accuracy.

CONCLUSION

This image integration and transformation method for brain normalization should facilitate practical intra-operative brain mapping. In the future, this method may be helpful for pre-operatively or intra-operatively predicting brain function.

A nonrigid registration method for correcting brain deformation induced by tumor resection

PURPOSE

This paper presents a nonrigid registration method to align preoperative MRI with intraoperative MRI to compensate for brain deformation during tumor resection. This method extends traditional point-based nonrigid registration in two aspects: (1) allow the input data to be incomplete and (2) simulate the underlying deformation with a heterogeneous biomechanical model.

METHODS

The method formulates the registration as a three-variable (point correspondence, deformation field, and resection region) functional minimization problem, in which point correspondence is represented by a fuzzy assign matrix; Deformation field is represented by a piecewise linear function regularized by the strain energy of a heterogeneous biomechanical model; and resection region is represented by a maximal simply connected tetrahedral mesh. A nested expectation and maximization framework is developed to simultaneously resolve these three variables.

RESULTS

To evaluate this method, the authors conducted experiments on both synthetic data and clinical MRI data. The synthetic experiment confirmed their hypothesis that the removal of additional elements from the biomechanical model can improve the accuracy of the registration. The clinical MRI experiments on 25 patients showed that the proposed method outperforms the ITK implementation of a physics-based nonrigid registration method. The proposed method improves the accuracy by 2.88 mm on average when the error is measured by a robust Hausdorff distance metric on Canny edge points, and improves the accuracy by 1.56 mm on average when the error is measured by six anatomical points.

CONCLUSIONS

The proposed method can effectively correct brain deformation induced by tumor resection.

Toward a real time multi-tissue Adaptive Physics-Based Non-Rigid Registration framework for brain tumor resection

This paper presents an adaptive non-rigid registration method for aligning pre-operative MRI with intra-operative MRI (iMRI) to compensate for brain deformation during brain tumor resection. This method extends a successful existing Physics-Based Non-Rigid Registration (PBNRR) technique implemented in ITKv4.5. The new method relies on a parallel adaptive heterogeneous biomechanical Finite Element (FE) model for tissue/tumor removal depicted in the iMRI. In contrast the existing PBNRR in ITK relies on homogeneous static FE model designed for brain shift only (i.e., it is not designed to handle brain tumor resection). As a result, the new method (1) accurately captures the intra-operative deformations associated with the tissue removal due to tumor resection and (2) reduces the end-to-end execution time to within the time constraints imposed by the neurosurgical procedure. The evaluation of the new method is based on 14 clinical cases with: (i) brain shift only (seven cases), (ii) partial tumor resection (two cases), and (iii) complete tumor resection (five cases). The new adaptive method can reduce the alignment error up to seven and five times compared to a rigid and ITK's PBNRR registration methods, respectively. On average, the alignment error of the new method is reduced by 9.23 and 5.63 mm compared to the alignment error from the rigid and PBNRR method implemented in ITK. Moreover, the total execution time for all the case studies is about 1 min or less in a Linux Dell workstation with 12 Intel Xeon 3.47 GHz CPU cores and 96 GB of RAM.