Volumetric intraoperative brain deformation compensation: model development and phantom validation

Acoustic radiation force for analyzing the mechanical stress in ultrasound neuromodulation

Objective. Although recent studies have shown that mechanical stress plays an important role in ultrasound neuromodulation, the magnitude and distribution of the mechanical stress generated in tissues by focused ultrasound transducers have not been adequately examined. Various acoustic radiation force (ARF) equations used in previous studies have been evaluated based on the tissue displacement results and are suitable for estimating the displacement. However, it is unclear whether mechanical stress can be accurately determined. This study evaluates the mechanical stress predicted by various AFR equations and suggests the optimal equation for estimating the mechanical stress in the brain tissue.Approach. In this paper, brain tissue responses are compared through numerical finite element simulations by applying the three most used ARF equations-Reynolds stress force ((RSF)), momentum flux density tensor force, and attenuation force. Three ARF fields obtained from the same pressure field were applied to the linear elastic model to calculate the displacement, mechanical stress, and mean pressure generated inside the tissue. Both the simple pressure field using a single transducer and the complex standing wave pressure field using two transducers were simulated.Main results. For the case using a single transducer, all three ARFs showed similar displacement. However, when comparing the mechanical stress results, only the results using the RSF showed a strong stress tensor at the focal point. For the case of using two transducers, the displacement and stress tensor field of the pattern related to the standing wave were calculated only from the results using the RSF.Significance. The model using RSF equation allows accurate analysis on stress tensor inside the tissue for ultrasound neuromodulation.

Development of Innovative Neurosurgical Operation Support Method Using Mixed-Reality Computer Graphics

Background

In neurosurgery, it is important to inspect the spatial correspondence between the preoperative medical image (virtual space), and the intraoperative findings (real space) to improve the safety of the surgery. Navigation systems and related modalities have been reported as methods for matching this correspondence. However, because of the influence of the brain shift accompanying craniotomy, registration accuracy is reduced. In the present study, to overcome these issues, we developed a spatially accurate registration method of medical fusion 3-dimensional computer graphics and the intraoperative brain surface photograph, and its registration accuracy was measured.

Methods

The subjects included 16 patients with glioma. Nonrigid registration using the landmarks and thin-plate spline methods was performed for the fusion 3-dimensional computer graphics and the intraoperative brain surface photograph, termed mixed-reality computer graphics. Regarding the registration accuracy measurement, the target registration error was measured by two neurosurgeons, with 10 points for each case at the midpoint of the landmarks.

Results

The number of target registration error measurement points was 160 in the 16 cases. The target registration error was 0.72 ± 0.04 mm. Aligning the intraoperative brain surface photograph and the fusion 3-dimensional computer graphics required ∼10 minutes on average. The average number of landmarks used for alignment was 24.6.

Conclusions

Mixed-reality computer graphics enabled highly precise spatial alignment between the real space and virtual space. Mixed-reality computer graphics have the potential to improve the safety of the surgery by allowing complementary observation of brain surface photographs and fusion 3-dimensional computer graphics.

Catheter guided cerebral glioma resection combined with awake craniotomy: its usefulness and surgical outcome

Purpose: A challenging aspect of glioma surgery is to distinguish tumour tissue from surrounding eloquent structures and perform resection with accuracy. Various technologies have been used to address this issue including neuronavigator, intraoperative magnetic resonant imaging, intraoperative ultrasound, and fluorescence, each of which has certain drawbacks and limitations. In this study, authors demonstrate the technique of using stereotactically placed catheters as guidance during cerebral glioma resection and report the surgical outcomes. Materials and methods: This study included patients with intrinsic cerebral tumour adjacent to the eloquent structures. Catheter trajectories were planned using three-dimensional cerebral reconstruction on navigation software and catheters were stereotactically placed to mark the intended extent of resection. All craniotomies were performed in awake fashion under neurophysiologic mapping and continuous physical examination for safe maximal resection. Clinical outcome and intended versus actual extent of resection were analysed. Results: Between January 2015 and December 2016, 15 consecutive patients (8 males and 7 females) with intrinsic cerebral tumour underwent craniotomy with this technique. Median age was 43 years. Seven patients (46.7%) had worsening neurological status within 24 h postoperatively. Of these 7 patients, 6 patients (85.7%) regained preoperative neurological status by 6 months. The intended extent of resections were total, subtotal and partial in 3 (20%), 9 (60%), and 3 (20%) patients, respectively. The actual extent of resections were total, subtotal and partial in 3 (20%), 8(53.3%), and 4 (26.7%) patients, respectively. There were no catheter related complications. There was no 30-day postoperative mortality. Conclusions: Catheter guided resection along with awake surgery and neurophysiologic monitoring is a valid technique for infiltrative tumour, especially for ones locating near eloquent structures where the margin of error is low. This is a simple and economical technique which requires only standard equipment widely available to neurosurgical operating theatres.

Segmenting the Brain Surface From CT Images With Artifacts Using Locally Oriented Appearance and Dictionary Learning

The accurate segmentation of the brain surface in post-surgical computed tomography (CT) images is critical for image-guided neurosurgical procedures in epilepsy patients. Following surgical implantation of intracranial electrodes, surgeons require accurate registration of the post-implantation CT images to the pre-implantation functional and structural magnetic resonance imaging to guide surgical resection of epileptic tissue. One way to perform the registration is via surface matching. The key challenge in this setup is the CT segmentation, where the extraction of the cortical surface is difficult due to the missing parts of the skull and artifacts introduced from the electrodes. In this paper, we present a dictionary learning-based method to segment the brain surface in post-surgical CT images of epilepsy patients following surgical implantation of electrodes. We propose learning a model of locally oriented appearance that captures both the normal tissue and the artifacts found along this brain surface boundary. Utilizing a database of clinical epilepsy imaging data to train and test our approach, we demonstrate that our method using locally oriented image appearance both more accurately extracts the brain surface and better localizes electrodes on the post-operative brain surface compared to standard, non-oriented appearance modeling. In addition, we compare our method to a standard atlas-based segmentation approach and to a U-Net-based deep convolutional neural network segmentation method.

In vivo modeling of interstitial pressure in a porcine model: approximation of poroelastic properties and effects of enhanced anatomical structure modeling

The purpose of this investigation is to test whether a poroelastic model with enhanced structure can capture in vivo interstitial pressure dynamics in a brain undergoing mock surgical loads. Using interstitial pressure data from a porcine study, we use an inverse model to reconstruct material properties in an effort to capture these in vivo brain tissue dynamics. Four distinct models for the reconstruction of parameters are investigated (full anatomical condition description, condition without dural septa description, condition without ventricle boundary description, and the conventional fully saturated model). These models are systematic in their development to isolate the influence of three model characteristics: the dural septa, the treatment of the ventricles, and the treatment of the brain as a saturated media. This study demonstrates that to capture appropriate pressure compartmentalization, interstitial pressure gradients, pressure transient effects, and deformations within the brain, the proposed boundary conditions and structural enhancement coupled with a heterogeneous description invoking partial saturation are needed in a biphasic poroelastic model. These findings suggest that with enhanced anatomical modeling and appropriate model assumptions, poroelastic models can be used to capture quite complex brain deformations and interstitial pressure dynamics.

Retrospective study comparing model-based deformation correction to intraoperative magnetic resonance imaging for image-guided neurosurgery

Brain shift during tumor resection compromises the spatial validity of registered preoperative imaging data that is critical to image-guided procedures. One current clinical solution to mitigate the effects is to reimage using intraoperative magnetic resonance (iMR) imaging. Although iMR has demonstrated benefits in accounting for preoperative-to-intraoperative tissue changes, its cost and encumbrance have limited its widespread adoption. While iMR will likely continue to be employed for challenging cases, a cost-effective model-based brain shift compensation strategy is desirable as a complementary technology for standard resections. We performed a retrospective study of [Formula: see text] tumor resection cases, comparing iMR measurements with intraoperative brain shift compensation predicted by our model-based strategy, driven by sparse intraoperative cortical surface data. For quantitative assessment, homologous subsurface targets near the tumors were selected on preoperative MR and iMR images. Once rigidly registered, intraoperative shift measurements were determined and subsequently compared to model-predicted counterparts as estimated by the brain shift correction framework. When considering moderate and high shift ([Formula: see text], [Formula: see text] measurements per case), the alignment error due to brain shift reduced from [Formula: see text] to [Formula: see text], representing [Formula: see text] correction. These first steps toward validation are promising for model-based strategies.

A combined registration and finite element analysis method for fast estimation of intraoperative brain shift; phantom and animal model study

BACKGROUND

Finite element models for estimation of intraoperative brain shift suffer from huge computational cost. In these models, image registration and finite element analysis are two time-consuming processes.

METHODS

The proposed method is an improved version of our previously developed Finite Element Drift (FED) registration algorithm. In this work the registration process is combined with the finite element analysis. In the Combined FED (CFED), the deformation of whole brain mesh is iteratively calculated by geometrical extension of a local load vector which is computed by FED.

RESULTS

While the processing time of the FED-based method including registration and finite element analysis was about 70 s, the computation time of the CFED was about 3.2 s. The computational cost of CFED is almost 50% less than similar state of the art brain shift estimators based on finite element models.

CONCLUSIONS

The proposed combination of registration and structural analysis can make the calculation of brain deformation much faster.

Brain shift in neuronavigation of brain tumors: A review

PURPOSE

Neuronavigation based on preoperative imaging data is a ubiquitous tool for image guidance in neurosurgery. However, it is rendered unreliable when brain shift invalidates the patient-to-image registration. Many investigators have tried to explain, quantify, and compensate for this phenomenon to allow extended use of neuronavigation systems for the duration of surgery. The purpose of this paper is to present an overview of the work that has been done investigating brain shift.

METHODS

A review of the literature dealing with the explanation, quantification and compensation of brain shift is presented. The review is based on a systematic search using relevant keywords and phrases in PubMed. The review is organized based on a developed taxonomy that classifies brain shift as occurring due to physical, surgical or biological factors.

RESULTS

This paper gives an overview of the work investigating, quantifying, and compensating for brain shift in neuronavigation while describing the successes, setbacks, and additional needs in the field. An analysis of the literature demonstrates a high variability in the methods used to quantify brain shift as well as a wide range in the measured magnitude of the brain shift, depending on the specifics of the intervention. The analysis indicates the need for additional research to be done in quantifying independent effects of brain shift in order for some of the state of the art compensation methods to become useful.

CONCLUSION

This review allows for a thorough understanding of the work investigating brain shift and introduces the needs for future avenues of investigation of the phenomenon.

Automatic tracking of intraoperative brain surface displacements in brain tumor surgery

In brain tumor surgery, soft-tissue deformation, known as brain shift, introduces inaccuracies in the application of the preoperative surgical plan and impedes the advancement of image-guided surgical (IGS) systems. Considerable progress in using patient-specific biomechanical models to update the preoperative images intraoperatively has been made. These model-update methods rely on accurate intraoperative 3D brain surface displacements. In this work, we investigate and develop a fully automatic method to compute these 3D displacements for lengthy (~15 minutes) stereo-pair video sequences acquired during neurosurgery. The first part of the method finds homologous points temporally in the video and the second part computes the nonrigid transformation between these homologous points. Our results, based on parts of 2 clinical cases, show that this speedy and promising method can robustly provide 3D brain surface measurements for use with model-based updating frameworks.

Learning intervention-induced deformations for non-rigid MR-CT registration and electrode localization in epilepsy patients

This paper describes a framework for learning a statistical model of non-rigid deformations induced by interventional procedures. We make use of this learned model to perform constrained non-rigid registration of pre-procedural and post-procedural imaging. We demonstrate results applying this framework to non-rigidly register post-surgical computed tomography (CT) brain images to pre-surgical magnetic resonance images (MRIs) of epilepsy patients who had intra-cranial electroencephalography electrodes surgically implanted. Deformations caused by this surgical procedure, imaging artifacts caused by the electrodes, and the use of multi-modal imaging data make non-rigid registration challenging. Our results show that the use of our proposed framework to constrain the non-rigid registration process results in significantly improved and more robust registration performance compared to using standard rigid and non-rigid registration methods.

Computational Modeling for Enhancing Soft Tissue Image Guided Surgery: An Application in Neurosurgery

With the recent advances in computing, the opportunities to translate computational models to more integrated roles in patient treatment are expanding at an exciting rate. One area of considerable development has been directed towards correcting soft tissue deformation within image guided neurosurgery applications. This review captures the efforts that have been undertaken towards enhancing neuronavigation by the integration of soft tissue biomechanical models, imaging and sensing technologies, and algorithmic developments. In addition, the review speaks to the evolving role of modeling frameworks within surgery and concludes with some future directions beyond neurosurgical applications.

Evaluation of conoscopic holography for estimating tumor resection cavities in model-based image-guided neurosurgery

Surgical navigation relies on accurately mapping the intraoperative state of the patient to models derived from preoperative images. In image-guided neurosurgery, soft tissue deformations are common and have been shown to compromise the accuracy of guidance systems. In lieu of whole-brain intraoperative imaging, some advocate the use of intraoperatively acquired sparse data from laser-range scans, ultrasound imaging, or stereo reconstruction coupled with a computational model to drive subsurface deformations. Some authors have reported on compensating for brain sag, swelling, retraction, and the application of pharmaceuticals such as mannitol with these models. To date, strategies for modeling tissue resection have been limited. In this paper, we report our experiences with a novel digitization approach, called a conoprobe, to document tissue resection cavities and assess the impact of resection on model-based guidance systems. Specifically, the conoprobe was used to digitize the interior of the resection cavity during eight brain tumor resection surgeries and then compared against model prediction results of tumor locations. We should note that no effort was made to incorporate resection into the model but rather the objective was to determine if measurement was possible to study the impact on modeling tissue resection. In addition, the digitized resection cavity was compared with early postoperative MRI scans to determine whether these scans can further inform tissue resection. The results demonstrate benefit in model correction despite not having resection explicitly modeled. However, results also indicate the challenge that resection provides for model-correction approaches. With respect to the digitization technology, it is clear that the conoprobe provides important real-time data regarding resection and adds another dimension to our noncontact instrumentation framework for soft-tissue deformation compensation in guidance systems.

Estimation of intra-operative brain shift based on constrained Kalman filter

In this study, the problem of estimation of brain shift is addressed by which the accuracy of neuronavigation systems can be improved. To this end, the actual brain shift is considered as a Gaussian random vector with a known mean and an unknown covariance. Then, brain surface imaging is employed together with solutions of linear elastic model and the best estimation is found using constrained Kalman filter (CKF). Moreover, a recursive method (RCKF) is presented, the computational cost of which in the operating room is significantly lower than CKF, because it is not required to compute inverse of any large matrix. Finally, the theory is verified by the simulation results, which show the superiority of the proposed method as compared to one existing method.

Decompressive craniectomy (DC) at the non-injured side of the brain has the potential to improve patient outcome as measured with computational simulation

OBJECTIVE

Decompressive craniectomy (DC) is efficient in reducing the intracranial pressure in several complicated disorders such as traumatic brain injury (TBI) and stroke. The neurosurgical procedure has indeed reduced the number of deaths. However, parallel with the reduced fatal cases, the number of vegetative patients has increased significantly. Mechanical stretching in axonal fibers has been suggested to contribute to the unfavorable outcome. Thus, there is a need for improving treatment procedures that allow both reduced fatal and vegetative outcomes. The hypothesis is that by performing the DC at the non-injured side of the head, stretching of axonal fibers at the injured brain tissue can be reduced, thereby having the potential to improve patient outcome.

METHODS

Six patients, one with TBI and five with stroke, were treated with DC and where each patient's pre- and postoperative computerized tomography (CT) were analyzed and transferred to a finite element (FE) model of the human head and brain to simulate DC both at the injured and non-injured sides of the head. Poroelastic material was used to simulate brain tissue.

RESULTS

The computational simulation showed slightly to substantially increased axonal strain levels over 40 % on the injured side where the actual DC had been performed in the six patients. However, when the simulation DC was performed on the opposite, non-injured side, there was a substantial reduction in axonal strain levels at the injured side of brain tissue. Also, at the opposite, non-injured side, the axonal strain level was substantially lower in the brain tissue. The reduced axonal strain level could be verified by analyzing a number of coronal sections in each patient. Further analysis of axial slices showed that falx may tentatively explain part of the different axonal strain levels between the DC performances at injured and opposite, non-injured sides of the head.

CONCLUSIONS

By using a FE method it is possible to optimize the DC procedure to a non-injured area of the head thereby having the potential to reduce axonal stretching at the injured brain tissue. The postoperative DC stretching of axonal fibers may be influenced by different anatomical structures including falx. It is suggested that including computational FE simulation images may offer guidance to reduce axonal strain level tailoring the anatomical location of DC performance in each patient.

Persistent and automatic intraoperative 3D digitization of surfaces under dynamic magnifications of an operating microscope

One of the major challenges impeding advancement in image-guided surgical (IGS) systems is the soft-tissue deformation during surgical procedures. These deformations reduce the utility of the patient's preoperative images and may produce inaccuracies in the application of preoperative surgical plans. Solutions to compensate for the tissue deformations include the acquisition of intraoperative tomographic images of the whole organ for direct displacement measurement and techniques that combines intraoperative organ surface measurements with computational biomechanical models to predict subsurface displacements. The later solution has the advantage of being less expensive and amenable to surgical workflow. Several modalities such as textured laser scanners, conoscopic holography, and stereo-pair cameras have been proposed for the intraoperative 3D estimation of organ surfaces to drive patient-specific biomechanical models for the intraoperative update of preoperative images. Though each modality has its respective advantages and disadvantages, stereo-pair camera approaches used within a standard operating microscope is the focus of this article. A new method that permits the automatic and near real-time estimation of 3D surfaces (at 1 Hz) under varying magnifications of the operating microscope is proposed. This method has been evaluated on a CAD phantom object and on full-length neurosurgery video sequences (∼1 h) acquired intraoperatively by the proposed stereovision system. To the best of our knowledge, this type of validation study on full-length brain tumor surgery videos has not been done before. The method for estimating the unknown magnification factor of the operating microscope achieves accuracy within 0.02 of the theoretical value on a CAD phantom and within 0.06 on 4 clinical videos of the entire brain tumor surgery. When compared to a laser range scanner, the proposed method for reconstructing 3D surfaces intraoperatively achieves root mean square errors (surface-to-surface distance) in the 0.28-0.81 mm range on the phantom object and in the 0.54-1.35 mm range on 4 clinical cases. The digitization accuracy of the presented stereovision methods indicate that the operating microscope can be used to deliver the persistent intraoperative input required by computational biomechanical models to update the patient's preoperative images and facilitate active surgical guidance.

A Mechanics-Based Nonrigid Registration Method for Liver Surgery Using Sparse Intraoperative Data

In open abdominal image-guided liver surgery, sparse measurements of the organ surface can be taken intraoperatively via a laser-range scanning device or a tracked stylus with relatively little impact on surgical workflow. We propose a novel nonrigid registration method which uses sparse surface data to reconstruct a mapping between the preoperative CT volume and the intraoperative patient space. The mapping is generated using a tissue mechanics model subject to boundary conditions consistent with surgical supportive packing during liver resection therapy. Our approach iteratively chooses parameters which define these boundary conditions such that the deformed tissue model best fits the intraoperative surface data. Using two liver phantoms, we gathered a total of five deformation datasets with conditions comparable to open surgery. The proposed nonrigid method achieved a mean target registration error (TRE) of 3.3 mm for targets dispersed throughout the phantom volume, using a limited region of surface data to drive the nonrigid registration algorithm, while rigid registration resulted in a mean TRE of 9.5 mm. In addition, we studied the effect of surface data extent, the inclusion of subsurface data, the trade-offs of using a nonlinear tissue model, robustness to rigid misalignments, and the feasibility in five clinical datasets.

Tissue localization during resective epilepsy surgery

Object

Imaging-guided surgery (IGS) systems are widely used in neurosurgical practice. During epilepsy surgery, the authors routinely use IGS landmarks to localize intracranial electrodes and/or specific brain regions. The authors have developed a technique to coregister these landmarks with pre- and postoperative scans and the Montreal Neurological Institute (MNI) standard space brain MRI to allow 1) localization and identification of tissue anatomy; and 2) identification of Brodmann areas (BAs) of the tissue resected during epilepsy surgery. Tracking tissue in this fashion allows for better correlation of patient outcome to clinical factors, functional neuroimaging findings, and pathological characteristics and molecular studies of resected tissue.

Methods

Tissue samples were collected in 21 patients. Coordinates from intraoperative tissue localization were downloaded from the IGS system and transformed into patient space, as defined by preoperative high-resolution T1-weighted MRI volume. Tissue landmarks in patient space were then transformed into MNI standard space for identification of the BAs of the tissue samples.

Results

Anatomical locations of resected tissue were identified from the intraoperative resection landmarks. The BAs were identified for 17 of the 21 patients. The remaining patients had abnormal brain anatomy that could not be meaningfully coregistered with the MNI standard brain without causing extensive distortion.

Conclusions

This coregistration and landmark tracking technique allows localization of tissue that is resected from patients with epilepsy and identification of the BAs for each resected region. The ability to perform tissue localization allows investigators to relate preoperative, intraoperative, and postoperative functional and anatomical brain imaging to better understand patient outcomes, improve patient safety, and aid in research.