1
|
Taleb A, Guigou C, Leclerc S, Lalande A, Bozorg Grayeli A. Image-to-Patient Registration in Computer-Assisted Surgery of Head and Neck: State-of-the-Art, Perspectives, and Challenges. J Clin Med 2023; 12:5398. [PMID: 37629441 PMCID: PMC10455300 DOI: 10.3390/jcm12165398] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Revised: 08/08/2023] [Accepted: 08/14/2023] [Indexed: 08/27/2023] Open
Abstract
Today, image-guided systems play a significant role in improving the outcome of diagnostic and therapeutic interventions. They provide crucial anatomical information during the procedure to decrease the size and the extent of the approach, to reduce intraoperative complications, and to increase accuracy, repeatability, and safety. Image-to-patient registration is the first step in image-guided procedures. It establishes a correspondence between the patient's preoperative imaging and the intraoperative data. When it comes to the head-and-neck region, the presence of many sensitive structures such as the central nervous system or the neurosensory organs requires a millimetric precision. This review allows evaluating the characteristics and the performances of different registration methods in the head-and-neck region used in the operation room from the perspectives of accuracy, invasiveness, and processing times. Our work led to the conclusion that invasive marker-based methods are still considered as the gold standard of image-to-patient registration. The surface-based methods are recommended for faster procedures and applied on the surface tissues especially around the eyes. In the near future, computer vision technology is expected to enhance these systems by reducing human errors and cognitive load in the operating room.
Collapse
Affiliation(s)
- Ali Taleb
- Team IFTIM, Institute of Molecular Chemistry of University of Burgundy (ICMUB UMR CNRS 6302), Univ. Bourgogne Franche-Comté, 21000 Dijon, France; (C.G.); (S.L.); (A.L.); (A.B.G.)
| | - Caroline Guigou
- Team IFTIM, Institute of Molecular Chemistry of University of Burgundy (ICMUB UMR CNRS 6302), Univ. Bourgogne Franche-Comté, 21000 Dijon, France; (C.G.); (S.L.); (A.L.); (A.B.G.)
- Otolaryngology Department, University Hospital of Dijon, 21000 Dijon, France
| | - Sarah Leclerc
- Team IFTIM, Institute of Molecular Chemistry of University of Burgundy (ICMUB UMR CNRS 6302), Univ. Bourgogne Franche-Comté, 21000 Dijon, France; (C.G.); (S.L.); (A.L.); (A.B.G.)
| | - Alain Lalande
- Team IFTIM, Institute of Molecular Chemistry of University of Burgundy (ICMUB UMR CNRS 6302), Univ. Bourgogne Franche-Comté, 21000 Dijon, France; (C.G.); (S.L.); (A.L.); (A.B.G.)
- Medical Imaging Department, University Hospital of Dijon, 21000 Dijon, France
| | - Alexis Bozorg Grayeli
- Team IFTIM, Institute of Molecular Chemistry of University of Burgundy (ICMUB UMR CNRS 6302), Univ. Bourgogne Franche-Comté, 21000 Dijon, France; (C.G.); (S.L.); (A.L.); (A.B.G.)
- Otolaryngology Department, University Hospital of Dijon, 21000 Dijon, France
| |
Collapse
|
2
|
Pivazyan G, Sandhu FA, Beaufort AR, Cunningham BW. Basis for error in stereotactic and computer-assisted surgery in neurosurgical applications: literature review. Neurosurg Rev 2022; 46:20. [PMID: 36536143 DOI: 10.1007/s10143-022-01928-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Revised: 11/29/2022] [Accepted: 12/07/2022] [Indexed: 12/24/2022]
Abstract
Technological advancements in optoelectronic motion capture systems have allowed for the development of high-precision computer-assisted surgery (CAS) used in cranial and spinal surgical procedures. Errors generated sequentially throughout the chain of components of CAS may have cumulative effect on the accuracy of implant and instrumentation placement - potentially affecting patient outcomes. Navigational integrity and maintenance of fidelity of optoelectronic data is the cornerstone of CAS. Error reporting measures vary between studies. Understanding error generation, mechanisms of propagation, and how they relate to workflow can assist clinicians in error mitigation and improve accuracy during navigation in neurosurgical procedures. Diligence in planning, fiducial positioning, system registration, and intra-operative workflow have the potential to improve accuracy and decrease disparity between planned and final instrumentation and implant position. This study reviews the potential errors associated with each step in computer-assisted surgery and provides a basis for disparity in intrinsic accuracy versus achieved accuracy in the clinical operative environment.
Collapse
Affiliation(s)
- Gnel Pivazyan
- Department of Neurosurgery, MedStar Georgetown University Hospital, Washington, District of Columbia, USA.
- Musculoskeletal Education Center, Department of Orthopaedic Surgery, MedStar Union Memorial Hospital, Baltimore, MD, USA.
| | - Faheem A Sandhu
- Department of Neurosurgery, MedStar Georgetown University Hospital, Washington, District of Columbia, USA
| | | | - Bryan W Cunningham
- Musculoskeletal Education Center, Department of Orthopaedic Surgery, MedStar Union Memorial Hospital, Baltimore, MD, USA
| |
Collapse
|
3
|
Sdika M, Alston L, Rousseau D, Guyotat J, Mahieu-Williame L, Montcel B. Repetitive motion compensation for real time intraoperative video processing. Med Image Anal 2019; 53:1-10. [PMID: 30640039 DOI: 10.1016/j.media.2018.12.005] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2018] [Revised: 11/02/2018] [Accepted: 12/17/2018] [Indexed: 11/19/2022]
Abstract
In this paper, we present a motion compensation algorithm dedicated to video processing during neurosurgery. After craniotomy, the brain surface undergoes a repetitive motion due to the cardiac pulsation. This motion as well as potential video camera motion prevent accurate video analysis. We propose a dedicated motion model where the brain deformation is described using a linear basis learned from a few initial frames of the video. As opposed to other works using linear basis for the flow, the camera motion is explicitly accounted in the transformation model. Despite the nonlinear nature of our model, all the motion parameters are robustly estimated all at once, using only one singular value decomposition (SVD), making our procedure computationally efficient. A Lagrangian specification of the flow field ensures the stability of the method. Experiments on in vivo data are presented to evaluate the capacity of the method to cope with occlusion or camera motion. The method we propose satisfies the intraoperative constraints: it is robust to surgical tools occlusions, it works in real time, and it is able to handle large camera viewpoint changes.
Collapse
Affiliation(s)
- Michaël Sdika
- Univ. Lyon, INSA Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206, Lyon, F69100, France.
| | - Laure Alston
- Univ. Lyon, INSA Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206, Lyon, F69100, France
| | - David Rousseau
- Univ. Lyon, INSA Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206, Lyon, F69100, France
| | - Jacques Guyotat
- Service de Neurochirurgie D, Hospices Civils de Lyon, Bron, France
| | - Laurent Mahieu-Williame
- Univ. Lyon, INSA Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206, Lyon, F69100, France
| | - Bruno Montcel
- Univ. Lyon, INSA Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206, Lyon, F69100, France
| |
Collapse
|
4
|
Speers AD, Ma B, Jarnagin WR, Himidan S, Simpson AL, Wildes RP. Fast and accurate vision-based stereo reconstruction and motion estimation for image-guided liver surgery. Healthc Technol Lett 2018; 5:208-214. [PMID: 30464852 PMCID: PMC6222177 DOI: 10.1049/htl.2018.5071] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2018] [Accepted: 08/20/2018] [Indexed: 11/25/2022] Open
Abstract
Image-guided liver surgery aims to enhance the precision of resection and ablation by providing fast localisation of tumours and adjacent complex vasculature to improve oncologic outcome. This Letter presents a novel end-to-end solution for fast stereo reconstruction and motion estimation that demonstrates high accuracy with phantom and clinical data. The authors’ computationally efficient coarse-to-fine (CTF) stereo approach facilitates liver imaging by accounting for low texture regions, enabling precise three-dimensional (3D) boundary recovery through the use of adaptive windows and utilising a robust 3D motion estimator to reject spurious data. To the best of their knowledge, theirs is the only adaptive CTF matching approach to reconstruction and motion estimation that registers time series of reconstructions to a single key frame for registration to a volumetric computed tomography scan. The system is evaluated empirically in controlled laboratory experiments with a liver phantom and motorised stages for precise quantitative evaluation. Additional evaluation is provided through testing with patient data during liver resection.
Collapse
Affiliation(s)
- Andrew D Speers
- Department of Electrical Engineering and Computer Science, York University, Toronto, ON, Canada
| | - Burton Ma
- Department of Electrical Engineering and Computer Science, York University, Toronto, ON, Canada
| | - William R Jarnagin
- Hepatopancreatobiliary Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Sharifa Himidan
- Department of Surgery, The Hospital for Sick Children, Toronto, ON, Canada.,Department of Surgery, University of Toronto, Toronto, ON, Canada
| | - Amber L Simpson
- Hepatopancreatobiliary Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Richard P Wildes
- Department of Electrical Engineering and Computer Science, York University, Toronto, ON, Canada
| |
Collapse
|
5
|
Guha D, Yang VXD. Perspective review on applications of optics in spinal surgery. JOURNAL OF BIOMEDICAL OPTICS 2018; 23:1-8. [PMID: 29893070 DOI: 10.1117/1.jbo.23.6.060601] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/04/2018] [Accepted: 05/23/2018] [Indexed: 06/08/2023]
Abstract
Optical technologies may be applied to multiple facets of spinal surgery from diagnostics to intraoperative image guidance to therapeutics. In diagnostics, the current standard remains cross-sectional static imaging. Optical surface scanning tools may have an important role; however, significant work is required to clearly correlate surface metrics to radiographic and clinically relevant spinal anatomy and alignment. In the realm of intraoperative image guidance, optical tracking is widely developed as the current standard of instrument tracking, however remains compromised by line-of-sight issues and more globally cumbersome registration workflows. Surface scanning registration tools are being refined to address concerns over workflow and learning curves, and allow real-time update of tissue deformation; however, the line-of-sight issues plaguing instrument tracking remain to be addressed. In therapeutics, optical applications exist in both visualization, in the form of endoscopes, and ablation, in the form of lasers. Further work is required to extend the feasibility of laser ablation to multiple tissues, including disc, bone, and tumor, in a safe and time-efficient manner. Finally, we postulate some of the short- and long-term opportunities for future growth of optical techniques in the context of spinal surgery. Particular emphasis is placed on intraoperative image guidance, the area of the authors' primary expertise.
Collapse
Affiliation(s)
- Daipayan Guha
- University of Toronto, Division of Neurosurgery, Toronto, Ontario, Canada
| | - Victor X D Yang
- University of Toronto, Division of Neurosurgery, Toronto, Ontario, Canada
- Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
- Ryerson University, Bioengineering and Biophotonics Laboratory, Toronto, Ontario, Canada
| |
Collapse
|
6
|
Collins JA, Weis JA, Heiselman JS, Clements LW, Simpson AL, Jarnagin WR, Miga MI. Improving Registration Robustness for Image-Guided Liver Surgery in a Novel Human-to-Phantom Data Framework. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:1502-1510. [PMID: 28212080 PMCID: PMC5757161 DOI: 10.1109/tmi.2017.2668842] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
In open image-guided liver surgery (IGLS), a sparse representation of the intraoperative organ surface can be acquired to drive image-to-physical registration. We hypothesize that uncharacterized error induced by variation in the collection patterns of organ surface data limits the accuracy and robustness of an IGLS registration. Clinical validation of such registration methods is challenged due to the difficulty in obtaining data representative of the true state of organ deformation. We propose a novel human-to-phantom validation framework that transforms surface collection patterns from in vivo IGLS procedures (n = 13) onto a well-characterized hepatic deformation phantom for the purpose of validating surface-driven, volumetric nonrigid registration methods. An important feature of the approach is that it centers on combining workflow-realistic data acquisition and surgical deformations that are appropriate in behavior and magnitude. Using the approach, we investigate volumetric target registration error (TRE) with both current rigid IGLS and our improved nonrigid registration methods. Additionally, we introduce a spatial data resampling approach to mitigate the workflow-sensitive sampling problem. Using our human-to-phantom approach, TRE after routine rigid registration was 10.9 ± 0.6 mm with a signed closest point distance associated with residual surface fit in the range of ±10 mm, highly representative of open liver resections. After applying our novel resampling strategy and improved deformation correction method, TRE was reduced by 51%, i.e., a TRE of 5.3 ± 0.5 mm. This paper reported herein realizes a novel tractable approach for the validation of image-to-physical registration methods and demonstrates promising results for our correction method.
Collapse
Affiliation(s)
| | - Jared A. Weis
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37235 USA
| | - Jon S. Heiselman
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37235 USA
| | - Logan W. Clements
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37235 USA
| | | | | | - Michael I. Miga
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37235 USA
| |
Collapse
|
7
|
Bayer S, Maier A, Ostermeier M, Fahrig R. Intraoperative Imaging Modalities and Compensation for Brain Shift in Tumor Resection Surgery. Int J Biomed Imaging 2017; 2017:6028645. [PMID: 28676821 PMCID: PMC5476838 DOI: 10.1155/2017/6028645] [Citation(s) in RCA: 45] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2017] [Accepted: 05/03/2017] [Indexed: 11/26/2022] Open
Abstract
Intraoperative brain shift during neurosurgical procedures is a well-known phenomenon caused by gravity, tissue manipulation, tumor size, loss of cerebrospinal fluid (CSF), and use of medication. For the use of image-guided systems, this phenomenon greatly affects the accuracy of the guidance. During the last several decades, researchers have investigated how to overcome this problem. The purpose of this paper is to present a review of publications concerning different aspects of intraoperative brain shift especially in a tumor resection surgery such as intraoperative imaging systems, quantification, measurement, modeling, and registration techniques. Clinical experience of using intraoperative imaging modalities, details about registration, and modeling methods in connection with brain shift in tumor resection surgery are the focuses of this review. In total, 126 papers regarding this topic are analyzed in a comprehensive summary and are categorized according to fourteen criteria. The result of the categorization is presented in an interactive web tool. The consequences from the categorization and trends in the future are discussed at the end of this work.
Collapse
Affiliation(s)
- Siming Bayer
- Pattern Recognition Lab, Friedrich-Alexander-University Erlangen-Nuremberg (FAU), Erlangen, Germany
| | - Andreas Maier
- Pattern Recognition Lab, Friedrich-Alexander-University Erlangen-Nuremberg (FAU), Erlangen, Germany
| | | | | |
Collapse
|
8
|
Kumar AN, Miga MI, Pheiffer TS, Chambless LB, Thompson RC, Dawant BM. Automatic tracking of intraoperative brain surface displacements in brain tumor surgery. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2016; 2014:1509-12. [PMID: 25570256 DOI: 10.1109/embc.2014.6943888] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
In brain tumor surgery, soft-tissue deformation, known as brain shift, introduces inaccuracies in the application of the preoperative surgical plan and impedes the advancement of image-guided surgical (IGS) systems. Considerable progress in using patient-specific biomechanical models to update the preoperative images intraoperatively has been made. These model-update methods rely on accurate intraoperative 3D brain surface displacements. In this work, we investigate and develop a fully automatic method to compute these 3D displacements for lengthy (~15 minutes) stereo-pair video sequences acquired during neurosurgery. The first part of the method finds homologous points temporally in the video and the second part computes the nonrigid transformation between these homologous points. Our results, based on parts of 2 clinical cases, show that this speedy and promising method can robustly provide 3D brain surface measurements for use with model-based updating frameworks.
Collapse
|
9
|
Jiang J, Nakajima Y, Sohma Y, Saito T, Kin T, Oyama H, Saito N. Marker-less tracking of brain surface deformations by non-rigid registration integrating surface and vessel/sulci features. Int J Comput Assist Radiol Surg 2016; 11:1687-701. [PMID: 26945999 DOI: 10.1007/s11548-016-1358-7] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2015] [Accepted: 02/09/2016] [Indexed: 10/22/2022]
Abstract
PURPOSE To compensate for brain shift in image-guided neurosurgery, we propose a new non-rigid registration method that integrates surface and vessel/sulci feature to noninvasively track the brain surface. METHOD Textured brain surfaces were acquired using phase-shift three-dimensional (3D) shape measurement, which offers 2D image pixels and their corresponding 3D points directly. Measured brain surfaces were noninvasively tracked using the proposed method by minimizing a new energy function, which is a weighted combination of 3D point corresponding estimation and surface deformation constraints. Initially, the measured surfaces were divided into featured and non-featured parts using a Frangi filter. The corresponding feature/non-feature points between intraoperative brain surfaces were estimated using the closest point algorithm. Subsequently, smoothness and rigidity constraints were introduced in the energy function for a smooth surface deformation and local surface detail conservation, respectively. Our 3D shape measurement accuracy was evaluated using 20 spheres for bias and precision errors. In addition, the proposed method was evaluated based on root mean square error (RMSE) and target registration error (TRE) with five porcine brains for which deformations were produced by gravity and pushing with different displacements in both the vertical and horizontal directions. RESULTS The minimum and maximum bias errors were 0.32 and 0.61 mm, respectively. The minimum and maximum precision errors were 0.025 and 0.30 mm, respectively. Quantitative validation with porcine brains showed that the average RMSE and TRE were 0.1 and 0.9 mm, respectively. CONCLUSION The proposed method appeared to be advantageous in integrating vessels/sulci feature, robust to changes in deformation magnitude and integrated feature numbers, and feasible in compensating for brain shift deformation in surgeries.
Collapse
Affiliation(s)
- Jue Jiang
- Department of Bioengineering, Graduate School of Engineering, University of Tokyo, Room 213A, Engineering Building #12, Yayoi 2-11-16, Bunkyo, Tokyo, 113-8656, Japan.
| | - Yoshikazu Nakajima
- Department of Bioengineering, Graduate School of Engineering, University of Tokyo, Room 213A, Engineering Building #12, Yayoi 2-11-16, Bunkyo, Tokyo, 113-8656, Japan
| | - Yoshio Sohma
- Department of Bioengineering, Graduate School of Engineering, University of Tokyo, Room 213A, Engineering Building #12, Yayoi 2-11-16, Bunkyo, Tokyo, 113-8656, Japan
| | - Toki Saito
- Department of Bioengineering, Graduate School of Engineering, University of Tokyo, Room 213A, Engineering Building #12, Yayoi 2-11-16, Bunkyo, Tokyo, 113-8656, Japan.,Department of Clinical Information Engineering, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Taichi Kin
- Department of Bioengineering, Graduate School of Engineering, University of Tokyo, Room 213A, Engineering Building #12, Yayoi 2-11-16, Bunkyo, Tokyo, 113-8656, Japan.,Department of Neurosurgery, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Horoshi Oyama
- Department of Bioengineering, Graduate School of Engineering, University of Tokyo, Room 213A, Engineering Building #12, Yayoi 2-11-16, Bunkyo, Tokyo, 113-8656, Japan.,Department of Clinical Information Engineering, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Nobuhito Saito
- Department of Bioengineering, Graduate School of Engineering, University of Tokyo, Room 213A, Engineering Building #12, Yayoi 2-11-16, Bunkyo, Tokyo, 113-8656, Japan.,Department of Neurosurgery, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| |
Collapse
|
10
|
Marreiros FMM, Rossitti S, Karlsson PM, Wang C, Gustafsson T, Carleberg P, Smedby Ö. Superficial vessel reconstruction with a multiview camera system. J Med Imaging (Bellingham) 2016; 3:015001. [PMID: 26759814 DOI: 10.1117/1.jmi.3.1.015001] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2015] [Accepted: 11/23/2015] [Indexed: 11/14/2022] Open
Abstract
We aim at reconstructing superficial vessels of the brain. Ultimately, they will serve to guide the deformation methods to compensate for the brain shift. A pipeline for three-dimensional (3-D) vessel reconstruction using three mono-complementary metal-oxide semiconductor cameras has been developed. Vessel centerlines are manually selected in the images. Using the properties of the Hessian matrix, the centerline points are assigned direction information. For correspondence matching, a combination of methods was used. The process starts with epipolar and spatial coherence constraints (geometrical constraints), followed by relaxation labeling and an iterative filtering where the 3-D points are compared to surfaces obtained using the thin-plate spline with decreasing relaxation parameter. Finally, the points are shifted to their local centroid position. Evaluation in virtual, phantom, and experimental images, including intraoperative data from patient experiments, shows that, with appropriate camera positions, the error estimates (root-mean square error and mean error) are [Formula: see text].
Collapse
Affiliation(s)
- Filipe M M Marreiros
- Linköping University, Center for Medical Image Science and Visualization, Campus US, Linköping SE-581 85, Sweden; Linköping University, Department of Science and Technology-Media and Information Technology, Campus Norrköping, Norrköping SE-601 74, Sweden; Linköping University, Department of Medical and Health Sciences, Campus US, Linköping SE-581 85, Sweden
| | - Sandro Rossitti
- County Council of Östergötland , Department of Neurosurgery, Linköping University, Campus US, Linköping SE-581 85, Sweden
| | - Per M Karlsson
- County Council of Östergötland , Department of Neurosurgery, Linköping University, Campus US, Linköping SE-581 85, Sweden
| | - Chunliang Wang
- Linköping University, Center for Medical Image Science and Visualization, Campus US, Linköping SE-581 85, Sweden; Royal Institute of Technology, School of Technology and Health, Alfred Nobels Allé 10, Huddinge SE-141 52, Sweden
| | | | - Per Carleberg
- XM Reality AB , Diskettgatan 11B, Linköping SE-583 35, Sweden
| | - Örjan Smedby
- Linköping University, Center for Medical Image Science and Visualization, Campus US, Linköping SE-581 85, Sweden; Linköping University, Department of Science and Technology-Media and Information Technology, Campus Norrköping, Norrköping SE-601 74, Sweden; Linköping University, Department of Medical and Health Sciences, Campus US, Linköping SE-581 85, Sweden; Royal Institute of Technology, School of Technology and Health, Alfred Nobels Allé 10, Huddinge SE-141 52, Sweden
| |
Collapse
|
11
|
Ji S, Fan X, Paulsen KD, Roberts DW, Mirza SK, Lollis SS. Intraoperative CT as a registration benchmark for intervertebral motion compensation in image-guided open spinal surgery. Int J Comput Assist Radiol Surg 2015; 10:2009-20. [PMID: 26194485 PMCID: PMC4734629 DOI: 10.1007/s11548-015-1255-5] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2015] [Accepted: 06/30/2015] [Indexed: 02/19/2023]
Abstract
PURPOSE An accurate and reliable benchmark of registration accuracy and intervertebral motion compensation is important for spinal image guidance. In this study, we evaluated the utility of intraoperative CT (iCT) in place of bone-implanted screws as the ground-truth registration and illustrated its use to benchmark the performance of intraoperative stereovision (iSV). METHODS A template-based, multi-body registration scheme was developed to individually segment and pair corresponding vertebrae between preoperative CT and iCT of the spine. Intervertebral motion was determined from the resulting vertebral pair-wise registrations. The accuracy of the image-driven registration was evaluated using surface-to-surface distance error (SDE) based on segmented bony features and was independently verified using point-to-point target registration error (TRE) computed from bone-implanted mini-screws. Both SDE and TRE were used to assess the compensation accuracy using iSV. RESULTS The iCT-based technique was evaluated on four explanted porcine spines (20 vertebral pairs) with artificially induced motion. We report a registration accuracy of 0.57 [Formula: see text] 0.32 mm (range 0.34-1.14 mm) and 0.29 [Formula: see text] 0.15 mm (range 0.14-0.78 mm) in SDE and TRE, respectively, for all vertebrae pooled, with an average intervertebral rotation of [Formula: see text] (range 1.5[Formula: see text]-7.9[Formula: see text]). The iSV-based compensation accuracy for one sample (four vertebrae) was 1.32 [Formula: see text] 0.19 mm and 1.72 [Formula: see text] 0.55 mm in SDE and TRE, respectively, exceeding the recommended accuracy of 2 mm. CONCLUSION This study demonstrates the effectiveness of iCT in place of invasive fiducials as a registration ground truth. These findings are important for future development of on-demand spinal image guidance using radiation-free images such as stereovision and ultrasound on human subjects.
Collapse
Affiliation(s)
- Songbai Ji
- Thayer School of Engineering, Dartmouth College, 14 Engineering Drive, Hanover, NH, 03755, USA.
- Geisel School of Medicine, Dartmouth College, Hanover, NH, 03755, USA.
| | - Xiaoyao Fan
- Thayer School of Engineering, Dartmouth College, 14 Engineering Drive, Hanover, NH, 03755, USA
| | - Keith D Paulsen
- Thayer School of Engineering, Dartmouth College, 14 Engineering Drive, Hanover, NH, 03755, USA
- Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766, USA
| | - David W Roberts
- Geisel School of Medicine, Dartmouth College, Hanover, NH, 03755, USA
- Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766, USA
| | - Sohail K Mirza
- Geisel School of Medicine, Dartmouth College, Hanover, NH, 03755, USA
- Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766, USA
| | - S Scott Lollis
- Geisel School of Medicine, Dartmouth College, Hanover, NH, 03755, USA
- Dartmouth Hitchcock Medical Center, Lebanon, NH, 03766, USA
| |
Collapse
|
12
|
Ji S, Fan X, Paulsen KD, Roberts DW, Mirza SK, Lollis SS. Patient Registration Using Intraoperative Stereovision in Image-guided Open Spinal Surgery. IEEE Trans Biomed Eng 2015; 62:2177-86. [PMID: 25826802 PMCID: PMC4545737 DOI: 10.1109/tbme.2015.2415731] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
Abstract
Despite its widespread availability and success in open cranial neurosurgery, image-guidance technology remains more limited in use in open spinal procedures, in large part, because of patient registration challenges. In this study, we evaluated the feasibility of using intraoperative stereovision (iSV) for accurate, efficient, and robust patient registration in an open spinal fusion surgery. Geometrical surfaces of exposed vertebrae were first reconstructed from iSV. A classical multistart registration was then executed between point clouds generated from iSV and preoperative computed tomography images of the spine. With two pairs of feature points manually identified to facilitate the registration, an average registration accuracy of 1.43 mm in terms of surface-to-surface distance error was achieved in eight patient cases using a single iSV image pair sampling 2-3 vertebral segments. The iSV registration error was consistently smaller than the conventional landmark approach for every case (average of 2.02 mm with the same error metric). The large capture ranges (average of 23.8 mm in translation and 46.0° in rotation) found in the iSV patient registration suggest the technique may offer sufficient robustness for practical application in the operating room. Although some manual effort was still necessary, the manually-derived inputs for iSV registration only needed to be approximate as opposed to be precise and accurate for the manual efforts required in landmark registration. The total computational cost of the iSV registration was 1.5 min on average, significantly less than the typical ∼30 min required for the landmark approach. These findings support the clinical feasibility of iSV to offer accurate, efficient, and robust patient registration in open spinal surgery, and therefore, its potential to further increase the adoption of image guidance in this surgical specialty.
Collapse
Affiliation(s)
- Songbai Ji
- Thayer School of Engineering, Dartmouth, Hanover, NH 03755 USA
| | - Xiaoyao Fan
- Thayer School of Engineering, Dartmouth, Hanover, NH 03755 USA
| | | | - David W. Roberts
- Geisel School of Medicine, Dartmouth College, Hanover NH 03755, USA, and with Dartmouth Hitchcock Medical Center, Lebanon NH 03766 USA
| | - Sohail K. Mirza
- Geisel School of Medicine, Dartmouth College, Hanover NH 03755, USA, and with Dartmouth Hitchcock Medical Center, Lebanon NH 03766 USA
| | - S. Scott Lollis
- Geisel School of Medicine, Dartmouth College, Hanover NH 03755, USA, and with Dartmouth Hitchcock Medical Center, Lebanon NH 03766 USA
| |
Collapse
|
13
|
A method for the assessment of time-varying brain shift during navigated epilepsy surgery. Int J Comput Assist Radiol Surg 2015; 11:473-81. [DOI: 10.1007/s11548-015-1259-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2015] [Accepted: 07/01/2015] [Indexed: 10/23/2022]
|
14
|
Fan X, Ji S, Hartov A, Roberts DW, Paulsen KD. Stereovision to MR image registration for cortical surface displacement mapping to enhance image-guided neurosurgery. Med Phys 2015; 41:102302. [PMID: 25281972 PMCID: PMC5176089 DOI: 10.1118/1.4894705] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE A surface registration method is presented to align intraoperative stereovision (iSV) with preoperative magnetic resonance (pMR) images, which utilizes both geometry and texture information to extract tissue displacements as part of the overall process of compensating for intraoperative brain deformation in order to maintain accurate neuronavigational image guidance during surgery. METHODS A sum-of-squared-difference rigid image registration was first executed to detect lateral shift of the cortical surface and was followed by a mutual-information-based block matching method to detect local nonrigid deformation caused by distention or collapse of the cortical surface. Ten (N = 10) surgical cases were evaluated in which an independent point measurement of a dominant cortical surface feature location was recorded with a tracked stylus in each case and compared to its surface-registered counterpart. The full three-dimensional (3D) displacement field was also extracted to drive a biomechanical brain deformation model, the results of which were reconciled with the reconstructed iSV surface as another form of evaluation. RESULTS Differences between the tracked stylus coordinates of cortical surface features and their surface-registered locations were 1.94 ± 0.59 mm on average across the ten cases. When the complete displacement map derived from surface registration was utilized, the resulting images generated from mechanical model updates were consistent in terms of both geometry (1-2 mm of model misfit) and texture, and were generated with less than 10 min of computational time. Analysis of the surface-registered 3D displacements indicate that the magnitude of motion ranged from 4.03 to 9.79 mm in the ten patient cases, and the amount of lateral shift was not related statistically to the direction of gravity (p = 0.73 ≫ 0.05) or the craniotomy size (p = 0.48 ≫ 0.05) at the beginning of surgery. CONCLUSIONS The iSV-pMR surface registration method utilizes texture and geometry information to extract both global lateral shift and local nonrigid movement of the cortical surface in 3D. The results suggest small differences exist in surface-registered locations when compared to positions measured independently with a coregistered stylus and when the full iSV surface was aligned with model-updated MR. The effectiveness and efficiency of the registration method is also minimally disruptive to surgical workflow.
Collapse
Affiliation(s)
- Xiaoyao Fan
- Thayer School of Engineering, Dartmouth College, Hanover, New Hampshire 03755
| | - Songbai Ji
- Thayer School of Engineering, Dartmouth College, Hanover, New Hampshire 03755 and Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire 03755
| | - Alex Hartov
- Thayer School of Engineering, Dartmouth College, Hanover, New Hampshire 03755 and Norris Cotton Cancer Center, Lebanon, New Hampshire 03756
| | - David W Roberts
- Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire 03755; Norris Cotton Cancer Center, Lebanon, New Hampshire 03756; and Dartmouth-Hitchcock Medical Center, Lebanon, New Hampshire 03756
| | - Keith D Paulsen
- Thayer School of Engineering, Dartmouth College, Hanover, New Hampshire 03755; Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire 03755; Norris Cotton Cancer Center, Lebanon, New Hampshire 03756; and Dartmouth-Hitchcock Medical Center, Lebanon, New Hampshire 03756
| |
Collapse
|
15
|
Faria C, Sadowsky O, Bicho E, Ferrigno G, Joskowicz L, Shoham M, Vivanti R, De Momi E. Validation of a stereo camera system to quantify brain deformation due to breathing and pulsatility. Med Phys 2014; 41:113502. [DOI: 10.1118/1.4897569] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|
16
|
Gupta D, Hill NJ, Adamo MA, Ritaccio A, Schalk G. Localizing ECoG electrodes on the cortical anatomy without post-implantation imaging. Neuroimage Clin 2014; 6:64-76. [PMID: 25379417 PMCID: PMC4215521 DOI: 10.1016/j.nicl.2014.07.015] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2014] [Revised: 07/26/2014] [Accepted: 07/29/2014] [Indexed: 01/22/2023]
Abstract
INTRODUCTION Electrocorticographic (ECoG) grids are placed subdurally on the cortex in people undergoing cortical resection to delineate eloquent cortex. ECoG signals have high spatial and temporal resolution and thus can be valuable for neuroscientific research. The value of these data is highest when they can be related to the cortical anatomy. Existing methods that establish this relationship rely either on post-implantation imaging using computed tomography (CT), magnetic resonance imaging (MRI) or X-Rays, or on intra-operative photographs. For research purposes, it is desirable to localize ECoG electrodes on the brain anatomy even when post-operative imaging is not available or when intra-operative photographs do not readily identify anatomical landmarks. METHODS We developed a method to co-register ECoG electrodes to the underlying cortical anatomy using only a pre-operative MRI, a clinical neuronavigation device (such as BrainLab VectorVision), and fiducial markers. To validate our technique, we compared our results to data collected from six subjects who also had post-grid implantation imaging available. We compared the electrode coordinates obtained by our fiducial-based method to those obtained using existing methods, which are based on co-registering pre- and post-grid implantation images. RESULTS Our fiducial-based method agreed with the MRI-CT method to within an average of 8.24 mm (mean, median = 7.10 mm) across 6 subjects in 3 dimensions. It showed an average discrepancy of 2.7 mm when compared to the results of the intra-operative photograph method in a 2D coordinate system. As this method does not require post-operative imaging such as CTs, our technique should prove useful for research in intra-operative single-stage surgery scenarios. To demonstrate the use of our method, we applied our method during real-time mapping of eloquent cortex during a single-stage surgery. The results demonstrated that our method can be applied intra-operatively in the absence of post-operative imaging to acquire ECoG signals that can be valuable for neuroscientific investigations.
Collapse
Affiliation(s)
- Disha Gupta
- Dept. of Neurology, Albany Medical College, Albany, NY, USA
- Neural Injury and Repair, Wadsworth Center, New York State Dept. of Health, Albany, NY, USA
- Early Brain Injury and Motor Recovery Lab, Burke-Cornell Medical Research Institute, White Plains, NY, USA
| | - N. Jeremy Hill
- Neural Injury and Repair, Wadsworth Center, New York State Dept. of Health, Albany, NY, USA
- Translational Neurological Research Laboratory, Helen Hayes Hospital, West Haverstraw, NY, USA
| | | | | | - Gerwin Schalk
- Dept. of Neurology, Albany Medical College, Albany, NY, USA
- Neural Injury and Repair, Wadsworth Center, New York State Dept. of Health, Albany, NY, USA
- Dept. of Neurosurgery, Washington University, St. Louis, MO, USA
- Dept. of Biomed. Eng., Rensselaer Polytechnic Institute, Troy, NY, USA
- Dept. of Biomed. Sci., State Univ. of New York at Albany, Albany, NY, USA
- Dept. of Elec. and Comp. Eng., Univ. of Texas at El Paso, El Paso, TX, USA
| |
Collapse
|
17
|
Kumar AN, Miga MI, Pheiffer TS, Chambless LB, Thompson RC, Dawant BM. Persistent and automatic intraoperative 3D digitization of surfaces under dynamic magnifications of an operating microscope. Med Image Anal 2014; 19:30-45. [PMID: 25189364 DOI: 10.1016/j.media.2014.07.004] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2013] [Revised: 07/22/2014] [Accepted: 07/23/2014] [Indexed: 12/15/2022]
Abstract
One of the major challenges impeding advancement in image-guided surgical (IGS) systems is the soft-tissue deformation during surgical procedures. These deformations reduce the utility of the patient's preoperative images and may produce inaccuracies in the application of preoperative surgical plans. Solutions to compensate for the tissue deformations include the acquisition of intraoperative tomographic images of the whole organ for direct displacement measurement and techniques that combines intraoperative organ surface measurements with computational biomechanical models to predict subsurface displacements. The later solution has the advantage of being less expensive and amenable to surgical workflow. Several modalities such as textured laser scanners, conoscopic holography, and stereo-pair cameras have been proposed for the intraoperative 3D estimation of organ surfaces to drive patient-specific biomechanical models for the intraoperative update of preoperative images. Though each modality has its respective advantages and disadvantages, stereo-pair camera approaches used within a standard operating microscope is the focus of this article. A new method that permits the automatic and near real-time estimation of 3D surfaces (at 1 Hz) under varying magnifications of the operating microscope is proposed. This method has been evaluated on a CAD phantom object and on full-length neurosurgery video sequences (∼1 h) acquired intraoperatively by the proposed stereovision system. To the best of our knowledge, this type of validation study on full-length brain tumor surgery videos has not been done before. The method for estimating the unknown magnification factor of the operating microscope achieves accuracy within 0.02 of the theoretical value on a CAD phantom and within 0.06 on 4 clinical videos of the entire brain tumor surgery. When compared to a laser range scanner, the proposed method for reconstructing 3D surfaces intraoperatively achieves root mean square errors (surface-to-surface distance) in the 0.28-0.81 mm range on the phantom object and in the 0.54-1.35 mm range on 4 clinical cases. The digitization accuracy of the presented stereovision methods indicate that the operating microscope can be used to deliver the persistent intraoperative input required by computational biomechanical models to update the patient's preoperative images and facilitate active surgical guidance.
Collapse
Affiliation(s)
- Ankur N Kumar
- Vanderbilt University, Department of Electrical Engineering, Nashville, TN 37235, USA
| | - Michael I Miga
- Vanderbilt University, Department of Biomedical Engineering, Nashville, TN 37235, USA
| | - Thomas S Pheiffer
- Vanderbilt University, Department of Biomedical Engineering, Nashville, TN 37235, USA
| | - Lola B Chambless
- Vanderbilt University Medical Center, Department of Neurological Surgery, Nashville, TN 37232, USA
| | - Reid C Thompson
- Vanderbilt University Medical Center, Department of Neurological Surgery, Nashville, TN 37232, USA
| | - Benoit M Dawant
- Vanderbilt University, Department of Electrical Engineering, Nashville, TN 37235, USA
| |
Collapse
|
18
|
Ji S, Fan X, Roberts DW, Hartov A, Paulsen KD. Cortical surface shift estimation using stereovision and optical flow motion tracking via projection image registration. Med Image Anal 2014; 18:1169-83. [PMID: 25077845 DOI: 10.1016/j.media.2014.07.001] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2012] [Revised: 07/03/2014] [Accepted: 07/03/2014] [Indexed: 10/25/2022]
Abstract
Stereovision is an important intraoperative imaging technique that captures the exposed parenchymal surface noninvasively during open cranial surgery. Estimating cortical surface shift efficiently and accurately is critical to compensate for brain deformation in the operating room (OR). In this study, we present an automatic and robust registration technique based on optical flow (OF) motion tracking to compensate for cortical surface displacement throughout surgery. Stereo images of the cortical surface were acquired at multiple time points after dural opening to reconstruct three-dimensional (3D) texture intensity-encoded cortical surfaces. A local coordinate system was established with its z-axis parallel to the average surface normal direction of the reconstructed cortical surface immediately after dural opening in order to produce two-dimensional (2D) projection images. A dense displacement field between the two projection images was determined directly from OF motion tracking without the need for feature identification or tracking. The starting and end points of the displacement vectors on the two cortical surfaces were then obtained following spatial mapping inversion to produce the full 3D displacement of the exposed cortical surface. We evaluated the technique with images obtained from digital phantoms and 18 surgical cases - 10 of which involved independent measurements of feature locations acquired with a tracked stylus for accuracy comparisons, and 8 others of which 4 involved stereo image acquisitions at three or more time points during surgery to illustrate utility throughout a procedure. Results from the digital phantom images were very accurate (0.05 pixels). In the 10 surgical cases with independently digitized point locations, the average agreement between feature coordinates derived from the cortical surface reconstructions was 1.7-2.1mm relative to those determined with the tracked stylus probe. The agreement in feature displacement tracking was also comparable to tracked probe data (difference in displacement magnitude was <1mm on average). The average magnitude of cortical surface displacement was 7.9 ± 5.7 mm (range 0.3-24.4 mm) in all patient cases with the displacement components along gravity being 5.2 ± 6.0 mm relative to the lateral movement of 2.4 ± 1.6 mm. Thus, our technique appears to be sufficiently accurate and computationally efficiency (typically ∼15 s), for applications in the OR.
Collapse
Affiliation(s)
- Songbai Ji
- Thayer School of Engineering, Dartmouth College, Hanover, NH 03755, USA; Geisel School of Medicine, Dartmouth College, Hanover, NH 03755, USA.
| | - Xiaoyao Fan
- Thayer School of Engineering, Dartmouth College, Hanover, NH 03755, USA
| | - David W Roberts
- Geisel School of Medicine, Dartmouth College, Hanover, NH 03755, USA; Dartmouth Hitchcock Medical Center, Lebanon, NH 03756, USA
| | - Alex Hartov
- Thayer School of Engineering, Dartmouth College, Hanover, NH 03755, USA
| | - Keith D Paulsen
- Thayer School of Engineering, Dartmouth College, Hanover, NH 03755, USA; Geisel School of Medicine, Dartmouth College, Hanover, NH 03755, USA
| |
Collapse
|
19
|
DeLorenzo C, Papademetris X, Staib LH, Vives KP, Spencer DD, Duncan JS. Volumetric intraoperative brain deformation compensation: model development and phantom validation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2012; 31:1607-19. [PMID: 22562728 PMCID: PMC3600363 DOI: 10.1109/tmi.2012.2197407] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
During neurosurgery, nonrigid brain deformation may affect the reliability of tissue localization based on preoperative images. To provide accurate surgical guidance in these cases, preoperative images must be updated to reflect the intraoperative brain. This can be accomplished by warping these preoperative images using a biomechanical model. Due to the possible complexity of this deformation, intraoperative information is often required to guide the model solution. In this paper, a linear elastic model of the brain is developed to infer volumetric brain deformation associated with measured intraoperative cortical surface displacement. The developed model relies on known material properties of brain tissue, and does not require further knowledge about intraoperative conditions. To provide an initial estimation of volumetric model accuracy, as well as determine the model's sensitivity to the specified material parameters and surface displacements, a realistic brain phantom was developed. Phantom results indicate that the linear elastic model significantly reduced localization error due to brain shift, from > 16 mm to under 5 mm, on average. In addition, though in vivo quantitative validation is necessary, preliminary application of this approach to images acquired during neocortical epilepsy cases confirms the feasibility of applying the developed model to in vivo data.
Collapse
|
20
|
Stereoscopic Scene Flow for Robotic Assisted Minimally Invasive Surgery. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION – MICCAI 2012 2012; 15:479-86. [DOI: 10.1007/978-3-642-33415-3_59] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
21
|
Risholm P, Golby AJ, Wells W. Multimodal image registration for preoperative planning and image-guided neurosurgical procedures. Neurosurg Clin N Am 2011; 22:197-206, viii. [PMID: 21435571 DOI: 10.1016/j.nec.2010.12.001] [Citation(s) in RCA: 37] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
Abstract
Image registration is the process of transforming images acquired at different time points, or with different imaging modalities, into the same coordinate system. It is an essential part of any neurosurgical planning and navigation system because it facilitates combining images with important complementary, structural, and functional information to improve the information based on which a surgeon makes critical decisions. Brigham and Women's Hospital (BWH) has been one of the pioneers in developing intraoperative registration methods for aligning preoperative and intraoperative images of the brain. This article presents an overview of intraoperative registration and highlights some recent developments at BWH.
Collapse
Affiliation(s)
- Petter Risholm
- Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, 75 Francis Street, Boston, MA 02115, USA.
| | | | | |
Collapse
|
22
|
Ding S, Miga MI, Pheiffer TS, Simpson AL, Thompson RC, Dawant BM. Tracking of vessels in intra-operative microscope video sequences for cortical displacement estimation. IEEE Trans Biomed Eng 2011; 58:1985-93. [PMID: 21317077 DOI: 10.1109/tbme.2011.2112656] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
This article presents a method designed to automatically track cortical vessels in intra-operative microscope video sequences. The main application of this method is the estimation of cortical displacement that occurs during tumor resection procedures. The method works in three steps. First, models of vessels selected in the first frame of the sequence are built. These models are then used to track vessels across frames in the video sequence. Finally, displacements estimated using the vessels are extrapolated to the entire image. The method has been tested retrospectively on images simulating large displacement, tumor resection, and partial occlusion by surgical instruments and on 21 video sequences comprising several thousand frames acquired from three patients. Qualitative results show that the method is accurate, robust to the appearance and disappearance of surgical instruments, and capable of dealing with large differences in images caused by resection. Quantitative results show a mean vessel tracking error (VTE) of 2.4 pixels (0.3 or 0.6 mm, depending on the spatial resolution of the images) and an average target registration error (TRE) of 3.3 pixels (0.4 or 0.8 mm).
Collapse
Affiliation(s)
- Siyi Ding
- Electrical Engineering Department, Vanderbilt University, Nashville, TN 37212, USA
| | | | | | | | | | | |
Collapse
|
23
|
Ji S, Fan X, Roberts DW, Paulsen KD. Cortical surface strain estimation using stereovision. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2011; 14:412-9. [PMID: 22003644 PMCID: PMC3774044 DOI: 10.1007/978-3-642-23623-5_52] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/19/2023]
Abstract
We present a completely noninvasive technique to estimate soft tissue surface strain by differentiating three-dimensional displacements obtained from optical flow motion tracking using stereo images. The implementation of the strain estimation algorithm was verified with simulated data and its application was illustrated in three open cranial neurosurgical cases, where cortical surface strain induced by arterial blood pressure pulsation was evaluated. Local least squares smoothing was applied to the displacement field prior to strain estimation to reduce the effect of noise during differentiation. Maximum principal strains (epsilon1) of up to 7% were found in the exposed cortical area on average, and the largest strains (up to -18%) occurred near the craniotomy rim with the majority of epsilon1 perpendicular to the boundary, indicating relative stretching along this direction. The technique offers a new approach for soft tissue strain estimation for the purpose of biomechanical characterization.
Collapse
Affiliation(s)
- Songbai Ji
- Thayer School of Engineering, Dartmouth College, Hanover, NH 03755
| | - Xiaoyao Fan
- Thayer School of Engineering, Dartmouth College, Hanover, NH 03755
| | - David W. Roberts
- Norris Cotton Cancer Center, Lebanon, NH 03756
- Dartmouth Hitchcock Medical Center, Lebanon, NH 03756
| | - Keith D. Paulsen
- Thayer School of Engineering, Dartmouth College, Hanover, NH 03755
- Norris Cotton Cancer Center, Lebanon, NH 03756
| |
Collapse
|
24
|
Chen I, Coffey AM, Ding S, Dumpuri P, Dawant BM, Thompson RC, Miga MI. Intraoperative brain shift compensation: accounting for dural septa. IEEE Trans Biomed Eng 2010; 58:499-508. [PMID: 21097376 DOI: 10.1109/tbme.2010.2093896] [Citation(s) in RCA: 43] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Biomechanical models that describe soft tissue deformation provide a relatively inexpensive way to correct registration errors in image-guided neurosurgical systems caused by nonrigid brain shift. Quantifying the factors that cause this deformation to sufficient precision is a challenging task. To circumvent this difficulty, atlas-based methods have been developed recently that allow for uncertainty, yet still capture the first-order effects associated with deformation. The inverse solution is driven by sparse intraoperative surface measurements, which could bias the reconstruction and affect the subsurface accuracy of the model prediction. Studies using intraoperative MR have shown that the deformation in the midline, tentorium, and contralateral hemisphere is relatively small. The dural septa act as rigid membranes supporting the brain parenchyma and compartmentalizing the brain. Accounting for these structures in models may be an important key to improving subsurface shift accuracy. A novel method to segment the tentorium cerebelli will be described, along with the procedure for modeling the dural septa. Results in seven clinical cases show a qualitative improvement in subsurface shift accuracy making the predicted deformation more congruous with previous observations in the literature. The results also suggest a considerably more important role for hyperosmotic drug modeling for the intraoperative shift correction environment.
Collapse
Affiliation(s)
- Ishita Chen
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37235, USA.
| | | | | | | | | | | | | |
Collapse
|
25
|
A head phantom prototype to verify subdural electrode localization tools in epilepsy surgery. Neuroimage 2010; 54 Suppl 1:S256-62. [PMID: 20211264 DOI: 10.1016/j.neuroimage.2010.03.007] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2009] [Revised: 02/10/2010] [Accepted: 03/02/2010] [Indexed: 11/22/2022] Open
Abstract
When planning epilepsy surgery, the position of subdural electrodes in relation to the cortex is crucial. Electrodes may dislocate after implantation. Neurosurgeons are highly interested in the accuracy of methods that visualize these electrodes. In order to determine the accuracy of an electrode visualization method, we have developed a physical head phantom and evaluated our new method of subdural electrode localization. This method projects automatically segmented electrodes of a preimplantation computed tomography (CT) data set onto the segmented brain surface of a postimplantation magnetic resonance imaging (MRI) data set within 2 to 5 min. The phantom consists of a skull, an adipose layer for skin replication, and a deformable brain. It further contains gyri and sulci structures, composed of gelatin and different additives used as phantom material for white matter, gray matter, and cerebrospinal fluid. The phantom allows a well-defined displacement of an "implanted" electrode grid perpendicular to the brain surface. By using the phantom data, we demonstrated that our electrode visualization tool did in fact function accurately. The image contrasts between different phantom materials in MRI and CT phantom data sets were similar to patient data sets. The phantom appears suitable for obtaining a more complex patient data replication, as well as for simulating different deformation scenarios.
Collapse
|