1
|
Gao H, Lyu M, Zhao X, Yang F, Bai X. Contour-aware network with class-wise convolutions for 3D abdominal multi-organ segmentation. Med Image Anal 2023; 87:102838. [PMID: 37196536 DOI: 10.1016/j.media.2023.102838] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2022] [Revised: 03/21/2023] [Accepted: 05/05/2023] [Indexed: 05/19/2023]
Abstract
Accurate delineation of multiple organs is a critical process for various medical procedures, which could be operator-dependent and time-consuming. Existing organ segmentation methods, which were mainly inspired by natural image analysis techniques, might not fully exploit the traits of the multi-organ segmentation task and could not accurately segment the organs with various shapes and sizes simultaneously. In this work, the characteristics of multi-organ segmentation are considered: the global count, position and scale of organs are generally predictable, while their local shape and appearance are volatile. Thus, we supplement the region segmentation backbone with a contour localization task to increase the certainty along delicate boundaries. Meantime, each organ has exclusive anatomical traits, which motivates us to deal with class variability with class-wise convolutions to highlight organ-specific features and suppress irrelevant responses at different field-of-views. To validate our method with adequate amounts of patients and organs, we constructed a multi-center dataset, which contains 110 3D CT scans with 24,528 axial slices, and provided voxel-level manual segmentations of 14 abdominal organs, which adds up to 1,532 3D structures in total. Extensive ablation and visualization studies on it validate the effectiveness of the proposed method. Quantitative analysis shows that we achieve state-of-the-art performance for most abdominal organs, and obtain 3.63 mm 95% Hausdorff Distance and 83.32% Dice Similarity Coefficient on an average.
Collapse
Affiliation(s)
- Hongjian Gao
- Image Processing Center, Beihang University, Beijing 102206, China
| | - Mengyao Lyu
- School of Software, Tsinghua University, Beijing 100084, China; Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China
| | - Xinyue Zhao
- School of Medical Imaging, Xuzhou Medical University, Xuzhou 221004, China
| | - Fan Yang
- Image Processing Center, Beihang University, Beijing 102206, China
| | - Xiangzhi Bai
- Image Processing Center, Beihang University, Beijing 102206, China; State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, China; Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100191, China.
| |
Collapse
|
2
|
Matsumae M, Nishiyama J, Kuroda K. Intraoperative MR Imaging during Glioma Resection. Magn Reson Med Sci 2022; 21:148-167. [PMID: 34880193 PMCID: PMC9199972 DOI: 10.2463/mrms.rev.2021-0116] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Accepted: 10/11/2021] [Indexed: 11/09/2022] Open
Abstract
One of the major issues in the surgical treatment of gliomas is the concern about maximizing the extent of resection while minimizing neurological impairment. Thus, surgical planning by carefully observing the relationship between the glioma infiltration area and eloquent area of the connecting fibers is crucial. Neurosurgeons usually detect an eloquent area by functional MRI and identify a connecting fiber by diffusion tensor imaging. However, during surgery, the accuracy of neuronavigation can be decreased due to brain shift, but the positional information may be updated by intraoperative MRI and the next steps can be planned accordingly. In addition, various intraoperative modalities may be used to guide surgery, including neurophysiological monitoring that provides real-time information (e.g., awake surgery, motor-evoked potentials, and sensory evoked potential); photodynamic diagnosis, which can identify high-grade glioma cells; and other imaging techniques that provide anatomical information during the surgery. In this review, we present the historical and current context of the intraoperative MRI and some related approaches for an audience active in the technical, clinical, and research areas of radiology, as well as mention important aspects regarding safety and types of devices.
Collapse
Affiliation(s)
- Mitsunori Matsumae
- Department of Neurosurgery, Tokai University School of Medicine, Isehara, Kanagawa, Japan
| | - Jun Nishiyama
- Department of Neurosurgery, Tokai University School of Medicine, Isehara, Kanagawa, Japan
| | - Kagayaki Kuroda
- Department of Human and Information Sciences, School of Information Science and Technology, Tokai University, Hiratsuka, Kanagawa, Japan
| |
Collapse
|
3
|
Morales Mojica CM, Velazco-Garcia JD, Pappas EP, Birbilis TA, Becker A, Leiss EL, Webb A, Seimenis I, Tsekos NV. A Holographic Augmented Reality Interface for Visualizing of MRI Data and Planning of Neurosurgical Procedures. J Digit Imaging 2021; 34:1014-1025. [PMID: 34027587 DOI: 10.1007/s10278-020-00412-3] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2020] [Revised: 12/06/2020] [Accepted: 12/18/2020] [Indexed: 10/21/2022] Open
Abstract
The recent introduction of wireless head-mounted displays (HMD) promises to enhance 3D image visualization by immersing the user into 3D morphology. This work introduces a prototype holographic augmented reality (HAR) interface for the 3D visualization of magnetic resonance imaging (MRI) data for the purpose of planning neurosurgical procedures. The computational platform generates a HAR scene that fuses pre-operative MRI sets, segmented anatomical structures, and a tubular tool for planning an access path to the targeted pathology. The operator can manipulate the presented images and segmented structures and perform path-planning using voice and gestures. On-the-fly, the software uses defined forbidden-regions to prevent the operator from harming vital structures. In silico studies using the platform with a HoloLens HMD assessed its functionality and the computational load and memory for different tasks. A preliminary qualitative evaluation revealed that holographic visualization of high-resolution 3D MRI data offers an intuitive and interactive perspective of the complex brain vasculature and anatomical structures. This initial work suggests that immersive experiences may be an unparalleled tool for planning neurosurgical procedures.
Collapse
Affiliation(s)
- Cristina M Morales Mojica
- MRI Lab, Department of Computer Science, University of Houston, 4800 Calhoun Road PGH 501, Houston, TX, USA
| | - Jose D Velazco-Garcia
- MRI Lab, Department of Computer Science, University of Houston, 4800 Calhoun Road PGH 501, Houston, TX, USA
| | - Eleftherios P Pappas
- Medical Physics Laboratory, School of Medicine, National and Kapodistrian University of Athens, Athens, Greece
| | | | - Aaron Becker
- Department of Electrical and Computer Engineering, University of Houston, Houston, TX, USA
| | - Ernst L Leiss
- MRI Lab, Department of Computer Science, University of Houston, 4800 Calhoun Road PGH 501, Houston, TX, USA
| | - Andrew Webb
- C.J. Gorter Center for High Field MRI, Leiden University Medical Center, Leiden, Netherlands
| | - Ioannis Seimenis
- Medical Physics Laboratory, School of Medicine, National and Kapodistrian University of Athens, Athens, Greece
| | - Nikolaos V Tsekos
- MRI Lab, Department of Computer Science, University of Houston, 4800 Calhoun Road PGH 501, Houston, TX, USA.
| |
Collapse
|
4
|
A Platform Integrating Acquisition, Reconstruction, Visualization, and Manipulator Control Modules for MRI-Guided Interventions. J Digit Imaging 2020; 32:420-432. [PMID: 30483988 DOI: 10.1007/s10278-018-0152-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022] Open
Abstract
This work presents a platform that integrates a customized MRI data acquisition scheme with reconstruction and three-dimensional (3D) visualization modules along with a module for controlling an MRI-compatible robotic device to facilitate the performance of robot-assisted, MRI-guided interventional procedures. Using dynamically-acquired MRI data, the computational framework of the platform generates and updates a 3D model representing the area of the procedure (AoP). To image structures of interest in the AoP that do not reside inside the same or parallel slices, the MRI acquisition scheme was modified to collect a multi-slice set of intraoblique to each other slices; which are termed composing slices. Moreover, this approach interleaves the collection of the composing slices so the same k-space segments of all slices are collected during similar time instances. This time matching of the k-space segments results in spatial matching of the imaged objects in the individual composing slices. The composing slices were used to generate and update the 3D model of the AoP. The MRI acquisition scheme was evaluated with computer simulations and experimental studies. Computer simulations demonstrated that k-space segmentation and time-matched interleaved acquisition of these segments provide spatial matching of the structures imaged with composing slices. Experimental studies used the platform to image the maneuvering of an MRI-compatible manipulator that carried tubing filled with MRI contrast agent. In vivo experimental studies to image the abdomen and contrast enhanced heart on free-breathing subjects without cardiac triggering demonstrated spatial matching of imaged anatomies in the composing planes. The described interventional MRI framework could assist in performing real-time MRI-guided interventions.
Collapse
|
5
|
Wang H, Liu S, Wang T, Zhang C, Feng T, Tian C. Three-dimensional interventional photoacoustic imaging for biopsy needle guidance with a linear array transducer. JOURNAL OF BIOPHOTONICS 2019; 12:e201900212. [PMID: 31407486 DOI: 10.1002/jbio.201900212] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/29/2019] [Revised: 07/24/2019] [Accepted: 08/09/2019] [Indexed: 06/10/2023]
Abstract
Needle placement is important for many clinical interventions, such as tissue biopsy, regional anesthesia and drug delivery. It is essential to visualize the spatial position of the needle and the target tissue during the interventions using appropriate imaging techniques. Based on the contrast of optical absorption, photoacoustic imaging is well suited for the guidance of interventional procedures. However, conventional photoacoustic imaging typically provides two-dimensional (2D) slices of the region of interest and could only visualize the needle and the target when they are within the imaging plane of the probe at the same time. This requires great alignment skill and effort. To ease this problem, we developed a 3D interventional photoacoustic imaging technique by fast scanning a linear array ultrasound probe and stitching acquired image slices. in vivo sentinel lymph node biopsy experiment shows that the technique could precisely locate a needle and a sentinel lymph node in a tissue volume while a perfusion experiment demonstrates that the technique could visualize the 3D distribution of injected methylene blue dye underneath the skin at high temporal and spatial resolution. The proposed technique provides a practical way for photoacoustic image-guided interventions.
Collapse
Affiliation(s)
- Hang Wang
- Department of Precision Machinery and Precision Instrumentation, University of Science and Technology of China, Hefei, Anhui, China
- Key Laboratory of Precision Scientific Instrumentation of Anhui Higher Education Institutes, University of Science and Technology of China, Hefei, Anhui, China
| | - Songde Liu
- Department of Precision Machinery and Precision Instrumentation, University of Science and Technology of China, Hefei, Anhui, China
- Key Laboratory of Precision Scientific Instrumentation of Anhui Higher Education Institutes, University of Science and Technology of China, Hefei, Anhui, China
| | - Tong Wang
- Department of Optics and Optical Engineering, University of Science and Technology of China, Hefei, Anhui, China
| | - Chenxi Zhang
- Department of Precision Machinery and Precision Instrumentation, University of Science and Technology of China, Hefei, Anhui, China
- Key Laboratory of Precision Scientific Instrumentation of Anhui Higher Education Institutes, University of Science and Technology of China, Hefei, Anhui, China
| | - Ting Feng
- School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing, Jiangsu, China
| | - Chao Tian
- Department of Precision Machinery and Precision Instrumentation, University of Science and Technology of China, Hefei, Anhui, China
- Key Laboratory of Precision Scientific Instrumentation of Anhui Higher Education Institutes, University of Science and Technology of China, Hefei, Anhui, China
| |
Collapse
|
6
|
Three-dimensional volume rendering of pelvic models and paraurethral masses based on MRI cross-sectional images. Int Urogynecol J 2017; 28:1579-1587. [DOI: 10.1007/s00192-017-3317-4] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2017] [Accepted: 03/08/2017] [Indexed: 11/25/2022]
|
7
|
Shahedi M, Cool DW, Romagnoli C, Bauman GS, Bastian-Jordan M, Gibson E, Rodrigues G, Ahmad B, Lock M, Fenster A, Ward AD. Spatially varying accuracy and reproducibility of prostate segmentation in magnetic resonance images using manual and semiautomated methods. Med Phys 2015; 41:113503. [PMID: 25370674 DOI: 10.1118/1.4899182] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Three-dimensional (3D) prostate image segmentation is useful for cancer diagnosis and therapy guidance, but can be time-consuming to perform manually and involves varying levels of difficulty and interoperator variability within the prostatic base, midgland (MG), and apex. In this study, the authors measured accuracy and interobserver variability in the segmentation of the prostate on T2-weighted endorectal magnetic resonance (MR) imaging within the whole gland (WG), and separately within the apex, midgland, and base regions. METHODS The authors collected MR images from 42 prostate cancer patients. Prostate border delineation was performed manually by one observer on all images and by two other observers on a subset of ten images. The authors used complementary boundary-, region-, and volume-based metrics [mean absolute distance (MAD), Dice similarity coefficient (DSC), recall rate, precision rate, and volume difference (ΔV)] to elucidate the different types of segmentation errors that they observed. Evaluation for expert manual and semiautomatic segmentation approaches was carried out. Compared to manual segmentation, the authors' semiautomatic approach reduces the necessary user interaction by only requiring an indication of the anteroposterior orientation of the prostate and the selection of prostate center points on the apex, base, and midgland slices. Based on these inputs, the algorithm identifies candidate prostate boundary points using learned boundary appearance characteristics and performs regularization based on learned prostate shape information. RESULTS The semiautomated algorithm required an average of 30 s of user interaction time (measured for nine operators) for each 3D prostate segmentation. The authors compared the segmentations from this method to manual segmentations in a single-operator (mean whole gland MAD = 2.0 mm, DSC = 82%, recall = 77%, precision = 88%, and ΔV = - 4.6 cm(3)) and multioperator study (mean whole gland MAD = 2.2 mm, DSC = 77%, recall = 72%, precision = 86%, and ΔV = - 4.0 cm(3)). These results compared favorably with observed differences between manual segmentations and a simultaneous truth and performance level estimation reference for this data set (whole gland differences as high as MAD = 3.1 mm, DSC = 78%, recall = 66%, precision = 77%, and ΔV = 15.5 cm(3)). The authors found that overall, midgland segmentation was more accurate and repeatable than the segmentation of the apex and base, with the base posing the greatest challenge. CONCLUSIONS The main conclusions of this study were that (1) the semiautomated approach reduced interobserver segmentation variability; (2) the segmentation accuracy of the semiautomated approach, as well as the accuracies of recently published methods from other groups, were within the range of observed expert variability in manual prostate segmentation; and (3) further efforts in the development of computer-assisted segmentation would be most productive if focused on improvement of segmentation accuracy and reduction of variability within the prostatic apex and base.
Collapse
Affiliation(s)
- Maysam Shahedi
- London Regional Cancer Program, London, Ontario N6A 5W9, Canada; Robarts Research Institute, The University of Western Ontario, London, Ontario N6A 3K7, Canada; and Graduate Program in Biomedical Engineering, The University of Western Ontario, London, Ontario N6A 3K7, Canada
| | - Derek W Cool
- Robarts Research Institute, The University of Western Ontario, London, Ontario N6A 3K7, Canadaand The Department of Medical Imaging, The University of Western Ontario, London, Ontario N6A 3K7, Canada
| | - Cesare Romagnoli
- The Department of Medical Imaging, The University of Western Ontario, London, Ontario N6A 3K7, Canada
| | - Glenn S Bauman
- London Regional Cancer Program, London, Ontario N6A 5W9, Canada; The Department of Medical Biophysics, The University of Western Ontario, London, Ontario N6A 3K7, Canada; and The Department of Oncology, The University of Western Ontario, London, Ontario N6A 3K7, Canada
| | - Matthew Bastian-Jordan
- The Department of Medical Imaging, The University of Western Ontario, London, Ontario N6A 3K7, Canada
| | - Eli Gibson
- Robarts Research Institute, The University of Western Ontario, London, Ontario N6A 3K7, Canada and Graduate Program in Biomedical Engineering, The University of Western Ontario, London, Ontario N6A 3K7, Canada
| | - George Rodrigues
- London Regional Cancer Program, London, Ontario N6A 5W9, Canada and The Department of Oncology, The University of Western Ontario, London, Ontario N6A 3K7, Canada
| | - Belal Ahmad
- London Regional Cancer Program, London, Ontario N6A 5W9, Canada and The Department of Oncology, The University of Western Ontario, London, Ontario N6A 3K7, Canada
| | - Michael Lock
- London Regional Cancer Program, London, Ontario N6A 5W9, Canada and The Department of Oncology, The University of Western Ontario, London, Ontario N6A 3K7, Canada
| | - Aaron Fenster
- Robarts Research Institute, The University of Western Ontario, London, Ontario N6A 3K7, Canada; Graduate Program in Biomedical Engineering, The University of Western Ontario, London, Ontario N6A 3K7, Canada; The Department of Medical Biophysics, The University of Western Ontario, London, Ontario N6A 3K7, Canada; and The Department of Medical Imaging, The University of Western Ontario, London, Ontario N6A 3K7, Canada
| | - Aaron D Ward
- London Regional Cancer Program, London, Ontario N6A 5W9, Canada; Graduate Program in Biomedical Engineering, The University of Western Ontario, London, Ontario N6A 3K7, Canada; The Department of Medical Biophysics, The University of Western Ontario, London, Ontario N6A 3K7, Canada; and The Department of Oncology, The University of Western Ontario, London, Ontario N6A 3K7, Canada
| |
Collapse
|
8
|
Rube MA, Holbrook AB, Cox BF, Houston JG, Melzer A. Wireless MR tracking of interventional devices using phase-field dithering and projection reconstruction. Magn Reson Imaging 2014; 32:693-701. [PMID: 24721007 DOI: 10.1016/j.mri.2014.03.007] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2013] [Revised: 03/11/2014] [Accepted: 03/11/2014] [Indexed: 11/16/2022]
Abstract
PURPOSE Device tracking is crucial for interventional MRI (iMRI) because conventional device materials do not contribute to the MR signal, may cause susceptibility artifacts and are generally invisible if moved out of the scan plane. A robust method for wireless tracking and dynamic guidance of interventional devices equipped with wirelessly connected resonant circuits (wRC) is presented. METHODS The proposed method uses weak spatially-selective excitation pulses with very low flip angle (0.3°), a Hadamard multiplexed tracking scheme and employs phase-field dithering to obtain the 3D position of a wRC. RF induced heating experiments (ASTM protocol) and balloon angioplasties of the iliac artery were conducted in a perfused vascular phantom and three Thiel soft-embalmed human cadavers. RESULTS Device tip tracking was interleaved with various user-selectable fast pulse sequences receiving a geometry update from the tracking kernel in less than 30ms. Integrating phase-field dithering significantly improved our tracking robustness for catheters with small diameters (4-6 French). The volume root mean square distance error was 2.81mm (standard deviation: 1.31mm). No significant RF induced heating (<0.6°C) was detected during heating experiments. CONCLUSION This tip tracking approach provides flexible, fast and robust feedback loop, intuitive iMRI scanner interaction, does not constrain the physician and delivers very low specific absorption rates. Devices with wRC can be exchanged during a procedure without modifications to the iMRI setup or the pulse sequence. A drawback of our current implementation is that position information is available for a single tracking coil only. This was satisfactory for balloon angioplasties of the iliac artery, but further studies are required for complex navigation and catheter shapes before animal trials and clinical application.
Collapse
Affiliation(s)
- Martin A Rube
- Institute for Medical Science and Technology, Division of Imaging and Technology, University of Dundee, Dundee, United Kingdom.
| | - Andrew B Holbrook
- Department of Radiology, Stanford University, Stanford, California, USA
| | - Benjamin F Cox
- Institute for Medical Science and Technology, Division of Imaging and Technology, University of Dundee, Dundee, United Kingdom
| | - J Graeme Houston
- Department of Clinical Radiology, Ninewells Hospital and Medical School, NHS Tayside, Dundee, United Kingdom
| | - Andreas Melzer
- Institute for Medical Science and Technology, Division of Imaging and Technology, University of Dundee, Dundee, United Kingdom
| |
Collapse
|
9
|
Calligaris D, Norton I, Feldman DR, Ide JL, Dunn IF, Eberlin LS, Cooks RG, Jolesz FA, Golby AJ, Santagata S, Agar NY. Mass spectrometry imaging as a tool for surgical decision-making. JOURNAL OF MASS SPECTROMETRY : JMS 2013; 48:1178-87. [PMID: 24259206 PMCID: PMC3957233 DOI: 10.1002/jms.3295] [Citation(s) in RCA: 64] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/23/2013] [Revised: 10/03/2013] [Accepted: 10/10/2013] [Indexed: 05/18/2023]
Abstract
Despite significant advances in image-guided therapy, surgeons are still too often left with uncertainty when deciding to remove tissue. This binary decision between removing and leaving tissue during surgery implies that the surgeon should be able to distinguish tumor from healthy tissue. In neurosurgery, current image-guidance approaches such as magnetic resonance imaging (MRI) combined with neuronavigation offer a map as to where the tumor should be, but the only definitive method to characterize the tissue at stake is histopathology. Although extremely valuable information is derived from this gold standard approach, it is limited to very few samples during surgery and is not practically used for the delineation of tumor margins. The development and implementation of faster, comprehensive, and complementary approaches for tissue characterization are required to support surgical decision-making--an incremental and iterative process with tumor removed in multiple and often minute biopsies. The development of atmospheric pressure ionization sources makes it possible to analyze tissue specimens with little to no sample preparation. Here, we highlight the value of desorption electrospray ionization as one of many available approaches for the analysis of surgical tissue. Twelve surgical samples resected from a patient during surgery were analyzed and diagnosed as glioblastoma tumor or necrotic tissue by standard histopathology, and mass spectrometry results were further correlated to histopathology for critical validation of the approach. The use of a robust statistical approach reiterated results from the qualitative detection of potential biomarkers of these tissue types. The correlation of the mass spectrometry and histopathology results to MRI brings significant insight into tumor presentation that could not only serve to guide tumor resection, but that is also worthy of more detailed studies on our understanding of tumor presentation on MRI.
Collapse
Affiliation(s)
- David Calligaris
- Department of Neurosurgery, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA 02115
| | - Isaiah Norton
- Department of Neurosurgery, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA 02115
| | - Daniel R. Feldman
- Department of Pathology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, 02115
| | - Jennifer L. Ide
- Department of Neurosurgery, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA 02115
| | - Ian F. Dunn
- Department of Neurosurgery, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA 02115
| | - Livia S. Eberlin
- Department of Chemistry and Center for Analytical Instrumentation Development, Purdue University, West Lafayette, IN 47907
| | - R. Graham Cooks
- Department of Chemistry and Center for Analytical Instrumentation Development, Purdue University, West Lafayette, IN 47907
| | - Ferenc A. Jolesz
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA 02115
| | - Alexandra J. Golby
- Department of Neurosurgery, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA 02115
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA 02115
| | - Sandro Santagata
- Department of Pathology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, 02115
| | - Nathalie Y. Agar
- Department of Neurosurgery, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA 02115
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA 02115
- Department of Chemistry and Center for Analytical Instrumentation Development, Purdue University, West Lafayette, IN 47907
- Corresponding author: Dr. Nathalie Y.R. Agar Departments of Neurosurgery and Radiology, Brigham and Women’s Hospital, and Department of Cancer Biology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA 02115. , +1617/525-7374
| |
Collapse
|
10
|
Toth R, Ribault J, Gentile J, Sperling D, Madabhushi A. Simultaneous Segmentation of Prostatic Zones Using Active Appearance Models With Multiple Coupled Levelsets. COMPUTER VISION AND IMAGE UNDERSTANDING : CVIU 2013; 117:1051-1060. [PMID: 23997571 PMCID: PMC3756603 DOI: 10.1016/j.cviu.2012.11.013] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
In this work we present an improvement to the popular Active Appearance Model (AAM) algorithm, that we call the Multiple-Levelset AAM (MLA). The MLA can simultaneously segment multiple objects, and makes use of multiple levelsets, rather than anatomical landmarks, to define the shapes. AAMs traditionally define the shape of each object using a set of anatomical landmarks. However, landmarks can be difficult to identify, and AAMs traditionally only allow for segmentation of a single object of interest. The MLA, which is a landmark independent AAM, allows for levelsets of multiple objects to be determined and allows for them to be coupled with image intensities. This gives the MLA the flexibility to simulataneously segmentation multiple objects of interest in a new image. In this work we apply the MLA to segment the prostate capsule, the prostate peripheral zone (PZ), and the prostate central gland (CG), from a set of 40 endorectal, T2-weighted MRI images. The MLA system we employ in this work leverages a hierarchical segmentation framework, so constructed as to exploit domain specific attributes, by utilizing a given prostate segmentation to help drive the segmentations of the CG and PZ, which are embedded within the prostate. Our coupled MLA scheme yielded mean Dice accuracy values of .81, .79 and .68 for the prostate, CG, and PZ, respectively using a leave-one-out cross validation scheme over 40 patient studies. When only considering the midgland of the prostate, the mean DSC values were .89, .84, and .76 for the prostate, CG, and PZ respectively.
Collapse
Affiliation(s)
- Robert Toth
- Dept. of Biomedical Engineering, Rutgers University, Piscataway, NJ, 08854
| | | | - John Gentile
- New Jersey Institute of Radiology, Carlstadt, NJ, 07072
| | - Dan Sperling
- New Jersey Institute of Radiology, Carlstadt, NJ, 07072
| | - Anant Madabhushi
- Dept. of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, 44120
| |
Collapse
|
11
|
Orringer DA, Golby A, Jolesz F. Neuronavigation in the surgical management of brain tumors: current and future trends. Expert Rev Med Devices 2013; 9:491-500. [PMID: 23116076 DOI: 10.1586/erd.12.42] [Citation(s) in RCA: 142] [Impact Index Per Article: 12.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
Neuronavigation has become an ubiquitous tool in the surgical management of brain tumors. This review describes the use and limitations of current neuronavigational systems for brain tumor biopsy and resection. Methods for integrating intraoperative imaging into neuronavigational datasets developed to address the diminishing accuracy of positional information that occurs over the course of brain tumor resection are discussed. In addition, the process of integration of functional MRI and tractography into navigational models is reviewed. Finally, emerging concepts and future challenges relating to the development and implementation of experimental imaging technologies in the navigational environment are explored.
Collapse
Affiliation(s)
- Daniel A Orringer
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis Street, Boston, MA 02115, USA
| | | | | |
Collapse
|
12
|
von Jako CR, Zuk Y, Zur O, Gilboa P. A novel accurate minioptical tracking system for percutaneous needle placement. IEEE Trans Biomed Eng 2013; 60:2222-5. [PMID: 23481683 DOI: 10.1109/tbme.2013.2251883] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The novel optical tracking system employs a miniature video camera, mounted on the hub of an interventional needle, to determine the location and orientation of the needle relative to a skin-attached sticker with color reference markers. A computed tomography (CT) scan is used to register the same reference markers to the anatomy in the CT images, and thus, register the needle to the anatomy and to a user-selected target. A computer displays a simulation of the interventional needle on the CT images, providing guidance information to assist a user in directing the needle to the target. Bench testing was performed on a custom phantom to determine the accuracy of this minioptical tracking system. The resulting accuracy data demonstrate a good correlation with phantom coordinates and the CT images.
Collapse
|
13
|
Schulz G, Waschkies C, Pfeiffer F, Zanette I, Weitkamp T, David C, Müller B. Multimodal imaging of human cerebellum - merging X-ray phase microtomography, magnetic resonance microscopy and histology. Sci Rep 2012; 2:826. [PMID: 23145319 PMCID: PMC3494013 DOI: 10.1038/srep00826] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2012] [Accepted: 10/02/2012] [Indexed: 01/22/2023] Open
Abstract
Imaging modalities including magnetic resonance imaging and X-ray computed tomography are established methods in daily clinical diagnosis of human brain. Clinical equipment does not provide sufficient spatial resolution to obtain morphological information on the cellular level, essential for applying minimally or non-invasive surgical interventions. Therefore, generic data with lateral sub-micrometer resolution have been generated from histological slices post mortem. Sub-cellular spatial resolution, lost in the third dimension as a result of sectioning, is obtained using magnetic resonance microscopy and micro computed tomography. We demonstrate that for human cerebellum grating-based X-ray phase tomography shows complementary contrast to magnetic resonance microscopy and histology. In this study, the contrast-to-noise values of magnetic resonance microscopy and phase tomography were comparable whereas the spatial resolution in phase tomography is an order of magnitude better. The registered data with their complementary information permit the distinct segmentation of tissues within the human cerebellum.
Collapse
Affiliation(s)
- Georg Schulz
- Biomaterials Science Center, University of Basel, Basel, Switzerland
| | - Conny Waschkies
- Animal Imaging Center, Institute for Biomedical Engineering, ETH & University of Zurich, Switzerland
| | - Franz Pfeiffer
- Department of Physics (E17), Technische Universität München, Garching, Germany
| | - Irene Zanette
- Department of Physics (E17), Technische Universität München, Garching, Germany
- European Synchrotron Radiation Facility, Grenoble, France
| | | | - Christian David
- Laboratory for Micro- and Nanotechnology, Paul Scherrer Institut, Villigen, Switzerland
| | - Bert Müller
- Biomaterials Science Center, University of Basel, Basel, Switzerland
| |
Collapse
|
14
|
Toth R, Madabhushi A. Multifeature landmark-free active appearance models: application to prostate MRI segmentation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2012; 31:1638-1650. [PMID: 22665505 DOI: 10.1109/tmi.2012.2201498] [Citation(s) in RCA: 63] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
Active shape models (ASMs) and active appearance models (AAMs) are popular approaches for medical image segmentation that use shape information to drive the segmentation process. Both approaches rely on image derived landmarks (specified either manually or automatically) to define the object's shape, which require accurate triangulation and alignment. An alternative approach to modeling shape is the levelset representation, defined as a set of signed distances to the object's surface. In addition, using multiple image derived attributes (IDAs) such as gradient information has previously shown to offer improved segmentation results when applied to ASMs, yet little work has been done exploring IDAs in the context of AAMs. In this work, we present a novel AAM methodology that utilizes the levelset implementation to overcome the issues relating to specifying landmarks, and locates the object of interest in a new image using a registration based scheme. Additionally, the framework allows for incorporation of multiple IDAs. Our multifeature landmark-free AAM (MFLAAM) utilizes an efficient, intuitive, and accurate algorithm for identifying those IDAs that will offer the most accurate segmentations. In this paper, we evaluate our MFLAAM scheme for the problem of prostate segmentation from T2-w MRI volumes. On a cohort of 108 studies, the levelset MFLAAM yielded a mean Dice accuracy of 88% ± 5%, and a mean surface error of 1.5 mm ±.8 mm with a segmentation time of 150/s per volume. In comparison, a state of the art AAM yielded mean Dice and surface error values of 86% ± 9% and 1.6 mm ± 1.0 mm, respectively. The differences with respect to our levelset-based MFLAAM model are statistically significant . In addition, our results were in most cases superior to several recent state of the art prostate MRI segmentation methods.
Collapse
Affiliation(s)
- Robert Toth
- Department of Biomedical Engineering, Rutgers University, Piscataway, NJ 08854, USA.
| | | |
Collapse
|
15
|
Eberlin LS, Norton I, Dill AL, Golby AJ, Ligon KL, Santagata S, Cooks RG, Agar NYR. Classifying human brain tumors by lipid imaging with mass spectrometry. Cancer Res 2011; 72:645-54. [PMID: 22139378 DOI: 10.1158/0008-5472.can-11-2465] [Citation(s) in RCA: 222] [Impact Index Per Article: 17.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Brain tissue biopsies are required to histologically diagnose brain tumors, but current approaches are limited by tissue characterization at the time of surgery. Emerging technologies such as mass spectrometry imaging can enable a rapid direct analysis of cancerous tissue based on molecular composition. Here, we illustrate how gliomas can be rapidly classified by desorption electrospray ionization-mass spectrometry (DESI-MS) imaging, multivariate statistical analysis, and machine learning. DESI-MS imaging was carried out on 36 human glioma samples, including oligodendroglioma, astrocytoma, and oligoastrocytoma, all of different histologic grades and varied tumor cell concentration. Gray and white matter from glial tumors were readily discriminated and detailed diagnostic information could be provided. Classifiers for subtype, grade, and concentration features generated with lipidomic data showed high recognition capability with more than 97% cross-validation. Specimen classification in an independent validation set agreed with expert histopathology diagnosis for 79% of tested features. Together, our findings offer proof of concept that intraoperative examination and classification of brain tissue by mass spectrometry can provide surgeons, pathologists, and oncologists with critical and previously unavailable information to rapidly guide surgical resections that can improve management of patients with malignant brain tumors.
Collapse
Affiliation(s)
- Livia S Eberlin
- Department of Chemistry and Center for Analytical Instrumentation Development, Purdue University, West Lafayette, Indiana 47907, USA
| | | | | | | | | | | | | | | |
Collapse
|
16
|
Seimenis I, Tsekos NV, Keroglou C, Eracleous E, Pitris C, Christoforou EG. An Approach for Preoperative Planning and Performance of MR-guided Interventions Demonstrated With a Manual Manipulator in a 1.5T MRI Scanner. Cardiovasc Intervent Radiol 2011; 35:359-67. [DOI: 10.1007/s00270-011-0147-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/16/2010] [Accepted: 02/25/2011] [Indexed: 10/18/2022]
|
17
|
Amarnath GS, Muddugangadhar BC, Tripathi S, Dikshit S, MS D. Biomaterials for Dental Implants: An Overview. ACTA ACUST UNITED AC 2011. [DOI: 10.5005/jp-journals-10012-1030] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
|
18
|
Dumpuri P, Clements LW, Dawant BM, Miga MI. Model-updated image-guided liver surgery: preliminary results using surface characterization. PROGRESS IN BIOPHYSICS AND MOLECULAR BIOLOGY 2010; 103:197-207. [PMID: 20869385 PMCID: PMC3819171 DOI: 10.1016/j.pbiomolbio.2010.09.014] [Citation(s) in RCA: 37] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/01/2010] [Revised: 08/30/2010] [Accepted: 09/15/2010] [Indexed: 11/18/2022]
Abstract
The current protocol for image guidance in open abdominal liver tumor removal surgeries involves a rigid registration between the patient's operating room space and the pre-operative diagnostic image-space. Systematic studies have shown that the liver can deform up to 2 cm during surgeries in a non-rigid fashion thereby compromising the accuracy of these surgical navigation systems. Compensating for intra-operative deformations using mathematical models has shown promising results. In this work, we follow up the initial rigid registration with a computational approach that is geared towards minimizing the residual closest point distances between the un-deformed pre-operative surface and the rigidly registered intra-operative surface. We also use a surface Laplacian equation based filter that generates a realistic deformation field. Preliminary validation of the proposed computational framework was performed using phantom experiments and clinical trials. The proposed framework improved the rigid registration errors for the phantom experiments on average by 43%, and 74% using partial and full surface data, respectively. With respect to clinical data, it improved the closest point residual error associated with rigid registration by 54% on average for the clinical cases. These results are highly encouraging and suggest that computational models can be used to increase the accuracy of image-guided open abdominal liver tumor removal surgeries.
Collapse
Affiliation(s)
- Prashanth Dumpuri
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN 37235, USA.
| | | | | | | |
Collapse
|
19
|
Archip N, Clatz O, Whalen S, Dimaio SP, Black PM, Jolesz FA, Golby A, Warfield SK. Compensation of geometric distortion effects on intraoperative magnetic resonance imaging for enhanced visualization in image-guided neurosurgery. Neurosurgery 2008; 62:209-15; discussion 215-6. [PMID: 18424988 DOI: 10.1227/01.neu.0000317395.08466.e6] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
Abstract
OBJECTIVE Preoperative magnetic resonance imaging (MRI), functional MRI, diffusion tensor MRI, magnetic resonance spectroscopy, and positron-emission tomographic scans may be aligned to intraoperative MRI to enhance visualization and navigation during image-guided neurosurgery. However, several effects (both machine- and patient-induced distortions) lead to significant geometric distortion of intraoperative MRI. Therefore, a precise alignment of these image modalities requires correction of the geometric distortion. We propose and evaluate a novel method to compensate for the geometric distortion of intraoperative 0.5-T MRI in image-guided neurosurgery. METHODS In this initial pilot study, 11 neurosurgical procedures were prospectively enrolled. The scheme used to correct the geometric distortion is based on a nonrigid registration algorithm introduced by our group. This registration scheme uses image features to establish correspondence between images. It estimates a smooth geometric distortion compensation field by regularizing the displacements estimated at the correspondences. A patient-specific linear elastic material model is used to achieve the regularization. The geometry of intraoperative images (0.5 T) is changed so that the images match the preoperative MRI scans (3 T). RESULTS We compared the alignment between preoperative and intraoperative imaging using 1) only rigid registration without correction of the geometric distortion, and 2) rigid registration and compensation for the geometric distortion. We evaluated the success of the geometric distortion correction algorithm by measuring the Hausdorff distance between boundaries in the 3-T and 0.5-T MRIs after rigid registration alone and with the addition of geometric distortion correction of the 0.5-T MRI. Overall, the mean magnitude of the geometric distortion measured on the intraoperative images is 10.3 mm with a minimum of 2.91 mm and a maximum of 21.5 mm. The measured accuracy of the geometric distortion compensation algorithm is 1.93 mm. There is a statistically significant difference between the accuracy of the alignment of preoperative and intraoperative images, both with and without the correction of geometric distortion (P < 0.001). CONCLUSION The major contributions of this study are 1) identification of geometric distortion of intraoperative images relative to preoperative images, 2) measurement of the geometric distortion, 3) application of nonrigid registration to compensate for geometric distortion during neurosurgery, 4) measurement of residual distortion after geometric distortion correction, and 5) phantom study to quantify geometric distortion.
Collapse
Affiliation(s)
- Neculai Archip
- Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts 02115, USA
| | | | | | | | | | | | | | | |
Collapse
|
20
|
Advances in pediatric minimal access therapy: a cautious journey from therapeutic endoscopy to transluminal surgery based on the adult experience. J Pediatr Gastroenterol Nutr 2008; 46:359-69. [PMID: 18367946 DOI: 10.1097/mpg.0b013e31815c720b] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
21
|
Ozcan A, Christoforou E, Brown D, Tsekos N. Fast and efficient radiological interventions via a graphical user interface commanded magnetic resonance compatible robotic device. CONFERENCE PROCEEDINGS : ... ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL CONFERENCE 2008; 2006:1762-7. [PMID: 17946067 DOI: 10.1109/iembs.2006.259920] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
The graphical user interface for an MR compatible robotic device has the capability of displaying oblique MR slices in 2D and a 3D virtual environment along with the representation of the robotic arm in order to swiftly complete the intervention. Using the advantages of the MR modality the device saves time and effort, is safer for the medical staff and is more comfortable for the patient.
Collapse
Affiliation(s)
- Alpay Ozcan
- Mallinkcrodt Inst. of Radiol., Washington Univ. Sch. of Med., St. Louis, MO, USA.
| | | | | | | |
Collapse
|
22
|
Tsekos NV, Khanicheh A, Christoforou E, Mavroidis C. Magnetic resonance-compatible robotic and mechatronics systems for image-guided interventions and rehabilitation: a review study. Annu Rev Biomed Eng 2007; 9:351-87. [PMID: 17439358 DOI: 10.1146/annurev.bioeng.9.121806.160642] [Citation(s) in RCA: 147] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The continuous technological progress of magnetic resonance imaging (MRI), as well as its widespread clinical use as a highly sensitive tool in diagnostics and advanced brain research, has brought a high demand for the development of magnetic resonance (MR)-compatible robotic/mechatronic systems. Revolutionary robots guided by real-time three-dimensional (3-D)-MRI allow reliable and precise minimally invasive interventions with relatively short recovery times. Dedicated robotic interfaces used in conjunction with fMRI allow neuroscientists to investigate the brain mechanisms of manipulation and motor learning, as well as to improve rehabilitation therapies. This paper gives an overview of the motivation, advantages, technical challenges, and existing prototypes for MR-compatible robotic/mechatronic devices.
Collapse
Affiliation(s)
- Nikolaos V Tsekos
- Cardiovascular Imaging Laboratory, Mallinckrodt Institute of Radiology, Washington University, St. Louis, Missouri 63110, USA.
| | | | | | | |
Collapse
|
23
|
Naito S. Recent developments and perspectives of image-guided precision surgery for malignancies. Int J Clin Oncol 2007. [DOI: 10.1007/s10147-007-0671-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
24
|
Hashizume M. MRI-guided laparoscopic and robotic surgery for malignancies. Int J Clin Oncol 2007; 12:94-8. [PMID: 17443276 DOI: 10.1007/s10147-007-0664-z] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2007] [Indexed: 11/25/2022]
Abstract
Endoscopic surgery has some clear benefits, but it also has some disadvantages in reducing surgeons' normal dexterity and limiting their ability to deal with difficult situations. Computer-aided surgery has been proposed to overcome some of the drawbacks of traditional minimally invasive surgery. The proposed systems make possible a secure, precise procedure with no limitations on the operator's freedom of movement. Image-guided surgery is a new technical tool in surgical oncology. Interventional magnetic resonance imaging (MRI) has entered a new stage in which computer-based techniques play an expanding role in planning, monitoring, and controlling procedures. MRI-guided surgery not only represents a technical challenge but is a transformation from conventional hand-eye coordination to interactive navigational operations. We have recently developed an MRI-guided robot-assisted interventional surgical system as well as an MRI-compatible endoscope. They allow the performance of precise image-guided interventional therapy and endoscopic surgery. MRI-guided laparoscopic surgery is now feasible for malignancies and will play an important part in the development of minimally invasive therapy.
Collapse
Affiliation(s)
- Makoto Hashizume
- Department of Advanced Medical Initiatives, Faculty of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-ku, Fukuoka 812-8582, Japan.
| |
Collapse
|
25
|
Archip N, Clatz O, Whalen S, Kacher D, Fedorov A, Kot A, Chrisochoides N, Jolesz F, Golby A, Black PM, Warfield SK. Non-rigid alignment of pre-operative MRI, fMRI, and DT-MRI with intra-operative MRI for enhanced visualization and navigation in image-guided neurosurgery. Neuroimage 2006; 35:609-24. [PMID: 17289403 PMCID: PMC3358788 DOI: 10.1016/j.neuroimage.2006.11.060] [Citation(s) in RCA: 93] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2006] [Revised: 11/15/2006] [Accepted: 11/16/2006] [Indexed: 11/18/2022] Open
Abstract
OBJECTIVE The usefulness of neurosurgical navigation with current visualizations is seriously compromised by brain shift, which inevitably occurs during the course of the operation, significantly degrading the precise alignment between the pre-operative MR data and the intra-operative shape of the brain. Our objectives were (i) to evaluate the feasibility of non-rigid registration that compensates for the brain deformations within the time constraints imposed by neurosurgery, and (ii) to create augmented reality visualizations of critical structural and functional brain regions during neurosurgery using pre-operatively acquired fMRI and DT-MRI. MATERIALS AND METHODS Eleven consecutive patients with supratentorial gliomas were included in our study. All underwent surgery at our intra-operative MR imaging-guided therapy facility and have tumors in eloquent brain areas (e.g. precentral gyrus and cortico-spinal tract). Functional MRI and DT-MRI, together with MPRAGE and T2w structural MRI were acquired at 3 T prior to surgery. SPGR and T2w images were acquired with a 0.5 T magnet during each procedure. Quantitative assessment of the alignment accuracy was carried out and compared with current state-of-the-art systems based only on rigid registration. RESULTS Alignment between pre-operative and intra-operative datasets was successfully carried out during surgery for all patients. Overall, the mean residual displacement remaining after non-rigid registration was 1.82 mm. There is a statistically significant improvement in alignment accuracy utilizing our non-rigid registration in comparison to the currently used technology (p<0.001). CONCLUSIONS We were able to achieve intra-operative rigid and non-rigid registration of (1) pre-operative structural MRI with intra-operative T1w MRI; (2) pre-operative fMRI with intra-operative T1w MRI, and (3) pre-operative DT-MRI with intra-operative T1w MRI. The registration algorithms as implemented were sufficiently robust and rapid to meet the hard real-time constraints of intra-operative surgical decision making. The validation experiments demonstrate that we can accurately compensate for the deformation of the brain and thus can construct an augmented reality visualization to aid the surgeon.
Collapse
Affiliation(s)
- Neculai Archip
- Department of Radiology, Harvard Medical School, Brigham and Women's Hospital, 75 Francis St., Boston, MA 02115, USA.
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
26
|
Hirai N, Kosaka A, Kawamata T, Hori T, Iseki H. Image-guided neurosurgery system integrating AR-based navigation and open-MRI monitoring. ACTA ACUST UNITED AC 2006; 10:59-71. [PMID: 16298917 DOI: 10.3109/10929080500229389] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
As endoscopic surgery has become a popular form of minimally invasive surgery, it increasingly requires useful imaging tools to help the surgeons perform safe and secure operations. Our navigation system provides surgeons with visual information by overlaying 3D wire frame models of tumor onto live images, as well as by displaying relative the positions of surgical tools and the target tumor. Such 3D wire frame models are generated from pre-operative CT/MR images with the help of a 3D surgical simulation software. Another important function of our system is real-time volume rendering of intra-operative MR images for the target tumor. This function allows surgeons to carefully observe the vicinity of the tumor regions to be removed, by rendering the sectional views with respect to the surgical tool position, so that surgical performance can be easily monitored during the operation. We tested this navigation system in more than 10 clinical operations and verified the effectiveness of the navigation and surgical performance.
Collapse
Affiliation(s)
- Nobuyuki Hirai
- Institute of Advanced Biomedical Engineering and Science, Graduate School of Medicine, Tokyo Women's Medical University, Japan.
| | | | | | | | | |
Collapse
|
27
|
van de Kraats EB, van Walsum T, Verlaan JJ, Voormolen MHJ, Mali WPTM, Niessen WJ. Three-dimensional rotational X-ray navigation for needle guidance in percutaneous vertebroplasty: an accuracy study. Spine (Phila Pa 1976) 2006; 31:1359-64. [PMID: 16721300 DOI: 10.1097/01.brs.0000218580.54036.1b] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
STUDY DESIGN The position of a needle tip displayed on a navigation system after transpedicular introduction into a vertebral body is compared with the real position of the needle tip when using a direct navigation coupling between a three-dimensional rotational X-ray (3DRX) system and a navigation system. OBJECTIVES To assess whether the needle tip position displayed by the navigation system corresponds to the real needle position and to quantitatively determine needle navigation accuracy in a clinically relevant setting. SUMMARY OF BACKGROUND DATA Image-guided navigation has reportedly increased the accuracy and safety of pedicle screw insertion and decreased complication rates. In former studies, the result of image-guided navigation was mainly compared qualitatively with the result of conventional fluoroscopy-guided procedures. Previously, a direct navigation coupling between a 3DRX system and a standard navigation system was introduced that bypasses the need for explicit patient-to-image registration necessary for image-guided orthopedic surgery. In a phantom experiment, the reported accuracy of navigation with the coupling to a 3DRX system was approximately 1 mm. However, in a clinical setting, additional errors can be introduced. METHODS Twenty-three needles were placed transpedicularly into vertebral bodies of embalmed human trunks using 3DRX-guided navigation. The navigated needle tip positions were compared with the real needle tip positions manually extracted from 3DRX volumes acquired after completion of the introduction. RESULTS The average distance between the navigated needle tip and the real position of the needle tip extracted from a postprocedure 3DRX volume was 2.5 +/- 1.5 mm. CONCLUSIONS Accuracy of 3DRX-guided navigation is 2.5 +/- 1.5 mm in a clinically relevant setting, which is less than the accuracy determined in phantom experiments.
Collapse
|
28
|
Lazebnik RS, Weinberg BD, Breen MS, Lewin JS, Wilson DL. Semiautomatic parametric model-based 3D lesion segmentation for evaluation of MR-guided radiofrequency ablation therapy. Acad Radiol 2005; 12:1491-501. [PMID: 16321737 DOI: 10.1016/j.acra.2005.07.011] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2005] [Revised: 07/20/2005] [Accepted: 07/23/2005] [Indexed: 10/25/2022]
Abstract
RATIONALE AND OBJECTIVES Interventional magnetic resonance imaging (iMRI) allows real-time guidance and optimization of radiofrequency ablation of pathologic tissue. For many tissues, resulting lesions have a characteristic two-boundary appearance featuring an inner region and an outer hyper-intense margin in both T2 and contrast-enhanced (CE) T1-weighted MR images. We created a geometric model-based semiautomatic method to aid in real-time lesion segmentation, cross-sectional/three-dimensional visualization, and intra/posttreatment evaluation. MATERIALS AND METHODS Our method relies on a 12-parameter, 3-dimensional, globally deformable model with quadric surfaces that describe both lesion boundaries. We present an energy minimization approach to quickly and semiautomatically fit the model to a gray-scale MR image volume. We applied the method to in vivo lesions (n = 10) in a rabbit thigh model, using T2 and CE T1-weighted MR images, and compared the results with manually segmented boundaries. RESULTS For all lesions, the median error was < or =1.21 mm for the inner region and < or =1.00 mm for the outer hyper-intense region, values that favorably compare to a voxel width of 0.7 mm and distances between the borders manually segmented by the two operators. CONCLUSION Our method provides a precise, semiautomatic approximation of lesion shape for ellipsoidal lesions. Further, the method has clinical applications in lesion visualization, volume estimation, and treatment evaluation.
Collapse
Affiliation(s)
- Roee S Lazebnik
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH 44106, USA
| | | | | | | | | |
Collapse
|
29
|
Appendices. J Laparoendosc Adv Surg Tech A 2005. [DOI: 10.1089/lap.2005.15.563] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
|
30
|
Haker SJ, Mulkern RV, Roebuck JR, Barnes AS, Dimaio S, Hata N, Tempany CMC. Magnetic resonance-guided prostate interventions. Top Magn Reson Imaging 2005; 16:355-68. [PMID: 16924169 DOI: 10.1097/00002142-200510000-00003] [Citation(s) in RCA: 14] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/11/2023]
Abstract
We review our experience using an open 0.5-T magnetic resonance (MR) interventional unit to guide procedures in the prostate. This system allows access to the patient and real-time MR imaging simultaneously and has made it possible to perform prostate biopsy and brachytherapy under MR guidance. We review MR imaging of the prostate and its use in targeted therapy, and describe our use of image processing methods such as image registration to further facilitate precise targeting. We describe current developments with a robot assist system being developed to aid radioactive seed placement.
Collapse
Affiliation(s)
- Steven J Haker
- Department of Radiology, Brigham and Women's Hospital, 75 Francis Street, Boston, MA 02115, USA.
| | | | | | | | | | | | | |
Collapse
|
31
|
Abe H, Kurumi Y, Naka S, Shiomi H, Umeda T, Naitoh H, Endo Y, Hanasawa K, Morikawa S, Tani T. Open-configuration MR-guided microwave thermocoagulation therapy for metastatic liver tumors from breast cancer. Breast Cancer 2005; 12:26-31. [PMID: 15657520 DOI: 10.2325/jbcs.12.26] [Citation(s) in RCA: 29] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
BACKGROUND Liver metastases from breast cancer are associated with a poor prognosis, however, local control with microwave thermocoagulation therapy has been used in certain subgroups of these patients in the past decade. In this study, open-configuration magnetic resonance (MR) -guided microwave thermocoagulation therapy was used for metastatic liver tumors from breast cancer, and the efficacy of this treatment was assessed. METHODS Between June 2000 and April 2004, we used MR-guided microwave thermocoagulation therapy on 11 nodules in 8 patients with metastatic liver tumors from breast cancer. The procedure was carried out under general anesthesia. A 0.5 T open-configuration MR system and a microwave coagulator were used. Near-real-time MR images and real-time temperature images were collected and displayed on the monitor. The MR-compatible thoracoscope was used and combined with MR imaging guidance. Navigation software, a 3D Slicer, was installed and customized. RESULTS The customized navigation software displayed near-real-time MR images. The percutaneous puncture into the tumors was successful in all cases. No mortality or major complications occurred as a result of the procedures. Five of the 8 patients are alive with new metastatic foci with a mean observation period of 25.9 months. CONCLUSIONS We developed several devices to allow safe, easy, and accurate MR-guided microwave thermocoagulation therapy of liver tumors. Open-configuration MR-guided microwave thermocoagulation therapy appears to be a feasible method for tumor ablation of metastatic liver tumors from breast cancer.
Collapse
Affiliation(s)
- Hajime Abe
- Division of General Surgery, Department of Surgery, Shiga University of Medical Science, Seta-Tsukinowa, Otsu, Shiga, 520-2192, Japan.
| | | | | | | | | | | | | | | | | | | |
Collapse
|
32
|
Pitiot A, Bardinet E, Thompson PM, Malandain G. Piecewise affine registration of biological images for volume reconstruction. Med Image Anal 2005; 10:465-83. [PMID: 15963755 DOI: 10.1016/j.media.2005.03.008] [Citation(s) in RCA: 56] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2004] [Revised: 01/26/2005] [Accepted: 03/04/2005] [Indexed: 11/25/2022]
Abstract
This manuscript tackles the reconstruction of 3-D volumes via mono-modal registration of series of 2-D biological images (histological sections, autoradiographs, cryosections, etc.). The process of acquiring these images typically induces composite transformations that we model as a number of rigid or affine local transformations embedded in an elastic one. We propose a registration approach closely derived from this model. Given a pair of input images, we first compute a dense similarity field between them with a block matching algorithm. We use as a similarity measure an extension of the classical correlation coefficient that improves the consistency of the field. A hierarchical clustering algorithm then automatically partitions the field into a number of classes from which we extract independent pairs of sub-images. Our clustering algorithm relies on the Earth mover's distribution metric and is additionally guided by robust least-square estimation of the transformations associated with each cluster. Finally, the pairs of sub-images are, independently, affinely registered and a hybrid affine/non-linear interpolation scheme is used to compose the output registered image. We investigate the behavior of our approach on several batches of histological data and discuss its sensitivity to parameters and noise.
Collapse
Affiliation(s)
- Alain Pitiot
- Mirada Solutions, Ltd., Level 1, 23-38 Hythe Bridge Street, Oxford, OX1 2EP, United Kingdom.
| | | | | | | |
Collapse
|
33
|
Verhey JF, Wisser J, Keller T, Westin CF, Kikinis R. Rigid overlay of volume sonography and MR image data of the female pelvic floor using a fiducial based alignment—feasibility due to a case series. Comput Med Imaging Graph 2005; 29:243-9. [PMID: 15890251 DOI: 10.1016/j.compmedimag.2004.10.006] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2004] [Accepted: 10/26/2004] [Indexed: 10/25/2022]
Abstract
The visual combination of different medical image acquisition techniques (modalities) can lead to new modalities with enhanced informative content. In this paper, we present an overlay technique of magnetic resonance (MR) and 3D US image data sets of the female anal canal (internal and external sphincter) as a base for a new diagnostic modality. It is a new field of the application of the overlay technique. Three corresponding MR and US volume data sets from the female pelvic floor region were filtered using adaptive filtering techniques and overlayed (=registered rigidly) with a landmark based alignment method.
Collapse
Affiliation(s)
- Janko F Verhey
- Department of Medical Informatics, University of Goettingen, Robert-Koch-Str. 40, D-37075 Goettingen, Germany.
| | | | | | | | | |
Collapse
|
34
|
Schulz T, Tröbs RB, Schneider JP, Hirsch W, Puccini S, Schmidt F, Kahn T. Pediatric MR-guided interventions. Eur J Radiol 2005; 53:57-66. [PMID: 15607853 DOI: 10.1016/j.ejrad.2004.07.024] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2004] [Revised: 07/20/2004] [Accepted: 07/26/2004] [Indexed: 11/16/2022]
Abstract
MRI guided interventions are a relatively new but steadily growing field within surgery in pediatric age. Besides the advantages of MRI, such as multiplanar capability and excellent soft tissue contrast and spatial resolution, particularly relevant for the pediatric population is the lack of ionizing radiation. There is meanwhile a group of well defined diagnostic or therapeutic indications for applying MR imaging during pediatric interventions. Aim of this review is to give an overview about indications of MR-guided procedures in children as well as the advantages and disadvantages of MR-guided interventions. We also briefly discuss interventional MR-systems and MR-compatible devices. It is our opinion that MR-guidance for pediatric interventions is a promising technique at the beginning of its development.
Collapse
Affiliation(s)
- T Schulz
- University of Leipzig, Department of Diagnostic Radiology, Liebigstrasse 20, 04103 Leipzig, Germany.
| | | | | | | | | | | | | |
Collapse
|
35
|
Verhey JF, Wisser J, Warfield SK, Rexilius J, Kikinis R. Non-rigid registration of a 3D ultrasound and a MR image data set of the female pelvic floor using a biomechanical model. Biomed Eng Online 2005; 4:19. [PMID: 15777475 PMCID: PMC1079899 DOI: 10.1186/1475-925x-4-19] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2005] [Accepted: 03/18/2005] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND The visual combination of different modalities is essential for many medical imaging applications in the field of Computer-Assisted medical Diagnosis (CAD) to enhance the clinical information content. Clinically, incontinence is a diagnosis with high clinical prevalence and morbidity rate. The search for a method to identify risk patients and to control the success of operations is still a challenging task. The conjunction of magnetic resonance (MR) and 3D ultrasound (US) image data sets could lead to a new clinical visual representation of the morphology as we show with corresponding data sets of the female anal canal with this paper. METHODS We present a feasibility study for a non-rigid registration technique based on a biomechanical model for MR and US image data sets of the female anal canal as a base for a new innovative clinical visual representation. RESULTS It is shown in this case study that the internal and external sphincter region could be registered elastically and the registration partially corrects the compression induced by the ultrasound transducer, so the MR data set showing the native anatomy is used as a frame for the US data set showing the same region with higher resolution but distorted by the transducer CONCLUSION The morphology is of special interest in the assessment of anal incontinence and the non-rigid registration of normal clinical MR and US image data sets is a new field of the adaptation of this method incorporating the advantages of both technologies.
Collapse
Affiliation(s)
- Janko F Verhey
- Department of Medical Informatics, University Hospital Goettingen, Germany
| | - Josef Wisser
- Department of Obstetrics, University Hospital Zuerich, Switzerland
| | - Simon K Warfield
- Surgical Planning Laboratory, Department of Radiology, Brigham and Women's Hospital, Boston, USA
| | - Jan Rexilius
- MeVis – Center for Medical Diagnostic Systems and Visualization, Bremen, Germany
| | - Ron Kikinis
- Surgical Planning Laboratory, Department of Radiology, Brigham and Women's Hospital, Boston, USA
| |
Collapse
|
36
|
Tsekos NV, Ozcan A, Christoforou E. A Prototype Manipulator for Magnetic Resonance-Guided Interventions Inside Standard Cylindrical Magnetic Resonance Imaging Scanners. J Biomech Eng 2005; 127:972-80. [PMID: 16438235 DOI: 10.1115/1.2049339] [Citation(s) in RCA: 51] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The aim of this work is to develop a remotely controlled manipulator to perform minimally invasive diagnostic and therapeutic interventions in the abdominal and thoracic cavities, with real-time magnetic resonance imaging (MRI) guidance inside clinical cylindrical MR scanners. The manipulator is composed of a three degree of freedom Cartesian motion system, which resides outside the gantry of the scanner, and serves as the holder and global positioner of a three degree of freedom arm which extends inside the gantry of the scanner At its distal end, the arm's end-effector can carry an interventional tool such as a biopsy needle, which can be advanced to a desired depth by means of a seventh degree of freedom. These seven degrees of freedom, provided by the entire assembly, offer extended manipulability to the device and a wide envelope of operation to the user, who can select a trajectory suitable for the procedure. The device is constructed of nonmagnetic and nonconductive fiberglass, and carbon fiber composite materials, to minimize artifacts and distortion on the MR images as well as eliminate effects on its operation from the high magnetic field and the fast switching magnetic field gradients used in MR imaging. A user interface was developed for man-in-the-loop control of the device using real-time MR images. The user interface fuses all sensor signals (MR and manipulator information) in a visualization, planning, and control command environment. Path planning is performed with graphical tools for setting the trajectory of insertion of the interventional tool using multislice and/or three dimensional MR images which are refreshed in real time. The device control is performed with an embedded computer which runs real-time control software. The manipulator compatibility with the MR environment and image-guided operation was tested on a 1.5 T MR scanner.
Collapse
Affiliation(s)
- Nikolaos V Tsekos
- Cardiovascular Imaging Laboratory, Mallinckrodt Institute of Radiology and Department of Biomedical Engineering, Washington University, Room 1300, CB 8225, 4525 Scott Avenue, St. Louis, MO 63110, USA.
| | | | | |
Collapse
|
37
|
Abstract
MRI-guided neurosurgery not only represents a technical challenge but a transformation from conventional hand-eye coordination to interactive navigational operations. In the future, multimodality-based images will be merged into a single model, in which anatomy and pathologic changes are at once distinguished and integrated into the same intuitive framework. The long-term goals of improving surgical procedures and attendant outcomes, reducing costs, and achieving broad use can be achieved with a three-pronged approach: 1. Improving the presentation of preoperative and real-time intraoperative image information 2. Integrating imaging and treatment-related technology into therapy delivery systems 3. Testing the clinical utility of image guidance in surgery The recent focus in technology development is on improving our ability to understand and apply medical images and imaging systems. Areas of active research include image processing, model-based image analysis, model deformation, real-time registration, real-time 3D (so-called "four-dimensional") imaging, and the integration and presentation of image and sensing information in the operating room. Key elements of the technical matrix also include visualization and display platforms and related software for information and display, model-based image understanding, the use of computing clusters to speed computation (ie, algorithms with partitioned computation to optimize performance), and advanced devices and systems for 3D device tracking (navigation). Current clinical applications are successfully incorporating real-time and/or continuously up-dated image-based information for direct intra-operative visualization. In addition to using traditional imaging systems during surgery, we foresee optimized use of molecular marker technology, direct measures of tissue characterization (ie, optical measurements and/or imaging), and integration of the next generation of surgical and therapy devices (including image-guided robotic systems). Although we expect the primary clinical thrusts of MRI-guided therapy to remain in neurosurgery, with the possible addition of other areas like orthopedic, head, neck, and spine surgery, we also anticipate increased use of image-guided focal thermal ablative methods (eg, laser, RF, cryoablation, high-intensity focused ultrasound). By validating the effectiveness of MRI-guided therapy in specific clinical procedures while refining the technology that serves as its underpinning at the same time, we expect many neurosurgeons will eventually embrace MRI as their intraoperative imaging choice. Clearly, intraoperative MRI offers several palpable advantages. Most important among these are improved medical outcomes, shorter hospitalization, and better and faster procedures with fewer complications. Certain economic and practical barriers also impede the large-scale use of intraoperative MRI. Although there has been a concerted technical effort to increase the benefit/cost ratio by gathering more accurate information, designing more localized and less invasive treatment devices, and developing better methods to orient and position therapy end-effectors, further research is needed. Indeed, the drive to improve and upgrade technology is ongoing. Specifically, in the context of the real-time representation of the patient's anatomy, we have improved the quality and utility of the information presented to the surgeon, which, in turn, contributes to more successful surgical outcomes. We can also expect improvements in intraoperative imaging systems as well as increased use of nonimaging sensors and robotics to facilitate more widespread use of intraoperative MRI.
Collapse
Affiliation(s)
- Ferenc A Jolesz
- Division of MRI and Image Guided Therapy Program, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, 75 Francis Street, Boston, MA 02115, USA.
| |
Collapse
|
38
|
Sato K, Morikawa S, Inubushi T, Kurumi Y, Naka S, Haque HA, Demura K, Tani T. Alternate Biplanar MR Navigation for Microwave Ablation of Liver Tumors. Magn Reson Med Sci 2005; 4:89-94. [PMID: 16340163 DOI: 10.2463/mrms.4.89] [Citation(s) in RCA: 26] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022] Open
Abstract
Real-time MR (magnetic resonance) images in two perpendicular planes, both of which included the path of the needle, were utilized for MR-guided microwave ablation of liver tumors. The two image planes were automatically and alternately switched by new MR scanner control software installed on an external PC. This technique is possible only with MRI (magnetic resonance imaging) units with multiplanar and multisection capabilities. Reformatted images in the corresponding two planes were also constructed from preoperative three-dimensional volume data. These four images (two real-time and two reformatted) were continuously visible to the surgeons. These images enabled the needle position in the three-dimensional space to be accurately and clearly recognized, in contrast to the difficulty encountered with two-dimensional MR images in a single image plane. This technique was also applied to MR temperature mapping during microwave ablation, as it allowed monitoring of the spread of the heat in a three-dimensional space. This type of computer-integrated image navigation was demonstrated to be feasible for MR-guided microwave ablation of liver tumors.
Collapse
Affiliation(s)
- Koichiro Sato
- Department of Surgery, Shiga University of Medical Science, Ohtsu, Shiga 520-2192, Japan.
| | | | | | | | | | | | | | | |
Collapse
|
39
|
Oh DS, Black PM. A low-field intraoperative MRI system for glioma surgery: is it worthwhile? Neurosurg Clin N Am 2005; 16:135-41. [PMID: 15561533 DOI: 10.1016/j.nec.2004.07.010] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
As intraoperative MRI expands its presence, its use will undoubtedly increase in glioma surgery. The foregoing discussion makes it clear that its benefits are unsurpassed by any other existing system. Because of their radiographic characteristics and gross appearance, gliomas are particularly suited for intraoperative MRI-guided surgery. It enables us to localize gliomas and define tumor margins precisely when, during surgery, the difference between tumor and brain is not easy to discern. The images generated during surgery serve as a detailed and updated map within which navigation is performed with utmost precision. Its significance is further highlighted when dealing with tumors in eloquent areas of the brain, where uncertainties over the location of tumor in relation to important brain structures can hinder the removal of tumor. By providing accurate positional information and in conjunction with cortical mapping techniques, intraoperative MRI enhances the confidence of the surgeon to go forward with resection or to stop when reaching important cortex. It allows us to perform the resection to the desired limit without causing injury to nearby important structures, thereby preventing postoperative neurologic deficits. The tracking system guides us in targeting each minute part of the tumor with unprecedented accuracy, and the ability to update images makes possible the constant evaluation of the progress of surgery. This near-real-time imaging can eliminate the errors brought about by the brain shifting that occurs throughout surgery. It also serves the important purpose of verifying the presence and position of any remaining tumor in the operative field. By means of sequential imaging, additional resection can be performed on any remaining tumor until imaging shows completion. The unwanted occurrence of finding residual tumor on a postoperative scan is thus practically eliminated. As a result, the surgical goal of complete or optimal resection can be achieved without any guesswork. Ultimately, what this means for the glioma patient is increased likelihood of longer survival brought about by a more thorough tumor resection. Intraoperative MRI addresses many of the surgical challenges posed by gliomas. As it becomes more available, there will come a point when the prevailing persuasion will be that some poorly defined tumors near eloquent cortex should not be operated on without intraoperative MRI. In the final analysis, not only is intraoperative MRI worthwhile but it will, in all likelihood, become a standard of care for many glioma cases.
Collapse
Affiliation(s)
- Dennis S Oh
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis Street, Boston, MA 02115, USA.
| | | |
Collapse
|
40
|
Schulz T, Puccini S, Schneider JP, Kahn T. Interventional and intraoperative MR: review and update of techniques and clinical experience. Eur Radiol 2004; 14:2212-27. [PMID: 15480689 DOI: 10.1007/s00330-004-2496-9] [Citation(s) in RCA: 49] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2004] [Revised: 08/12/2004] [Accepted: 08/16/2004] [Indexed: 11/30/2022]
Abstract
The concept of interventional magnetic resonance imaging (MRI) is based on the integration of diagnostic and therapeutic procedures, favored by the combination of the excellent morphological and functional imaging characteristics of MRI. The spectrum of MRI-assisted interventions ranges from biopsies and intraoperative guidance to thermal ablation modalities and vascular interventions. The most relevant recently published experimental and clinical results are discussed. In the future, interventional MRI is expected to play an important role in interventional radiology, minimal invasive therapy and guidance of surgical procedures. However, the associated high costs require a careful evaluation of its potentials in order to ensure cost-effective medical care.
Collapse
Affiliation(s)
- Thomas Schulz
- Department of Diagnostic Radiology, Leipzig University Hospital, Liebigstrasse 20, 04103 Leipzig, Germany.
| | | | | | | |
Collapse
|
41
|
Morikawa S, Inubushi T, Kurumi Y, Naka S, Sato K, Demura K, Tani T, Haque HA, Tokuda J, Hata N. Advanced computer assistance for magnetic resonance-guided microwave thermocoagulation of liver tumors. Acad Radiol 2003; 10:1442-9. [PMID: 14697012 DOI: 10.1016/s1076-6332(03)00508-7] [Citation(s) in RCA: 30] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
RATIONALE AND OBJECTIVES The purpose of this study was to utilize computer assistance effectively for both easy and accurate magnetic resonance (MR) image-guided microwave thermocoagulation therapy of liver tumors. MATERIALS AND METHODS An open configuration MR scanner and a microwave coagulator at 2.45 GHz were used. Navigation software, a 3D Slicer, was customized to combine fluoroscopic MR images and preoperative MR images for the navigation. New functions to display MR temperature maps with simple parameter setting, and to record and display the coagulated areas by multiple microwave ablations in the 3-dimensional space (footprinting), were also introduced into the software. The VGA signal of the computer display was directly transferred to the surgeon's monitor. RESULTS The customized software could be used for both accurate image navigation and convenient and easy temperature monitoring. Because repeated punctures and ablations are usually required in this procedure, the footprinting function made targeting of the tumors both easy and accurate and was quite effective in achieving the necessary and sufficient treatment. Furthermore, clear display on the surgeon's monitor, which was obtained by direct transfer of the VGA signal, enabled precise image navigation. CONCLUSION The newly developed computer assistance was quite useful and helpful for this MR-guided procedure.
Collapse
Affiliation(s)
- Shigehiro Morikawa
- Molecular Neuroscience Research Center, Shiga University of Medical Science, Seta Tsukinowa-cho, Ohtsu, Shiga 520-2192, Japan
| | | | | | | | | | | | | | | | | | | |
Collapse
|
42
|
Lazebnik RS, Lancaster TL, Breen MS, Lewin JS, Wilson DL. Volume registration using needle paths and point landmarks for evaluation of interventional MRI treatments. IEEE TRANSACTIONS ON MEDICAL IMAGING 2003; 22:653-660. [PMID: 12846434 DOI: 10.1109/tmi.2003.812246] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
We created a method for three-dimensional (3-D) registration of medical images (e.g., magnetic resonance imaging (MRI) or computed tomography) to images of physical tissue sections or to other medical images and evaluated its accuracy. Our method proved valuable for evaluation of animal model experiments on interventional-MRI guided thermal ablation and on a new localized drug delivery system. The method computes an optimum set of rigid body registration parameters by minimization of the Euclidean distances between automatically chosen correspondence points, along manually selected fiducial needle paths, and optional point landmarks, using the iterative closest point algorithm. For numerically simulated experiments, using two needle paths over a range of needle orientations, mean voxel displacement errors depended mostly on needle localization error when the angle between needles was at least 20 degrees. For parameters typical of our in vivo experiments, the mean voxel displacement error was < 0.35 mm. In addition, we determined that the distance objective function was a useful diagnostic for predicting registration quality. To evaluate the registration quality of physical specimens, we computed the misregistration for a needle not considered during the optimization procedure. We registered an ex vivo sheep brain MR volume with another MR volume and tissue section photographs, using various combinations of needle and point landmarks. Mean registration error was always < or = 0.54 mm for MR-to-MR registrations and < or = 0.52 mm for MR to tissue section registrations. We also applied the method to correlate MR volumes of radio-frequency induced thermal ablation lesions with actual tissue destruction. In this case, in vivo rabbit thigh volumes were registered to photographs of ex vivo tissue sections using two needle paths. Mean registration errors were between 0.7 and 1.36 mm over all rabbits, the largest error less than two MR voxel widths. We conclude that our method provides sufficient spatial correspondence to facilitate comparison of 3-D image data with data from gross pathology tissue sections and histology.
Collapse
Affiliation(s)
- Roee S Lazebnik
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH 44106-7207 USA
| | | | | | | | | |
Collapse
|
43
|
Nabavi A, Gering DT, Kacher DF, Talos IF, Wells WM, Kikinis R, Black PM, Jolesz FA. Surgical navigation in the open MRI. ACTA NEUROCHIRURGICA. SUPPLEMENT 2003; 85:121-5. [PMID: 12570147 DOI: 10.1007/978-3-7091-6043-5_17] [Citation(s) in RCA: 36] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
The introduction of MRI into neurosurgery has opened multiple avenues, but also introduced new challenges. The open-configuration intraoperative MRI installed at the Brigham and Women's Hospital in 1996 has been used for more than 500 open craniotomies and beyond 100 biopsies. Furthermore the versatile applicability, employing the same principles, is evident by its frequent use in other areas of the body. However, while intraoperative scanning in the SignaSP yielded unprecedented imaging during neurosurgical procedures their usage for navigation proved bulky and unhandy. To be fully integrated into the procedure, acquisition and display of intraoperative data have to be dynamic and primarily driven by the surgeon performing the procedure. To use the benefits of computer-assisted navigation systems together with immediate availability of intraoperative imaging we developed a software package. This "3D Slicer" has been used routinely for biopsies and open craniotomies. The system is stable and reliable. Pre- and intraoperative data can be visualized to plan and perform surgery, as well as to accommodate for intraoperative deformations, "brain shift", by providing online data acquisition.
Collapse
Affiliation(s)
- A Nabavi
- Department of Neurosurgery, University Kiel, Kiel, Germany
| | | | | | | | | | | | | | | |
Collapse
|
44
|
Abstract
Of all the advances in imaging science in the past twenty years, none has had a greater impact than Magnetic Resonance Imaging. Since its introduction as a diagnostic tool in the mid-1980's, MRI has evolved into the premier neuroimaging modality, and with the addition of higher field magnets, we are able to achieve spatial resolution of such superb quality that even the most exquisite details of the brain anatomy can be visualized. With the implementation of intraoperative, neurosurgical MRI, we can not only monitor brain shifts and deformations; we can achieve intraoperative navigation using intraoperative image updates. In the future, intraoperative MRI can be used not only to localize, target, and resect brain tumors and other lesions but also to fully comprehend the surrounding cortical and white matter functional anatomy. In addition to the inclusion of new imaging methods such as diffusion tensor imaging, new therapeutic methods will be applied. Especially encouraging are the promising results in MRI-guided Focused Ultrasound Surgery, in which the non-invasive thermal ablation of tumors is monitored and controlled by MRI. With the clinical introduction of these advances, intraoperative MRI is changing the face of Neurosurgery today.
Collapse
Affiliation(s)
- F A Jolesz
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
45
|
Morikawa S, Inubushi T, Kurumi Y, Naka S, Sato K, Tani T, Haque HA, Tokuda JI, Hata N. New assistive devices for MR-guided microwave thermocoagulation of liver tumors. Acad Radiol 2003; 10:180-8. [PMID: 12583570 DOI: 10.1016/s1076-6332(03)80043-0] [Citation(s) in RCA: 31] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
RATIONALE AND OBJECTIVES The purpose of this study was to develop and test new assistive devices to aid in the performance of safe, easy, and accurate microwave thermocoagulation therapy guided by magnetic resonance (MR) imaging. MATERIALS AND METHODS An open-configuration MR imager with an optical tracking system for image plane control and a microwave coagulator operating at 2.45 GHz were used. Liver tumors were percutaneously punctured under the guidance of MR images and ablated. Handpiece adapters were then prepared for the optical tracking system. An MR-compatible endoscopic system also was used. Navigation software was installed and customized. These devices were combined to provide near-real-time MR image-guided navigation during thermocoagulation therapy for liver tumors. RESULTS The handpiece adapters improved the flexibility of approaches for percutaneous puncture of tumors. The MR-compatible endoscope was used as a thoracoscope, and tumors just below the diaphragm were safely and easily punctured through the diaphragm. The customized navigation software displayed near-real-time MR images together with two reformatted images (on the same plane and on a perpendicular plane) from the registered high-resolution three-dimensional data, enabling accurate MR imaging navigation. CONCLUSION These new assistive devices made it easier to perform safe, easy, and accurate MR-guided thermocoagulation therapy of liver tumors.
Collapse
Affiliation(s)
- Shigehiro Morikawa
- Molecular Neuroscience Research Center, Shiga University of Medical Science, Seta Tsukinowa-cho, Ohtsu, Shiga 520-2192, Japan
| | | | | | | | | | | | | | | | | |
Collapse
|
46
|
Gray CF, Redpath TW, Smith FW, Staff RT. Advanced imaging: Magnetic resonance imaging in implant dentistry. Clin Oral Implants Res 2003; 14:18-27. [PMID: 12562361 DOI: 10.1034/j.1600-0501.2003.140103.x] [Citation(s) in RCA: 54] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
For accurate and safe placement of dental implants, and planning of associated surgery, a full assessment of the surgical anatomy of the site is necessary. Thus, it is highly desirable to have tomographic, sectional information available, to permit the implant to be aligned correctly. In recent years, X-ray computed tomography (CT) has become accepted as the gold standard in assessment, but the exposure to ionising radiation can be substantial. Artefacts due to dental restorations can also be significant, and some doubts may exist over the accuracy of reformatted CT. Magnetic resonance imaging (MRI) entails no exposure to ionising radiation, and allows direct acquisition of tomographic information in any desired plane. Sequential studies may be safely performed, allowing us a valuable insight into bone graft behaviour. Other than in a small number of cases, MRI may be safely used for presurgical assessments. Artefacts are few and in most cases localised. The surgical confidence from the sectional information gained is a significant step forward in the safe placement of dental implants.
Collapse
Affiliation(s)
- Crawford F Gray
- Department of Bio-Medical Physics and Bio-Engineering, University of Aberdeen, Scotland
| | | | | | | |
Collapse
|
47
|
Abstract
Parallel with current applications in minimally invasive surgery, the introduction of new imaging modalities, and the availability of high-performance computing, new image-guided therapies are being developed at an impressive rate. Indeed, across a broad front of imaging technologies, rapid advances are being realized. Vastly refined technology for processing and using images, as well as improved therapeutic end-effectors, have no doubt hastened this remarkable progress. At the same time, advances in clinical evaluation and complementary technologies will provide the necessary infrastructure through which IGT can be applied in diverse therapeutic settings--from the already well-established neurosurgical applications to the thermal ablation of tumors in organs other than the brain. That IGT is more efficient and effective and less expensive than conventional surgery has been confirmed both in extensive, long-term studies and in ongoing, revolutionary applications in the operating room. We have laid critical groundwork with this extraordinary technology and have now begun to realize quantifiable benefits in terms of improved surgical and patient outcomes.
Collapse
Affiliation(s)
- Kirby G Vosburgh
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115, USA
| | | |
Collapse
|
48
|
An Autostereoscopic Display System for Image-Guided Surgery Using High-Quality Integral Videography with High Performance Computing. ACTA ACUST UNITED AC 2003. [DOI: 10.1007/978-3-540-39903-2_31] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register]
|
49
|
|
50
|
Abstract
PURPOSE OF REVIEW The capabilities of interventional radiology are developing faster than perhaps any other branch of medicine. Coupled with and fuelled by parallel advances in computer technology, medical physics and developments in endovascular catheter technology, interventional radiologists are innovating not only replacements for open surgeries, but entirely new therapies as well. This has, however, provided a range of new potential complications for the patient and, in contrast to other areas, presents risks for the anesthesiologist as well. RECENT FINDINGS The techniques involved in interventional radiology have found applications throughout not only medicine but surgery in particular. Here there has been a medicalization of surgical procedures. CT scanning has evolved to the extent that it is now possible to utilize multislice CT scanners, ones with multiple, flat panel digital detectors, to provide real time CT fluoroscopy. Similarly this technology has facilitated the construction of hybrid iMR/X-ray systems, thus enabling dual modality imaging without moving the patient. Another facet of the new breed of iMR systems is their integration in real time with computerized, frameless stereotactic navigation systems. This has enabled the radiological image to keep pace with the changes in anatomy consequent to anesthetic and surgical manipulations. SUMMARY In the light of these new developments in interventional radiology there is much research to be done. Further developments in imaging and computer processing technology will doubtless make possible the real time integration of anatomical image with metabolic state and functional anatomy. The impact of the hazards of these new techniques on the safety of anesthesia has, however, been the subject of virtually no research. A particularly needy area will be the ergonomics of the delivery of anesthesia care in these new environments.
Collapse
|