1
|
Windolf C, Yu H, Paulk AC, Meszéna D, Muñoz W, Boussard J, Hardstone R, Caprara I, Jamali M, Kfir Y, Xu D, Chung JE, Sellers KK, Ye Z, Shaker J, Lebedeva A, Raghavan RT, Trautmann E, Melin M, Couto J, Garcia S, Coughlin B, Elmaleh M, Christianson D, Greenlee JDW, Horváth C, Fiáth R, Ulbert I, Long MA, Movshon JA, Shadlen MN, Churchland MM, Churchland AK, Steinmetz NA, Chang EF, Schweitzer JS, Williams ZM, Cash SS, Paninski L, Varol E. DREDge: robust motion correction for high-density extracellular recordings across species. Nat Methods 2025; 22:788-800. [PMID: 40050699 DOI: 10.1038/s41592-025-02614-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 01/24/2025] [Indexed: 03/12/2025]
Abstract
High-density microelectrode arrays have opened new possibilities for systems neuroscience, but brain motion relative to the array poses challenges for downstream analyses. We introduce DREDge (Decentralized Registration of Electrophysiology Data), a robust algorithm for the registration of noisy, nonstationary extracellular electrophysiology recordings. In addition to estimating motion from action potential data, DREDge enables automated, high-temporal-resolution motion tracking in local field potential data. In human intraoperative recordings, DREDge's local field potential-based tracking reliably recovered evoked potentials and single-unit spike sorting. In recordings of deep probe insertions in nonhuman primates, DREDge tracked motion across centimeters of tissue and several brain regions while mapping single-unit electrophysiological features. DREDge reliably improved motion correction in acute mouse recordings, especially in those made with a recent ultrahigh-density probe. Applying DREDge to recordings from chronic implantations in mice yielded stable motion tracking despite changes in neural activity between experimental sessions. These advances enable automated, scalable registration of electrophysiological data across species, probes and drift types, providing a foundation for downstream analyses of these rich datasets.
Collapse
Affiliation(s)
- Charlie Windolf
- Department of Statistics, Columbia University, New York City, NY, USA.
- Zuckerman Institute, Columbia University, New York City, NY, USA.
| | - Han Yu
- Zuckerman Institute, Columbia University, New York City, NY, USA
- Department of Electrical Engineering, Columbia University, New York City, NY, USA
| | - Angelique C Paulk
- Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Domokos Meszéna
- Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
- Institute of Cognitive Neuroscience and Psychology, HUN-REN Research Centre for Natural Sciences, Budapest, Hungary
| | - William Muñoz
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Julien Boussard
- Department of Statistics, Columbia University, New York City, NY, USA
- Zuckerman Institute, Columbia University, New York City, NY, USA
| | - Richard Hardstone
- Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Irene Caprara
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Mohsen Jamali
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Yoav Kfir
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Duo Xu
- Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA, USA
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
| | - Jason E Chung
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
| | - Kristin K Sellers
- Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA, USA
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
| | - Zhiwen Ye
- Department of Neurobiology and Biophysics, University of Washington, Seattle, WA, USA
| | - Jordan Shaker
- Department of Neurobiology and Biophysics, University of Washington, Seattle, WA, USA
| | | | - R T Raghavan
- Center for Neural Science, New York University, New York City, NY, USA
| | - Eric Trautmann
- Zuckerman Institute, Columbia University, New York City, NY, USA
- Department of Neuroscience, Columbia University Medical Center, New York City, NY, USA
- Grossman Center for the Statistics of Mind, Columbia University, New York City, NY, USA
- CTRL-Labs at Reality Labs, Seattle, WA, USA
- Department of Neurological Surgery, University of California, Davis, Davis, CA, USA
| | - Max Melin
- David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
| | - João Couto
- David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
| | - Samuel Garcia
- Centre National de la Recherche Scientifique, Centre de Recherche en Neurosciences de Lyon, Lyon, France
| | - Brian Coughlin
- Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Margot Elmaleh
- NYU Neuroscience Institute and Department of Otolaryngology, New York University Langone Medical Center, New York City, NY, US
| | - David Christianson
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA, USA
| | - Jeremy D W Greenlee
- Department of Neurosurgery, University of Iowa Hospitals and Clinics, Iowa City, IA, USA
| | - Csaba Horváth
- Institute of Cognitive Neuroscience and Psychology, HUN-REN Research Centre for Natural Sciences, Budapest, Hungary
| | - Richárd Fiáth
- Institute of Cognitive Neuroscience and Psychology, HUN-REN Research Centre for Natural Sciences, Budapest, Hungary
| | - István Ulbert
- Institute of Cognitive Neuroscience and Psychology, HUN-REN Research Centre for Natural Sciences, Budapest, Hungary
- Department of Information Technology and Bionics, Péter Pázmány Catholic University, Budapest, Hungary
- Department of Neurosurgery and Neurointervention, Faculty of Medicine, Semmelweis University, Budapest, Hungary
| | - Michael A Long
- NYU Neuroscience Institute and Department of Otolaryngology, New York University Langone Medical Center, New York City, NY, US
| | - J Anthony Movshon
- Center for Neural Science, New York University, New York City, NY, USA
| | - Michael N Shadlen
- Zuckerman Institute, Columbia University, New York City, NY, USA
- Howard Hughes Medical Institute, Chevy Chase, MD, USA
| | - Mark M Churchland
- Zuckerman Institute, Columbia University, New York City, NY, USA
- Department of Neuroscience, Columbia University Medical Center, New York City, NY, USA
- Grossman Center for the Statistics of Mind, Columbia University, New York City, NY, USA
- Kavli Institute for Brain Science, Columbia University, New York City, NY, USA
| | - Anne K Churchland
- David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA
| | - Nicholas A Steinmetz
- Department of Neurobiology and Biophysics, University of Washington, Seattle, WA, USA
| | - Edward F Chang
- Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA, USA
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
| | - Jeffrey S Schweitzer
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Ziv M Williams
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Sydney S Cash
- Department of Neurology, Center for Neurotechnology and Neurorecovery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Liam Paninski
- Department of Statistics, Columbia University, New York City, NY, USA
- Zuckerman Institute, Columbia University, New York City, NY, USA
- Department of Neuroscience, Columbia University Medical Center, New York City, NY, USA
- Grossman Center for the Statistics of Mind, Columbia University, New York City, NY, USA
| | - Erdem Varol
- Department of Statistics, Columbia University, New York City, NY, USA
- Zuckerman Institute, Columbia University, New York City, NY, USA
- Department of Computer Science & Engineering, New York University, New York City, NY, USA
| |
Collapse
|
2
|
Drakopoulos F, Liu Y, Garner K, Chrisochoides N. Image-to-mesh conversion method for multi-tissue medical image computing simulations. ENGINEERING WITH COMPUTERS 2024; 40:3979-4005. [PMID: 39717418 PMCID: PMC11666122 DOI: 10.1007/s00366-024-02023-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Accepted: 07/01/2024] [Indexed: 12/25/2024]
Abstract
Converting a three-dimensional medical image into a 3D mesh that satisfies both the quality and fidelity constraints of predictive simulations and image-guided surgical procedures remains a critical problem. Presented is an image-to-mesh conversion method called CBC3D. It first discretizes a segmented image by generating an adaptive Body-Centered Cubic (BCC) mesh of high-quality elements. Next, the tetrahedral mesh is converted into a mixed-element mesh of tetrahedra, pentahedra, and hexahedra to decrease element count while maintaining quality. Finally, the mesh surfaces are deformed to their corresponding physical image boundaries, improving the mesh's fidelity. The deformation scheme builds upon the ITK open-source library and is based on the concept of energy minimization, relying on a multi-material point-based registration. It uses non-connectivity patterns to implicitly control the number of extracted feature points needed for the registration and, thus, adjusts the trade-off between the achieved mesh fidelity and the deformation speed. We compare CBC3D with four widely used and state-of-the-art homegrown image-to-mesh conversion methods from industry and academia. Results indicate that the CBC3D meshes (i) achieve high fidelity, (ii) keep the element count reasonably low, and (iii) exhibit good element quality.
Collapse
Affiliation(s)
- Fotis Drakopoulos
- Center for Real-Time Computing, Department of Computer Science, Old Dominion University, Norfolk, VA, United States of America
| | - Yixun Liu
- Center for Real-Time Computing, Department of Computer Science, Old Dominion University, Norfolk, VA, United States of America
| | - Kevin Garner
- Center for Real-Time Computing, Department of Computer Science, Old Dominion University, Norfolk, VA, United States of America
| | - Nikos Chrisochoides
- Center for Real-Time Computing, Department of Computer Science, Old Dominion University, Norfolk, VA, United States of America
| |
Collapse
|
3
|
Zigiotto L, Amorosino G, Saviola F, Jovicich J, Annicchiarico L, Rozzanigo U, Olivetti E, Avesani P, Sarubbo S. Spontaneous unilateral spatial neglect recovery after brain tumour resection: A multimodal diffusion and rs-fMRI case report. J Neuropsychol 2024; 18 Suppl 1:91-114. [PMID: 37431064 DOI: 10.1111/jnp.12339] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2023] [Accepted: 05/25/2023] [Indexed: 07/12/2023]
Abstract
Patients with unilateral spatial neglect (USN) are unable to explore or to report stimuli presented in the left personal and extra-personal space. USN is usually caused by lesion of the right parietal lobe: nowadays, it is also clear the key role of structural connections (the second and the third branch of the right Superior Longitudinal Fasciculus, respectively, SLF II and III) and functional networks (Dorsal and Ventral Attention Network, respectively, DAN and VAN) in USN. In this multimodal case report, we have merged those structural and functional information derived from a patient with a right parietal lobe tumour and USN before surgery. Functional, structural and neuropsychological data were also collected 6 months after surgery, when the USN was spontaneously recovered. Diffusion metrics and Functional Connectivity (FC) of the right SLF and DAN, before and after surgery, were compared with the same data of a patient with a tumour in a similar location, but without USN, and with a control sample. Results indicate an impairment in the right SLF III and a reduction of FC of the right DAN in patients with USN before surgery compared to controls; after surgery, when USN was recovered, patient's diffusion metrics and FC showed no differences compared to the controls. This single case and its multimodal approach reinforce the crucial role of the right SLF III and DAN in the development and recovery of egocentric and allocentric extra-personal USN, highlighting the need to preserve these structural and functional areas during brain surgery.
Collapse
Affiliation(s)
- Luca Zigiotto
- Department of Neurosurgery, 'S. Chiara' Hospital, Azienda Provinciale per i Servizi Sanitari, Trento, Italy
- Structural and Functional Connectivity Lab Project, 'S. Chiara' Hospital, Azienda Provinciale per i Servizi Sanitari, Trento, Italy
- Department of Psychology, 'S. Chiara' Hospital, Azienda Provinciale per i Servizi Sanitari, Trento, Italy
| | - Gabriele Amorosino
- Neuroinformatics Laboratory (NILab), Bruno Kessler Foundation (FBK), Trento, Italy
- Center for Mind/Brain Sciences-CIMeC, University of Trento, Rovereto, Italy
| | - Francesca Saviola
- Center for Mind/Brain Sciences-CIMeC, University of Trento, Rovereto, Italy
| | - Jorge Jovicich
- Center for Mind/Brain Sciences-CIMeC, University of Trento, Rovereto, Italy
| | - Luciano Annicchiarico
- Department of Neurosurgery, 'S. Chiara' Hospital, Azienda Provinciale per i Servizi Sanitari, Trento, Italy
- Structural and Functional Connectivity Lab Project, 'S. Chiara' Hospital, Azienda Provinciale per i Servizi Sanitari, Trento, Italy
| | - Umberto Rozzanigo
- Department of Neuroradiology, 'S. Chiara' Hospital, Azienda Provinciale per i Servizi Sanitari, Trento, Italy
| | - Emanuele Olivetti
- Neuroinformatics Laboratory (NILab), Bruno Kessler Foundation (FBK), Trento, Italy
- Center for Mind/Brain Sciences-CIMeC, University of Trento, Rovereto, Italy
| | - Paolo Avesani
- Neuroinformatics Laboratory (NILab), Bruno Kessler Foundation (FBK), Trento, Italy
- Center for Mind/Brain Sciences-CIMeC, University of Trento, Rovereto, Italy
| | - Silvio Sarubbo
- Department of Neurosurgery, 'S. Chiara' Hospital, Azienda Provinciale per i Servizi Sanitari, Trento, Italy
- Structural and Functional Connectivity Lab Project, 'S. Chiara' Hospital, Azienda Provinciale per i Servizi Sanitari, Trento, Italy
| |
Collapse
|
4
|
Chrisochoides N, Liu Y, Drakopoulos F, Kot A, Foteinos P, Tsolakis C, Billias E, Clatz O, Ayache N, Fedorov A, Golby A, Black P, Kikinis R. Comparison of physics-based deformable registration methods for image-guided neurosurgery. Front Digit Health 2023; 5:1283726. [PMID: 38144260 PMCID: PMC10740151 DOI: 10.3389/fdgth.2023.1283726] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2023] [Accepted: 11/02/2023] [Indexed: 12/26/2023] Open
Abstract
This paper compares three finite element-based methods used in a physics-based non-rigid registration approach and reports on the progress made over the last 15 years. Large brain shifts caused by brain tumor removal affect registration accuracy by creating point and element outliers. A combination of approximation- and geometry-based point and element outlier rejection improves the rigid registration error by 2.5 mm and meets the real-time constraints (4 min). In addition, the paper raises several questions and presents two open problems for the robust estimation and improvement of registration error in the presence of outliers due to sparse, noisy, and incomplete data. It concludes with preliminary results on leveraging Quantum Computing, a promising new technology for computationally intensive problems like Feature Detection and Block Matching in addition to finite element solver; all three account for 75% of computing time in deformable registration.
Collapse
Affiliation(s)
- Nikos Chrisochoides
- Center for Real-Time Computing, Computer Science Department, Old Dominion University, Norfolk, VA, United States
| | - Yixun Liu
- Center for Real-Time Computing, Computer Science Department, Old Dominion University, Norfolk, VA, United States
| | - Fotis Drakopoulos
- Center for Real-Time Computing, Computer Science Department, Old Dominion University, Norfolk, VA, United States
| | - Andriy Kot
- Center for Real-Time Computing, Computer Science Department, Old Dominion University, Norfolk, VA, United States
| | - Panos Foteinos
- Center for Real-Time Computing, Computer Science Department, Old Dominion University, Norfolk, VA, United States
| | - Christos Tsolakis
- Center for Real-Time Computing, Computer Science Department, Old Dominion University, Norfolk, VA, United States
| | - Emmanuel Billias
- Center for Real-Time Computing, Computer Science Department, Old Dominion University, Norfolk, VA, United States
| | - Olivier Clatz
- Inria, French Research Institute for Digital Science, Sophia Antipolis, Valbonne, France
| | - Nicholas Ayache
- Inria, French Research Institute for Digital Science, Sophia Antipolis, Valbonne, France
| | - Andrey Fedorov
- Center for Real-Time Computing, Computer Science Department, Old Dominion University, Norfolk, VA, United States
- Neuroimaging Analysis Center, Department of Radiology, Harvard Medical School, Boston, MA, United States
| | - Alex Golby
- Neuroimaging Analysis Center, Department of Radiology, Harvard Medical School, Boston, MA, United States
- Image-guided Neurosurgery, Department of Neurosurgery, Harvard Medical School, Boston, MA, United States
| | - Peter Black
- Image-guided Neurosurgery, Department of Neurosurgery, Harvard Medical School, Boston, MA, United States
| | - Ron Kikinis
- Neuroimaging Analysis Center, Department of Radiology, Harvard Medical School, Boston, MA, United States
| |
Collapse
|
5
|
Sollmann N, Zhang H, Kloth C, Zimmer C, Wiestler B, Rosskopf J, Kreiser K, Schmitz B, Beer M, Krieg SM. Modern preoperative imaging and functional mapping in patients with intracranial glioma. ROFO-FORTSCHR RONTG 2023; 195:989-1000. [PMID: 37224867 DOI: 10.1055/a-2083-8717] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/26/2023]
Abstract
Magnetic resonance imaging (MRI) in therapy-naïve intracranial glioma is paramount for neuro-oncological diagnostics, and it provides images that are helpful for surgery planning and intraoperative guidance during tumor resection, including assessment of the involvement of functionally eloquent brain structures. This study reviews emerging MRI techniques to depict structural information, diffusion characteristics, perfusion alterations, and metabolism changes for advanced neuro-oncological imaging. In addition, it reflects current methods to map brain function close to a tumor, including functional MRI and navigated transcranial magnetic stimulation with derived function-based tractography of subcortical white matter pathways. We conclude that modern preoperative MRI in neuro-oncology offers a multitude of possibilities tailored to clinical needs, and advancements in scanner technology (e. g., parallel imaging for acceleration of acquisitions) make multi-sequence protocols increasingly feasible. Specifically, advanced MRI using a multi-sequence protocol enables noninvasive, image-based tumor grading and phenotyping in patients with glioma. Furthermore, the add-on use of preoperatively acquired MRI data in combination with functional mapping and tractography facilitates risk stratification and helps to avoid perioperative functional decline by providing individual information about the spatial location of functionally eloquent tissue in relation to the tumor mass. KEY POINTS:: · Advanced preoperative MRI allows for image-based tumor grading and phenotyping in glioma.. · Multi-sequence MRI protocols nowadays make it possible to assess various tumor characteristics (incl. perfusion, diffusion, and metabolism).. · Presurgical MRI in glioma is increasingly combined with functional mapping to identify and enclose individual functional areas.. · Advancements in scanner technology (e. g., parallel imaging) facilitate increasing application of dedicated multi-sequence imaging protocols.. CITATION FORMAT: · Sollmann N, Zhang H, Kloth C et al. Modern preoperative imaging and functional mapping in patients with intracranial glioma. Fortschr Röntgenstr 2023; 195: 989 - 1000.
Collapse
Affiliation(s)
- Nico Sollmann
- Department of Diagnostic and Interventional Radiology, University Hospital Ulm, Ulm, Germany
- Department of Diagnostic and Interventional Neuroradiology, School of Medicine, Klinikum rechts der Isar, Technical University of Munich, München, Germany
- TUM-Neuroimaging Center, Klinikum rechts der Isar, Technical University of Munich, München, Germany
- Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, United States
| | - Haosu Zhang
- Department of Neurosurgery, School of Medicine, Klinikum rechts der Isar, Technical University of Munich, München, Germany
| | - Christopher Kloth
- Department of Diagnostic and Interventional Radiology, University Hospital Ulm, Ulm, Germany
| | - Claus Zimmer
- Department of Diagnostic and Interventional Neuroradiology, School of Medicine, Klinikum rechts der Isar, Technical University of Munich, München, Germany
- TUM-Neuroimaging Center, Klinikum rechts der Isar, Technical University of Munich, München, Germany
| | - Benedikt Wiestler
- Department of Diagnostic and Interventional Neuroradiology, School of Medicine, Klinikum rechts der Isar, Technical University of Munich, München, Germany
- TranslaTUM - Central Institute for Translational Cancer Research, Klinikum rechts der Isar, Technical University of Munich, München, Germany
| | - Johannes Rosskopf
- Department of Diagnostic and Interventional Radiology, University Hospital Ulm, Ulm, Germany
- Section of Neuroradiology, Bezirkskrankenhaus Günzburg, Günzburg, Germany
| | - Kornelia Kreiser
- Department of Diagnostic and Interventional Radiology, University Hospital Ulm, Ulm, Germany
- Department of Radiology and Neuroradiology, Universitäts- und Rehabilitationskliniken Ulm, Ulm, Germany
| | - Bernd Schmitz
- Department of Diagnostic and Interventional Radiology, University Hospital Ulm, Ulm, Germany
- Section of Neuroradiology, Bezirkskrankenhaus Günzburg, Günzburg, Germany
| | - Meinrad Beer
- Department of Diagnostic and Interventional Radiology, University Hospital Ulm, Ulm, Germany
| | - Sandro M Krieg
- TUM-Neuroimaging Center, Klinikum rechts der Isar, Technical University of Munich, München, Germany
- Department of Neurosurgery, School of Medicine, Klinikum rechts der Isar, Technical University of Munich, München, Germany
| |
Collapse
|
6
|
Chrisochoides N, Fedorov A, Liu Y, Kot A, Foteinos P, Drakopoulos F, Tsolakis C, Billias E, Clatz O, Ayache N, Golby A, Black P, Kikinis R. Real-Time Dynamic Data Driven Deformable Registration for Image-Guided Neurosurgery: Computational Aspects. ARXIV 2023:arXiv:2309.03336v1. [PMID: 37731651 PMCID: PMC10508827] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 09/22/2023]
Abstract
Current neurosurgical procedures utilize medical images of various modalities to enable the precise location of tumors and critical brain structures to plan accurate brain tumor resection. The difficulty of using preoperative images during the surgery is caused by the intra-operative deformation of the brain tissue (brain shift), which introduces discrepancies concerning the preoperative configuration. Intra-operative imaging allows tracking such deformations but cannot fully substitute for the quality of the pre-operative data. Dynamic Data Driven Deformable Non-Rigid Registration (D4NRR) is a complex and time-consuming image processing operation that allows the dynamic adjustment of the pre-operative image data to account for intra-operative brain shift during the surgery. This paper summarizes the computational aspects of a specific adaptive numerical approximation method and its variations for registering brain MRIs. It outlines its evolution over the last 15 years and identifies new directions for the computational aspects of the technique.
Collapse
Affiliation(s)
- Nikos Chrisochoides
- Center for Real-Time Computing, Computer Science Department, Old Dominion University, Norfolk, VA
| | - Andrey Fedorov
- Center for Real-Time Computing, Computer Science Department, Old Dominion University, Norfolk, VA
- Neuroimaging Analysis Center, Department of Radiology, Harvard Medical School, Boston, MA
| | - Yixun Liu
- Center for Real-Time Computing, Computer Science Department, Old Dominion University, Norfolk, VA
| | - Andriy Kot
- Center for Real-Time Computing, Computer Science Department, Old Dominion University, Norfolk, VA
| | - Panos Foteinos
- Center for Real-Time Computing, Computer Science Department, Old Dominion University, Norfolk, VA
| | - Fotis Drakopoulos
- Center for Real-Time Computing, Computer Science Department, Old Dominion University, Norfolk, VA
| | - Christos Tsolakis
- Center for Real-Time Computing, Computer Science Department, Old Dominion University, Norfolk, VA
| | - Emmanuel Billias
- Center for Real-Time Computing, Computer Science Department, Old Dominion University, Norfolk, VA
| | - Olivier Clatz
- Inria, French Research Institute for Digital Science, Sophia Antipolis, France
| | - Nicholas Ayache
- Inria, French Research Institute for Digital Science, Sophia Antipolis, France
| | - Alex Golby
- Neuroimaging Analysis Center, Department of Radiology, Harvard Medical School, Boston, MA
- Image-guided Neurosurgery, Department of Neurosurgery, Harvard Medical School, Boston, MA
| | - Peter Black
- Image-guided Neurosurgery, Department of Neurosurgery, Harvard Medical School, Boston, MA
| | - Ron Kikinis
- Neuroimaging Analysis Center, Department of Radiology, Harvard Medical School, Boston, MA
| |
Collapse
|
7
|
Bierbrier J, Eskandari M, Giovanni DAD, Collins DL. Toward Estimating MRI-Ultrasound Registration Error in Image-Guided Neurosurgery. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2023; 70:999-1015. [PMID: 37022005 DOI: 10.1109/tuffc.2023.3239320] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Image-guided neurosurgery allows surgeons to view their tools in relation to preoperatively acquired patient images and models. To continue using neuronavigation systems throughout operations, image registration between preoperative images [typically magnetic resonance imaging (MRI)] and intraoperative images (e.g., ultrasound) is common to account for brain shift (deformations of the brain during surgery). We implemented a method to estimate MRI-ultrasound registration errors, with the goal of enabling surgeons to quantitatively assess the performance of linear or nonlinear registrations. To the best of our knowledge, this is the first dense error estimating algorithm applied to multimodal image registrations. The algorithm is based on a previously proposed sliding-window convolutional neural network that operates on a voxelwise basis. To create training data where the true registration error is known, simulated ultrasound images were created from preoperative MRI images and artificially deformed. The model was evaluated on artificially deformed simulated ultrasound data and real ultrasound data with manually annotated landmark points. The model achieved a mean absolute error (MAE) of 0.977 ± 0.988 mm and a correlation of 0.8 ± 0.062 on the simulated ultrasound data, and an MAE of 2.24 ± 1.89 mm and a correlation of 0.246 on the real ultrasound data. We discuss concrete areas to improve the results on real ultrasound data. Our progress lays the foundation for future developments and ultimately implementation of clinical neuronavigation systems.
Collapse
|
8
|
Ragnhildstveit A, Li C, Zimmerman MH, Mamalakis M, Curry VN, Holle W, Baig N, Uğuralp AK, Alkhani L, Oğuz-Uğuralp Z, Romero-Garcia R, Suckling J. Intra-operative applications of augmented reality in glioma surgery: a systematic review. Front Surg 2023; 10:1245851. [PMID: 37671031 PMCID: PMC10476869 DOI: 10.3389/fsurg.2023.1245851] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Accepted: 08/04/2023] [Indexed: 09/07/2023] Open
Abstract
Background Augmented reality (AR) is increasingly being explored in neurosurgical practice. By visualizing patient-specific, three-dimensional (3D) models in real time, surgeons can improve their spatial understanding of complex anatomy and pathology, thereby optimizing intra-operative navigation, localization, and resection. Here, we aimed to capture applications of AR in glioma surgery, their current status and future potential. Methods A systematic review of the literature was conducted. This adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guideline. PubMed, Embase, and Scopus electronic databases were queried from inception to October 10, 2022. Leveraging the Population, Intervention, Comparison, Outcomes, and Study design (PICOS) framework, study eligibility was evaluated in the qualitative synthesis. Data regarding AR workflow, surgical application, and associated outcomes were then extracted. The quality of evidence was additionally examined, using hierarchical classes of evidence in neurosurgery. Results The search returned 77 articles. Forty were subject to title and abstract screening, while 25 proceeded to full text screening. Of these, 22 articles met eligibility criteria and were included in the final review. During abstraction, studies were classified as "development" or "intervention" based on primary aims. Overall, AR was qualitatively advantageous, due to enhanced visualization of gliomas and critical structures, frequently aiding in maximal safe resection. Non-rigid applications were also useful in disclosing and compensating for intra-operative brain shift. Irrespective, there was high variance in registration methods and measurements, which considerably impacted projection accuracy. Most studies were of low-level evidence, yielding heterogeneous results. Conclusions AR has increasing potential for glioma surgery, with capacity to positively influence the onco-functional balance. However, technical and design limitations are readily apparent. The field must consider the importance of consistency and replicability, as well as the level of evidence, to effectively converge on standard approaches that maximize patient benefit.
Collapse
Affiliation(s)
- Anya Ragnhildstveit
- Integrated Research Literacy Group, Draper, UT, United States
- Department of Psychiatry, University of Cambridge, Cambridge, England
| | - Chao Li
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, England
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, England
| | | | - Michail Mamalakis
- Department of Psychiatry, University of Cambridge, Cambridge, England
| | - Victoria N. Curry
- Integrated Research Literacy Group, Draper, UT, United States
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, United States
| | - Willis Holle
- Integrated Research Literacy Group, Draper, UT, United States
- Department of Physics and Astronomy, The University of Utah, Salt Lake City, UT, United States
| | - Noor Baig
- Integrated Research Literacy Group, Draper, UT, United States
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA, United States
| | | | - Layth Alkhani
- Integrated Research Literacy Group, Draper, UT, United States
- Department of Biology, Stanford University, Stanford, CA, United States
| | | | - Rafael Romero-Garcia
- Department of Psychiatry, University of Cambridge, Cambridge, England
- Instituto de Biomedicina de Sevilla (IBiS) HUVR/CSIC/Universidad de Sevilla/CIBERSAM, ISCIII, Dpto. de Fisiología Médica y Biofísica
| | - John Suckling
- Department of Psychiatry, University of Cambridge, Cambridge, England
| |
Collapse
|
9
|
De Benedictis A, Marasi A, Rossi-Espagnet MC, Napolitano A, Parrillo C, Fracassi D, Baldassari G, Borro L, Bua A, de Palma L, Luisi C, Pepi C, Savioli A, Luglietto D, Marras CE. Vertical Hemispherotomy: Contribution of Advanced Three-Dimensional Modeling for Presurgical Planning and Training. J Clin Med 2023; 12:jcm12113779. [PMID: 37297974 DOI: 10.3390/jcm12113779] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2023] [Revised: 04/22/2023] [Accepted: 04/22/2023] [Indexed: 06/12/2023] Open
Abstract
Vertical hemispherotomy is an effective treatment for many drug-resistant encephalopathies with unilateral involvement. One of the main factors influencing positive surgical results and long-term seizure freedom is the quality of disconnection. For this reason, perfect anatomical awareness is mandatory during each step of the procedure. Although previous groups attempted to reproduce the surgical anatomy through schematic representations, cadaveric dissections, and intraoperative photographs and videos, a comprehensive understanding of the approach may still be difficult, especially for less experienced neurosurgeons. In this work, we reported the application of advanced technology for three-dimensional (3D) modeling and visualization of the main neurova-scular structures during vertical hemispherotomy procedures. In the first part of the study, we built a detailed 3D model of the main structures and landmarks involved during each disconnection phase. In the second part, we discussed the adjunctive value of augmented reality systems for the management of the most challenging etiologies, such as hemimegalencephaly and post-ischemic encephalopathy. We demonstrated the contribution of advanced 3D modeling and visualization to enhance the quality of anatomical representation and interaction between the operator and model according to a surgical perspective, optimizing the quality of presurgical planning, intraoperative orientation, and educational training.
Collapse
Affiliation(s)
- Alessandro De Benedictis
- Neurosurgery Unit, Bambino Gesù Children's Hospital, IRCCS, 4, Piazza S. Onofrio, 00165 Rome, Italy
| | - Alessandra Marasi
- Neurosurgery Unit, Bambino Gesù Children's Hospital, IRCCS, 4, Piazza S. Onofrio, 00165 Rome, Italy
| | | | - Antonio Napolitano
- Medical Physics Unit, Bambino Gesù Children's Hospital, IRCCS, 4, Piazza S. Onofrio, 00165 Rome, Italy
| | - Chiara Parrillo
- Medical Physics Unit, Bambino Gesù Children's Hospital, IRCCS, 4, Piazza S. Onofrio, 00165 Rome, Italy
| | - Donatella Fracassi
- Medical Physics Unit, Bambino Gesù Children's Hospital, IRCCS, 4, Piazza S. Onofrio, 00165 Rome, Italy
| | - Giulia Baldassari
- Medical Physics Unit, Bambino Gesù Children's Hospital, IRCCS, 4, Piazza S. Onofrio, 00165 Rome, Italy
| | - Luca Borro
- Multimodal Imaging Unit, Bambino Gesù Children's Hospital, IRCCS, 4, Piazza S. Onofrio, 00165 Rome, Italy
| | - Antonella Bua
- Neurosurgery Unit, Bambino Gesù Children's Hospital, IRCCS, 4, Piazza S. Onofrio, 00165 Rome, Italy
| | - Luca de Palma
- Clinical and Experimental Neurology, Bambino Gesù Children's Hospital, IRCCS, 4, Piazza S. Onofrio, 00165 Rome, Italy
| | - Concetta Luisi
- Clinical and Experimental Neurology, Bambino Gesù Children's Hospital, IRCCS, 4, Piazza S. Onofrio, 00165 Rome, Italy
| | - Chiara Pepi
- Clinical and Experimental Neurology, Bambino Gesù Children's Hospital, IRCCS, 4, Piazza S. Onofrio, 00165 Rome, Italy
| | - Alessandra Savioli
- Intensive Care Unit, Bambino Gesù Children's Hospital, IRCCS, 4, Piazza S. Onofrio, 00165 Rome, Italy
| | - Davide Luglietto
- Neurosurgery Unit, Bambino Gesù Children's Hospital, IRCCS, 4, Piazza S. Onofrio, 00165 Rome, Italy
| | - Carlo E Marras
- Neurosurgery Unit, Bambino Gesù Children's Hospital, IRCCS, 4, Piazza S. Onofrio, 00165 Rome, Italy
| |
Collapse
|
10
|
Wahlstedt I, George Smith A, Andersen CE, Behrens CP, Nørring Bekke S, Boye K, van Overeem Felter M, Josipovic M, Petersen J, Risumlund SL, Tascón-Vidarte JD, van Timmeren JE, Vogelius IR. Interfractional dose accumulation for MR-guided liver SBRT: Variation among algorithms is highly patient- and fraction-dependent. Radiother Oncol 2022; 182:109448. [PMID: 36566988 DOI: 10.1016/j.radonc.2022.109448] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2022] [Revised: 11/22/2022] [Accepted: 12/12/2022] [Indexed: 12/24/2022]
Abstract
BACKGROUND AND PURPOSE Daily plan adaptations could take the dose delivered in previous fractions into account. Due to high dose delivered per fraction, low number of fractions, steep dose gradients, and large interfractional organ deformations, this might be particularly important for liver SBRT. This study investigates inter-algorithm variation of interfractional dose accumulation for MR-guided liver SBRT. MATERIALS AND METHODS We assessed 27 consecutive MR-guided liver SBRT treatments of 67.5 Gy in three (n = 15) or 50 Gy in five fractions (n = 12), both prescribed to the GTV. We calculated fraction doses on daily patient anatomy, warped these doses to the simulation MRI using seven different algorithms, and accumulated the warped doses. Thus, we obtained differences in planned doses and warped or accumulated doses for each algorithm. This enabled us to calculate the inter-algorithm variations in warped doses per fraction and in accumulated doses per treatment course. RESULTS The four intensity-based algorithms were more consistent with planned PTV dose than affine or contour-based algorithms. The mean (range) variation of the dose difference for PTV D95% due to dose warping by these intensity-based algorithms was 10.4 percentage points (0.3 to 43.7) between fractions and 8.6 (0.3 to 24.9) between accumulated treatment doses. As seen by these ranges, the variation was very dependent on the patient and the fraction being analyzed. Nevertheless, no correlations between patient or plan characteristics on the one hand and inter-algorithm dose warping variation on the other hand was found. CONCLUSION Inter-algorithm dose accumulation variation is highly patient- and fraction-dependent for MR-guided liver SBRT. We advise against trusting a single algorithm for dose accumulation in liver SBRT.
Collapse
Affiliation(s)
- Isak Wahlstedt
- Department of Health Technology, Technical University of Denmark, Anker Engelunds Vej 1, Bygning 101A, 2800 Kongens Lyngby, Denmark; Department of Oncology, Centre for Cancer and Organ Diseases, Copenhagen University Hospital - Rigshospitalet (RH), Blegdamsvej 9, 2100 Copenhagen, Denmark; Department of Oncology, Copenhagen University Hospital - Herlev and Gentofte (HGH), Borgmester Ib Juuls Vej 7, 2730 Herlev, Denmark.
| | - Abraham George Smith
- Department of Oncology, Centre for Cancer and Organ Diseases, Copenhagen University Hospital - Rigshospitalet (RH), Blegdamsvej 9, 2100 Copenhagen, Denmark; Department of Computer Science, University of Copenhagen, Universitetsparken 1, 2100 Copenhagen, Denmark
| | - Claus Erik Andersen
- Department of Health Technology, Technical University of Denmark, Anker Engelunds Vej 1, Bygning 101A, 2800 Kongens Lyngby, Denmark
| | - Claus Preibisch Behrens
- Department of Health Technology, Technical University of Denmark, Anker Engelunds Vej 1, Bygning 101A, 2800 Kongens Lyngby, Denmark; Department of Oncology, Copenhagen University Hospital - Herlev and Gentofte (HGH), Borgmester Ib Juuls Vej 7, 2730 Herlev, Denmark
| | - Susanne Nørring Bekke
- Department of Oncology, Copenhagen University Hospital - Herlev and Gentofte (HGH), Borgmester Ib Juuls Vej 7, 2730 Herlev, Denmark
| | - Kristian Boye
- Department of Oncology, Centre for Cancer and Organ Diseases, Copenhagen University Hospital - Rigshospitalet (RH), Blegdamsvej 9, 2100 Copenhagen, Denmark
| | - Mette van Overeem Felter
- Department of Oncology, Copenhagen University Hospital - Herlev and Gentofte (HGH), Borgmester Ib Juuls Vej 7, 2730 Herlev, Denmark
| | - Mirjana Josipovic
- Department of Oncology, Centre for Cancer and Organ Diseases, Copenhagen University Hospital - Rigshospitalet (RH), Blegdamsvej 9, 2100 Copenhagen, Denmark; Department of Health and Medical Sciences, University of Copenhagen, Blegdamsvej 3B, 2200 Copenhagen, Denmark
| | - Jens Petersen
- Department of Oncology, Centre for Cancer and Organ Diseases, Copenhagen University Hospital - Rigshospitalet (RH), Blegdamsvej 9, 2100 Copenhagen, Denmark; Department of Computer Science, University of Copenhagen, Universitetsparken 1, 2100 Copenhagen, Denmark
| | - Signe Lenora Risumlund
- Department of Oncology, Centre for Cancer and Organ Diseases, Copenhagen University Hospital - Rigshospitalet (RH), Blegdamsvej 9, 2100 Copenhagen, Denmark
| | - José David Tascón-Vidarte
- Department of Computer Science, University of Copenhagen, Universitetsparken 1, 2100 Copenhagen, Denmark
| | | | - Ivan Richter Vogelius
- Department of Oncology, Centre for Cancer and Organ Diseases, Copenhagen University Hospital - Rigshospitalet (RH), Blegdamsvej 9, 2100 Copenhagen, Denmark; Department of Health and Medical Sciences, University of Copenhagen, Blegdamsvej 3B, 2200 Copenhagen, Denmark
| |
Collapse
|
11
|
Whiteman AS, Bartsch AJ, Kang J, Johnson TD. Bayesian inference for brain activity from functional magnetic resonance imaging collected at two spatial resolutions. Ann Appl Stat 2022; 16:2626-2647. [DOI: 10.1214/22-aoas1606] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Affiliation(s)
- Andrew S. Whiteman
- Department of Biostatistics, University of Michigan School of Public Health
| | - Andreas J. Bartsch
- Radiologie Bamberg and Department of Neuroradiology, University of Heidelberg
| | - Jian Kang
- Department of Biostatistics, University of Michigan School of Public Health
| | - Timothy D. Johnson
- Department of Biostatistics, University of Michigan School of Public Health
| |
Collapse
|
12
|
Bennion NJ, Zappalá S, Potts M, Woolley M, Marshall D, Evans SL. In vivo measurement of human brain material properties under quasi-static loading. J R Soc Interface 2022; 19:20220557. [PMID: 36514891 PMCID: PMC9748497 DOI: 10.1098/rsif.2022.0557] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022] Open
Abstract
Computational modelling of the brain requires accurate representation of the tissues concerned. Mechanical testing has numerous challenges, in particular for low strain rates, like neurosurgery, where redistribution of fluid is biomechanically important. A finite-element (FE) model was generated in FEBio, incorporating a spring element/fluid-structure interaction representation of the pia-arachnoid complex (PAC). The model was loaded to represent gravity in prone and supine positions. Material parameter identification and sensitivity analysis were performed using statistical software, comparing the FE results to human in vivo measurements. Results for the brain Ogden parameters µ, α and k yielded values of 670 Pa, -19 and 148 kPa, supporting values reported in the literature. Values of the order of 1.2 MPa and 7.7 kPa were obtained for stiffness of the pia mater and out-of-plane tensile stiffness of the PAC, respectively. Positional brain shift was found to be non-rigid and largely driven by redistribution of fluid within the tissue. To the best of our knowledge, this is the first study using in vivo human data and gravitational loading in order to estimate the material properties of intracranial tissues. This model could now be applied to reduce the impact of positional brain shift in stereotactic neurosurgery.
Collapse
Affiliation(s)
| | - Stefano Zappalá
- School of Computer Science and Informatics, Cardiff University, Cardiff CF24 3AA, UK,Cardiff University Brain Research Imaging Centre (CUBRIC), School of Psychology, Cardiff University, Cardiff CF24 4HQ, UK
| | - Matthew Potts
- School of Engineering, Cardiff University, Cardiff CF10 3AT, UK
| | - Max Woolley
- Functional Neurosurgery Research Group, School of Clinical Sciences, University of Bristol, Bristol, UK,Renishaw Neuro Solutions Ltd, Wotton Road, Wotton-under-Edge GL12 8SP, UK
| | - David Marshall
- School of Computer Science and Informatics, Cardiff University, Cardiff CF24 3AA, UK
| | - Sam L. Evans
- School of Engineering, Cardiff University, Cardiff CF10 3AT, UK
| |
Collapse
|
13
|
Cobbinah BM, Sorg C, Yang Q, Ternblom A, Zheng C, Han W, Che L, Shao J. Reducing variations in multi-center Alzheimer's disease classification with convolutional adversarial autoencoder. Med Image Anal 2022; 82:102585. [PMID: 36057187 DOI: 10.1016/j.media.2022.102585] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2021] [Revised: 07/22/2022] [Accepted: 08/15/2022] [Indexed: 11/29/2022]
Abstract
Based on brain magnetic resonance imaging (MRI), multiple variations ranging from MRI scanners to center-specific parameter settings, imaging protocols, and brain region-of-interest (ROI) definitions pose a big challenge for multi-center Alzheimer's disease characterization and classification. Existing approaches to reduce such variations require intricate multi-step, often manual preprocessing pipelines, including skull stripping, segmentation, registration, cortical reconstruction, and ROI outlining. Such procedures are time-consuming, and more importantly, tend to be user biased. Contrasting costly and biased preprocessing pipelines, the question arises whether we can design a deep learning model to automatically reduce these variations from multiple centers for Alzheimer's disease classification? In this study, we used T1 and T2-weighted structural MRI from Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset based on three groups with 375 subjects, respectively: patients with Alzheimer's disease (AD) dementia, with mild cognitive impairment (MCI), and healthy controls (HC); to test our approach, we defined AD classification as classifying an individual's structural image to one of the three group labels. We first introduced a convolutional adversarial autoencoder (CAAE) to reduce the variations existing in multi-center raw MRI scans by automatically registering them into a common aligned space. Afterward, a convolutional residual soft attention network (CRAT) was further proposed for AD classification. Canonical classification procedures demonstrated that our model achieved classification accuracies of 91.8%, 90.05%, and 88.10% for the 2-way classification tasks using the RAW aligned MRI scans, including AD vs. HC, AD vs. MCI, and MCI vs. HC, respectively. Thus, our automated approach achieves comparable or even better classification performance by comparing it with many baselines with dedicated conventional preprocessing pipelines. Furthermore, the uncovered brain hotpots, i.e., hippocampus, amygdala, and temporal pole, are consistent with previous studies.
Collapse
Affiliation(s)
- Bernard M Cobbinah
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, 611731 Chengdu, China
| | - Christian Sorg
- Department of Neuroradiology, TUM-NIC Neuroimaging Center of Technical University Munich, Germany
| | - Qinli Yang
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, 611731 Chengdu, China
| | - Arvid Ternblom
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, 611731 Chengdu, China
| | - Changgang Zheng
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, 611731 Chengdu, China
| | - Wei Han
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, 611731 Chengdu, China
| | - Liwei Che
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, 611731 Chengdu, China
| | - Junming Shao
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, 611731 Chengdu, China; Center for Information in BioMedicine, University of Electronic Science and Technology of China, 611731 Chengdu, China; Yangtze Delta Region Institute (Huzhou), University of Electronic Science and Technology of China, Huzhou 313001, China.
| |
Collapse
|
14
|
Janelle F, Iorio-Morin C, D'amour S, Fortin D. Superior Longitudinal Fasciculus: A Review of the Anatomical Descriptions With Functional Correlates. Front Neurol 2022; 13:794618. [PMID: 35572948 PMCID: PMC9093186 DOI: 10.3389/fneur.2022.794618] [Citation(s) in RCA: 81] [Impact Index Per Article: 27.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2021] [Accepted: 02/21/2022] [Indexed: 12/20/2022] Open
Abstract
The superior longitudinal fasciculus (SLF) is part of the longitudinal association fiber system, which lays connections between the frontal lobe and other areas of the ipsilateral hemisphere. As a dominant association fiber bundle, it should correspond to a well-defined structure with a clear anatomical definition. However, this is not the case, and a lot of confusion and overlap surrounds this entity. In this review/opinion study, we survey relevant current literature on the topic and try to clarify the definition of SLF in each hemisphere. After a comparison of postmortem dissections and data obtained from diffusion MRI studies, we discuss the specifics of this bundle regarding its anatomical landmarks, differences in lateralization, as well as individual variability. We also discuss the confusion regarding the arcuate fasciculus in relation to the SLF. Finally, we recommend a nomenclature based on the findings exposed in this review and finalize with a discussion on relevant functional correlates of the structure.
Collapse
|
15
|
Yu Y, Bourantas G, Zwick B, Joldes G, Kapur T, Frisken S, Kikinis R, Nabavi A, Golby A, Wittek A, Miller K. Computer simulation of tumour resection-induced brain deformation by a meshless approach. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN BIOMEDICAL ENGINEERING 2022; 38:e3539. [PMID: 34647427 PMCID: PMC8881972 DOI: 10.1002/cnm.3539] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/15/2021] [Revised: 09/06/2021] [Accepted: 10/03/2021] [Indexed: 06/13/2023]
Abstract
Tumour resection requires precise planning and navigation to maximise tumour removal while simultaneously protecting nearby healthy tissues. Neurosurgeons need to know the location of the remaining tumour after partial tumour removal before continuing with the resection. Our approach to the problem uses biomechanical modelling and computer simulation to compute the brain deformations after the tumour is resected. In this study, we use meshless Total Lagrangian explicit dynamics as the solver. The problem geometry is extracted from the patient-specific magnetic resonance imaging (MRI) data and includes the parenchyma, tumour, cerebrospinal fluid and skull. The appropriate non-linear material formulation is used. Loading is performed by imposing intra-operative conditions of gravity and reaction forces between the tumour and surrounding healthy parenchyma tissues. A finite frictionless sliding contact is enforced between the skull (rigid) and parenchyma. The meshless simulation results are compared to intra-operative MRI sections. We also calculate Hausdorff distances between the computed deformed surfaces (ventricles and tumour cavities) and surfaces observed intra-operatively. Over 80% of points on the ventricle surface and 95% of points on the tumour cavity surface were successfully registered (results within the limits of two times the original in-plane resolution of the intra-operative image). Computed results demonstrate the potential for our method in estimating the tissue deformation and tumour boundary during the resection.
Collapse
Affiliation(s)
- Yue Yu
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Western Australia, Australia
| | - George Bourantas
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Western Australia, Australia
| | - Benjamin Zwick
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Western Australia, Australia
| | - Grand Joldes
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Western Australia, Australia
| | - Tina Kapur
- Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Sarah Frisken
- Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Ron Kikinis
- Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Arya Nabavi
- Department of Neurosurgery, KRH Klinikum Nordstadt, Hannover, Germany
| | - Alexandra Golby
- Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Adam Wittek
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Western Australia, Australia
| | - Karol Miller
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Western Australia, Australia
- Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
16
|
Drakopoulos F, Tsolakis C, Angelopoulos A, Liu Y, Yao C, Kavazidi KR, Foroglou N, Fedorov A, Frisken S, Kikinis R, Golby A, Chrisochoides N. Adaptive Physics-Based Non-Rigid Registration for Immersive Image-Guided Neuronavigation Systems. Front Digit Health 2021; 2:613608. [PMID: 34713074 PMCID: PMC8521897 DOI: 10.3389/fdgth.2020.613608] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Accepted: 12/23/2020] [Indexed: 12/21/2022] Open
Abstract
Objective: In image-guided neurosurgery, co-registered preoperative anatomical, functional, and diffusion tensor imaging can be used to facilitate a safe resection of brain tumors in eloquent areas of the brain. However, the brain deforms during surgery, particularly in the presence of tumor resection. Non-Rigid Registration (NRR) of the preoperative image data can be used to create a registered image that captures the deformation in the intraoperative image while maintaining the quality of the preoperative image. Using clinical data, this paper reports the results of a comparison of the accuracy and performance among several non-rigid registration methods for handling brain deformation. A new adaptive method that automatically removes mesh elements in the area of the resected tumor, thereby handling deformation in the presence of resection is presented. To improve the user experience, we also present a new way of using mixed reality with ultrasound, MRI, and CT. Materials and methods: This study focuses on 30 glioma surgeries performed at two different hospitals, many of which involved the resection of significant tumor volumes. An Adaptive Physics-Based Non-Rigid Registration method (A-PBNRR) registers preoperative and intraoperative MRI for each patient. The results are compared with three other readily available registration methods: a rigid registration implemented in 3D Slicer v4.4.0; a B-Spline non-rigid registration implemented in 3D Slicer v4.4.0; and PBNRR implemented in ITKv4.7.0, upon which A-PBNRR was based. Three measures were employed to facilitate a comprehensive evaluation of the registration accuracy: (i) visual assessment, (ii) a Hausdorff Distance-based metric, and (iii) a landmark-based approach using anatomical points identified by a neurosurgeon. Results: The A-PBNRR using multi-tissue mesh adaptation improved the accuracy of deformable registration by more than five times compared to rigid and traditional physics based non-rigid registration, and four times compared to B-Spline interpolation methods which are part of ITK and 3D Slicer. Performance analysis showed that A-PBNRR could be applied, on average, in <2 min, achieving desirable speed for use in a clinical setting. Conclusions: The A-PBNRR method performed significantly better than other readily available registration methods at modeling deformation in the presence of resection. Both the registration accuracy and performance proved sufficient to be of clinical value in the operating room. A-PBNRR, coupled with the mixed reality system, presents a powerful and affordable solution compared to current neuronavigation systems.
Collapse
Affiliation(s)
- Fotis Drakopoulos
- Center for Real-Time Computing, Old Dominion University, Norfolk, VA, United States
| | - Christos Tsolakis
- Center for Real-Time Computing, Old Dominion University, Norfolk, VA, United States.,Department of Computer Science, Old Dominion University, Norfolk, VA, United States
| | - Angelos Angelopoulos
- Center for Real-Time Computing, Old Dominion University, Norfolk, VA, United States.,Department of Computer Science, Old Dominion University, Norfolk, VA, United States
| | - Yixun Liu
- Center for Real-Time Computing, Old Dominion University, Norfolk, VA, United States
| | - Chengjun Yao
- Department of Neurosurgery, Huashan Hospital, Shanghai, China
| | | | - Nikolaos Foroglou
- Department of Neurosurgery, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Andrey Fedorov
- Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, United States
| | - Sarah Frisken
- Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, United States
| | - Ron Kikinis
- Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, United States
| | - Alexandra Golby
- Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, United States.,Department of Neurosurgery, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, United States
| | - Nikos Chrisochoides
- Center for Real-Time Computing, Old Dominion University, Norfolk, VA, United States.,Department of Computer Science, Old Dominion University, Norfolk, VA, United States
| |
Collapse
|
17
|
Bastos DCDA, Juvekar P, Tie Y, Jowkar N, Pieper S, Wells WM, Bi WL, Golby A, Frisken S, Kapur T. Challenges and Opportunities of Intraoperative 3D Ultrasound With Neuronavigation in Relation to Intraoperative MRI. Front Oncol 2021; 11:656519. [PMID: 34026631 PMCID: PMC8139191 DOI: 10.3389/fonc.2021.656519] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Accepted: 04/09/2021] [Indexed: 11/15/2022] Open
Abstract
Introduction Neuronavigation greatly improves the surgeons ability to approach, assess and operate on brain tumors, but tends to lose its accuracy as the surgery progresses and substantial brain shift and deformation occurs. Intraoperative MRI (iMRI) can partially address this problem but is resource intensive and workflow disruptive. Intraoperative ultrasound (iUS) provides real-time information that can be used to update neuronavigation and provide real-time information regarding the resection progress. We describe the intraoperative use of 3D iUS in relation to iMRI, and discuss the challenges and opportunities in its use in neurosurgical practice. Methods We performed a retrospective evaluation of patients who underwent image-guided brain tumor resection in which both 3D iUS and iMRI were used. The study was conducted between June 2020 and December 2020 when an extension of a commercially available navigation software was introduced in our practice enabling 3D iUS volumes to be reconstructed from tracked 2D iUS images. For each patient, three or more 3D iUS images were acquired during the procedure, and one iMRI was acquired towards the end. The iUS images included an extradural ultrasound sweep acquired before dural incision (iUS-1), a post-dural opening iUS (iUS-2), and a third iUS acquired immediately before the iMRI acquisition (iUS-3). iUS-1 and preoperative MRI were compared to evaluate the ability of iUS to visualize tumor boundaries and critical anatomic landmarks; iUS-3 and iMRI were compared to evaluate the ability of iUS for predicting residual tumor. Results Twenty-three patients were included in this study. Fifteen patients had tumors located in eloquent or near eloquent brain regions, the majority of patients had low grade gliomas (11), gross total resection was achieved in 12 patients, postoperative temporary deficits were observed in five patients. In twenty-two iUS was able to define tumor location, tumor margins, and was able to indicate relevant landmarks for orientation and guidance. In sixteen cases, white matter fiber tracts computed from preoperative dMRI were overlaid on the iUS images. In nineteen patients, the EOR (GTR or STR) was predicted by iUS and confirmed by iMRI. The remaining four patients where iUS was not able to evaluate the presence or absence of residual tumor were recurrent cases with a previous surgical cavity that hindered good contact between the US probe and the brainsurface. Conclusion This recent experience at our institution illustrates the practical benefits, challenges, and opportunities of 3D iUS in relation to iMRI.
Collapse
Affiliation(s)
| | - Parikshit Juvekar
- Department of Neurosurgery, Brigham and Womens Hospital, Harvard Medical School, Boston, MA, United States
| | - Yanmei Tie
- Department of Neurosurgery, Brigham and Womens Hospital, Harvard Medical School, Boston, MA, United States
| | - Nick Jowkar
- Department of Neurosurgery, Brigham and Womens Hospital, Harvard Medical School, Boston, MA, United States
| | - Steve Pieper
- Department of Neurosurgery, Brigham and Womens Hospital, Harvard Medical School, Boston, MA, United States
| | - Willam M Wells
- Department of Neurosurgery, Brigham and Womens Hospital, Harvard Medical School, Boston, MA, United States
| | - Wenya Linda Bi
- Department of Neurosurgery, Brigham and Womens Hospital, Harvard Medical School, Boston, MA, United States
| | - Alexandra Golby
- Department of Neurosurgery, Brigham and Womens Hospital, Harvard Medical School, Boston, MA, United States
| | - Sarah Frisken
- Department of Neurosurgery, Brigham and Womens Hospital, Harvard Medical School, Boston, MA, United States
| | - Tina Kapur
- Department of Neurosurgery, Brigham and Womens Hospital, Harvard Medical School, Boston, MA, United States
| |
Collapse
|
18
|
Wallner J, Schwaiger M, Hochegger K, Gsaxner C, Zemann W, Egger J. A review on multiplatform evaluations of semi-automatic open-source based image segmentation for cranio-maxillofacial surgery. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2019; 182:105102. [PMID: 31610359 DOI: 10.1016/j.cmpb.2019.105102] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2019] [Revised: 09/09/2019] [Accepted: 09/27/2019] [Indexed: 06/10/2023]
Abstract
BACKGROUND AND OBJECTIVES Computer-assisted technologies, such as image-based segmentation, play an important role in the diagnosis and treatment support in cranio-maxillofacial surgery. However, although many segmentation software packages exist, their clinical in-house use is often challenging due to constrained technical, human or financial resources. Especially technological solutions or systematic evaluations of open-source based segmentation approaches are lacking. The aim of this contribution is to assess and review the segmentation quality and the potential clinical use of multiple commonly available and license-free segmentation methods on different medical platforms. METHODS In this contribution, the quality and accuracy of open-source segmentation methods was assessed on different platforms using patient-specific clinical CT-data and reviewed with the literature. The image-based segmentation algorithms GrowCut, Robust Statistics Segmenter, Region Growing 3D, Otsu & Picking, Canny Segmentation and Geodesic Segmenter were investigated in the mandible on the platforms 3D Slicer, MITK and MeVisLab. Comparisons were made between the segmentation algorithms and the ground truth segmentations of the same anatomy performed by two clinical experts (n = 20). Assessment parameters were the Dice Score Coefficient (DSC), the Hausdorff Distance (HD), and Pearsons correlation coefficient (r). RESULTS The segmentation accuracy was highest with the GrowCut (DSC 85.6%, HD 33.5 voxel) and the Canny (DSC 82.1%, HD 8.5 voxel) algorithm. Statistical differences between the assessment parameters were not significant (p < 0.05) and correlation coefficients were close to the value one (r > 0.94) for any of the comparison made between the segmentation methods and the ground truth schemes. Functionally stable and time-saving segmentations were observed. CONCLUSION High quality image-based semi-automatic segmentation was provided by the GrowCut and the Canny segmentation method. In the cranio-maxillofacial complex, these segmentation methods provide algorithmic alternatives for image-based segmentation in the clinical practice for e.g. surgical planning or visualization of treatment results and offer advantages through their open-source availability. This is the first systematic multi-platform comparison that evaluates multiple license-free, open-source segmentation methods based on clinical data for the improvement of algorithms and a potential clinical use in patient-individualized medicine. The results presented are reproducible by others and can be used for clinical and research purposes.
Collapse
Affiliation(s)
- Jürgen Wallner
- Medical University of Graz, Department of Oral and Maxillofacial Surgery, Auenbruggerplatz 5/1, Graz 8036, Austria; Computer Algorithms for Medicine Laboratory, Graz 8010, Austria.
| | - Michael Schwaiger
- Medical University of Graz, Department of Oral and Maxillofacial Surgery, Auenbruggerplatz 5/1, Graz 8036, Austria; Computer Algorithms for Medicine Laboratory, Graz 8010, Austria
| | - Kerstin Hochegger
- Computer Algorithms for Medicine Laboratory, Graz 8010, Austria; Institute for Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz 8010, Austria
| | - Christina Gsaxner
- Medical University of Graz, Department of Oral and Maxillofacial Surgery, Auenbruggerplatz 5/1, Graz 8036, Austria; Computer Algorithms for Medicine Laboratory, Graz 8010, Austria; Institute for Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz 8010, Austria
| | - Wolfgang Zemann
- Medical University of Graz, Department of Oral and Maxillofacial Surgery, Auenbruggerplatz 5/1, Graz 8036, Austria
| | - Jan Egger
- Medical University of Graz, Department of Oral and Maxillofacial Surgery, Auenbruggerplatz 5/1, Graz 8036, Austria; Computer Algorithms for Medicine Laboratory, Graz 8010, Austria; Institute for Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz 8010, Austria; Shanghai Jiao Tong University, School of Mechanical Engineering, Dong Chuan Road 800, Shanghai 200240, China
| |
Collapse
|
19
|
Frisken S, Luo M, Juvekar P, Bunevicius A, Machado I, Unadkat P, Bertotti MM, Toews M, Wells WM, Miga MI, Golby AJ. A comparison of thin-plate spline deformation and finite element modeling to compensate for brain shift during tumor resection. Int J Comput Assist Radiol Surg 2019; 15:75-85. [PMID: 31444624 DOI: 10.1007/s11548-019-02057-2] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2019] [Accepted: 08/14/2019] [Indexed: 10/26/2022]
Abstract
PURPOSE Brain shift during tumor resection can progressively invalidate the accuracy of neuronavigation systems and affect neurosurgeons' ability to achieve optimal resections. This paper compares two methods that have been presented in the literature to compensate for brain shift: a thin-plate spline deformation model and a finite element method (FEM). For this comparison, both methods are driven by identical sparse data. Specifically, both methods are driven by displacements between automatically detected and matched feature points from intraoperative 3D ultrasound (iUS). Both methods have been shown to be fast enough for intraoperative brain shift correction (Machado et al. in Int J Comput Assist Radiol Surg 13(10):1525-1538, 2018; Luo et al. in J Med Imaging (Bellingham) 4(3):035003, 2017). However, the spline method requires no preprocessing and ignores physical properties of the brain while the FEM method requires significant preprocessing and incorporates patient-specific physical and geometric constraints. The goal of this work was to explore the relative merits of these methods on recent clinical data. METHODS Data acquired during 19 sequential tumor resections in Brigham and Women's Hospital's Advanced Multi-modal Image-Guided Operating Suite between December 2017 and October 2018 were considered for this retrospective study. Of these, 15 cases and a total of 24 iUS to iUS image pairs met inclusion requirements. Automatic feature detection (Machado et al. in Int J Comput Assist Radiol Surg 13(10):1525-1538, 2018) was used to detect and match features in each pair of iUS images. Displacements between matched features were then used to drive both the spline model and the FEM method to compensate for brain shift between image acquisitions. The accuracies of the resultant deformation models were measured by comparing the displacements of manually identified landmarks before and after deformation. RESULTS The mean initial subcortical registration error between preoperative MRI and the first iUS image averaged 5.3 ± 0.75 mm. The mean subcortical brain shift, measured using displacements between manually identified landmarks in pairs of iUS images, was 2.5 ± 1.3 mm. Our results showed that FEM was able to reduce subcortical registration error by a small but statistically significant amount (from 2.46 to 2.02 mm). A large variability in the results of the spline method prevented us from demonstrating either a statistically significant reduction in subcortical registration error after applying the spline method or a statistically significant difference between the results of the two methods. CONCLUSIONS In this study, we observed less subcortical brain shift than has previously been reported in the literature (Frisken et al., in: Miller (ed) Biomechanics of the brain, Springer, Cham, 2019). This may be due to the fact that we separated out the initial misregistration between preoperative MRI and the first iUS image from our brain shift measurements or it may be due to modern neurosurgical practices designed to reduce brain shift, including reduced craniotomy sizes and better control of intracranial pressure with the use of mannitol and other medications. It appears that the FEM method and its use of geometric and biomechanical constraints provided more consistent brain shift correction and better correction farther from the driving feature displacements than the simple spline model. The spline-based method was simpler and tended to give better results for small deformations. However, large variability in the spline results and relatively small brain shift prevented this study from demonstrating a statistically significant difference between the results of the two methods.
Collapse
Affiliation(s)
- Sarah Frisken
- Department of Radiology, Brigham and Women's Hospital, Boston, MA, USA.
| | - Ma Luo
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Parikshit Juvekar
- Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA, USA
| | - Adomas Bunevicius
- Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA, USA
| | - Ines Machado
- Instituto Superior Tecnico, Universidade de Lisboa, Lisbon, Portugal
| | - Prashin Unadkat
- Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA, USA
| | - Melina M Bertotti
- Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA, USA
| | - Matt Toews
- Département de Génie des Systems, Ecole de Technologie Superieure, Montreal, Canada
| | - William M Wells
- Department of Radiology, Brigham and Women's Hospital, Boston, MA, USA.,Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Michael I Miga
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA.,Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, TN, USA.,Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, TN, USA.,Vanderbilt Institute for Surgery and Engineering, Vanderbilt University, Nashville, TN, USA
| | - Alexandra J Golby
- Department of Radiology, Brigham and Women's Hospital, Boston, MA, USA.,Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA, USA
| |
Collapse
|
20
|
Parkhomenko E, O'Leary M, Safiullah S, Walia S, Owyong M, Lin C, James R, Okhunov Z, Patel RM, Kaler KS, Landman J, Clayman R. Pilot Assessment of Immersive Virtual Reality Renal Models as an Educational and Preoperative Planning Tool for Percutaneous Nephrolithotomy. J Endourol 2019; 33:283-288. [DOI: 10.1089/end.2018.0626] [Citation(s) in RCA: 34] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022] Open
Affiliation(s)
- Egor Parkhomenko
- Department of Urology, School of Medicine, University of California, Irvine, Orange, California
| | - Mitchell O'Leary
- Department of Urology, School of Medicine, University of California, Irvine, Orange, California
| | - Shoaib Safiullah
- Department of Urology, School of Medicine, University of California, Irvine, Orange, California
| | - Sartaaj Walia
- Department of Urology, School of Medicine, University of California, Irvine, Orange, California
| | - Michael Owyong
- Department of Urology, School of Medicine, University of California, Irvine, Orange, California
| | - Cyrus Lin
- Department of Urology, School of Medicine, University of California, Irvine, Orange, California
| | - Ryan James
- Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, Washington
| | - Zhamshid Okhunov
- Department of Urology, School of Medicine, University of California, Irvine, Orange, California
| | - Roshan M. Patel
- Department of Urology, School of Medicine, University of California, Irvine, Orange, California
| | - Kamaljot S. Kaler
- Department of Urology, School of Medicine, University of California, Irvine, Orange, California
- Department of Surgery, Section of Urology, University of Calgary, Calgary, Canada
| | - Jaime Landman
- Department of Urology, School of Medicine, University of California, Irvine, Orange, California
| | - Ralph Clayman
- Department of Urology, School of Medicine, University of California, Irvine, Orange, California
| |
Collapse
|
21
|
Visualization of Brain Shift Corrected Functional Magnetic Resonance Imaging Data for Intraoperative Brain Mapping. World Neurosurg X 2019; 2:100021. [PMID: 31218295 PMCID: PMC6580887 DOI: 10.1016/j.wnsx.2019.100021] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2018] [Accepted: 02/06/2019] [Indexed: 11/22/2022] Open
Abstract
Background Brain tumor surgery requires careful balance between maximizing tumor excision and preserving eloquent cortex. In some cases, the surgeon may opt to perform an awake craniotomy including intraoperative mapping of brain function by direct cortical stimulation (DCS) to assist in surgical decision-making. Preoperatively, functional magnetic resonance imaging (fMRI) facilitates planning by identification of eloquent brain areas, helping to guide DCS and other aspects of the surgical plan. However, brain deformation (shift) limits the usefulness of preoperative fMRI during surgery. To address this, an integrated visualization method for fMRI and DCS results is developed that is intuitive for the surgeon. Methods An image registration pipeline was constructed to display preoperative fMRI data corrected for brain shift overlaid on images of the exposed cortical surface at the beginning and completion of DCS mapping. Preoperative fMRI and DCS data were registered for a range of misalignments, and the residual registration errors were calculated. The pipeline was validated on imaging data from five brain tumor patients who underwent awake craniotomy. Results Registration errors were well under 5 mm (the approximate spatial resolution of DCS) for misalignments of up to 25 mm and approximately 10–15°. For rotational misalignments up to 20°, the success rate was 95% for an error tolerance of 5 mm. Failures were negligible for rotational misalignments up to 10°. Good quality registrations were observed for all five patients. Conclusions A proof-of-concept image registration pipeline is presented with acceptable accuracy for intraoperative use, providing multimodality visualization with potential benefits for intraoperative brain mapping.
Collapse
Key Words
- 2D, 2-dimensional
- 3D, 3-Dimensional
- Awake craniotomy
- Brain mapping
- Brain tumor resection
- CT, Computed tomography
- DCS, Direct cortical stimulation
- Electric stimulation
- FOV, Field of view
- Functional mapping
- MRI, Magnetic resonance imaging
- Multimodal imaging
- RE, Registration error
- Surgical planning
- TE, Echo time
- TR, Repetition time
- fMRI, Functional magnetic resonance imaging
Collapse
|
22
|
Frisken S, Luo M, Machado I, Unadkat P, Juvekar P, Bunevicius A, Toews M, Wells WM, Miga MI, Golby AJ. Preliminary Results Comparing Thin Plate Splines with Finite Element Methods for Modeling Brain Deformation during Neurosurgery using Intraoperative Ultrasound. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2019; 10951:1095120. [PMID: 31000909 PMCID: PMC6467062 DOI: 10.1117/12.2512799] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Brain shift compensation attempts to model the deformation of the brain which occurs during the surgical removal of brain tumors to enable mapping of presurgical image data into patient coordinates during surgery and thus improve the accuracy and utility of neuro-navigation. We present preliminary results from clinical tumor resections that compare two methods for modeling brain deformation, a simple thin plate spline method that interpolates displacements and a more complex finite element method (FEM) that models physical and geometric constraints of the brain and its material properties. Both methods are driven by the same set of displacements at locations surrounding the tumor. These displacements were derived from sets of corresponding matched features that were automatically detected using the SIFT-Rank algorithm. The deformation accuracy was tested using a set of manually identified landmarks. The FEM method requires significantly more preprocessing than the spline method but both methods can be used to model deformations in the operating room in reasonable time frames. Our preliminary results indicate that the FEM deformation model significantly out-performs the spline-based approach for predicting the deformation of manual landmarks. While both methods compensate for brain shift, this work suggests that models that incorporate biophysics and geometric constraints may be more accurate.
Collapse
Affiliation(s)
- S Frisken
- Department of Radiology, Brigham and Women's Hospital, Boston, MA
| | - M Luo
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN
| | - I Machado
- Instituto Superior Tecnico, Universidade de Lisboa, Lisbon, PORTUGAL
| | - P Unadkat
- Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA
| | - P Juvekar
- Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA
| | - A Bunevicius
- Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA
| | - M Toews
- Département de Génie des Systems, Ecole de Technologie Superieure, Montreal, CANADA
| | - W M Wells
- Department of Radiology, Brigham and Women's Hospital, Boston, MA
- Comp. Sci. and Artificial Intelligence Lab., Massachusetts Institute of Technology, Cambridge, MA
| | - M I Miga
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN
- Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, TN
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, TN
- Vanderbilt Institute for Surgery and Engineering, Vanderbilt University, Nashville, TN
| | - A J Golby
- Department of Radiology, Brigham and Women's Hospital, Boston, MA
- Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA
| |
Collapse
|
23
|
Computed tomography data collection of the complete human mandible and valid clinical ground truth models. Sci Data 2019; 6:190003. [PMID: 30694227 PMCID: PMC6350631 DOI: 10.1038/sdata.2019.3] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2018] [Accepted: 12/14/2018] [Indexed: 11/08/2022] Open
Abstract
Image-based algorithmic software segmentation is an increasingly important topic in many medical fields. Algorithmic segmentation is used for medical three-dimensional visualization, diagnosis or treatment support, especially in complex medical cases. However, accessible medical databases are limited, and valid medical ground truth databases for the evaluation of algorithms are rare and usually comprise only a few images. Inaccuracy or invalidity of medical ground truth data and image-based artefacts also limit the creation of such databases, which is especially relevant for CT data sets of the maxillomandibular complex. This contribution provides a unique and accessible data set of the complete mandible, including 20 valid ground truth segmentation models originating from 10 CT scans from clinical practice without artefacts or faulty slices. From each CT scan, two 3D ground truth models were created by clinical experts through independent manual slice-by-slice segmentation, and the models were statistically compared to prove their validity. These data could be used to conduct serial image studies of the human mandible, evaluating segmentation algorithms and developing adequate image tools.
Collapse
|
24
|
Guo Z, Leong MCW, Su H, Kwok KW, Chan DTM, Poon WS. Techniques for Stereotactic Neurosurgery: Beyond the Frame, Toward the Intraoperative Magnetic Resonance Imaging–Guided and Robot-Assisted Approaches. World Neurosurg 2018; 116:77-87. [DOI: 10.1016/j.wneu.2018.04.155] [Citation(s) in RCA: 31] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2018] [Revised: 04/20/2018] [Accepted: 04/21/2018] [Indexed: 11/16/2022]
|
25
|
Gould L, Ekstrand C, Fourney DR, Mickleborough MJ, Ellchuk T, Borowsky R. The Effect of Tumor Neovasculature on Functional Magnetic Resonance Imaging Blood Oxygen Level–Dependent Activation. World Neurosurg 2018; 115:373-383. [DOI: 10.1016/j.wneu.2018.04.200] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2018] [Revised: 04/25/2018] [Accepted: 04/26/2018] [Indexed: 11/16/2022]
|
26
|
Wallner J, Hochegger K, Chen X, Mischak I, Reinbacher K, Pau M, Zrnc T, Schwenzer-Zimmerer K, Zemann W, Schmalstieg D, Egger J. Clinical evaluation of semi-automatic open-source algorithmic software segmentation of the mandibular bone: Practical feasibility and assessment of a new course of action. PLoS One 2018; 13:e0196378. [PMID: 29746490 PMCID: PMC5944980 DOI: 10.1371/journal.pone.0196378] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2016] [Accepted: 04/12/2018] [Indexed: 11/19/2022] Open
Abstract
INTRODUCTION Computer assisted technologies based on algorithmic software segmentation are an increasing topic of interest in complex surgical cases. However-due to functional instability, time consuming software processes, personnel resources or licensed-based financial costs many segmentation processes are often outsourced from clinical centers to third parties and the industry. Therefore, the aim of this trial was to assess the practical feasibility of an easy available, functional stable and licensed-free segmentation approach to be used in the clinical practice. MATERIAL AND METHODS In this retrospective, randomized, controlled trail the accuracy and accordance of the open-source based segmentation algorithm GrowCut was assessed through the comparison to the manually generated ground truth of the same anatomy using 10 CT lower jaw data-sets from the clinical routine. Assessment parameters were the segmentation time, the volume, the voxel number, the Dice Score and the Hausdorff distance. RESULTS Overall semi-automatic GrowCut segmentation times were about one minute. Mean Dice Score values of over 85% and Hausdorff Distances below 33.5 voxel could be achieved between the algorithmic GrowCut-based segmentations and the manual generated ground truth schemes. Statistical differences between the assessment parameters were not significant (p<0.05) and correlation coefficients were close to the value one (r > 0.94) for any of the comparison made between the two groups. DISCUSSION Complete functional stable and time saving segmentations with high accuracy and high positive correlation could be performed by the presented interactive open-source based approach. In the cranio-maxillofacial complex the used method could represent an algorithmic alternative for image-based segmentation in the clinical practice for e.g. surgical treatment planning or visualization of postoperative results and offers several advantages. Due to an open-source basis the used method could be further developed by other groups or specialists. Systematic comparisons to other segmentation approaches or with a greater data amount are areas of future works.
Collapse
Affiliation(s)
- Jürgen Wallner
- Department of Oral & Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 5/1, Graz, Austria
- Computer Algorithms for Medicine (Cafe) Laboratory, Graz, Austria
| | - Kerstin Hochegger
- Computer Algorithms for Medicine (Cafe) Laboratory, Graz, Austria
- Institute for Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz, Austria
| | - Xiaojun Chen
- School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Irene Mischak
- Department of Dental Medicine and Oral Health, Medical University of Graz, Billrothgasse 4, Graz, Austria
| | - Knut Reinbacher
- Department of Oral & Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 5/1, Graz, Austria
| | - Mauro Pau
- Department of Oral & Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 5/1, Graz, Austria
| | - Tomislav Zrnc
- Department of Oral & Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 5/1, Graz, Austria
| | - Katja Schwenzer-Zimmerer
- Department of Oral & Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 5/1, Graz, Austria
| | - Wolfgang Zemann
- Department of Oral & Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 5/1, Graz, Austria
| | - Dieter Schmalstieg
- Institute for Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz, Austria
| | - Jan Egger
- Computer Algorithms for Medicine (Cafe) Laboratory, Graz, Austria
- Institute for Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz, Austria
- BioTechMed-Graz, Krenngasse 37/1, Graz, Austria
| |
Collapse
|
27
|
Dey A, Billinghurst M, Lindeman RW, Swan JE. A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014. Front Robot AI 2018; 5:37. [PMID: 33500923 PMCID: PMC7805955 DOI: 10.3389/frobt.2018.00037] [Citation(s) in RCA: 71] [Impact Index Per Article: 10.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2017] [Accepted: 03/19/2018] [Indexed: 11/13/2022] Open
Abstract
Augmented Reality (AR) interfaces have been studied extensively over the last few decades, with a growing number of user-based experiments. In this paper, we systematically review 10 years of the most influential AR user studies, from 2005 to 2014. A total of 291 papers with 369 individual user studies have been reviewed and classified based on their application areas. The primary contribution of the review is to present the broad landscape of user-based AR research, and to provide a high-level view of how that landscape has changed. We summarize the high-level contributions from each category of papers, and present examples of the most influential user studies. We also identify areas where there have been few user studies, and opportunities for future research. Among other things, we find that there is a growing trend toward handheld AR user studies, and that most studies are conducted in laboratory settings and do not involve pilot testing. This research will be useful for AR researchers who want to follow best practices in designing their own AR user studies.
Collapse
Affiliation(s)
- Arindam Dey
- Empathic Computing Laboratory, University of South Australia, Mawson Lakes, SA, Australia
| | - Mark Billinghurst
- Empathic Computing Laboratory, University of South Australia, Mawson Lakes, SA, Australia
| | - Robert W Lindeman
- Human Interface Technology Lab New Zealand (HIT Lab NZ), University of Canterbury, Christchurch, New Zealand
| | - J Edward Swan
- Mississippi State University, Starkville, MS, United States
| |
Collapse
|
28
|
Münnich T, Klein J, Hattingen E, Noack A, Herrmann E, Seifert V, Senft C, Forster MT. Tractography Verified by Intraoperative Magnetic Resonance Imaging and Subcortical Stimulation During Tumor Resection Near the Corticospinal Tract. Oper Neurosurg (Hagerstown) 2018; 16:197-210. [DOI: 10.1093/ons/opy062] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2017] [Accepted: 03/08/2018] [Indexed: 02/07/2023] Open
Abstract
Abstract
BACKGROUND
Tractography is a popular tool for visualizing the corticospinal tract (CST). However, results may be influenced by numerous variables, eg, the selection of seeding regions of interests (ROIs) or the chosen tracking algorithm.
OBJECTIVE
To compare different variable sets by correlating tractography results with intraoperative subcortical stimulation of the CST, correcting intraoperative brain shift by the use of intraoperative MRI.
METHODS
Seeding ROIs were created by means of motor cortex segmentation, functional MRI (fMRI), and navigated transcranial magnetic stimulation (nTMS). Based on these ROIs, tractography was run for each patient using a deterministic and a probabilistic algorithm. Tractographies were processed on pre- and postoperatively acquired data.
RESULTS
Using a linear mixed effects statistical model, best correlation between subcortical stimulation intensity and the distance between tractography and stimulation sites was achieved by using the segmented motor cortex as seeding ROI and applying the probabilistic algorithm on preoperatively acquired imaging sequences. Tractographies based on fMRI or nTMS results differed very little, but with enlargement of positive nTMS sites the stimulation-distance correlation of nTMS-based tractography improved.
CONCLUSION
Our results underline that the use of tractography demands for careful interpretation of its virtual results by considering all influencing variables.
Collapse
Affiliation(s)
- Timo Münnich
- Department of Neurosurgery, Goet-he University Hospital, Frankfurt am Main, Germany
| | - Jan Klein
- Fraunhofer MEVIS, Institute for Medical Image Computing, Bremen, Germany
| | - Elke Hattingen
- Department of Neuroradiology, Goethe University Hospital, Frankfurt am Main, Germa-ny
| | - Anika Noack
- Department of Neurosurgery, Goet-he University Hospital, Frankfurt am Main, Germany
| | - Eva Herrmann
- Institute for Biostatistics and Math-ematical Modelling, Goethe-University Hospital, Frankfurt am Main, Germany
| | - Volker Seifert
- Department of Neurosurgery, Goet-he University Hospital, Frankfurt am Main, Germany
| | - Christian Senft
- Department of Neurosurgery, Goet-he University Hospital, Frankfurt am Main, Germany
| | | |
Collapse
|
29
|
Silva MA, See AP, Essayed WI, Golby AJ, Tie Y. Challenges and techniques for presurgical brain mapping with functional MRI. Neuroimage Clin 2017; 17:794-803. [PMID: 29270359 PMCID: PMC5735325 DOI: 10.1016/j.nicl.2017.12.008] [Citation(s) in RCA: 89] [Impact Index Per Article: 11.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2017] [Revised: 11/10/2017] [Accepted: 12/05/2017] [Indexed: 01/22/2023]
Abstract
Functional magnetic resonance imaging (fMRI) is increasingly used for preoperative counseling and planning, and intraoperative guidance for tumor resection in the eloquent cortex. Although there have been improvements in image resolution and artifact correction, there are still limitations of this modality. In this review, we discuss clinical fMRI's applications, limitations and potential solutions. These limitations depend on the following parameters: foundations of fMRI, physiologic effects of the disease, distinctions between clinical and research fMRI, and the design of the fMRI study. We also compare fMRI to other brain mapping modalities which should be considered as alternatives or adjuncts when appropriate, and discuss intraoperative use and validation of fMRI. These concepts direct the clinical application of fMRI in neurosurgical patients.
Collapse
Affiliation(s)
- Michael A Silva
- Harvard Medical School, Boston, MA, USA; Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA, USA
| | - Alfred P See
- Harvard Medical School, Boston, MA, USA; Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA, USA
| | - Walid I Essayed
- Harvard Medical School, Boston, MA, USA; Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA, USA
| | - Alexandra J Golby
- Harvard Medical School, Boston, MA, USA; Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA, USA; Department of Radiology, Brigham and Women's Hospital, Boston, MA, USA
| | - Yanmei Tie
- Harvard Medical School, Boston, MA, USA; Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA, USA.
| |
Collapse
|
30
|
Models and tissue mimics for brain shift simulations. Biomech Model Mechanobiol 2017; 17:249-261. [PMID: 28879577 PMCID: PMC5807478 DOI: 10.1007/s10237-017-0958-7] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2017] [Accepted: 08/22/2017] [Indexed: 11/02/2022]
Abstract
Capturing the deformation of human brain during neurosurgical operations is an extremely important task to improve the accuracy or surgical procedure and minimize permanent damage in patients. This study focuses on the development of an accurate numerical model for the prediction of brain shift during surgical procedures and employs a tissue mimic recently developed to capture the complexity of the human tissue. The phantom, made of a composite hydrogel, was designed to reproduce the dynamic mechanical behaviour of the brain tissue in a range of strain rates suitable for surgical procedures. The use of a well-controlled, accessible and MRI compatible alternative to real brain tissue allows us to rule out spurious effects due to patient geometry and tissue properties variability, CSF amount uncertainties, and head orientation. The performance of different constitutive descriptions is evaluated using a brain-skull mimic, which enables 3D deformation measurements by means of MRI scans. Our combined experimental and numerical investigation demonstrates the importance of using accurate constitutive laws when approaching the modelling of this complex organic tissue and supports the proposal of a hybrid poro-hyper-viscoelastic material formulation for the simulation of brain shift.
Collapse
|
31
|
Morin F, Courtecuisse H, Reinertsen I, Le Lann F, Palombi O, Payan Y, Chabanas M. Brain-shift compensation using intraoperative ultrasound and constraint-based biomechanical simulation. Med Image Anal 2017. [DOI: 10.1016/j.media.2017.06.003] [Citation(s) in RCA: 47] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
32
|
Christiaens M, Collette S, Overgaard J, Gregoire V, Kazmierska J, Castadot P, Giralt J, Grant W, Tomsej M, Bar-Deroma R, Monti AF, Hurkmans CW, Weber DC. Quality assurance of radiotherapy in the ongoing EORTC 1219-DAHANCA-29 trial for HPV/p16 negative squamous cell carcinoma of the head and neck: Results of the benchmark case procedure. Radiother Oncol 2017; 123:424-430. [PMID: 28478912 DOI: 10.1016/j.radonc.2017.04.019] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2015] [Revised: 04/17/2017] [Accepted: 04/17/2017] [Indexed: 11/29/2022]
Abstract
BACKGROUND AND PURPOSE The phase III EORTC 1219-DAHANCA 29 intergroup trial evaluates the influence of nimorazole in patients with locally advanced head and neck cancer when treated with accelerated radiotherapy (RT) in combination with chemotherapy. This article describes the results of the RT Benchmark Case (BC) performed before patient inclusion. MATERIALS AND METHODS The participating centers were asked to perform a 2-step BC, consisting of (1) a delineation and (2) a planning exercise according to the protocol guidelines. Submissions were prospectively centrally reviewed and feedback was given to the submitting centers. Sørensen-Dice similarity index (DSI) and the 95th percentile Hausdorff distance (HD) were retrospectively used to evaluate the agreement between the centers and the expert contours. RESULTS Fifty-four submissions (34 delineation and 20 planning exercises) from 19 centers were reviewed. Nine (47%) centers needed to perform the delineation step twice and three (16%) centers 3 times before receiving an approval. An increase in DSI-value and a decrease in HD, in particular for the prophylactic Clinical Target Volume (pCTV), could be found for the resubmitted cases. No unacceptable variations could be found for the planning exercise. CONCLUSIONS These BC-results highlight the need for effective and prospective RTQA in clinical trials. Even with clearly defined protocol guidelines, delineation and not planning remain the main reason for unacceptable protocol variations. The introduction of more objective quantitative analysis methods, such as the HD and DSI, in future trials might strengthen the evaluation by experts.
Collapse
Affiliation(s)
- Melissa Christiaens
- EORTC HQ, Brussels, Belgium; Department of Radiation Oncology, University Hospital Leuven, Belgium.
| | | | - Jens Overgaard
- Department of Radiation Oncology, Aarhus University Hospital, Denmark
| | - Vincent Gregoire
- Department of Radiation Oncology, Université Catholique de Louvain, St-Luc University Hospital, Brussels, Belgium
| | | | | | - Jordi Giralt
- Radiation Oncology, Hospital General Vall D'Hebron, Barcelona, Spain
| | - Warren Grant
- Oncology Centre, Cheltenham General Hospital, Gloucestershire Hospitals NHS Foundation Trust, UK
| | | | | | - Angelo F Monti
- Department of Medical Physics, Ospedale Niguarda Ca' Granda, Milan, Italy
| | - Coen Wilhelm Hurkmans
- ROG RTQA Strategic Committee, EORTC, Brussels, Belgium; Radiation Oncology, Catharina Hospital, Eindhoven, The Netherlands
| | - Damien Charles Weber
- ROG RTQA Strategic Committee, EORTC, Brussels, Belgium; Center for Proton Therapy, Paul Scherrer Institute, Villigen, Switzerland; University of Zürich, Switzerland
| |
Collapse
|
33
|
Luo J, Mou Z, Qin B, Li W, Yang F, Robini M, Zhu Y. Fast single image super-resolution using estimated low-frequency k-space data in MRI. Magn Reson Imaging 2017; 40:1-11. [PMID: 28366758 DOI: 10.1016/j.mri.2017.03.008] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2017] [Revised: 03/27/2017] [Accepted: 03/27/2017] [Indexed: 12/18/2022]
Abstract
PURPOSE Single image super-resolution (SR) is highly desired in many fields but obtaining it is often technically limited in practice. The purpose of this study was to propose a simple, rapid and robust single image SR method in magnetic resonance (MR) imaging (MRI). METHODS The idea is based on the mathematical formulation of the intrinsic link in k-space between a given (modulus) low-resolution (LR) image and the desired SR image. The method consists of two steps: 1) estimating the low-frequency k-space data of the desired SR image from a single LR image; 2) reconstructing the SR image using the estimated low-frequency and zero-filled high-frequency k-space data. The method was evaluated on digital phantom images, physical phantom MR images and real brain MR images, and compared with existing SR methods. RESULTS The proposed SR method exhibited a good robustness by reaching a clearly higher PSNR (25.77dB) and SSIM (0.991) averaged over different noise levels in comparison with existing edge-guided nonlinear interpolation (EGNI) (PSNR=23.78dB, SSIM=0.983), zero-filling (ZF) (PSNR=24.09dB, SSIM=0.985) and total variation (TV) (PSNR=24.54dB, SSIM=0.987) methods while presenting the same order of computation time as the ZF method but being much faster than the EGNI or TV method. The average PSNR or SSIM over different slice images of the proposed method (PSNR=26.33 dB or SSIM=0.955) was also higher than the EGNI (PSNR=25.07dB or SSIM=0.952), ZF (PSNR=24.97dB or SSIM=0.950) and TV (PSNR=25.70dB or SSIM=0.953) methods, demonstrating its good robustness to variation in anatomical structure of the images. Meanwhile, the proposed method always produced less ringing artifacts than the ZF method, gave a clearer image than the EGNI method, and did not exhibit any blocking effect presented in the TV method. In addition, the proposed method yielded the highest spatial consistency in the inter-slice dimension among the four methods. CONCLUSIONS This study proposed a fast, robust and efficient single image SR method with high spatial consistency in the inter-slice dimension for clinical MR images by estimating the low-frequency k-space data of the desired SR image from a single spatial modulus LR image.
Collapse
Affiliation(s)
- Jianhua Luo
- School of Aeronautics and Astronautics, Shanghai Jiao Tong University, 200240, China
| | - Zhiying Mou
- China National Aeronautical Radio Electronics Research Institute, Shanghai 200233, China
| | - Binjie Qin
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China.
| | - Wanqing Li
- School of Computer Science and Software Engineering, University of Wollongong, NSW 2522, Australia
| | - Feng Yang
- School of Computer and Information Technology, Beijing Jiao Tong University, China
| | - Marc Robini
- University of Lyon; CNRS UMR 5220; Inserm U1206; INSA Lyon, Creatis, France
| | - Yuemin Zhu
- University of Lyon; CNRS UMR 5220; Inserm U1206; INSA Lyon, Creatis, France
| |
Collapse
|
34
|
Lin JS, Fuentes DT, Chandler A, Prabhu SS, Weinberg JS, Baladandayuthapani V, Hazle JD, Schellingerhout D. Performance Assessment for Brain MR Imaging Registration Methods. AJNR Am J Neuroradiol 2017; 38:973-980. [PMID: 28279984 DOI: 10.3174/ajnr.a5122] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2016] [Accepted: 12/12/2016] [Indexed: 11/07/2022]
Abstract
BACKGROUND AND PURPOSE Clinical brain MR imaging registration algorithms are often made available by commercial vendors without figures of merit. The purpose of this study was to suggest a rational performance comparison methodology for these products. MATERIALS AND METHODS Twenty patients were imaged on clinical 3T scanners by using 4 sequences: T2-weighted, FLAIR, susceptibility-weighted angiography, and T1 postcontrast. Fiducial landmark sites (n = 1175) were specified throughout these image volumes to define identical anatomic locations across sequences. Multiple registration algorithms were applied by using the T2 sequence as a fixed reference. Euclidean error was calculated before and after each registration and compared with a criterion standard landmark registration. The Euclidean effectiveness ratio is the fraction of Euclidean error remaining after registration, and the statistical effectiveness ratio is similar, but accounts for dispersion and noise. RESULTS Before registration, error values for FLAIR, susceptibility-weighted angiography, and T1 postcontrast were 2.07 ± 0.55 mm, 2.63 ± 0.62 mm, and 3.65 ± 2.00 mm, respectively. Postregistration, the best error values for FLAIR, susceptibility-weighted angiography, and T1 postcontrast were 1.55 ± 0.46 mm, 1.34 ± 0.23 mm, and 1.06 ± 0.16 mm, with Euclidean effectiveness ratio values of 0.493, 0.181, and 0.096 and statistical effectiveness ratio values of 0.573, 0.352, and 0.929 for rigid mutual information, affine mutual information, and a commercial GE registration, respectively. CONCLUSIONS We demonstrate a method for comparing the performance of registration algorithms and suggest the Euclidean error, Euclidean effectiveness ratio, and statistical effectiveness ratio as performance metrics for clinical registration algorithms. These figures of merit allow registration algorithms to be rationally compared.
Collapse
Affiliation(s)
- J S Lin
- From the Department of Bioengineering (J.S.L.), Rice University, Houston, Texas.,Departments of Imaging Physics (J.S.L., D.T.F., A.C., J.D.H.)
| | - D T Fuentes
- Departments of Imaging Physics (J.S.L., D.T.F., A.C., J.D.H.)
| | - A Chandler
- Departments of Imaging Physics (J.S.L., D.T.F., A.C., J.D.H.).,Molecular Imaging and Computed Tomography Research (A.C.), GE Healthcare, Milwaukee, Wisconsin
| | | | | | | | - J D Hazle
- Departments of Imaging Physics (J.S.L., D.T.F., A.C., J.D.H.)
| | - D Schellingerhout
- Diagnostic Radiology (D.S.) .,Cancer Systems Imaging (D.S.), University of Texas M.D. Anderson Cancer Center, Houston, Texas
| |
Collapse
|
35
|
O'Donnell LJ, Suter Y, Rigolo L, Kahali P, Zhang F, Norton I, Albi A, Olubiyi O, Meola A, Essayed WI, Unadkat P, Ciris PA, Wells WM, Rathi Y, Westin CF, Golby AJ. Automated white matter fiber tract identification in patients with brain tumors. NEUROIMAGE-CLINICAL 2016; 13:138-153. [PMID: 27981029 PMCID: PMC5144756 DOI: 10.1016/j.nicl.2016.11.023] [Citation(s) in RCA: 95] [Impact Index Per Article: 10.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/09/2016] [Revised: 10/13/2016] [Accepted: 11/22/2016] [Indexed: 01/06/2023]
Abstract
We propose a method for the automated identification of key white matter fiber tracts for neurosurgical planning, and we apply the method in a retrospective study of 18 consecutive neurosurgical patients with brain tumors. Our method is designed to be relatively robust to challenges in neurosurgical tractography, which include peritumoral edema, displacement, and mass effect caused by mass lesions. The proposed method has two parts. First, we learn a data-driven white matter parcellation or fiber cluster atlas using groupwise registration and spectral clustering of multi-fiber tractography from healthy controls. Key fiber tract clusters are identified in the atlas. Next, patient-specific fiber tracts are automatically identified using tractography-based registration to the atlas and spectral embedding of patient tractography. Results indicate good generalization of the data-driven atlas to patients: 80% of the 800 fiber clusters were identified in all 18 patients, and 94% of the 800 fiber clusters were found in 16 or more of the 18 patients. Automated subject-specific tract identification was evaluated by quantitative comparison to subject-specific motor and language functional MRI, focusing on the arcuate fasciculus (language) and corticospinal tracts (motor), which were identified in all patients. Results indicate good colocalization: 89 of 95, or 94%, of patient-specific language and motor activations were intersected by the corresponding identified tract. All patient-specific activations were within 3mm of the corresponding language or motor tract. Overall, our results indicate the potential of an automated method for identifying fiber tracts of interest for neurosurgical planning, even in patients with mass lesions. Spectral clustering machine learning approach for white matter tract identification Data-driven white matter parcellation learned from healthy subjects tractography White matter parcellation applied to 18 consecutive patients with brain tumors Arcuate fasciculus and corticospinal tracts identified in all patients All tracts within 3 mm of corresponding patient-specific functional activations
Collapse
Affiliation(s)
- Lauren J O'Donnell
- Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| | - Yannick Suter
- Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA; Institute for Surgical Technology and Biomechanics, University of Bern, Switzerland
| | - Laura Rigolo
- Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| | - Pegah Kahali
- Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| | - Fan Zhang
- Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| | - Isaiah Norton
- Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| | - Angela Albi
- Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA; Center for Mind/Brain Sciences (CIMEC), University of Trento, Rovereto, Italy
| | - Olutayo Olubiyi
- Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| | - Antonio Meola
- Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| | - Walid I Essayed
- Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| | - Prashin Unadkat
- Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| | - Pelin Aksit Ciris
- Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA; Department of Biomedical Engineering, Akdeniz University, Antalya, Turkey
| | - William M Wells
- Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| | - Yogesh Rathi
- Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| | | | - Alexandra J Golby
- Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| |
Collapse
|
36
|
Atalay HA, Ülker V, Alkan İ, Canat HL, Özkuvancı Ü, Altunrende F. Impact of Three-Dimensional Printed Pelvicaliceal System Models on Residents' Understanding of Pelvicaliceal System Anatomy Before Percutaneous Nephrolithotripsy Surgery: A Pilot Study. J Endourol 2016; 30:1132-1137. [DOI: 10.1089/end.2016.0307] [Citation(s) in RCA: 39] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Affiliation(s)
- Hasan Anıl Atalay
- Department of Urology, Okmeydanı Training and Research Hospital, Sisli-Istanbul, Turkey
| | - Volkan Ülker
- Department of Urology, Okmeydanı Training and Research Hospital, Sisli-Istanbul, Turkey
| | - İlter Alkan
- Department of Urology, Okmeydanı Training and Research Hospital, Sisli-Istanbul, Turkey
| | - Halil Lütfi Canat
- Department of Urology, Okmeydanı Training and Research Hospital, Sisli-Istanbul, Turkey
| | - Ünsal Özkuvancı
- Department of Urology, Istanbul Medical School, Çapa- Istanbul, Turkey
| | - Fatih Altunrende
- Department of Urology, Okmeydanı Training and Research Hospital, Sisli-Istanbul, Turkey
| |
Collapse
|
37
|
Roura E, Schneider T, Modat M, Daga P, Muhlert N, Chard D, Ourselin S, Lladó X, Gandini Wheeler-Kingshott C. Multi-channel registration of fractional anisotropy and T1-weighted images in the presence of atrophy: application to multiple sclerosis. FUNCTIONAL NEUROLOGY 2016; 30:245-56. [PMID: 26727703 DOI: 10.11138/fneur/2015.30.4.245] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Co-registration of structural T1-weighted (T1w) scans and diffusion tensor imaging (DTI)-derived fractional anisotropy (FA) maps to a common space is of particular interest in neuroimaging, as T1w scans can be used for brain segmentation while DTI can provide microstructural tissue information. While the effect of lesions on registration has been tackled and solutions are available, the issue of atrophy is still open to discussion. Multi-channel (MC) registration algorithms have the advantage of maintaining anatomical correspondence between different contrast images after registration to any target space. In this work, we test the performance of an MC registration approach applied to T1w and FA data using simulated brain atrophy images. Experimental results are compared with a standard single-channel registration approach. Multi-channel registration of fractional anisotropy and T1-weighted images in the presence of atrophy: application to multiple sclerosis Both qualitative and quantitative evaluations are presented, showing that the MC approach provides better alignment with the target while maintaining better T1w and FA co-alignment.
Collapse
|
38
|
Drakopoulos F, Chrisochoides NP. Accurate and fast deformable medical image registration for brain tumor resection using image-guided neurosurgery. COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING: IMAGING & VISUALIZATION 2016. [DOI: 10.1080/21681163.2015.1067869] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
39
|
Selbekk T, Solheim O, Unsgård G. Ultrasound-guided neurosurgery: experiences from 20 years of cross-disciplinary research in Trondheim, Norway. Neurosurg Focus 2016; 40:E2. [PMID: 26926060 DOI: 10.3171/2015.12.focus15582] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Affiliation(s)
- Tormod Selbekk
- Department of Medical Technology, SINTEF;,Norwegian National Advisory Unit for Ultrasound and Image-Guided Therapy; and
| | - Ole Solheim
- Department of Neuroscience, Norwegian University of Science and Technology;,Norwegian National Advisory Unit for Ultrasound and Image-Guided Therapy; and.,Department of Neurosurgery, St. Olav's University Hospital, Trondheim, Norway
| | - Geirmund Unsgård
- Department of Neuroscience, Norwegian University of Science and Technology;,Norwegian National Advisory Unit for Ultrasound and Image-Guided Therapy; and.,Department of Neurosurgery, St. Olav's University Hospital, Trondheim, Norway
| |
Collapse
|
40
|
Williams D, Zheng Y, Davey PG, Bao F, Shen M, Elsheikh A. Reconstruction of 3D surface maps from anterior segment optical coherence tomography images using graph theory and genetic algorithms. Biomed Signal Process Control 2016. [DOI: 10.1016/j.bspc.2015.11.004] [Citation(s) in RCA: 32] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
41
|
Ahmad S, Khan MF. Topology preserving non-rigid image registration using time-varying elasticity model for MRI brain volumes. Comput Biol Med 2015; 67:21-8. [PMID: 26492319 DOI: 10.1016/j.compbiomed.2015.09.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2015] [Accepted: 09/29/2015] [Indexed: 10/22/2022]
Abstract
In this paper, we present a new non-rigid image registration method that imposes a topology preservation constraint on the deformation. We propose to incorporate the time varying elasticity model into the deformable image matching procedure and constrain the Jacobian determinant of the transformation over the entire image domain. The motion of elastic bodies is governed by a hyperbolic partial differential equation, generally termed as elastodynamics wave equation, which we propose to use as a deformation model. We carried out clinical image registration experiments on 3D magnetic resonance brain scans from IBSR database. The results of the proposed registration approach in terms of Kappa index and relative overlap computed over the subcortical structures were compared against the existing topology preserving non-rigid image registration methods and non topology preserving variant of our proposed registration scheme. The Jacobian determinant maps obtained with our proposed registration method were qualitatively and quantitatively analyzed. The results demonstrated that the proposed scheme provides good registration accuracy with smooth transformations, thereby guaranteeing the preservation of topology.
Collapse
Affiliation(s)
- Sahar Ahmad
- National University of Sciences and Technology (NUST), Military College of Signals, Islamabad, Pakistan.
| | - Muhammad Faisal Khan
- National University of Sciences and Technology (NUST), Military College of Signals, Islamabad, Pakistan.
| |
Collapse
|
42
|
Computational Modeling for Enhancing Soft Tissue Image Guided Surgery: An Application in Neurosurgery. Ann Biomed Eng 2015; 44:128-38. [PMID: 26354118 DOI: 10.1007/s10439-015-1433-1] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2015] [Accepted: 08/18/2015] [Indexed: 01/14/2023]
Abstract
With the recent advances in computing, the opportunities to translate computational models to more integrated roles in patient treatment are expanding at an exciting rate. One area of considerable development has been directed towards correcting soft tissue deformation within image guided neurosurgery applications. This review captures the efforts that have been undertaken towards enhancing neuronavigation by the integration of soft tissue biomechanical models, imaging and sensing technologies, and algorithmic developments. In addition, the review speaks to the evolving role of modeling frameworks within surgery and concludes with some future directions beyond neurosurgical applications.
Collapse
|
43
|
Pereira VM, Smit-Ockeloen I, Brina O, Babic D, Breeuwer M, Schaller K, Lovblad KO, Ruijters D. Volumetric Measurements of Brain Shift Using Intraoperative Cone-Beam Computed Tomography: Preliminary Study. Oper Neurosurg (Hagerstown) 2015; 12:4-13. [PMID: 29506247 DOI: 10.1227/neu.0000000000000999] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2014] [Accepted: 07/24/2015] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Cerebrospinal fluid leakage and ventricular compression during open surgery may lead to brain deformation called brain shift. Brain shift may affect intraoperative navigation that is based on image-based preoperative planning. Tools to correct or predict these anatomic modifications can be important to maintain precision during open guided neurosurgery. OBJECTIVE To obtain a reliable intraoperative volumetric deformation vector field describing brain shift during intracranial neurosurgical procedures. METHODS We acquired preoperative and intraoperative cone-beam computed tomography enhanced with intravenous injection of iodine contrast. These data sets were preprocessed and elastically registered to obtain the volumetric brain shift deformation vector fields. RESULTS We obtained the brain shift deformation vector field in 9 cases. The deformation fields proved to be highly nonlinear, particularly around the ventricles. Interpatient variability was considerable, with a maximum deformation ranging from 8.1 to 26.6 mm and a standard deviation ranging from 0.9 to 4.9 mm. CONCLUSION Contrast-enhanced cone-beam computed tomography provides a feasible technique for intraoperatively determining brain shift deformation vector fields. This technique can be used perioperatively to adjust preoperative planning and coregistration during neurosurgical procedures.
Collapse
Affiliation(s)
- Vitor Mendes Pereira
- Division of Neuroradiology, Department of Medical Imaging, University Hospitals of Geneva, Geneva, Switzerland.,Division of Neuroradiology, Joint Department of Medical Imaging and Division of Neurosurgery, Department of Surgery, University Health Network, Toronto, Ontario, Canada
| | - Iris Smit-Ockeloen
- Eindhoven University of Technology, Department of Biomedical Engineering, Eindhoven, the Netherlands
| | - Olivier Brina
- Division of Neuroradiology, Department of Medical Imaging, University Hospitals of Geneva, Geneva, Switzerland
| | | | - Marcel Breeuwer
- Eindhoven University of Technology, Department of Biomedical Engineering, Eindhoven, the Netherlands.,Philips Healthcare, Best, the Netherlands
| | - Karl Schaller
- Division of Neurosurgery, University Hospitals of Geneva, Geneva, Switzerland
| | - Karl-Olof Lovblad
- Division of Neuroradiology, Department of Medical Imaging, University Hospitals of Geneva, Geneva, Switzerland
| | | |
Collapse
|
44
|
Liu Y, Yao C, Drakopoulos F, Wu J, Zhou L, Chrisochoides N. A nonrigid registration method for correcting brain deformation induced by tumor resection. Med Phys 2015; 41:101710. [PMID: 25281949 DOI: 10.1118/1.4893754] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE This paper presents a nonrigid registration method to align preoperative MRI with intraoperative MRI to compensate for brain deformation during tumor resection. This method extends traditional point-based nonrigid registration in two aspects: (1) allow the input data to be incomplete and (2) simulate the underlying deformation with a heterogeneous biomechanical model. METHODS The method formulates the registration as a three-variable (point correspondence, deformation field, and resection region) functional minimization problem, in which point correspondence is represented by a fuzzy assign matrix; Deformation field is represented by a piecewise linear function regularized by the strain energy of a heterogeneous biomechanical model; and resection region is represented by a maximal simply connected tetrahedral mesh. A nested expectation and maximization framework is developed to simultaneously resolve these three variables. RESULTS To evaluate this method, the authors conducted experiments on both synthetic data and clinical MRI data. The synthetic experiment confirmed their hypothesis that the removal of additional elements from the biomechanical model can improve the accuracy of the registration. The clinical MRI experiments on 25 patients showed that the proposed method outperforms the ITK implementation of a physics-based nonrigid registration method. The proposed method improves the accuracy by 2.88 mm on average when the error is measured by a robust Hausdorff distance metric on Canny edge points, and improves the accuracy by 1.56 mm on average when the error is measured by six anatomical points. CONCLUSIONS The proposed method can effectively correct brain deformation induced by tumor resection.
Collapse
Affiliation(s)
- Yixun Liu
- The Department of Computer Science, Old Dominion University, Norfolk, Virginia 23529
| | - Chengjun Yao
- The Department of Neurosurgery, Huashan Hospital, Shanghai 200040, China
| | - Fotis Drakopoulos
- The Department of Computer Science, Old Dominion University, Norfolk, Virginia 23529
| | - Jinsong Wu
- The Department of Neurosurgery, Huashan Hospital, Shanghai 200040, China
| | - Liangfu Zhou
- The Department of Neurosurgery, Huashan Hospital, Shanghai 200040, China
| | - Nikos Chrisochoides
- The Department of Computer Science, Old Dominion University, Norfolk, Virginia 23529
| |
Collapse
|
45
|
Gardner SJ, Wen N, Kim J, Liu C, Pradhan D, Aref I, Cattaneo R, Vance S, Movsas B, Chetty IJ, Elshaikh MA. Contouring variability of human- and deformable-generated contours in radiotherapy for prostate cancer. Phys Med Biol 2015; 60:4429-47. [PMID: 25988718 DOI: 10.1088/0031-9155/60/11/4429] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
This study was designed to evaluate contouring variability of human-and deformable-generated contours on planning CT (PCT) and CBCT for ten patients with low-or intermediate-risk prostate cancer. For each patient in this study, five radiation oncologists contoured the prostate, bladder, and rectum, on one PCT dataset and five CBCT datasets. Consensus contours were generated using the STAPLE method in the CERR software package. Observer contours were compared to consensus contour, and contour metrics (Dice coefficient, Hausdorff distance, Contour Distance, Center-of-Mass [COM] Deviation) were calculated. In addition, the first day CBCT was registered to subsequent CBCT fractions (CBCTn: CBCT2-CBCT5) via B-spline Deformable Image Registration (DIR). Contours were transferred from CBCT1 to CBCTn via the deformation field, and contour metrics were calculated through comparison with consensus contours generated from human contour set. The average contour metrics for prostate contours on PCT and CBCT were as follows: Dice coefficient-0.892 (PCT), 0.872 (CBCT-Human), 0.824 (CBCT-Deformed); Hausdorff distance-4.75 mm (PCT), 5.22 mm (CBCT-Human), 5.94 mm (CBCT-Deformed); Contour Distance (overall contour)-1.41 mm (PCT), 1.66 mm (CBCT-Human), 2.30 mm (CBCT-Deformed); COM Deviation-2.01 mm (PCT), 2.78 mm (CBCT-Human), 3.45 mm (CBCT-Deformed). For human contours on PCT and CBCT, the difference in average Dice coefficient between PCT and CBCT (approx. 2%) and Hausdorff distance (approx. 0.5 mm) was small compared to the variation between observers for each patient (standard deviation in Dice coefficient of 5% and Hausdorff distance of 2.0 mm). However, additional contouring variation was found for the deformable-generated contours (approximately 5.0% decrease in Dice coefficient and 0.7 mm increase in Hausdorff distance relative to human-generated contours on CBCT). Though deformable contours provide a reasonable starting point for contouring on CBCT, we conclude that contours generated with B-Spline DIR require physician review and editing if they are to be used in the clinic.
Collapse
Affiliation(s)
- Stephen J Gardner
- Department of Radiation Oncology, Josephine Ford Cancer Institute, Henry Ford Health System, Detroit, MI 48202, USA
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
46
|
Olubiyi OI, Ozdemir A, Incekara F, Tie Y, Dolati P, Hsu L, Santagata S, Chen Z, Rigolo L, Golby AJ. Intraoperative Magnetic Resonance Imaging in Intracranial Glioma Resection: A Single-Center, Retrospective Blinded Volumetric Study. World Neurosurg 2015; 84:528-36. [PMID: 25937354 DOI: 10.1016/j.wneu.2015.04.044] [Citation(s) in RCA: 32] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2015] [Revised: 04/13/2015] [Accepted: 04/16/2015] [Indexed: 10/23/2022]
Abstract
BACKGROUND Intraoperative magnetic resonance imaging (IoMRI) was devised to overcome brain shifts during craniotomies. Yet, the acceptance of IoMRI is limited. OBJECTIVE To evaluate impact of IoMRI on intracranial glioma resection outcome including overall patient survival. METHODS A retrospective review of records was performed on a cohort of 164 consecutive patients who underwent resection surgery for newly diagnosed intracranial gliomas either with or without IoMRI technology performed by 2 neurosurgeons in our center. Patient follow-up was at least 5 years. Extent of resection (EOR) was calculated using pre- and postoperative contrast-enhanced and T2-weighted MR-images. Adjusted analysis was performed to compare gross total resection (GTR), EOR, permanent surgery-associated neurologic deficit, and overall survival between the 2 groups. RESULTS Overall median EOR was 92.1%, and 97.45% with IoMRI use and 89.9% without IoMRI, with crude (unadjusted) P < 0.005. GTR was achieved in 49.3% of IoMRI cases, versus in only 21.4% of no-IoMRI cases, P < 0.001. GTR achieved was more with the use of IoMRI among gliomas located in both eloquent and noneloquent brain areas, P = 0.017 and <0.001, respectively. Permanent surgery-associated neurologic deficit was not (statistically) more significant with no-IoMRI, P = 0.284 (13.8% vs. 6.7%). In addition, the IoMRI group had better 5-year overall survival, P < 0.001. CONCLUSION This study shows that the use of IoMRI was associated with greater rates of EOR and GTR, and better overall 5-year survival in both eloquent brain areas located and non-eloquent brain areas located gliomas, with no increased risk of neurologic complication.
Collapse
Affiliation(s)
- Olutayo Ibukunolu Olubiyi
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
| | - Aysegul Ozdemir
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA; Department of Neurosurgery, Haseki Training and Research Hospital, Cad. Fatih, Istanbul, Turkey
| | - Fatih Incekara
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA; Erasmus Medical Center Rotterdam, Netherlands
| | - Yanmei Tie
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Parviz Dolati
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Liangge Hsu
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Sandro Santagata
- Department of Pathology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Zhenrui Chen
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA; Department of Neurosurgery, Jinling Hospital, Southern Medical University, Nanjing, Jiangsu, China
| | - Laura Rigolo
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Alexandra J Golby
- Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA; Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
47
|
Gao Y, Zhu L, Cates J, MacLeod RS, Bouix S, Tannenbaum A. A Kalman Filtering Perspective for Multiatlas Segmentation. SIAM JOURNAL ON IMAGING SCIENCES 2015; 8:1007-1029. [PMID: 26807162 PMCID: PMC4722821 DOI: 10.1137/130933423] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
In multiatlas segmentation, one typically registers several atlases to the novel image, and their respective segmented label images are transformed and fused to form the final segmentation. In this work, we provide a new dynamical system perspective for multiatlas segmentation, inspired by the following fact: The transformation that aligns the current atlas to the novel image can be not only computed by direct registration but also inferred from the transformation that aligns the previous atlas to the image together with the transformation between the two atlases. This process is similar to the global positioning system on a vehicle, which gets position by inquiring from the satellite and by employing the previous location and velocity-neither answer in isolation being perfect. To solve this problem, a dynamical system scheme is crucial to combine the two pieces of information; for example, a Kalman filtering scheme is used. Accordingly, in this work, a Kalman multiatlas segmentation is proposed to stabilize the global/affine registration step. The contributions of this work are twofold. First, it provides a new dynamical systematic perspective for standard independent multiatlas registrations, and it is solved by Kalman filtering. Second, with very little extra computation, it can be combined with most existing multiatlas segmentation schemes for better registration/segmentation accuracy.
Collapse
Affiliation(s)
- Yi Gao
- Department of Biomedical Informatics and Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, NY 11794
| | - Liangjia Zhu
- Department of Computer Science, Stony Brook University, Stony Brook, NY 11790
| | - Joshua Cates
- Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, UT 84112
| | - Rob S. MacLeod
- Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, UT 84112
| | - Sylvain Bouix
- Department of Psychiatry, Harvard Medical School, Boston, MA 02215
| | - Allen Tannenbaum
- Department of Computer Science and Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, NY 11794
| |
Collapse
|
48
|
Stippich C, Blatow M, Garcia M. Task-Based Presurgical Functional MRI in Patients with Brain Tumors. CLINICAL FUNCTIONAL MRI 2015. [DOI: 10.1007/978-3-662-45123-6_4] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/11/2023]
|
49
|
The role of diffusion tensor imaging in brain tumor surgery: A review of the literature. Clin Neurol Neurosurg 2014; 124:51-8. [DOI: 10.1016/j.clineuro.2014.06.009] [Citation(s) in RCA: 72] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2014] [Revised: 05/27/2014] [Accepted: 06/08/2014] [Indexed: 12/31/2022]
|
50
|
The Promise of Multimodal Image Guidance in Neurosurgery. World Neurosurg 2014; 82:e183-4. [DOI: 10.1016/j.wneu.2014.02.021] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2013] [Accepted: 02/12/2014] [Indexed: 11/18/2022]
|