1
|
Chamberland M, Yang JYM, Aydogan DB. Real-time tractography: computation and visualization. Brain Struct Funct 2025; 230:62. [PMID: 40328906 DOI: 10.1007/s00429-025-02928-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2025] [Accepted: 04/27/2025] [Indexed: 05/08/2025]
Abstract
Did you know that even though tractography is often considered a computationally expensive and offline process, the latest algorithms can now be performed in real-time without sacrificing accuracy? Interactive real-time tractography has proven to be valuable in surgical planning and has the potential to enhance neuromodulation therapies, highlighting the importance of speed and precision in the generation of tractograms. This demand has driven the development of nearly 50 visualization tools over the past two decades, with advances in interactive real-time tractography offering new possibilities and providing rich insights into brain connectivity.
Collapse
Affiliation(s)
- Maxime Chamberland
- Department of Mathematics and Computer Science, Eindhoven University of Technology, Eindhoven, The Netherlands.
| | - Joseph Yuan-Mou Yang
- Department of Neurosurgery, Neuroscience Advanced Clinical Imaging Service (NACIS), The Royal Children's Hospital, Melbourne, Australia
- Neuroscience Research, Murdoch Children's Research Institute, Parkville, Melbourne, Australia
- Department of Paediatrics, University of Melbourne, Parkville, Melbourne, Australia
| | - Dogu Baran Aydogan
- A.I. Virtanen Institute for Molecular Sciences, University of Eastern Finland, Kuopio, Finland
| |
Collapse
|
2
|
Kim DHC, Williams LJ, Hernandez-Fernandez M, Bjornson BH. Comparison of CPU and GPU bayesian estimates of fibre orientations from diffusion MRI. PLoS One 2022; 17:e0252736. [PMID: 35446840 PMCID: PMC9023062 DOI: 10.1371/journal.pone.0252736] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Accepted: 03/28/2022] [Indexed: 11/18/2022] Open
Abstract
Background
The correct estimation of fibre orientations is a crucial step for reconstructing human brain tracts. Bayesian Estimation of Diffusion Parameters Obtained using Sampling Techniques (bedpostx) is able to estimate several fibre orientations and their diffusion parameters per voxel using Markov Chain Monte Carlo (MCMC) in a whole brain diffusion MRI data, and it is capable of running on GPUs, achieving speed-up of over 100 times compared to CPUs. However, few studies have looked at whether the results from the CPU and GPU algorithms differ. In this study, we compared CPU and GPU bedpostx outputs by running multiple trials of both algorithms on the same whole brain diffusion data and compared each distribution of output using Kolmogorov-Smirnov tests.
Results
We show that distributions of fibre fraction parameters and principal diffusion direction angles from bedpostx and bedpostx_gpu display few statistically significant differences in shape and are localized sparsely throughout the whole brain. Average output differences are small in magnitude compared to underlying uncertainty.
Conclusions
Despite small amount of differences in output between CPU and GPU bedpostx algorithms, results are comparable given the difference in operation order and library usage between CPU and GPU bedpostx.
Collapse
Affiliation(s)
- Danny H. C. Kim
- Brain Mapping, Neuroinformatics and Neurotechnology Laboratory, BC Children’s Hospital, Vancouver, British Columbia, Canada
- * E-mail:
| | - Lynne J. Williams
- Brain Mapping, Neuroinformatics and Neurotechnology Laboratory, BC Children’s Hospital, Vancouver, British Columbia, Canada
- BC Children’s Hospital MRI Research Facility, Vancouver, British Columbia, Canada
| | - Moises Hernandez-Fernandez
- Wellcome Centre for Integrative Neuroimaging (WIN)—Centre for Functional Magnetic Resonance Imaging of the Brain (FMRIB), University of Oxford, United Kingdom
| | - Bruce H. Bjornson
- Brain Mapping, Neuroinformatics and Neurotechnology Laboratory, BC Children’s Hospital, Vancouver, British Columbia, Canada
- BC Children’s Hospital MRI Research Facility, Vancouver, British Columbia, Canada
- Division of Neurology, Department of Pediatrics, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| |
Collapse
|
3
|
Schultz T, Vilanova A. Diffusion MRI visualization. NMR IN BIOMEDICINE 2019; 32:e3902. [PMID: 29485226 DOI: 10.1002/nbm.3902] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/07/2016] [Revised: 11/22/2017] [Accepted: 01/04/2018] [Indexed: 06/08/2023]
Abstract
Modern diffusion magnetic resonance imaging (dMRI) acquires intricate volume datasets and biological meaning can only be found in the relationship between its different measurements. Suitable strategies for visualizing these complicated data have been key to interpretation by physicians and neuroscientists, for drawing conclusions on brain connectivity and for quality control. This article provides an overview of visualization solutions that have been proposed to date, ranging from basic grayscale and color encodings to glyph representations and renderings of fiber tractography. A particular focus is on ongoing and possible future developments in dMRI visualization, including comparative, uncertainty, interactive and dense visualizations.
Collapse
Affiliation(s)
- Thomas Schultz
- Bonn-Aachen International Center for Information Technology, Bonn, Germany
- Department of Computer Science, University of Bonn, Bonn, Germany
| | - Anna Vilanova
- Department of Electrical Engineering Mathematics and Computer Science (EEMCS), TU Delft, Delft, the Netherlands
| |
Collapse
|
4
|
Chang LC, El-Araby E, Dang VQ, Dao LH. GPU acceleration of nonlinear diffusion tensor estimation using CUDA and MPI. Neurocomputing 2014. [DOI: 10.1016/j.neucom.2013.12.035] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
5
|
Harnessing graphics processing units for improved neuroimaging statistics. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2014; 13:587-97. [PMID: 23625719 DOI: 10.3758/s13415-013-0165-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
Simple models and algorithms based on restrictive assumptions are often used in the field of neuroimaging for studies involving functional magnetic resonance imaging, voxel based morphometry, and diffusion tensor imaging. Nonparametric statistical methods or flexible Bayesian models can be applied rather easily to yield more trustworthy results. The spatial normalization step required for multisubject studies can also be improved by taking advantage of more robust algorithms for image registration. A common drawback of algorithms based on weaker assumptions, however, is the increase in computational complexity. In this short overview, we will therefore present some examples of how inexpensive PC graphics hardware, normally used for demanding computer games, can be used to enable practical use of more realistic models and accurate algorithms, such that the outcome of neuroimaging studies really can be trusted.
Collapse
|
6
|
Chamberland M, Whittingstall K, Fortin D, Mathieu D, Descoteaux M. Real-time multi-peak tractography for instantaneous connectivity display. Front Neuroinform 2014; 8:59. [PMID: 24910610 PMCID: PMC4038925 DOI: 10.3389/fninf.2014.00059] [Citation(s) in RCA: 54] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2013] [Accepted: 05/14/2014] [Indexed: 12/13/2022] Open
Abstract
The computerized process of reconstructing white matter tracts from diffusion MRI (dMRI) data is often referred to as tractography. Tractography is nowadays central in structural connectivity since it is the only non-invasive technique to obtain information about brain wiring. Most publicly available tractography techniques and most studies are based on a fixed set of tractography parameters. However, the scale and curvature of fiber bundles can vary from region to region in the brain. Therefore, depending on the area of interest or subject (e.g., healthy control vs. tumor patient), optimal tracking parameters can be dramatically different. As a result, a slight change in tracking parameters may return different connectivity profiles and complicate the interpretation of the results. Having access to tractography parameters can thus be advantageous, as it will help in better isolating those which are sensitive to certain streamline features and potentially converge on optimal settings which are area-specific. In this work, we propose a real-time fiber tracking (RTT) tool which can instantaneously compute and display streamlines. To achieve such real-time performance, we propose a novel evolution equation based on the upsampled principal directions, also called peaks, extracted at each voxel of the dMRI dataset. The technique runs on a single Computer Processing Unit (CPU) without the need for Graphical Unit Processing (GPU) programming. We qualitatively illustrate and quantitatively evaluate our novel multi-peak RTT technique on phantom and human datasets in comparison with the state of the art offline tractography from MRtrix, which is robust to fiber crossings. Finally, we show how our RTT tool facilitates neurosurgical planning and allows one to find fibers that infiltrate tumor areas, otherwise missing when using the standard default tracking parameters.
Collapse
Affiliation(s)
- Maxime Chamberland
- Centre de Recherche CHUS, University of Sherbrooke Sherbrooke, QC, Canada ; Department of Nuclear Medecine and Radiobiology, University of Sherbrooke Sherbrooke, QC, Canada ; Sherbrooke Connectivity Imaging Lab, Computer Science Department, Faculty of Science, University of Sherbrooke Sherbrooke, QC, Canada
| | - Kevin Whittingstall
- Centre de Recherche CHUS, University of Sherbrooke Sherbrooke, QC, Canada ; Department of Nuclear Medecine and Radiobiology, University of Sherbrooke Sherbrooke, QC, Canada ; Department of Diagnostic Radiology, University of Sherbrooke Sherbrooke, QC, Canada
| | - David Fortin
- Centre de Recherche CHUS, University of Sherbrooke Sherbrooke, QC, Canada ; Division of Neurosurgery and Neuro-Oncology, Faculty of Medicine and Health Science, University of Sherbrooke Sherbrooke, QC, Canada
| | - David Mathieu
- Division of Neurosurgery and Neuro-Oncology, Faculty of Medicine and Health Science, University of Sherbrooke Sherbrooke, QC, Canada
| | - Maxime Descoteaux
- Centre de Recherche CHUS, University of Sherbrooke Sherbrooke, QC, Canada ; Sherbrooke Connectivity Imaging Lab, Computer Science Department, Faculty of Science, University of Sherbrooke Sherbrooke, QC, Canada
| |
Collapse
|
7
|
Eklund A, Dufort P, Forsberg D, LaConte SM. Medical image processing on the GPU - past, present and future. Med Image Anal 2013; 17:1073-94. [PMID: 23906631 DOI: 10.1016/j.media.2013.05.008] [Citation(s) in RCA: 127] [Impact Index Per Article: 10.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2012] [Revised: 05/07/2013] [Accepted: 05/22/2013] [Indexed: 01/22/2023]
Abstract
Graphics processing units (GPUs) are used today in a wide range of applications, mainly because they can dramatically accelerate parallel computing, are affordable and energy efficient. In the field of medical imaging, GPUs are in some cases crucial for enabling practical use of computationally demanding algorithms. This review presents the past and present work on GPU accelerated medical image processing, and is meant to serve as an overview and introduction to existing GPU implementations. The review covers GPU acceleration of basic image processing operations (filtering, interpolation, histogram estimation and distance transforms), the most commonly used algorithms in medical imaging (image registration, image segmentation and image denoising) and algorithms that are specific to individual modalities (CT, PET, SPECT, MRI, fMRI, DTI, ultrasound, optical imaging and microscopy). The review ends by highlighting some future possibilities and challenges.
Collapse
Affiliation(s)
- Anders Eklund
- Virginia Tech Carilion Research Institute, Virginia Tech, Roanoke, USA.
| | | | | | | |
Collapse
|
8
|
Eklund A, Andersson M, Knutsson H. fMRI analysis on the GPU-possibilities and challenges. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2012; 105:145-161. [PMID: 21862169 DOI: 10.1016/j.cmpb.2011.07.007] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/15/2010] [Revised: 07/06/2011] [Accepted: 07/11/2011] [Indexed: 05/31/2023]
Abstract
Functional magnetic resonance imaging (fMRI) makes it possible to non-invasively measure brain activity with high spatial resolution. There are however a number of issues that have to be addressed. One is the large amount of spatio-temporal data that needs to be processed. In addition to the statistical analysis itself, several preprocessing steps, such as slice timing correction and motion compensation, are normally applied. The high computational power of modern graphic cards has already successfully been used for MRI and fMRI. Going beyond the first published demonstration of GPU-based analysis of fMRI data, all the preprocessing steps and two statistical approaches, the general linear model (GLM) and canonical correlation analysis (CCA), have been implemented on a GPU. For an fMRI dataset of typical size (80 volumes with 64×64×22voxels), all the preprocessing takes about 0.5s on the GPU, compared to 5s with an optimized CPU implementation and 120s with the commonly used statistical parametric mapping (SPM) software. A random permutation test with 10,000 permutations, with smoothing in each permutation, takes about 50s if three GPUs are used, compared to 0.5-2.5h with an optimized CPU implementation. The presented work will save time for researchers and clinicians in their daily work and enables the use of more advanced analysis, such as non-parametric statistics, both for conventional fMRI and for real-time fMRI.
Collapse
Affiliation(s)
- Anders Eklund
- Division of Medical Informatics, Department of Biomedical Engineering, Linköping University, Sweden.
| | | | | |
Collapse
|
9
|
CUDA-Accelerated Geodesic Ray-Tracing for Fiber Tracking. Int J Biomed Imaging 2011; 2011:698908. [PMID: 21941525 PMCID: PMC3176496 DOI: 10.1155/2011/698908] [Citation(s) in RCA: 13] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2011] [Revised: 06/17/2011] [Accepted: 06/24/2011] [Indexed: 11/18/2022] Open
Abstract
Diffusion Tensor Imaging (DTI) allows to noninvasively measure the diffusion of water in fibrous tissue. By reconstructing the fibers from DTI data using a fiber-tracking algorithm, we can deduce the structure of the tissue. In this paper, we outline an approach to accelerating such a fiber-tracking algorithm using a Graphics Processing Unit (GPU). This algorithm, which is based on the calculation of geodesics, has shown promising results for both synthetic and real data, but is limited in its applicability by its high computational requirements. We present a solution which uses the parallelism offered by modern GPUs, in combination with the CUDA platform by NVIDIA, to significantly reduce the execution time of the fiber-tracking algorithm. Compared to a multithreaded CPU implementation of the same algorithm, our GPU mapping achieves a speedup factor of up to 40 times.
Collapse
|
10
|
Yang YH, Huang TY, Wang FN, Chuang TC, Chen NK. Accelerating EPI distortion correction by utilizing a modern GPU-based parallel computation. J Neuroimaging 2011; 23:202-6. [PMID: 21914033 DOI: 10.1111/j.1552-6569.2011.00654.x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
BACKGROUND AND PURPOSE The combination of phase demodulation and field mapping is a practical method to correct echo planar imaging (EPI) geometric distortion. However, since phase dispersion accumulates in each phase-encoding step, the calculation complexity of phase modulation is Ny-fold higher than conventional image reconstructions. Thus, correcting EPI images via phase demodulation is generally a time-consuming task. METHODS Parallel computing by employing general-purpose calculations on graphics processing units (GPU) can accelerate scientific computing if the algorithm is parallelized. This study proposes a method that incorporates the GPU-based technique into phase demodulation calculations to reduce computation time. The proposed parallel algorithm was applied to a PROPELLER-EPI diffusion tensor data set. RESULTS The GPU-based phase demodulation method reduced the EPI distortion correctly, and accelerated the computation. The total reconstruction time of the 16-slice PROPELLER-EPI diffusion tensor images with matrix size of 128 × 128 was reduced from 1,754 seconds to 101 seconds by utilizing the parallelized 4-GPU program. CONCLUSIONS GPU computing is a promising method to accelerate EPI geometric correction. The resulting reduction in computation time of phase demodulation should accelerate postprocessing for studies performed with EPI, and should effectuate the PROPELLER-EPI technique for clinical practice.
Collapse
Affiliation(s)
- Yao-Hao Yang
- Department of Electrical Engineering, National Taiwan University of Science and Technology, Taipei, Taiwan, ROC
| | | | | | | | | |
Collapse
|
11
|
Huang TY, Tang YW, Ju SY. Accelerating image registration of MRI by GPU-based parallel computation. Magn Reson Imaging 2011; 29:712-6. [PMID: 21531103 DOI: 10.1016/j.mri.2011.02.027] [Citation(s) in RCA: 24] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2010] [Revised: 01/26/2011] [Accepted: 02/20/2011] [Indexed: 11/30/2022]
Affiliation(s)
- Teng-Yi Huang
- Department of Electrical Engineering, National Taiwan University of Science and Technology, Taipei, Taiwan, R.O.C.
| | | | | |
Collapse
|
12
|
Mittmann A, Nobrega THC, Comunello E, Pinto JPO, Dellani PR, Stoeter P, von Wangenheim A. Performing real-time interactive fiber tracking. J Digit Imaging 2010; 24:339-51. [PMID: 20155382 DOI: 10.1007/s10278-009-9266-9] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2009] [Revised: 11/16/2009] [Accepted: 12/13/2009] [Indexed: 01/07/2023] Open
Abstract
Fiber tracking is a technique that, based on a diffusion tensor magnetic resonance imaging dataset, locates the fiber bundles in the human brain. Because it is a computationally expensive process, the interactivity of current fiber tracking tools is limited. We propose a new approach, which we termed real-time interactive fiber tracking, which aims at providing a rich and intuitive environment for the neuroradiologist. In this approach, fiber tracking is executed automatically every time the user acts upon the application. Particularly, when the volume of interest from which fiber trajectories are calculated is moved on the screen, fiber tracking is executed, even while it is being moved. We present our fiber tracking tool, which implements the real-time fiber tracking concept by using the video card's graphics processing units to execute the fiber tracking algorithm. Results show that real-time interactive fiber tracking is feasible on computers equipped with common, low-cost video cards.
Collapse
Affiliation(s)
- Adiel Mittmann
- Universidade Federal de Santa Catarina, Departamento de Informática e Estatística, 88040-970, Florianópolis, SC, Brazil.
| | | | | | | | | | | | | |
Collapse
|