Automated tract extraction via atlas based Adaptive Clustering

Diffusion MRI with Machine Learning

Diffusion-weighted magnetic resonance imaging (dMRI) of the brain offers unique capabilities including noninvasive probing of tissue microstructure and structural connectivity. It is widely used for clinical assessment of disease and injury, and for neuroscience research. Analyzing the dMRI data to extract useful information for medical and scientific purposes can be challenging. The dMRI measurements may suffer from strong noise and artifacts, and may exhibit high inter-session and inter-scanner variability in the data, as well as inter-subject heterogeneity in brain structure. Moreover, the relationship between measurements and the phenomena of interest can be highly complex. Recent years have witnessed increasing use of machine learning methods for dMRI analysis. This manuscript aims to assess these efforts, with a focus on methods that have addressed data preprocessing and harmonization, microstructure mapping, tractography, and white matter tract analysis. We study the main findings, strengths, and weaknesses of the existing methods and suggest topics for future research. We find that machine learning may be exceptionally suited to tackle some of the difficult tasks in dMRI analysis. However, for this to happen, several shortcomings of existing methods and critical unresolved issues need to be addressed. There is a pressing need to improve evaluation practices, to increase the availability of rich training datasets and validation benchmarks, as well as model generalizability, reliability, and explainability concerns.

A systematic review of automated methods to perform white matter tract segmentation

White matter tract segmentation is a pivotal research area that leverages diffusion-weighted magnetic resonance imaging (dMRI) for the identification and mapping of individual white matter tracts and their trajectories. This study aims to provide a comprehensive systematic literature review on automated methods for white matter tract segmentation in brain dMRI scans. Articles on PubMed, ScienceDirect [NeuroImage, NeuroImage (Clinical), Medical Image Analysis], Scopus and IEEEXplore databases and Conference proceedings of Medical Imaging Computing and Computer Assisted Intervention Society (MICCAI) and International Symposium on Biomedical Imaging (ISBI), were searched in the range from January 2013 until September 2023. This systematic search and review identified 619 articles. Adhering to the specified search criteria using the query, "white matter tract segmentation OR fiber tract identification OR fiber bundle segmentation OR tractography dissection OR white matter parcellation OR tract segmentation," 59 published studies were selected. Among these, 27% employed direct voxel-based methods, 25% applied streamline-based clustering methods, 20% used streamline-based classification methods, 14% implemented atlas-based methods, and 14% utilized hybrid approaches. The paper delves into the research gaps and challenges associated with each of these categories. Additionally, this review paper illuminates the most frequently utilized public datasets for tract segmentation along with their specific characteristics. Furthermore, it presents evaluation strategies and their key attributes. The review concludes with a detailed discussion of the challenges and future directions in this field.

Fibre orientation atlas guided rapid segmentation of white matter tracts

Fibre tract delineation from diffusion magnetic resonance imaging (MRI) is a valuable clinical tool for neurosurgical planning and navigation, as well as in research neuroimaging pipelines. Several popular methods are used for this task, each with different strengths and weaknesses making them more or less suited to different contexts. For neurosurgical imaging, priorities include ease of use, computational efficiency, robustness to pathology and ability to generalise to new tracts of interest. Many existing methods use streamline tractography, which may require expert neuroimaging operators for setting parameters and delineating anatomical regions of interest, or suffer from as a lack of generalisability to clinical scans involving deforming tumours and other pathologies. More recently, data-driven approaches including deep-learning segmentation models and streamline clustering methods have improved reproducibility and automation, although they can require large amounts of training data and/or computationally intensive image processing at the point of application. We describe an atlas-based direct tract mapping technique called 'tractfinder', utilising tract-specific location and orientation priors. Our aim was to develop a clinically practical method avoiding streamline tractography at the point of application while utilising prior anatomical knowledge derived from only 10-20 training samples. Requiring few training samples allows emphasis to be placed on producing high quality, neuro-anatomically accurate training data, and enables rapid adaptation to new tracts of interest. Avoiding streamline tractography at the point of application reduces computational time, false positives and vulnerabilities to pathology such as tumour deformations or oedema. Carefully filtered training streamlines and track orientation distribution mapping are used to construct tract specific orientation and spatial probability atlases in standard space. Atlases are then transformed to target subject space using affine registration and compared with the subject's voxel-wise fibre orientation distribution data using a mathematical measure of distribution overlap, resulting in a map of the tract's likely spatial distribution. This work includes extensive performance evaluation and comparison with benchmark techniques, including streamline tractography and the deep-learning method TractSeg, in two publicly available healthy diffusion MRI datasets (from TractoInferno and the Human Connectome Project) in addition to a clinical dataset comprising paediatric and adult brain tumour scans. Tract segmentation results display high agreement with established techniques while requiring less than 3 min on average when applied to a new subject. Results also display higher robustness than compared methods when faced with clinical scans featuring brain tumours and resections. As well as describing and evaluating a novel proposed tract delineation technique, this work continues the discussion on the challenges surrounding the white matter segmentation task, including issues of anatomical definitions and the use of quantitative segmentation comparison metrics.

Deep Learning Methods for Identification of White Matter Fiber Tracts: Review of State-of-the-Art and Future Prospective

Quantitative analysis of white matter fiber tracts from diffusion Magnetic Resonance Imaging (dMRI) data is of great significance in health and disease. For example, analysis of fiber tracts related to anatomically meaningful fiber bundles is highly demanded in pre-surgical and treatment planning, and the surgery outcome depends on accurate segmentation of the desired tracts. Currently, this process is mainly done through time-consuming manual identification performed by neuro-anatomical experts. However, there is a broad interest in automating the pipeline such that it is fast, accurate, and easy to apply in clinical settings and also eliminates the intra-reader variabilities. Following the advancements in medical image analysis using deep learning techniques, there has been a growing interest in using these techniques for the task of tract identification as well. Recent reports on this application show that deep learning-based tract identification approaches outperform existing state-of-the-art methods. This paper presents a review of current tract identification approaches based on deep neural networks. First, we review the recent deep learning methods for tract identification. Next, we compare them with respect to their performance, training process, and network properties. Finally, we end with a critical discussion of open challenges and possible directions for future works.

Deep fiber clustering: Anatomically informed fiber clustering with self-supervised deep learning for fast and effective tractography parcellation

White matter fiber clustering is an important strategy for white matter parcellation, which enables quantitative analysis of brain connections in health and disease. In combination with expert neuroanatomical labeling, data-driven white matter fiber clustering is a powerful tool for creating atlases that can model white matter anatomy across individuals. While widely used fiber clustering approaches have shown good performance using classical unsupervised machine learning techniques, recent advances in deep learning reveal a promising direction toward fast and effective fiber clustering. In this work, we propose a novel deep learning framework for white matter fiber clustering, Deep Fiber Clustering (DFC), which solves the unsupervised clustering problem as a self-supervised learning task with a domain-specific pretext task to predict pairwise fiber distances. This process learns a high-dimensional embedding feature representation for each fiber, regardless of the order of fiber points reconstructed during tractography. We design a novel network architecture that represents input fibers as point clouds and allows the incorporation of additional sources of input information from gray matter parcellation. Thus, DFC makes use of combined information about white matter fiber geometry and gray matter anatomy to improve the anatomical coherence of fiber clusters. In addition, DFC conducts outlier removal naturally by rejecting fibers with low cluster assignment probability. We evaluate DFC on three independently acquired cohorts, including data from 220 individuals across genders, ages (young and elderly adults), and different health conditions (healthy control and multiple neuropsychiatric disorders). We compare DFC to several state-of-the-art white matter fiber clustering algorithms. Experimental results demonstrate superior performance of DFC in terms of cluster compactness, generalization ability, anatomical coherence, and computational efficiency.

Quantitative mapping of the brain's structural connectivity using diffusion MRI tractography: A review

Diffusion magnetic resonance imaging (dMRI) tractography is an advanced imaging technique that enables in vivo reconstruction of the brain's white matter connections at macro scale. It provides an important tool for quantitative mapping of the brain's structural connectivity using measures of connectivity or tissue microstructure. Over the last two decades, the study of brain connectivity using dMRI tractography has played a prominent role in the neuroimaging research landscape. In this paper, we provide a high-level overview of how tractography is used to enable quantitative analysis of the brain's structural connectivity in health and disease. We focus on two types of quantitative analyses of tractography, including: 1) tract-specific analysis that refers to research that is typically hypothesis-driven and studies particular anatomical fiber tracts, and 2) connectome-based analysis that refers to research that is more data-driven and generally studies the structural connectivity of the entire brain. We first provide a review of methodology involved in three main processing steps that are common across most approaches for quantitative analysis of tractography, including methods for tractography correction, segmentation and quantification. For each step, we aim to describe methodological choices, their popularity, and potential pros and cons. We then review studies that have used quantitative tractography approaches to study the brain's white matter, focusing on applications in neurodevelopment, aging, neurological disorders, mental disorders, and neurosurgery. We conclude that, while there have been considerable advancements in methodological technologies and breadth of applications, there nevertheless remains no consensus about the "best" methodology in quantitative analysis of tractography, and researchers should remain cautious when interpreting results in research and clinical applications.

Assessing the Reliability of Template-Based Clustering for Tractography in Healthy Human Adults

Tractography is a non-invasive technique to investigate the brain’s structural pathways (also referred to as tracts) that connect different brain regions. A commonly used approach for identifying tracts is with template-based clustering, where unsupervised clustering is first performed on a template in order to label corresponding tracts in unseen data. However, the reliability of this approach has not been extensively studied. Here, an investigation into template-based clustering reliability was performed, assessing the output from two datasets: Human Connectome Project (HCP) and MyConnectome project. The effect of intersubject variability on template-based clustering reliability was investigated, as well as the reliability of both deep and superficial white matter tracts. Identified tracts were evaluated by assessing Euclidean distances from a dataset-specific tract average centroid, the volumetric overlap across corresponding tracts, and along-tract agreement of quantitative values. Further, two template-based techniques were employed to evaluate the reliability of different clustering approaches. Reliability assessment can increase the confidence of a tract identifying technique in future applications to study pathways of interest. The two different template-based approaches exhibited similar reliability for identifying both deep white matter tracts and the superficial white matter.

Diffusion MRI tractography for neurosurgery: the basics, current state, technical reliability and challenges

Diffusion magnetic resonance imaging (dMRI) tractography is currently the only imaging technique that allows for non-invasive delineation and visualisation of white matter (WM) tractsin vivo,prompting rapid advances in related fields of brain MRI research in recent years. One of its major clinical applications is for pre-surgical planning and intraoperative image guidance in neurosurgery, where knowledge about the location of WM tracts nearby the surgical target can be helpful to guide surgical resection and optimise post-surgical outcomes. Surgical injuries to these WM tracts can lead to permanent neurological and functional deficits, making the accuracy of tractography reconstructions paramount. The quality of dMRI tractography is influenced by many modifiable factors, ranging from MRI data acquisition through to the post-processing of tractography output, with the potential of error propagation based on decisions made at each and subsequent processing steps. Research over the last 25 years has significantly improved the anatomical accuracy of tractography. An updated review about tractography methodology in the context of neurosurgery is now timely given the thriving research activities in dMRI, to ensure more appropriate applications in the clinical neurosurgical realm. This article aims to review the dMRI physics, and tractography methodologies, highlighting recent advances to provide the key concepts of tractography-informed neurosurgery, with a focus on the general considerations, the current state of practice, technical challenges, potential advances, and future demands to this field.

Multimodal Assessment of the Motor System in Patients With Chronic Ischemic Stroke

BACKGROUND AND PURPOSE

Despite continuing efforts in the multimodal assessment of the motor system after stroke, conclusive findings on the complementarity of functional and structural metrics of the ipsilesional corticospinal tract integrity and the role of the contralesional hemisphere are still lacking. This research aimed to find the best combination of motor system metrics, allowing the classification of patients into 3 predefined groups of upper limb motor recovery.

METHODS

We enrolled 35 chronic ischemic stroke patients (mean 47 [26-66] years old, 29 [6-58] months poststroke) with a single supratentorial lesion and unilateral upper extremity weakness. Patients were divided into 3 groups, depending on upper limb motor recovery: good, moderate, and bad. Nonparametric statistical tests and regression analysis were used to investigate the relationships among microstructural (fractional anisotropy (FA) ratio of the corticospinal tracts at the internal capsule (IC) level (classic method) and along the length of the tracts (Fréchet distance), and of the corpus callosum) and functional (motor evoked potentials [MEPs] for 2 hand muscles) motor system metrics. Stratification rules were also tested using a decision tree classifier.

RESULTS

IC FA ratio in the IC and MEP absence were both equally discriminative of the bad motor outcome (96% accuracy). For the 3 recovery groups' classification, the best parameter combination was IC FA ratio and the Fréchet distance between the contralesional and ipsilesional corticospinal tract FA profiles (91% accuracy). No other metrics had any additional value for patients' classification. MEP presence differed for 2 investigated muscles.

CONCLUSIONS

This study demonstrates that better separation between 3 motor recovery groups may be achieved when considering the similarity between corticospinal tract FA profiles along its length in addition to region of interest-based assessment and lesion load calculation. Additionally, IC FA ratio and MEP absence are equally important markers for poor recovery, while for MEP probing it may be important to investigate more than one hand muscle.

Classifyber, a robust streamline-based linear classifier for white matter bundle segmentation

Virtual delineation of white matter bundles in the human brain is of paramount importance for multiple applications, such as pre-surgical planning and connectomics. A substantial body of literature is related to methods that automatically segment bundles from diffusion Magnetic Resonance Imaging (dMRI) data indirectly, by exploiting either the idea of connectivity between regions or the geometry of fiber paths obtained with tractography techniques, or, directly, through the information in volumetric data. Despite the remarkable improvement in automatic segmentation methods over the years, their segmentation quality is not yet satisfactory, especially when dealing with datasets with very diverse characteristics, such as different tracking methods, bundle sizes or data quality. In this work, we propose a novel, supervised streamline-based segmentation method, called Classifyber, which combines information from atlases, connectivity patterns, and the geometry of fiber paths into a simple linear model. With a wide range of experiments on multiple datasets that span from research to clinical domains, we show that Classifyber substantially improves the quality of segmentation as compared to other state-of-the-art methods and, more importantly, that it is robust across very diverse settings. We provide an implementation of the proposed method as open source code, as well as web service.

Freewater estimatoR using iNtErpolated iniTialization (FERNET): Characterizing peritumoral edema using clinically feasible diffusion MRI data

Characterization of healthy versus pathological tissue in the peritumoral area is confounded by the presence of edema, making free water estimation the key concern in modeling tissue microstructure. Most methods that model tissue microstructure are either based on advanced acquisition schemes not readily available in the clinic or are not designed to address the challenge of edema. This underscores the need for a robust free water elimination (FWE) method that estimates free water in pathological tissue but can be used with clinically prevalent single-shell diffusion tensor imaging data. FWE in single-shell data requires the fitting of a bi-compartment model, which is an ill-posed problem. Its solution requires optimization, which relies on an initialization step. We propose a novel initialization approach for FWE, FERNET, which improves the estimation of free water in edematous and infiltrated peritumoral regions, using single-shell diffusion MRI data. The method has been extensively investigated on simulated data and healthy dataset. Additionally, it has been applied to clinically acquired data from brain tumor patients to characterize the peritumoral region and improve tractography in it.

Neural Segmentation of Seeding ROIs (sROIs) for Pre-Surgical Brain Tractography

White matter tractography mapping is an important tool for neuro-surgical planning and navigation. It relies on the accurate manual delineation of anatomical seeding ROIs (sROIs) by neuroanatomy experts. Stringent pre-operative time-constraints and limited availability of experts suggest that automation tools are strongly needed for the task. In this article, we propose and compare several multi-modal fully convolutional network architectures for segmentation of sROIs. Inspired by their manual segmentation practice, anatomical information from T1w maps is fused by the network with directionally encoded color (DEC) maps to compute the segmentation. Qualitative and quantitative validation was performed on image data from 75 real tumor resection candidates for the sROIs of the motor tract, the arcuate fasciculus, and optic radiation. Favorable comparison was also obtained with state-of-the-art methods for the tumor dataset as well as the ISMRM 2017 traCED challenge dataset. The proposed networks showed promising results, indicating they may significantly improve the efficiency of pre-surgical tractography mapping, without compromising its quality.

Registration-free analysis of diffusion MRI tractography data across subjects through the human lifespan

Diffusion MRI tractography produces massive sets of streamlines that need to be clustered into anatomically meaningful white-matter bundles. Conventional clustering techniques group streamlines based on their proximity in Euclidean space. We have developed AnatomiCuts, an unsupervised method for clustering tractography streamlines based on their neighboring anatomical structures, rather than their coordinates in Euclidean space. In this work, we show that the anatomical similarity metric used in AnatomiCuts can be extended to find corresponding clusters across subjects and across hemispheres, without inter-subject or inter-hemispheric registration. Our proposed approach enables group-wise tract cluster analysis, as well as studies of hemispheric asymmetry. We evaluate our approach on data from the pilot MGH-Harvard-USC Lifespan Human Connectome project, showing improved correspondence in tract clusters across 184 subjects aged 8-90. Our method shows up to 38% improvement in the overlap of corresponding clusters when comparing subjects with large age differences. The techniques presented here do not require registration to a template and can thus be applied to populations with large inter-subject variability, e.g., due to brain development, aging, or neurological disorders.

Automatic, Age Consistent Reconstruction of the Corpus Callosum Guided by Coherency From In Utero Diffusion-Weighted MRI

Reconstruction of white matter connectivity in the fetal brain from in utero diffusion-weighted magnetic resonance imaging (MRI) faces many challenges, including subject motion, small anatomical scale, and limited image resolution and signal. These issues are compounded by the need to track significant changes in structural connectivity throughout development. We present an automated method for improved reliability and completeness of tract extraction across a wide range of gestational ages, based on the geometry of coherent patterns in streamline tractography, and apply it to the reconstruction of the corpus callosum. This method, focused specifically at addressing the challenges of fetal brain imaging, avoids depending on a tractography atlas, and handles variations in size, shape, and tissue properties of developing brains, both between subjects and across ages. Although tractography from in utero MRI generally suffers from a significant number of misleading and missing pathways, we demonstrate the feasibility of extracting the coherent bundle of the corpus callosum while avoiding inappropriate diversions into other tracts.

Challenges and Opportunities in Connectome Construction and Quantification in the Developing Human Fetal Brain

The white matter structure of the human brain undergoes critical developmental milestones in utero, which we can observe noninvasively using diffusion-weighted magnetic resonance imaging. In order to understand this fascinating developmental process, we must establish the variability inherent in such a challenging imaging environment and how measurable quantities can be transformed into meaningful connectomes. We review techniques for reconstructing and studying the brain connectome and explore promising opportunities for in utero studies that could lead to more accurate measurement of structural properties and allow for more refined and insightful analyses of the fetal brain. Opportunities for more sophisticated analyses of the properties of the brain and its dynamic changes have emerged in recent years, based on the development of iterative techniques to reconstruct motion-corrupted diffusion-weighted data. Although reconstruction quality is greatly improved, the treatment of fundamental quantities like edge strength requires careful treatment because of the specific challenges of imaging in utero. There are intriguing challenges to overcome, from those in analysis due to both imaging limitations and the significant changes in structural connectivity, to further image processing to address the specific properties of the target anatomy and quantification into a developmental connectome.

An anatomically curated fiber clustering white matter atlas for consistent white matter tract parcellation across the lifespan

This work presents an anatomically curated white matter atlas to enable consistent white matter tract parcellation across different populations. Leveraging a well-established computational pipeline for fiber clustering, we create a tract-based white matter atlas including information from 100 subjects. A novel anatomical annotation method is proposed that leverages population-based brain anatomical information and expert neuroanatomical knowledge to annotate and categorize the fiber clusters. A total of 256 white matter structures are annotated in the proposed atlas, which provides one of the most comprehensive tract-based white matter atlases covering the entire brain to date. These structures are composed of 58 deep white matter tracts including major long range association and projection tracts, commissural tracts, and tracts related to the brainstem and cerebellar connections, plus 198 short and medium range superficial fiber clusters organized into 16 categories according to the brain lobes they connect. Potential false positive connections are annotated in the atlas to enable their exclusion from analysis or visualization. In addition, the proposed atlas allows for a whole brain white matter parcellation into 800 fiber clusters to enable whole brain connectivity analyses. The atlas and related computational tools are open-source and publicly available. We evaluate the proposed atlas using a testing dataset of 584 diffusion MRI scans from multiple independently acquired populations, across genders, the lifespan (1 day-82 years), and different health conditions (healthy control, neuropsychiatric disorders, and brain tumor patients). Experimental results show successful white matter parcellation across subjects from different populations acquired on multiple scanners, irrespective of age, gender or disease indications. Over 99% of the fiber tracts annotated in the atlas were detected in all subjects on average. One advantage in terms of robustness is that the tract-based pipeline does not require any cortical or subcortical segmentations, which can have limited success in young children and patients with brain tumors or other structural lesions. We believe this is the first demonstration of consistent automated white matter tract parcellation across the full lifespan from birth to advanced age.

Neighborhood resolved fiber orientation distributions (NRFOD) in automatic labeling of white matter fiber pathways

Accurate digital representation of major white matter bundles in the brain is an important goal in neuroscience image computing since the representations can be used for surgical planning, intra-patient longitudinal analysis and inter-subject population connectivity studies. Reconstructing desired fiber bundles generally involves manual selection of regions of interest by an expert, which is subject to user bias and fatigue, hence an automation is desirable. To that end, we first present a novel anatomical representation based on Neighborhood Resolved Fiber Orientation Distributions (NRFOD) along the fibers. The resolved fiber orientations are obtained by generalized q-sampling imaging (GQI) and a subsequent diffusion decomposition method. A fiber-to-fiber distance measure between the proposed fiber representations is then used in a density-based clustering framework to select the clusters corresponding to the major pathways of interest. In addition, neuroanatomical priors are utilized to constrain the set of candidate fibers before density-based clustering. The proposed fiber clustering approach is exemplified on automation of the reconstruction of the major fiber pathways in the brainstem: corticospinal tract (CST); medial lemniscus (ML); middle cerebellar peduncle (MCP); inferior cerebellar peduncle (ICP); superior cerebellar peduncle (SCP). Experimental results on Human Connectome Project (HCP)'s publicly available "WU-Minn 500 Subjects + MEG2 dataset" and expert evaluations demonstrate the potential of the proposed fiber clustering method in brainstem white matter structure analysis.

Brain Cancer Imaging Phenomics Toolkit (brain-CaPTk): An Interactive Platform for Quantitative Analysis of Glioblastoma

Quantitative research, especially in the field of radio(geno)mics, has helped us understand fundamental mechanisms of neurologic diseases. Such research is integrally based on advanced algorithms to derive extensive radiomic features and integrate them into diagnostic and predictive models. To exploit the benefit of such complex algorithms, their swift translation into clinical practice is required, currently hindered by their complicated nature. brain-CaPTk is a modular platform, with components spanning across image processing, segmentation, feature extraction, and machine learning, that facilitates such translation, enabling quantitative analyses without requiring substantial computational background. Thus, brain-CaPTk can be seamlessly integrated into the typical quantification, analysis and reporting workflow of a radiologist, underscoring its clinical potential. This paper describes currently available components of brain-CaPTk and example results from their application in glioblastoma.

White Matter Tract Segmentation as Multiple Linear Assignment Problems

Diffusion magnetic resonance imaging (dMRI) allows to reconstruct the main pathways of axons within the white matter of the brain as a set of polylines, called streamlines. The set of streamlines of the whole brain is called the tractogram. Organizing tractograms into anatomically meaningful structures, called tracts, is known as the tract segmentation problem, with important applications to neurosurgical planning and tractometry. Automatic tract segmentation techniques can be unsupervised or supervised. A common criticism of unsupervised methods, like clustering, is that there is no guarantee to obtain anatomically meaningful tracts. In this work, we focus on supervised tract segmentation, which is driven by prior knowledge from anatomical atlases or from examples, i.e., segmented tracts from different subjects. We present a supervised tract segmentation method that segments a given tract of interest in the tractogram of a new subject using multiple examples as prior information. Our proposed tract segmentation method is based on the idea of streamline correspondence i.e., on finding corresponding streamlines across different tractograms. In the literature, streamline correspondence has been addressed with the nearest neighbor (NN) strategy. Differently, here we formulate the problem of streamline correspondence as a linear assignment problem (LAP), which is a cornerstone of combinatorial optimization. With respect to the NN, the LAP introduces a constraint of one-to-one correspondence between streamlines, that forces the correspondences to follow the local anatomical differences between the example and the target tract, neglected by the NN. In the proposed solution, we combined the Jonker-Volgenant algorithm (LAPJV) for solving the LAP together with an efficient way of computing the nearest neighbors of a streamline, which massively reduces the total amount of computations needed to segment a tract. Moreover, we propose a ranking strategy to merge correspondences coming from different examples. We validate the proposed method on tractograms generated from the human connectome project (HCP) dataset and compare the segmentations with the NN method and the ROI-based method. The results show that LAP-based segmentation is vastly more accurate than ROI-based segmentation and substantially more accurate than the NN strategy. We provide a Free/OpenSource implementation of the proposed method.

AnatomiCuts: Hierarchical clustering of tractography streamlines based on anatomical similarity

Diffusion MRI tractography produces massive sets of streamlines that contain a wealth of information on brain connections. The size of these datasets creates a need for automated clustering methods to group the streamlines into meaningful bundles. Conventional clustering techniques group streamlines based on their spatial coordinates. Neuroanatomists, however, define white-matter bundles based on the anatomical structures that they go through or next to, rather than their spatial coordinates. Thus we propose a similarity measure for clustering streamlines based on their position relative to cortical and subcortical brain regions. We incorporate this measure into a hierarchical clustering algorithm and compare it to a measure that relies on Euclidean distance, using data from the Human Connectome Project. We show that the anatomical similarity measure leads to a 20% improvement in the overlap of clusters with manually labeled tracts. Importantly, this is achieved without introducing any prior information from a tract atlas into the clustering algorithm, therefore without imposing the existence of any named tracts.

Cancer imaging phenomics toolkit: quantitative imaging analytics for precision diagnostics and predictive modeling of clinical outcome

The growth of multiparametric imaging protocols has paved the way for quantitative imaging phenotypes that predict treatment response and clinical outcome, reflect underlying cancer molecular characteristics and spatiotemporal heterogeneity, and can guide personalized treatment planning. This growth has underlined the need for efficient quantitative analytics to derive high-dimensional imaging signatures of diagnostic and predictive value in this emerging era of integrated precision diagnostics. This paper presents cancer imaging phenomics toolkit (CaPTk), a new and dynamically growing software platform for analysis of radiographic images of cancer, currently focusing on brain, breast, and lung cancer. CaPTk leverages the value of quantitative imaging analytics along with machine learning to derive phenotypic imaging signatures, based on two-level functionality. First, image analysis algorithms are used to extract comprehensive panels of diverse and complementary features, such as multiparametric intensity histogram distributions, texture, shape, kinetics, connectomics, and spatial patterns. At the second level, these quantitative imaging signatures are fed into multivariate machine learning models to produce diagnostic, prognostic, and predictive biomarkers. Results from clinical studies in three areas are shown: (i) computational neuro-oncology of brain gliomas for precision diagnostics, prediction of outcome, and treatment planning; (ii) prediction of treatment response for breast and lung cancer, and (iii) risk assessment for breast cancer.

Subject-Specific Structural Parcellations Based on Randomized AB-divergences

Brain parcellation provides a means to approach the brain in smaller regions. It also affords an appropriate dimensionality reduction in the creation of connectomes. Most approaches to creating connectomes start with registering individual scans to a template, which is then parcellated. Data processing usually ends with the projection of individual scans onto the parcellation for extracting individual biomarkers, such as connectivity signatures. During this process, registration errors can significantly alter the quality of biomarkers. In this paper, we propose to mitigate this issue with a hybrid approach for brain parcellation. We use diffusion MRI (dMRI) based structural connectivity measures to drive the refinement of an anatomical prior parcellation. Our method generates highly coherent structural parcels in native subject space while maintaining interpretability and correspondences across the population. This goal is achieved by registering a population-wide anatomical prior to individual dMRI scan and generating connectivity signatures for each voxel. The anatomical prior is then deformed by re-parcellating the brain according to the similarity between voxel connectivity signatures while constraining the number of parcels. We investigate a broad family of signature similarities known as AB-divergences and explain how a divergence adapted to our segmentation task can be selected. This divergence is used for parcellating a high-resolution dataset using two graph-based methods. The promising results obtained suggest that our approach produces coherent parcels and stronger connectomes than the original anatomical priors.

Recognition of white matter bundles using local and global streamline-based registration and clustering

Virtual dissection of diffusion MRI tractograms is cumbersome and needs extensive knowledge of white matter anatomy. This virtual dissection often requires several inclusion and exclusion regions-of-interest that make it a process that is very hard to reproduce across experts. Having automated tools that can extract white matter bundles for tract-based studies of large numbers of people is of great interest for neuroscience and neurosurgical planning. The purpose of our proposed method, named RecoBundles, is to segment white matter bundles and make virtual dissection easier to perform. This can help explore large tractograms from multiple persons directly in their native space. RecoBundles leverages latest state-of-the-art streamline-based registration and clustering to recognize and extract bundles using prior bundle models. RecoBundles uses bundle models as shape priors for detecting similar streamlines and bundles in tractograms. RecoBundles is 100% streamline-based, is efficient to work with millions of streamlines and, most importantly, is robust and adaptive to incomplete data and bundles with missing components. It is also robust to pathological brains with tumors and deformations. We evaluated our results using multiple bundles and showed that RecoBundles is in good agreement with the neuroanatomical experts and generally produced more dense bundles. Across all the different experiments reported in this paper, RecoBundles was able to identify the core parts of the bundles, independently from tractography type (deterministic or probabilistic) or size. Thus, RecoBundles can be a valuable method for exploring tractograms and facilitating tractometry studies.

Concurrent white matter bundles and grey matter networks using independent component analysis

Developments in non-invasive diffusion MRI tractography techniques have permitted the investigation of both the anatomy of white matter pathways connecting grey matter regions and their structural integrity. In parallel, there has been an expansion in automated techniques aimed at parcellating grey matter into distinct regions based on functional imaging. Here we apply independent component analysis to whole-brain tractography data to automatically extract brain networks based on their associated white matter pathways. This method decomposes the tractography data into components that consist of paired grey matter ‘nodes’ and white matter ‘edges’, and automatically separates major white matter bundles, including known cortico-cortical and cortico-subcortical tracts. We show how this framework can be used to investigate individual variations in brain networks (in terms of both nodes and edges) as well as their associations with individual differences in behaviour and anatomy. Finally, we investigate correspondences between tractography-based brain components and several canonical resting-state networks derived from functional MRI.

•

Parcellation of whole brain grey matter based on diffusion tractography using ICA.

•

Data driven patterns of connectivity correspond to region-of-interest based tractography.

•

Both hard and soft parcellations show good split-half reliability.

•

Cortical and subcortical parcels correspond to known resting state networks.

•

ICA provides a principled data-reduction step for tractography data.

Reproducibility of superficial white matter tracts using diffusion-weighted imaging tractography

Human brain connection map is far from being complete. In particular the study of the superficial white matter (SWM) is an unachieved task. Its description is essential for the understanding of human brain function and the study of pathogenesis triggered by abnormal connectivity. In this work we automatically created a multi-subject atlas of SWM diffusion-based bundles of the whole brain. For each subject, the complete cortico-cortical tractogram is first split into sub-tractograms connecting pairs of gyri. Then intra-subject shape-based fiber clustering performs compression of each sub-tractogram into a set of bundles. Proceeding further with shape-based clustering provides a match of the bundles across subjects. Bundles found in most of the subjects are instantiated in the atlas. To increase robustness, this procedure was performed with two independent groups of subjects, in order to discard bundles without match across the two independent atlases. Finally, the resulting intersection atlas was projected on a third independent group of subjects in order to filter out bundles without reproducible and reliable projection. The final multi-subject diffusion-based U-fiber atlas is composed of 100 bundles in total, 50 per hemisphere, from which 35 are common to both hemispheres.

Individualized Map of White Matter Pathways: Connectivity-Based Paradigm for Neurosurgical Planning

BACKGROUND

Advances in white matter tractography enhance neurosurgical planning and glioma resection, but white matter tractography is limited by biological variables such as edema, mass effect, and tract infiltration or selection biases related to regions of interest or fractional anisotropy values.

OBJECTIVE

To provide an automated tract identification paradigm that corrects for artifacts created by tumor edema and infiltration and provides a consistent, accurate method of fiber bundle identification.

METHODS

An automated tract identification paradigm was developed and evaluated for glioma surgery. A fiber bundle atlas was generated from 6 healthy participants. Fibers of a test set (including 3 healthy participants and 10 patients with brain tumors) were clustered adaptively with this atlas. Reliability of the identified tracts in both groups was assessed by comparison with 2 experts with the Cohen κ used to quantify concurrence. We evaluated 6 major fiber bundles: cingulum bundle, fornix, uncinate fasciculus, arcuate fasciculus, inferior fronto-occipital fasciculus, and inferior longitudinal fasciculus, the last 3 tracts mediating language function.

RESULTS

The automated paradigm demonstrated a reliable and practical method to identify white mater tracts, despite mass effect, edema, and tract infiltration. When the tumor demonstrated significant mass effect or shift, the automated approach was useful for providing an initialization to guide the expert with identification of the specific tract of interest.

CONCLUSION

We report a reliable paradigm for the automated identification of white matter pathways in patients with gliomas. This approach should enhance the neurosurgical objective of maximal safe resections.

ABBREVIATIONS

AF, arcuate fasciculusDTI, diffusion tensor imagingIFOF, inferior fronto-occipital fasciculusILF, inferior longitudinal fasciculusROI, region of interestWM, white matter.

A Simplified Method of Accurate Postprocessing of Diffusion Tensor Imaging for Use in Brain Tumor Resection

BACKGROUND: Use of diffusion tensor imaging (DTI) in brain tumor resection has been limited in part by a perceived difficulty in implementing the techniques into neurosurgical practice.

OBJECTIVE: To demonstrate a simple DTI postprocessing method performed without a neuroscientist and to share results in preserving patient function while aggressively resecting tumors.

METHODS: DTI data are obtained in all patients with tumors located within presumed eloquent cortices. Relevant white matter tracts are mapped and integrated with neuronavigation by a nonexpert in < 20 minutes. We report operative results in 43 consecutive awake craniotomy patients from January 2014 to December 2014 undergoing resection of intracranial lesions. We compare DTI-expected findings with stimulation mapping results for the corticospinal tract, superior longitudinal fasciculus, and inferior fronto-occipital fasciculus.

RESULTS: Twenty-eight patients (65%) underwent surgery for high-grade gliomas and 11 patients (26%) for low-grade gliomas. Seventeen patients had posterior temporal lesions; 10 had posterior frontal lesions; 8 had parietal-temporal-occipital junction lesions; and 8 had insular lesions. With DTI-defined tracts used as a guide, a combined 65 positive maps and 60 negative maps were found via stimulation mapping. Overall sensitivity and specificity of DTI were 98% and 95%, respectively. Permanent speech worsening occurred in 1 patient (2%), and permanent weakness occurred in 3 patients (7%). Greater than 90% resection was achieved in 32 cases (74%).

CONCLUSION: Accurate DTI is easily obtained, postprocessed, and implemented into neuronavigation within routine neurosurgical workflow. This information aids in resecting tumors while preserving eloquent cortices and subcortical networks.

An Example-Based Multi-Atlas Approach to Automatic Labeling of White Matter Tracts

We present an example-based multi-atlas approach for classifying white matter (WM) tracts into anatomic bundles. Our approach exploits expert-provided example data to automatically classify the WM tracts of a subject. Multiple atlases are constructed to model the example data from multiple subjects in order to reflect the individual variability of bundle shapes and trajectories over subjects. For each example subject, an atlas is maintained to allow the example data of a subject to be added or deleted flexibly. A voting scheme is proposed to facilitate the multi-atlas exploitation of example data. For conceptual simplicity, we adopt the same metrics in both example data construction and WM tract labeling. Due to the huge number of WM tracts in a subject, it is time-consuming to label each WM tract individually. Thus, the WM tracts are grouped according to their shape similarity, and WM tracts within each group are labeled simultaneously. To further enhance the computational efficiency, we implemented our approach on the graphics processing unit (GPU). Through nested cross-validation we demonstrated that our approach yielded high classification performance. The average sensitivities for bundles in the left and right hemispheres were 89.5% and 91.0%, respectively, and their average false discovery rates were 14.9% and 14.2%, respectively.

Robust and efficient linear registration of white-matter fascicles in the space of streamlines

The neuroscientific community today is very much interested in analyzing specific white matter bundles like the arcuate fasciculus, the corticospinal tract, or the recently discovered Aslant tract to study sex differences, lateralization and many other connectivity applications. For this reason, experts spend time manually segmenting these fascicles and bundles using streamlines obtained from diffusion MRI tractography. However, to date, there are very few computational tools available to register these fascicles directly so that they can be analyzed and their differences quantified across populations. In this paper, we introduce a novel, robust and efficient framework to align bundles of streamlines directly in the space of streamlines. We call this framework Streamline-based Linear Registration. We first show that this method can be used successfully to align individual bundles as well as whole brain streamlines. Additionally, if used as a piecewise linear registration across many bundles, we show that our novel method systematically provides higher overlap (Jaccard indices) than state-of-the-art nonlinear image-based registration in the white matter. We also show how our novel method can be used to create bundle-specific atlases in a straightforward manner and we give an example of a probabilistic atlas construction of the optic radiation. In summary, Streamline-based Linear Registration provides a solid registration framework for creating new methods to study the white matter and perform group-level tractometry analysis.

Automated multi-subject fiber clustering of mouse brain using dominant sets

Mapping of structural and functional connectivity may provide deeper understanding of brain function and disfunction. Diffusion Magnetic Resonance Imaging (DMRI) is a powerful technique to non-invasively delineate white matter (WM) tracts and to obtain a three-dimensional description of the structural architecture of the brain. However, DMRI tractography methods produce highly multi-dimensional datasets whose interpretation requires advanced analytical tools. Indeed, manual identification of specific neuroanatomical tracts based on prior anatomical knowledge is time-consuming and prone to operator-induced bias. Here we propose an automatic multi-subject fiber clustering method that enables retrieval of group-wise WM fiber bundles. In order to account for variance across subjects, we developed a multi-subject approach based on a method known as Dominant Sets algorithm, via an intra- and cross-subject clustering. The intra-subject step allows us to reduce the complexity of the raw tractography data, thus obtaining homogeneous neuroanatomically-plausible bundles in each diffusion space. The cross-subject step, characterized by a proper space-invariant metric in the original diffusion space, enables the identification of the same WM bundles across multiple subjects without any prior neuroanatomical knowledge. Quantitative analysis was conducted comparing our algorithm with spectral clustering and affinity propagation methods on synthetic dataset. We also performed qualitative analysis on mouse brain tractography retrieving significant WM structures. The approach serves the final goal of detecting WM bundles at a population level, thus paving the way to the study of the WM organization across groups.