QuickBundles, a Method for Tractography Simplification

Anat-SFSeg: Anatomically-guided superficial fiber segmentation with point-cloud deep learning

Diffusion magnetic resonance imaging (dMRI) tractography is a critical technique to map the brain's structural connectivity. Accurate segmentation of white matter, particularly the superficial white matter (SWM), is essential for neuroscience and clinical research. However, it is challenging to segment SWM due to the short adjacent gyri connection in a U-shaped pattern. In this work, we propose an Anatomically-guided Superficial Fiber Segmentation (Anat-SFSeg) framework to improve the performance on SWM segmentation. The framework consists of a unique fiber anatomical descriptor (named FiberAnatMap) and a deep learning network based on point-cloud data. The spatial coordinates of fibers represented as point clouds, as well as the anatomical features at both the individual and group levels, are fed into a neural network. The network is trained on Human Connectome Project (HCP) datasets and tested on the subjects with a range of cognitive impairment levels. One new metric named fiber anatomical region proportion (FARP), quantifies the ratio of fibers in the defined brain regions and enables the comparison with other methods. Another metric named anatomical region fiber count (ARFC), represents the average fiber number in each cluster for the assessment of inter-subject differences. The experimental results demonstrate that Anat-SFSeg achieves the highest accuracy on HCP datasets and exhibits great generalization on clinical datasets. Diffusion tensor metrics and ARFC show disorder severity associated alterations in patients with Alzheimer's disease (AD) and mild cognitive impairments (MCI). Correlations with cognitive grades show that these metrics are potential neuroimaging biomarkers for AD. Furthermore, Anat-SFSeg could be utilized to explore other neurodegenerative, neurodevelopmental or psychiatric disorders.

NerveTracker: a Python-based software toolkit for visualizing and tracking groups of nerve fibers in serial block-face microscopy with ultraviolet surface excitation images

Significance

Information about the spatial organization of fibers within a nerve is crucial to our understanding of nerve anatomy and its response to neuromodulation therapies. A serial block-face microscopy method [three-dimensional microscopy with ultraviolet surface excitation (3D-MUSE)] has been developed to image nerves over extended depths ex vivo. To routinely visualize and track nerve fibers in these datasets, a dedicated and customizable software tool is required.

Aim

Our objective was to develop custom software that includes image processing and visualization methods to perform microscopic tractography along the length of a peripheral nerve sample.

Approach

We modified common computer vision algorithms (optic flow and structure tensor) to track groups of peripheral nerve fibers along the length of the nerve. Interactive streamline visualization and manual editing tools are provided. Optionally, deep learning segmentation of fascicles (fiber bundles) can be applied to constrain the tracts from inadvertently crossing into the epineurium. As an example, we performed tractography on vagus and tibial nerve datasets and assessed accuracy by comparing the resulting nerve tracts with segmentations of fascicles as they split and merge with each other in the nerve sample stack.

Results

We found that a normalized Dice overlap (Dice norm ) metric had a mean value above 0.75 across several millimeters along the nerve. We also found that the tractograms were robust to changes in certain image properties (e.g., downsampling in-plane and out-of-plane), which resulted in only a 2% to 9% change to the meanDice norm values. In a vagus nerve sample, tractography allowed us to readily identify that subsets of fibers from four distinct fascicles merge into a single fascicle as we move ∼ 5    mm along the nerve's length.

Conclusions

Overall, we demonstrated the feasibility of performing automated microscopic tractography on 3D-MUSE datasets of peripheral nerves. The software should be applicable to other imaging approaches. The code is available at https://github.com/ckolluru/NerveTracker.

PhyberSIM: a tool for the generation of ground truth to evaluate brain fiber clustering algorithms

Diffusion Magnetic Resonance Imaging tractography is a non-invasive technique that produces a collection of streamlines representing the main white matter bundle trajectories. Methods, such as fiber clustering algorithms, are important in computational neuroscience and have been the basis of several white matter analysis methods and studies. Nevertheless, these clustering methods face the challenge of the absence of ground truth of white matter fibers, making their evaluation difficult. As an alternative solution, we present an innovative brain fiber bundle simulator that uses spline curves for fiber representation. The methodology uses a tubular model for the bundle simulation based on a bundle centroid and five radii along the bundle. The algorithm was tested by simulating 28 Deep White Matter atlas bundles, leading to low inter-bundle distances and high intersection percentages between the original and simulated bundles. To prove the utility of the simulator, we created three whole-brain datasets containing different numbers of fiber bundles to assess the quality performance of QuickBundles and Fast Fiber Clustering algorithms using five clustering metrics. Our results indicate that QuickBundles tends to split less and Fast Fiber Clustering tends to merge less, which is consistent with their expected behavior. The performance of both algorithms decreases when the number of bundles is increased due to higher bundle crossings. Additionally, the two algorithms exhibit robust behavior with input data permutation. To our knowledge, this is the first whole-brain fiber bundle simulator capable of assessing fiber clustering algorithms with realistic data.

TractGeoNet: A geometric deep learning framework for pointwise analysis of tract microstructure to predict language assessment performance

We propose a geometric deep-learning-based framework, TractGeoNet, for performing regression using diffusion magnetic resonance imaging (dMRI) tractography and associated pointwise tissue microstructure measurements. By employing a point cloud representation, TractGeoNet can directly utilize tissue microstructure and positional information from all points within a fiber tract without the need to average or bin data along the streamline as traditionally required by dMRI tractometry methods. To improve regression performance, we propose a novel loss function, the Paired-Siamese Regression loss, which encourages the model to focus on accurately predicting the relative differences between regression label scores rather than just their absolute values. In addition, to gain insight into the brain regions that contribute most strongly to the prediction results, we propose a Critical Region Localization algorithm. This algorithm identifies highly predictive anatomical regions within the white matter fiber tracts for the regression task. We evaluate the effectiveness of the proposed method by predicting individual performance on two neuropsychological assessments of language using a dataset of 20 association white matter fiber tracts from 806 subjects from the Human Connectome Project Young Adult dataset. The results demonstrate superior prediction performance of TractGeoNet compared to several popular regression models that have been applied to predict individual cognitive performance based on neuroimaging features. Of the twenty tracts studied, we find that the left arcuate fasciculus tract is the most highly predictive of the two studied language performance assessments. Within each tract, we localize critical regions whose microstructure and point information are highly and consistently predictive of language performance across different subjects and across multiple independently trained models. These critical regions are widespread and distributed across both hemispheres and all cerebral lobes, including areas of the brain considered important for language function such as superior and anterior temporal regions, pars opercularis, and precentral gyrus. Overall, TractGeoNet demonstrates the potential of geometric deep learning to enhance the study of the brain's white matter fiber tracts and to relate their structure to human traits such as language performance.

Short fiber bundle filtering and test-retest reproducibility of the Superficial White Matter

In recent years, there has been a growing interest in studying the Superficial White Matter (SWM). The SWM consists of short association fibers connecting near giry of the cortex, with a complex organization due to their close relationship with the cortical folding patterns. Therefore, their segmentation from dMRI tractography datasets requires dedicated methodologies to identify the main fiber bundle shape and deal with spurious fibers. This paper presents an enhanced short fiber bundle segmentation based on a SWM bundle atlas and the filtering of noisy fibers. The method was tuned and evaluated over HCP test-retest probabilistic tractography datasets (44 subjects). We propose four fiber bundle filters to remove spurious fibers. Furthermore, we include the identification of the main fiber fascicle to obtain well-defined fiber bundles. First, we identified four main bundle shapes in the SWM atlas, and performed a filter tuning in a subset of 28 subjects. The filter based on the Convex Hull provided the highest similarity between corresponding test-retest fiber bundles. Subsequently, we applied the best filter in the 16 remaining subjects for all atlas bundles, showing that filtered fiber bundles significantly improve test-retest reproducibility indices when removing between ten and twenty percent of the fibers. Additionally, we applied the bundle segmentation with and without filtering to the ABIDE-II database. The fiber bundle filtering allowed us to obtain a higher number of bundles with significant differences in fractional anisotropy, mean diffusivity, and radial diffusivity of Autism Spectrum Disorder patients relative to controls.

Blurred streamlines: A novel representation to reduce redundancy in tractography

Tractography is a powerful tool to study brain connectivity in vivo, but it is well known to suffer from an intrinsic trade-off between sensitivity and specificity. A critical - but usually underrated - parameter to choose that can heavily impact the quality of the estimates is the number of streamlines to be reconstructed for a given data set. In fact, sensitivity can be improved by generating more and more streamlines, as all real anatomical connections are likely reconstructed, but lots of false positives are inevitably introduced, too. Consequently, so-called tractography filtering techniques have become increasingly popular to get rid of these false positives and improve specificity. However, increasing number of streamlines introduces redundancy in tractography reconstructions, which may negatively impact the performance of filtering algorithms, especially those based on linear formulations. To address this problem, we introduce a novel streamlines representation, called "blurred streamlines", which drastically reduces the redundancy among streamlines by (i) clustering similar trajectories and (ii) spatially blurring the corresponding signal contributions. We tested the effectiveness of the blurred streamlines both on synthetic and in vivo data. Our results clearly show that this new representation is as accurate as state-of-the-art methods despite using only 5% of the input streamlines, thus significantly decreasing the computational complexity of filtering algorithms as well as storage requirements of the resulting reconstructions.

A systematic review of automated methods to perform white matter tract segmentation

White matter tract segmentation is a pivotal research area that leverages diffusion-weighted magnetic resonance imaging (dMRI) for the identification and mapping of individual white matter tracts and their trajectories. This study aims to provide a comprehensive systematic literature review on automated methods for white matter tract segmentation in brain dMRI scans. Articles on PubMed, ScienceDirect [NeuroImage, NeuroImage (Clinical), Medical Image Analysis], Scopus and IEEEXplore databases and Conference proceedings of Medical Imaging Computing and Computer Assisted Intervention Society (MICCAI) and International Symposium on Biomedical Imaging (ISBI), were searched in the range from January 2013 until September 2023. This systematic search and review identified 619 articles. Adhering to the specified search criteria using the query, "white matter tract segmentation OR fiber tract identification OR fiber bundle segmentation OR tractography dissection OR white matter parcellation OR tract segmentation," 59 published studies were selected. Among these, 27% employed direct voxel-based methods, 25% applied streamline-based clustering methods, 20% used streamline-based classification methods, 14% implemented atlas-based methods, and 14% utilized hybrid approaches. The paper delves into the research gaps and challenges associated with each of these categories. Additionally, this review paper illuminates the most frequently utilized public datasets for tract segmentation along with their specific characteristics. Furthermore, it presents evaluation strategies and their key attributes. The review concludes with a detailed discussion of the challenges and future directions in this field.

A, Hernandez Larzabal H, Román C, Poupon C, Mangin JF, Hernández C, Guevara P. Phybers: a package for brain tractography analysis

We present a Python library (Phybers) for analyzing brain tractography data. Tractography datasets contain streamlines (also called fibers) composed of 3D points representing the main white matter pathways. Several algorithms have been proposed to analyze this data, including clustering, segmentation, and visualization methods. The manipulation of tractography data is not straightforward due to the geometrical complexity of the streamlines, the file format, and the size of the datasets, which may contain millions of fibers. Hence, we collected and structured state-of-the-art methods for the analysis of tractography and packed them into a Python library, to integrate and share tools for tractography analysis. Due to the high computational requirements, the most demanding modules were implemented in C/C++. Available functions include brain Bundle Segmentation (FiberSeg), Hierarchical Fiber Clustering (HClust), Fast Fiber Clustering (FFClust), normalization to a reference coordinate system, fiber sampling, calculation of intersection between sets of brain fibers, tools for cluster filtering, calculation of measures from clusters, and fiber visualization. The library tools were structured into four principal modules: Segmentation, Clustering, Utils, and Visualization (Fibervis). Phybers is freely available on a GitHub repository under the GNU public license for non-commercial use and open-source development, which provides sample data and extensive documentation. In addition, the library can be easily installed on both Windows and Ubuntu operating systems through the pip library.

A robot-rodent interaction arena with adjustable spatial complexity for ethologically relevant behavioral studies

Outside of the laboratory, animals behave in spaces where they can transition between open areas and coverage as they interact with others. Replicating these conditions in the laboratory can be difficult to control and record. This has led to a dominance of relatively simple, static behavioral paradigms that reduce the ethological relevance of behaviors and may alter the engagement of cognitive processes such as planning and decision-making. Therefore, we developed a method for controllable, repeatable interactions with others in a reconfigurable space. Mice navigate a large honeycomb lattice of adjustable obstacles as they interact with an autonomous robot coupled to their actions. We illustrate the system using the robot as a pseudo-predator, delivering airpuffs to the mice. The combination of obstacles and a mobile threat elicits a diverse set of behaviors, such as increased path diversity, peeking, and baiting, providing a method to explore ethologically relevant behaviors in the laboratory.

Fibre orientation atlas guided rapid segmentation of white matter tracts

Fibre tract delineation from diffusion magnetic resonance imaging (MRI) is a valuable clinical tool for neurosurgical planning and navigation, as well as in research neuroimaging pipelines. Several popular methods are used for this task, each with different strengths and weaknesses making them more or less suited to different contexts. For neurosurgical imaging, priorities include ease of use, computational efficiency, robustness to pathology and ability to generalise to new tracts of interest. Many existing methods use streamline tractography, which may require expert neuroimaging operators for setting parameters and delineating anatomical regions of interest, or suffer from as a lack of generalisability to clinical scans involving deforming tumours and other pathologies. More recently, data-driven approaches including deep-learning segmentation models and streamline clustering methods have improved reproducibility and automation, although they can require large amounts of training data and/or computationally intensive image processing at the point of application. We describe an atlas-based direct tract mapping technique called 'tractfinder', utilising tract-specific location and orientation priors. Our aim was to develop a clinically practical method avoiding streamline tractography at the point of application while utilising prior anatomical knowledge derived from only 10-20 training samples. Requiring few training samples allows emphasis to be placed on producing high quality, neuro-anatomically accurate training data, and enables rapid adaptation to new tracts of interest. Avoiding streamline tractography at the point of application reduces computational time, false positives and vulnerabilities to pathology such as tumour deformations or oedema. Carefully filtered training streamlines and track orientation distribution mapping are used to construct tract specific orientation and spatial probability atlases in standard space. Atlases are then transformed to target subject space using affine registration and compared with the subject's voxel-wise fibre orientation distribution data using a mathematical measure of distribution overlap, resulting in a map of the tract's likely spatial distribution. This work includes extensive performance evaluation and comparison with benchmark techniques, including streamline tractography and the deep-learning method TractSeg, in two publicly available healthy diffusion MRI datasets (from TractoInferno and the Human Connectome Project) in addition to a clinical dataset comprising paediatric and adult brain tumour scans. Tract segmentation results display high agreement with established techniques while requiring less than 3 min on average when applied to a new subject. Results also display higher robustness than compared methods when faced with clinical scans featuring brain tumours and resections. As well as describing and evaluating a novel proposed tract delineation technique, this work continues the discussion on the challenges surrounding the white matter segmentation task, including issues of anatomical definitions and the use of quantitative segmentation comparison metrics.

Investigation into white matter microstructure differences in visual training by using an automated fiber tract subclassification segmentation quantification method

Visual training has emerged as a useful framework for investigating training-related brain plasticity, a highly complex task involving the interaction of visual orientation, attention, reasoning, and cognitive functions. However, the effects of long-term visual training on microstructural changes within white matter (WM) is poorly understood. Therefore, a set of visual training programs was designed, and automated fiber tract subclassification segmentation quantification based on diffusion magnetic resonance imaging was performed to obtain the anatomical changes in the brains of visual trainees. First, 40 healthy matched participants were randomly assigned to the training group or the control group. The training group underwent 10 consecutive weeks of visual training. Then, the fiber tracts of the subjects were automatically identified and further classified into fiber clusters to determine the differences between the two groups on a detailed scale. Next, each fiber cluster was divided into segments that can analyze specific areas of a fiber cluster. Lastly, the diffusion metrics of the two groups were comparatively analyzed to delineate the effects of visual training on WM microstructure. Our results showed that there were significant differences in the fiber clusters of the cingulate bundle, thalamus frontal, uncinate fasciculus, and corpus callosum between the training group compared and the control group. In addition, the training group exhibited lower mean fractional anisotropy, higher mean diffusivity and radial diffusivity than the control group. Therefore, the long-term cognitive activities, such as visual training, may systematically influence the WM properties of cognition, attention, memory, and processing speed.

Accelerated Brain Atrophy, Microstructural Decline and Connectopathy in Age-Related Macular Degeneration

Age-related macular degeneration (AMD) has recently been linked to cognitive impairment. We hypothesized that AMD modifies the brain aging trajectory, and we conducted a longitudinal diffusion MRI study on 40 participants (20 with AMD and 20 controls) to reveal the location, extent, and dynamics of AMD-related brain changes. Voxel-based analyses at the first visit identified reduced volume in AMD participants in the cuneate gyrus, associated with vision, and the temporal and bilateral cingulate gyrus, linked to higher cognition and memory. The second visit occurred 2 years after the first and revealed that AMD participants had reduced cingulate and superior frontal gyrus volumes, as well as lower fractional anisotropy (FA) for the bilateral occipital lobe, including the visual and the superior frontal cortex. We detected faster rates of volume and FA reduction in AMD participants in the left temporal cortex. We identified inter-lingual and lingual-cerebellar connections as important differentiators in AMD participants. Bundle analyses revealed that the lingual gyrus had a lower streamline length in the AMD participants at the first visit, indicating a connection between retinal and brain health. FA differences in select inter-lingual and lingual cerebellar bundles at the second visit showed downstream effects of vision loss. Our analyses revealed widespread changes in AMD participants, beyond brain networks directly involved in vision processing.

ReeBundle: A Method for Topological Modeling of White Matter Pathways Using Diffusion MRI

Tractography can generate millions of complex curvilinear fibers (streamlines) in 3D that exhibit the geometry of white matter pathways in the brain. Common approaches to analyzing white matter connectivity are based on adjacency matrices that quantify connection strength but do not account for any topological information. A critical element in neurological and developmental disorders is the topological deterioration and irregularities in streamlines. In this paper, we propose a novel Reeb graph-based method "ReeBundle" that efficiently encodes the topology and geometry of white matter fibers. Given the trajectories of neuronal fiber pathways (neuroanatomical bundle), we re-bundle the streamlines by modeling their spatial evolution to capture geometrically significant events (akin to a fingerprint). ReeBundle parameters control the granularity of the model and handle the presence of improbable streamlines commonly produced by tractography. Further, we propose a new Reeb graph-based distance metric that quantifies topological differences for automated quality control and bundle comparison. We show the practical usage of our method using two datasets: (1) For International Society for Magnetic Resonance in Medicine (ISMRM) dataset, ReeBundle handles the morphology of the white matter tract configurations due to branching and local ambiguities in complicated bundle tracts like anterior and posterior commissures; (2) For the longitudinal repeated measures in the Cognitive Resilience and Sleep History (CRASH) dataset, repeated scans of a given subject acquired weeks apart lead to provably similar Reeb graphs that differ significantly from other subjects, thus highlighting ReeBundle's potential for clinical fingerprinting of brain regions.

FASSt : Filtering via Symmetric Autoencoder for Spherical Superficial White Matter Tractography

Superficial white matter (SWM) plays an important role in functioning of the human brain, and it contains a large amount of cortico-cortical connections. However, the difficulties of generating complete and reliable U-fibers make SWM-related analysis lag behind relatively matured Deep white matter (DWM) analysis. With the aid of some newly proposed surface-based SWM tractography algorithms, we have developed a specialized SWM filtering method based on a symmetric variational autoencoder (VAE). In this work, we first demonstrate the advantage of the spherical representation and generate these spherical tracts using the triangular mesh and the registered spherical surface. We then introduce the Filtering via symmetric Autoencoder for Spherical Superficial White Matter tractography (FASSt) framework with a novel symmetric weights module to perform the filtering task in a latent space. We evaluate and compare our method with the state-of-the-art clustering-based method on diffusion MRI data from Human Connectome Project (HCP). The results show that our proposed method outperform these clustering methods and achieves excellent performance in groupwise consistency and topographic regularity.

FIESTA: Autoencoders for accurate fiber segmentation in tractography

White matter bundle segmentation is a cornerstone of modern tractography to study the brain's structural connectivity in domains such as neurological disorders, neurosurgery, and aging. In this study, we present FIESTA (FIbEr Segmentation in Tractography using Autoencoders), a reliable and robust, fully automated, and easily semi-automatically calibrated pipeline based on deep autoencoders that can dissect and fully populate white matter bundles. This pipeline is built upon previous works that demonstrated how autoencoders can be used successfully for streamline filtering, bundle segmentation, and streamline generation in tractography. Our proposed method improves bundle segmentation coverage by recovering hard-to-track bundles with generative sampling through the latent space seeding of the subject bundle and the atlas bundle. A latent space of streamlines is learned using autoencoder-based modeling combined with contrastive learning. Using an atlas of bundles in standard space (MNI), our proposed method segments new tractograms using the autoencoder latent distance between each tractogram streamline and its closest neighbor bundle in the atlas of bundles. Intra-subject bundle reliability is improved by recovering hard-to-track streamlines, using the autoencoder to generate new streamlines that increase the spatial coverage of each bundle while remaining anatomically correct. Results show that our method is more reliable than state-of-the-art automated virtual dissection methods such as RecoBundles, RecoBundlesX, TractSeg, White Matter Analysis and XTRACT. Our framework allows for the transition from one anatomical bundle definition to another with marginal calibration efforts. Overall, these results show that our framework improves the practicality and usability of current state-of-the-art bundle segmentation framework.

The Challenge of Diffusion Magnetic Resonance Imaging in Cerebral Palsy: A Proposed Method to Identify White Matter Pathways

Cerebral palsy (CP), a neuromotor disorder characterized by prenatal brain lesions, leads to white matter alterations and sensorimotor deficits. However, the CP-related diffusion neuroimaging literature lacks rigorous and consensual methodology for preprocessing and analyzing data due to methodological challenges caused by the lesion extent. Advanced methods are available to reconstruct diffusion signals and can update current advances in CP. Our study demonstrates the feasibility of analyzing diffusion CP data using a standardized and open-source pipeline. Eight children with CP (8-12 years old) underwent a single diffusion magnetic resonance imaging (MRI) session on a 3T scanner (Achieva 3.0T (TX), Philips Healthcare Medical Systems, Best, The Netherlands). Exclusion criteria were contraindication to MRI and claustrophobia. Anatomical and diffusion images were acquired. Data were corrected and analyzed using Tractoflow 2.3.0 version, an open-source and robust tool. The tracts were extracted with customized procedures based on existing atlases and freely accessed standardized libraries (ANTs, Scilpy). DTI, CSD, and NODDI metrics were computed for each tract. Despite lesion heterogeneity and size, we successfully reconstructed major pathways, except for a participant with a larger lesion. Our results highlight the feasibility of identifying and quantifying subtle white matter pathways. Ultimately, this will increase our understanding of the clinical symptoms to provide precision medicine and optimize rehabilitation.

PPA: Principal parcellation analysis for brain connectomes and multiple traits

Our understanding of the structure of the brain and its relationships with human traits is largely determined by how we represent the structural connectome. Standard practice divides the brain into regions of interest (ROIs) and represents the connectome as an adjacency matrix having cells measuring connectivity between pairs of ROIs. Statistical analyses are then heavily driven by the (largely arbitrary) choice of ROIs. In this article, we propose a human trait prediction framework utilizing a tractography-based representation of the brain connectome, which clusters fiber endpoints to define a data-driven white matter parcellation targeted to explain variation among individuals and predict human traits. This leads to Principal Parcellation Analysis (PPA), representing individual brain connectomes by compositional vectors building on a basis system of fiber bundles that captures the connectivity at the population level. PPA eliminates the need to choose atlases and ROIs a priori, and provides a simpler, vector-valued representation that facilitates easier statistical analysis compared to the complex graph structures encountered in classical connectome analyses. We illustrate the proposed approach through applications to data from the Human Connectome Project (HCP) and show that PPA connectomes improve power in predicting human traits over state-of-the-art methods based on classical connectomes, while dramatically improving parsimony and maintaining interpretability. Our PPA package is publicly available on GitHub, and can be implemented routinely for diffusion image data.

Deep Learning Methods for Identification of White Matter Fiber Tracts: Review of State-of-the-Art and Future Prospective

Quantitative analysis of white matter fiber tracts from diffusion Magnetic Resonance Imaging (dMRI) data is of great significance in health and disease. For example, analysis of fiber tracts related to anatomically meaningful fiber bundles is highly demanded in pre-surgical and treatment planning, and the surgery outcome depends on accurate segmentation of the desired tracts. Currently, this process is mainly done through time-consuming manual identification performed by neuro-anatomical experts. However, there is a broad interest in automating the pipeline such that it is fast, accurate, and easy to apply in clinical settings and also eliminates the intra-reader variabilities. Following the advancements in medical image analysis using deep learning techniques, there has been a growing interest in using these techniques for the task of tract identification as well. Recent reports on this application show that deep learning-based tract identification approaches outperform existing state-of-the-art methods. This paper presents a review of current tract identification approaches based on deep neural networks. First, we review the recent deep learning methods for tract identification. Next, we compare them with respect to their performance, training process, and network properties. Finally, we end with a critical discussion of open challenges and possible directions for future works.

Deep fiber clustering: Anatomically informed fiber clustering with self-supervised deep learning for fast and effective tractography parcellation

White matter fiber clustering is an important strategy for white matter parcellation, which enables quantitative analysis of brain connections in health and disease. In combination with expert neuroanatomical labeling, data-driven white matter fiber clustering is a powerful tool for creating atlases that can model white matter anatomy across individuals. While widely used fiber clustering approaches have shown good performance using classical unsupervised machine learning techniques, recent advances in deep learning reveal a promising direction toward fast and effective fiber clustering. In this work, we propose a novel deep learning framework for white matter fiber clustering, Deep Fiber Clustering (DFC), which solves the unsupervised clustering problem as a self-supervised learning task with a domain-specific pretext task to predict pairwise fiber distances. This process learns a high-dimensional embedding feature representation for each fiber, regardless of the order of fiber points reconstructed during tractography. We design a novel network architecture that represents input fibers as point clouds and allows the incorporation of additional sources of input information from gray matter parcellation. Thus, DFC makes use of combined information about white matter fiber geometry and gray matter anatomy to improve the anatomical coherence of fiber clusters. In addition, DFC conducts outlier removal naturally by rejecting fibers with low cluster assignment probability. We evaluate DFC on three independently acquired cohorts, including data from 220 individuals across genders, ages (young and elderly adults), and different health conditions (healthy control and multiple neuropsychiatric disorders). We compare DFC to several state-of-the-art white matter fiber clustering algorithms. Experimental results demonstrate superior performance of DFC in terms of cluster compactness, generalization ability, anatomical coherence, and computational efficiency.

Superficial white matter analysis: An efficient point-cloud-based deep learning framework with supervised contrastive learning for consistent tractography parcellation across populations and dMRI acquisitions

Diffusion MRI tractography is an advanced imaging technique that enables in vivo mapping of the brain's white matter connections. White matter parcellation classifies tractography streamlines into clusters or anatomically meaningful tracts. It enables quantification and visualization of whole-brain tractography. Currently, most parcellation methods focus on the deep white matter (DWM), whereas fewer methods address the superficial white matter (SWM) due to its complexity. We propose a novel two-stage deep-learning-based framework, Superficial White Matter Analysis (SupWMA), that performs an efficient and consistent parcellation of 198 SWM clusters from whole-brain tractography. A point-cloud-based network is adapted to our SWM parcellation task, and supervised contrastive learning enables more discriminative representations between plausible streamlines and outliers for SWM. We train our model on a large-scale tractography dataset including streamline samples from labeled long- and medium-range (over 40 mm) SWM clusters and anatomically implausible streamline samples, and we perform testing on six independently acquired datasets of different ages and health conditions (including neonates and patients with space-occupying brain tumors). Compared to several state-of-the-art methods, SupWMA obtains highly consistent and accurate SWM parcellation results on all datasets, showing good generalization across the lifespan in health and disease. In addition, the computational speed of SupWMA is much faster than other methods.

Convolutional-recurrent neural networks approximate diffusion tractography from T1-weighted MRI and associated anatomical context

Diffusion MRI (dMRI) streamline tractography is the gold-standard for in vivo estimation of white matter (WM) pathways in the brain. However, the high angular resolution dMRI acquisitions capable of fitting the microstructural models needed for tractography are often time-consuming and not routinely collected clinically, restricting the scope of tractography analyses. To address this limitation, we build on recent advances in deep learning which have demonstrated that streamline propagation can be learned from dMRI directly without traditional model fitting. Specifically, we propose learning the streamline propagator from T1w MRI to facilitate arbitrary tractography analyses when dMRI is unavailable. To do so, we present a novel convolutional-recurrent neural network (CoRNN) trained in a teacher-student framework that leverages T1w MRI, associated anatomical context, and streamline memory from data acquired for the Human Connectome Project. We characterize our approach under two common tractography paradigms, WM bundle analysis and structural connectomics, and find approximately a 5-15% difference between measures computed from streamlines generated with our approach and those generated using traditional dMRI tractography. When placed in the literature, these results suggest that the accuracy of WM measures computed from T1w MRI with our method is on the level of scan-rescan dMRI variability and raise an important question: is tractography truly a microstructural phenomenon, or has dMRI merely facilitated its discovery and implementation?

Symptom-circuit mappings of the schizophrenia connectome

OBJECTIVE

This paper aims to model the anatomical circuits underlying schizophrenia symptoms, and to explore patterns of abnormal connectivity among brain networks affected by psychopathology.

METHODS

T1 magnetic resonance imaging (MRI), diffusion weighted imaging (DWI), and resting-state functional MRI (rsfMRI) were obtained from a total of 126 patients with schizophrenia who were recruited for the study. The images were processed using the Omniscient software (https://www.o8t. com). We further apply the use of the Hollow-tree Super (HoTS) method to gain insights into what brain regions had abnormal connectivity that might be linked to the symptoms of schizophrenia.

RESULTS

The Positive and Negative Symptom Scale is characterised into 6 factors. Each symptom is mapped with specific anatomical abnormalities and circuits. Comparison between factors reveals co-occurrence in parcels in Factor 1 and Factor 2. Multiple large-scale networks are involved in SCZ symptomatology, with functional connectivity within Default Mode Network (DMN) and Central Executive Network (CEN) regions most frequently associated with measures of psychopathology.

CONCLUSION

We present a summary of the relevant anatomy for regions of the cortical areas as part of a larger effort to understand its contribution in schizophrenia. This unique machine learning-type approach maps symptoms to specific brain regions and circuits by bridging the diagnostic subtypes and analysing the features of the connectome.

Validate your white matter tractography algorithms with a reappraised ISMRM 2015 Tractography Challenge scoring system

Since 2015, research groups have sought to produce the ne plus ultra of tractography algorithms using the ISMRM 2015 Tractography Challenge as evaluation. In particular, since 2017, machine learning has made its entrance into the tractography world. The ISMRM 2015 Tractography Challenge is the most used phantom during tractography validation, although it contains limitations. Here, we offer a new scoring system for this phantom, where segmentation of the bundles is now based on manually defined regions of interest rather than on bundle recognition. Bundles are now more reliably segmented, offering more representative metrics for future users. New code is available online. Scores of the initial 96 submissions to the challenge are updated. Overall, conclusions from the 2015 challenge are confirmed with the new scoring, but individual tractogram scores have changed, and the data is much improved at the bundle- and streamline-level. This work also led to the production of a ground truth tractogram with less broken or looping streamlines and of an example of processed data, all available on the Tractometer website. This enhanced scoring system and new data should continue helping researchers develop and evaluate the next generation of tractography techniques.

Anatomically informed multi-level fiber tractography for targeted virtual dissection

OBJECTIVES

Diffusion-weighted MRI can assist preoperative planning by reconstructing the trajectory of eloquent fiber pathways, such as the corticospinal tract (CST). However, accurate reconstruction of the full extent of the CST remains challenging with existing tractography methods. We suggest a novel tractography algorithm exploiting unused fiber orientations to produce more complete and reliable results.

METHODS

Our novel approach, referred to as multi-level fiber tractography (MLFT), reconstructs fiber pathways by progressively considering previously unused fiber orientations at multiple levels of tract propagation. Anatomical priors are used to minimize the number of false-positive pathways. The MLFT method was evaluated on synthetic data and in vivo data by reconstructing the CST while compared to conventional tractography approaches.

RESULTS

The radial extent of MLFT reconstructions is comparable to that of probabilistic reconstruction: [Formula: see text] for the left and [Formula: see text] for the right hemisphere according to Wilcoxon test, while achieving significantly higher topography preservation compared to probabilistic tractography: [Formula: see text].

DISCUSSION

MLFT provides a novel way to reconstruct fiber pathways by adding the capability of including branching pathways in fiber tractography. Thanks to its robustness, feasible reconstruction extent and topography preservation, our approach may assist in clinical practice as well as in virtual dissection studies.

Short superficial white matter and aging: a longitudinal multi-site study of 1293 subjects and 2711 sessions

It is estimated that short association fibers running immediately beneath the cortex may make up as much as 60% of the total white matter volume. However, these have been understudied relative to the long-range association, projection, and commissural fibers of the brain. This is largely because of limitations of diffusion MRI fiber tractography, which is the primary methodology used to non-invasively study the white matter connections. Inspired by recent anatomical considerations and methodological improvements in superficial white matter (SWM) tractography, we aim to characterize changes in these fiber systems in cognitively normal aging, which provide insight into the biological foundation of age-related cognitive changes, and a better understanding of how age-related pathology differs from healthy aging. To do this, we used three large, longitudinal and cross-sectional datasets (N = 1293 subjects, 2711 sessions) to quantify microstructural features and length/volume features of several SWM systems. We find that axial, radial, and mean diffusivities show positive associations with age, while fractional anisotropy has negative associations with age in SWM throughout the entire brain. These associations were most pronounced in the frontal, temporal, and temporoparietal regions. Moreover, measures of SWM volume and length decrease with age in a heterogenous manner across the brain, with different rates of change in inter-gyri and intra-gyri SWM, and at slower rates than well-studied long-range white matter pathways. These features, and their variations with age, provide the background for characterizing normal aging, and, in combination with larger association pathways and gray matter microstructural features, may provide insight into fundamental mechanisms associated with aging and cognition.

Unraveling the Abnormal Molecular Mechanism of Suicide Inhibition of Cytochrome P450 3A4

Suicide inhibition of the CYP3A4 enzyme by a drug inactivates the enzyme in the drug biotransformation process and often shows safety concerns about the drug. Despite extensive experimental studies, the abnormal molecular mechanism of a suicide inhibitor that forms a covalent bond with the residue far away from the catalytically active center of CYP3A4 inactivating the enzyme remains elusive. Here, the authors used molecular simulation approaches to study in detail how diquinone methide (DQR), the metabolite product of raloxifene, unbinds from CYP3A4 and inactivates the enzyme at the atomistic level. The results clearly indicate that in one of the intermediate states formed in its unbinding process, DQR covalently binds to Cys239, a residue far away from the catalytically active center of CYP3A4, and hinders the substrate from entering or leaving the enzyme. This work therefore provides an unprecedented way of clarifying the abnormal mechanism of suicide inhibition of the CYP3A4 enzyme.

TractoInferno - A large-scale, open-source, multi-site database for machine learning dMRI tractography

TractoInferno is the world's largest open-source multi-site tractography database, including both research- and clinical-like human acquisitions, aimed specifically at machine learning tractography approaches and related ML algorithms. It provides 284 samples acquired from 3 T scanners across 6 different sites. Available data includes T1-weighted images, single-shell diffusion MRI (dMRI) acquisitions, spherical harmonics fitted to the dMRI signal, fiber ODFs, and reference streamlines for 30 delineated bundles generated using 4 tractography algorithms, as well as masks needed to run tractography algorithms. Manual quality control was additionally performed at multiple steps of the pipeline. We showcase TractoInferno by benchmarking the learn2track algorithm and 5 variations of the same recurrent neural network architecture. Creating the TractoInferno database required approximately 20,000 CPU-hours of processing power, 200 man-hours of manual QC, 3,000 GPU-hours of training baseline models, and 4 Tb of storage, to produce a final database of 350 Gb. By providing a standardized training dataset and evaluation protocol, TractoInferno is an excellent tool to address common issues in machine learning tractography.

A Long Short-Term Memory-Based Approach for Detecting Turns and Generating Road Intersections from Vehicle Trajectories

Owing to the widespread use of GPS-enabled devices, sensing road information from vehicle trajectories is becoming an attractive method for road map construction and update. Although the detection of intersections is critical for generating road networks, it is still a challenging task. Traditional approaches detect intersections by identifying turning points based on the heading changes. As the intersections vary greatly in pattern and size, the appropriate threshold for heading change varies from area to area, which leads to the difficulty of accurate detection. To overcome this shortcoming, we propose a deep learning-based approach to detect turns and generate intersections. First, we convert each trajectory into a feature sequence that stores multiple motion attributes of the vehicle along the trajectory. Next, a supervised method uses these feature sequences and labeled trajectories to train a long short-term memory (LSTM) model that detects turning trajectory segments (TTSs), each of which indicates a turn occurring at an intersection. Finally, the detected TTSs are clustered to obtain the intersection coverages and internal structures. The proposed approach was tested using vehicle trajectories collected in Wuhan, China. The intersection detection precision and recall were 94.0% and 91.9% in a central urban region and 94.1% and 86.7% in a semi-urban region, respectively, which were significantly higher than those of the previously established local G* statistic-based approaches. In addition to the applications for road map development, the newly developed approach may have broad implications for the analysis of spatiotemporal trajectory data.

Bundle-o-graphy: improving structural connectivity estimation with adaptive microstructure-informed tractography

Tractography is a powerful tool for the investigation of the complex organization of the brain in vivo, as it allows inferring the macroscopic pathways of the major fiber bundles of the white matter based on non-invasive diffusion-weighted magnetic resonance imaging acquisitions. Despite this unique and compelling ability, some studies have exposed the poor anatomical accuracy of the reconstructions obtained with this technique and challenged its effectiveness for studying brain connectivity. In this work, we describe a novel method to readdress tractography reconstruction problem in a global manner by combining the strengths of so-called generative and discriminative strategies. Starting from an input tractogram, we parameterize the connections between brain regions following a bundle-based representation that allows to drastically reducing the number of parameters needed to model groups of fascicles. The parameters space is explored following an MCMC generative approach, while a discrimininative method is exploited to globally evaluate the set of connections which is updated according to Bayes' rule. Our results on both synthetic and real brain data show that the proposed solution, called bundle-o-graphy, allows improving the anatomical accuracy of the reconstructions while keeping the computational complexity similar to other state-of-the-art methods.

FiberNeat: Unsupervised White Matter Tract Filtering

Whole-brain tractograms generated from diffusion MRI digitally represent the white matter structure of the brain and are composed of millions of streamlines. Such tractograms can have false positive and anatomically implausible streamlines. To obtain anatomically relevant streamlines and tracts, supervised and unsupervised methods can be used for tractogram clustering and tract extraction. Here we propose FiberNeat, an unsupervised white matter tract filtering method. FiberNeat takes an input set of streamlines that could either be unlabeled clusters or labeled tracts. Individual clusters/tracts are projected into a latent space using nonlinear dimensionality reduction techniques, t-SNE and UMAP, to find spurious and outlier streamlines. In addition, outlier streamline clusters are detected using DBSCAN and then removed from the data in streamline space. We performed quantitative comparisons with expertly delineated tracts. We ran FiberNeat on 131 participants' data from the ADNI3 dataset. We show that applying FiberNeat as a filtering step after bundle segmentation improves the quality of extracted tracts and helps improve tractometry.

Tractography of supplementary motor area projections in progressive speech apraxia and aphasia

•

Degeneration of SMA white matter tracts occurs in progressive apraxia of speech.

•

SMA commissural, putamen and precentral tracts were associated with speech apraxia.

•

Agrammatism was associated with SMA-prefrontal and frontal aslant tracts.

•

Tract profile analysis suggests different disease epicenters across syndromes.

Progressive apraxia of speech (AOS) is a motor speech disorder affecting the ability to produce phonetically or prosodically normal speech. Progressive AOS can present in isolation or co-occur with agrammatic aphasia and is associated with degeneration of the supplementary motor area. We aimed to assess breakdowns in structural connectivity from the supplementary motor area in patients with any combination of progressive AOS and/or agrammatic aphasia to determine which supplementary motor area tracts are specifically related to these clinical symptoms. Eighty-four patients with progressive AOS or progressive agrammatic aphasia were recruited by the Neurodegenerative Research Group and underwent neurological, speech/language, and neuropsychological testing, as well as 3 T diffusion magnetic resonance imaging. Of the 84 patients, 36 had apraxia of speech in isolation (primary progressive apraxia of speech, PPAOS), 40 had apraxia of speech and agrammatic aphasia (AOS-PAA), and eight had agrammatic aphasia in isolation (progressive agrammatic aphasia, PAA). Tractography was performed to identify 5 distinct tracts connecting to the supplementary motor area. Fractional anisotropy and mean diffusivity were assessed at 10 positions along the length of the tracts to construct tract profiles, and median profiles were calculated for each tract. In a case-control comparison, decreased fractional anisotropy and increased mean diffusivity were observed along the supplementary motor area commissural fibers in all three groups compared to controls. PPAOS also had abnormal diffusion in tracts from the supplementary motor area to the putamen, prefrontal cortex, Broca’s area (frontal aslant tract) and motor cortex, with greatest abnormalities observed closest to the supplementary motor area. The AOS-PAA group showed abnormalities in the same set of tracts, but with greater involvement of the supplementary motor area to prefrontal tract compared to PPAOS. PAA showed abnormalities in the left prefrontal and frontal aslant tracts compared to both other groups, with PAA showing greatest abnormalities furthest from the supplementary motor area. Severity of AOS correlated with tract metrics in the supplementary motor area commissural and motor cortex tracts. Severity of aphasia correlated with the frontal aslant and prefrontal tracts. These findings provide insight into how AOS and agrammatism are differentially related to disrupted diffusivity, with progressive AOS associated with abnormalities close to the supplementary motor area, and the frontal aslant and prefrontal tracts being particularly associated with agrammatic aphasia.

Disentangling the variability of the superficial white matter organization using regional-tractogram-based population stratification

Each variation of the cortical folding pattern implies a particular rearrangement of the geometry of the fibers of the underlying white matter. While this rearrangement only impacts the ends of the long pathways, it may affect most of the trajectory of the short bundles. Therefore, mapping the short fibers of the human brain using diffusion-based tractography requires a dedicated strategy to overcome the variability of the folding patterns. In this paper, we propose a fiber-based stratification strategy splitting the population into homogeneous groups for disentangling the superficial white matter bundle organization. This strategy introduces a new refined fiber distance which includes angular considerations for inferring fine-grained atlases of the short bundles surrounding a specific sulcus and a subtractogram distance that quantifies the similitude between fiber sets of two different subjects. The stratification splits the population into groups with similar regional fiber organization using manifold learning. We first successfully test the hypothesis that the main source of variability of the regional fiber organization is the variability of the regional folding pattern. Then, in each group, we proceed with the automatic identification of the most stable bundles, at a higher granularity level than what can be achieved with the non-stratified whole population, enabling the disentanglement of the very variable configuration of the short fibers. Finally, the method searches for bundle correspondence across groups to build a population level atlas. As a proof of concept, the atlas refinement achieved by this strategy is illustrated for the fibers that surround the central sulcus and the superior temporal sulcus using the HCP dataset.

A novel male Japanese quail structural connectivity atlas using ultra-high field diffusion MRI at 11.7 T

The structural connectivity of animal brains can be revealed using post-mortem diffusion-weighted magnetic resonance imaging (MRI). Despite the existence of several structural atlases of avian brains, few of them address the bird’s structural connectivity. In this study, a novel atlas of the structural connectivity is proposed for the male Japanese quail (Coturnix japonica), aiming at investigating two lines divergent on their emotionality trait: the short tonic immobility (STI) and the long tonic immobility (LTI) lines. The STI line presents a low emotionality trait, while the LTI line expresses a high emotionality trait. 21 male Japanese quail brains from both lines were scanned post-mortem for this study, using a preclinical Bruker 11.7 T MRI scanner. Diffusion-weighted MRI was performed using a 3D segmented echo planar imaging (EPI) pulsed gradient spin-echo (PGSE) sequence with a 200 \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\upmu$$\end{document}μm isotropic resolution, 75 diffusion-encoding directions and a b-value fixed at 4500 s/mm². Anatomical MRI was likewise performed using a 2D anatomical T₂-weighted spin-echo (SE) sequence with a 150 \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\upmu$$\end{document}μm isotropic resolution. This very first anatomical connectivity atlas of the male Japanese quail reveals 34 labeled fiber tracts and the existence of structural differences between the connectivity patterns characterizing the two lines. Thus, the link between the male Japanese quail’s connectivity and its underlying anatomical structures has reached a better understanding.

An atlas of white matter anatomy, its variability, and reproducibility based on constrained spherical deconvolution of diffusion MRI

Virtual dissection of white matter (WM) using diffusion MRI tractography is confounded by its poor reproducibility. Despite the increased adoption of advanced reconstruction models, early region-of-interest driven protocols based on diffusion tensor imaging (DTI) remain the dominant reference for virtual dissection protocols. Here we bridge this gap by providing a comprehensive description of typical WM anatomy reconstructed using a reproducible automated subject-specific parcellation-based approach based on probabilistic constrained-spherical deconvolution (CSD) tractography. We complement this with a WM template in MNI space comprising 68 bundles, including all associated anatomical tract selection labels and associated automated workflows. Additionally, we demonstrate bundle inter- and intra-subject variability using 40 (20 test-retest) datasets from the human connectome project (HCP) and 5 sessions with varying b-values and number of b-shells from the single-subject Multiple Acquisitions for Standardization of Structural Imaging Validation and Evaluation (MASSIVE) dataset. The most reliably reconstructed bundles were the whole pyramidal tracts, primary corticospinal tracts, whole superior longitudinal fasciculi, frontal, parietal and occipital segments of the corpus callosum and middle cerebellar peduncles. More variability was found in less dense bundles, e.g., the fornix, dentato-rubro-thalamic tract (DRTT), and premotor pyramidal tract. Using the DRTT as an example, we show that this variability can be reduced by using a higher number of seeding attempts. Overall inter-session similarity was high for HCP test-retest data (median weighted-dice = 0.963, stdev = 0.201 and IQR = 0.099). Compared to the HCP-template bundles there was a high level of agreement for the HCP test-retest data (median weighted-dice = 0.747, stdev = 0.220 and IQR = 0.277) and for the MASSIVE data (median weighted-dice = 0.767, stdev = 0.255 and IQR = 0.338). In summary, this WM atlas provides an overview of the capabilities and limitations of automated subject-specific probabilistic CSD tractography for mapping white matter fasciculi in healthy adults. It will be most useful in applications requiring a reproducible parcellation-based dissection protocol, and as an educational resource for applied neuroimaging and clinical professionals.

Assessing the Reliability of Template-Based Clustering for Tractography in Healthy Human Adults

Tractography is a non-invasive technique to investigate the brain’s structural pathways (also referred to as tracts) that connect different brain regions. A commonly used approach for identifying tracts is with template-based clustering, where unsupervised clustering is first performed on a template in order to label corresponding tracts in unseen data. However, the reliability of this approach has not been extensively studied. Here, an investigation into template-based clustering reliability was performed, assessing the output from two datasets: Human Connectome Project (HCP) and MyConnectome project. The effect of intersubject variability on template-based clustering reliability was investigated, as well as the reliability of both deep and superficial white matter tracts. Identified tracts were evaluated by assessing Euclidean distances from a dataset-specific tract average centroid, the volumetric overlap across corresponding tracts, and along-tract agreement of quantitative values. Further, two template-based techniques were employed to evaluate the reliability of different clustering approaches. Reliability assessment can increase the confidence of a tract identifying technique in future applications to study pathways of interest. The two different template-based approaches exhibited similar reliability for identifying both deep white matter tracts and the superficial white matter.

Dissociable oscillatory theta signatures of memory formation in the developing brain

Understanding complex human brain functions is critically informed by studying such functions during development. Here, we addressed a major gap in models of human memory by leveraging rare direct electrophysiological recordings from children and adolescents. Specifically, memory relies on interactions between the medial temporal lobe (MTL) and prefrontal cortex (PFC), and the maturation of these interactions is posited to play a key role in supporting memory development. To understand the nature of MTL-PFC interactions, we examined subdural recordings from MTL and PFC in 21 neurosurgical patients aged 5.9-20.5 years as they performed an established scene memory task. We determined signatures of memory formation by comparing the study of subsequently recognized to forgotten scenes in single trials. Results establish that MTL and PFC interact via two distinct theta mechanisms, an ∼3-Hz oscillation that supports amplitude coupling and slows down with age and an ∼7-Hz oscillation that supports phase coupling and speeds up with age. Slow and fast theta interactions immediately preceding scene onset further explained age-related differences in recognition performance. Last, with additional diffusion imaging data, we linked both functional mechanisms to the structural maturation of the cingulum tract. Our findings establish system-level dynamics of memory formation and suggest that MTL and PFC interact via increasingly dissociable mechanisms as memory improves across development.

Edges in brain networks: Contributions to models of structure and function

Network models describe the brain as sets of nodes and edges that represent its distributed organization. So far, most discoveries in network neuroscience have prioritized insights that highlight distinct groupings and specialized functional contributions of network nodes. Importantly, these functional contributions are determined and expressed by the web of their interrelationships, formed by network edges. Here, we underscore the important contributions made by brain network edges for understanding distributed brain organization. Different types of edges represent different types of relationships, including connectivity and similarity among nodes. Adopting a specific definition of edges can fundamentally alter how we analyze and interpret a brain network. Furthermore, edges can associate into collectives and higher order arrangements, describe time series, and form edge communities that provide insights into brain network topology complementary to the traditional node-centric perspective. Focusing on the edges, and the higher order or dynamic information they can provide, discloses previously underappreciated aspects of structural and functional network organization.

Fast Streamline Search: An Exact Technique for Diffusion MRI Tractography

In this work, a hierarchical search algorithm is proposed to efficiently compute the distance between similar tractography streamlines. This hierarchical framework offers an upper bound and a lower bound for the point-wise distance between two streamlines, which guarantees the validity of a proximity search. The proposed streamline representation enables the use of space-partitioning search trees to increase the tractography clustering speed without reducing its accuracy. The resulting approach enables a fast reconstruction a sparse distance matrix between two sets of streamlines, for all similar streamlines within a given radius. Alongside a white matter atlas, this fast streamline search can be used for accurate and reproducible tractogram clustering.

Auto-encoded Latent Representations of White Matter Streamlines for Quantitative Distance Analysis

Parcellation of whole brain tractograms is a critical step to study brain white matter structures and connectivity patterns. The existing methods based on supervised classification of streamlines into predefined streamline bundle types are not designed to explore sub-bundle structures, and methods with manually designed features are expensive to compute streamline-wise similarities. To resolve these issues, we propose a novel atlas-free method that learns a latent space using a deep recurrent auto-encoder trained in an unsupervised manner. The method efficiently embeds any length of streamlines to fixed-size feature vectors, named streamline embedding, for tractogram parcellation using non-parametric clustering in the latent space. The method was evaluated on the ISMRM 2015 tractography challenge dataset with discrimination of major bundles using clustering algorithms and streamline querying based on similarity, as well as real tractograms of 102 subjects Human Connectome Project. The learnt latent streamline and bundle representations open the possibility of quantitative studies of arbitrary granularity of sub-bundle structures using generic data mining techniques.

Alignment of Microarray Data

The aim in microarray data analysis is to discover patterns of gene expression and to identify similar genes. Simply comparing new gene sequences to known DNA sequences often does not reveal the function of a new gene; thus, more sophisticated techniques are in order. Nowadays, data mining techniques, and in particular the clustering process, play an important role in bioinformatics. To analyze vast amounts of data can be difficult; thus, a way to cluster similar data is needed. This chapter is devoted to illustrate the general data mining approach used in microarray data analysis, combining clustering, alignment and similarity, and to highlight a novel similarity measure capable of capturing hidden correlations between data.

Using diffusion MRI data acquired with ultra-high gradient strength to improve tractography in routine-quality data

The development of scanners with ultra-high gradient strength, spearheaded by the Human Connectome Project, has led to dramatic improvements in the spatial, angular, and diffusion resolution that is feasible for in vivo diffusion MRI acquisitions. The improved quality of the data can be exploited to achieve higher accuracy in the inference of both microstructural and macrostructural anatomy. However, such high-quality data can only be acquired on a handful of Connectom MRI scanners worldwide, while remaining prohibitive in clinical settings because of the constraints imposed by hardware and scanning time. In this study, we first update the classical protocols for tractography-based, manual annotation of major white-matter pathways, to adapt them to the much greater volume and variability of the streamlines that can be produced from today’s state-of-the-art diffusion MRI data. We then use these protocols to annotate 42 major pathways manually in data from a Connectom scanner. Finally, we show that, when we use these manually annotated pathways as training data for global probabilistic tractography with anatomical neighborhood priors, we can perform highly accurate, automated reconstruction of the same pathways in much lower-quality, more widely available diffusion MRI data. The outcomes of this work include both a new, comprehensive atlas of WM pathways from Connectom data, and an updated version of our tractography toolbox, TRActs Constrained by UnderLying Anatomy (TRACULA), which is trained on data from this atlas. Both the atlas and TRACULA are distributed publicly as part of FreeSurfer. We present the first comprehensive comparison of TRACULA to the more conventional, multi-region-of-interest approach to automated tractography, and the first demonstration of training TRACULA on high-quality, Connectom data to benefit studies that use more modest acquisition protocols.

Automated facial-vestibulocochlear nerve complex identification based on data-driven tractography clustering

Small size and intricate anatomical environment are the main difficulties facing tractography of the facial-vestibulocochlear nerve complex (FVN), and lead to challenges in fiber orientation distribution (FOD) modeling, fiber tracking, region-of-interest selection, and fiber filtering. Experts need rich experience in anatomy and tractography, as well as substantial labor costs, to identify the FVN. Thus, we present a pipeline to identify the FVN automatically, in what we believe is the first study of the automated identification of the FVN. First, we created an FVN template. Forty high-resolution multishell data were used to perform data-driven fiber clustering based on the multishell multitissue constraint spherical deconvolution FOD model and deterministic tractography. We selected the brainstem and cerebellum (BS-CB) region as the seed region and removed the fibers that reach other brain regions. We then performed spectral fiber clustering twice. The first clustering was to create a BS-CB atlas and separate the fibers that pass through the cerebellopontine angle, and the other one was to extract the FVN. Second, we registered the subject-specific fibers in the space of the FVN template and assigned each fiber to the closest cluster to identify the FVN automatically by spectral embedding. We applied the proposed method to different acquirement sites, including two different healthy datasets and two tumor patient datasets. Experimental results showed that our automatic identification results have ideal colocalization with expert manual identification in terms of spatial overlap and visualization. Importantly, we successfully applied our method to tumor patient data. The FVNs identified by the proposed method were in agreement with intraoperative findings.

Connectivity-based parcellation of normal and anatomically distorted human cerebral cortex

For over a century, neuroscientists have been working toward parcellating the human cortex into distinct neurobiological regions. Modern technologies offer many parcellation methods for healthy cortices acquired through magnetic resonance imaging. However, these methods are suboptimal for personalized neurosurgical application given that pathology and resection distort the cerebrum. We sought to overcome this problem by developing a novel connectivity‐based parcellation approach that can be applied at the single‐subject level. Utilizing normative diffusion data, we first developed a machine‐learning (ML) classifier to learn the typical structural connectivity patterns of healthy subjects. Specifically, the Glasser HCP atlas was utilized as a prior to calculate the streamline connectivity between each voxel and each parcel of the atlas. Using the resultant feature vector, we determined the parcel identity of each voxel in neurosurgical patients (n = 40) and thereby iteratively adjusted the prior. This approach enabled us to create patient‐specific maps independent of brain shape and pathological distortion. The supervised ML classifier re‐parcellated an average of 2.65% of cortical voxels across a healthy dataset (n = 178) and an average of 5.5% in neurosurgical patients. Our patient dataset consisted of subjects with supratentorial infiltrating gliomas operated on by the senior author who then assessed the validity and practical utility of the re‐parcellated diffusion data. We demonstrate a rapid and effective ML parcellation approach to parcellation of the human cortex during anatomical distortion. Our approach overcomes limitations of indiscriminately applying atlas‐based registration from healthy subjects by employing a voxel‐wise connectivity approach based on individual data.

Numerical uncertainty in analytical pipelines lead to impactful variability in brain networks

The analysis of brain-imaging data requires complex processing pipelines to support findings on brain function or pathologies. Recent work has shown that variability in analytical decisions, small amounts of noise, or computational environments can lead to substantial differences in the results, endangering the trust in conclusions. We explored the instability of results by instrumenting a structural connectome estimation pipeline with Monte Carlo Arithmetic to introduce random noise throughout. We evaluated the reliability of the connectomes, the robustness of their features, and the eventual impact on analysis. The stability of results was found to range from perfectly stable (i.e. all digits of data significant) to highly unstable (i.e. 0 - 1 significant digits). This paper highlights the potential of leveraging induced variance in estimates of brain connectivity to reduce the bias in networks without compromising reliability, alongside increasing the robustness and potential upper-bound of their applications in the classification of individual differences. We demonstrate that stability evaluations are necessary for understanding error inherent to brain imaging experiments, and how numerical analysis can be applied to typical analytical workflows both in brain imaging and other domains of computational sciences, as the techniques used were data and context agnostic and globally relevant. Overall, while the extreme variability in results due to analytical instabilities could severely hamper our understanding of brain organization, it also affords us the opportunity to increase the robustness of findings.

Group-Wise Cortical Surface Parcellation Based on Inter-Subject Fiber Clustering. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021;2021:2655-2659. [PMID: 34891798 DOI: 10.1109/embc46164.2021.9631099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0]

We present an automatic algorithm for the group-wise parcellation of the cortical surface. The method is based on the structural connectivity obtained from representative brain fiber clusters, calculated via an inter-subject clustering scheme. Preliminary regions were defined from cluster-cortical mesh intersection points. The final parcellation was obtained using parcel probability maps to model and integrate the connectivity information of all subjects, and graphs to represent the overlap between parcels. Two inter-subject clustering schemes were tested, generating a total of 171 and 109 parcels, respectively. The resulting parcels were quantitatively compared with three state-of-the-art atlases. The best parcellation returned 69 parcels with a Dice similarity coefficient greater than 0.5. To the best of our knowledge, this is the first diffusion-based cortex parcellation method based on whole-brain inter-subject fiber clustering.

Fiber Clustering Acceleration With a Modified Kmeans++ Algorithm Using Data Parallelism

Fiber clustering methods are typically used in brain research to study the organization of white matter bundles from large diffusion MRI tractography datasets. These methods enable exploratory bundle inspection using visualization and other methods that require identifying brain white matter structures in individuals or a population. Some applications, such as real-time visualization and inter-subject clustering, need fast and high-quality intra-subject clustering algorithms. This work proposes a parallel algorithm using a General Purpose Graphics Processing Unit (GPGPU) for fiber clustering based on the FFClust algorithm. The proposed GPGPU implementation exploits data parallelism using both multicore and GPU fine-grained parallelism present in commodity architectures, including current laptops and desktop computers. Our approach implements all FFClust steps in parallel, improving execution times in all of them. In addition, our parallel approach includes a parallel Kmeans++ algorithm implementation and defines a new variant of Kmeans++ to reduce the impact of choosing outliers as initial centroids. The results show that our approach provides clustering quality results very similar to FFClust, and it requires an execution time of 3.5 s for processing about a million fibers, achieving a speedup of 11.5 times compared to FFClust.

ABrainVis: an android brain image visualization tool

Background

The visualization and analysis of brain data such as white matter diffusion tractography and magnetic resonance imaging (MRI) volumes is commonly used by neuro-specialist and researchers to help the understanding of brain structure, functionality and connectivity. As mobile devices are widely used among users and their technology shows a continuous improvement in performance, different types of applications have been designed to help users in different work areas.

Results

We present, ABrainVis, an Android mobile tool that allows users to visualize different types of brain images, such as white matter diffusion tractographies, represented as fibers in 3D, segmented fiber bundles, MRI 3D images as rendered volumes and slices, and meshes. The tool enables users to choose and combine different types of brain imaging data to provide visual anatomical context for specific visualization needs. ABrainVis provides high performance over a wide range of Android devices, including tablets and cell phones using medium and large tractography datasets. Interesting visualizations including brain tumors and arteries, along with fiber, are given as examples of case studies using ABrainVis.

Conclusions

The functionality, flexibility and performance of ABrainVis tool introduce an improvement in user experience enabling neurophysicians and neuroscientists fast visualization of large tractography datasets, as well as the ability to incorporate other brain imaging data such as MRI volumes and meshes, adding anatomical contextual information.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12938-021-00909-0.

Tractography Processing with the Sparse Closest Point Transform

We propose a novel approach for processing diffusion MRI tractography datasets using the sparse closest point transform (SCPT). Tractography enables the 3D geometry of white matter pathways to be reconstructed; however, algorithms for processing them are often highly customized, and thus, do not leverage the existing wealth of machine learning (ML) algorithms. We investigated a vector-space tractography representation that aims to bridge this gap by using the SCPT, which consists of two steps: first, extracting sparse and representative landmarks from a tractography dataset, and second transforming curves relative to these landmarks with a closest point transform. We explore its use in three typical tasks: fiber bundle clustering, simplification, and selection across a population. The clustering algorithm groups fibers from single whole-brain datasets using a non-parametric k-means clustering algorithm, with performance compared with three alternative methods and across four datasets. The simplification algorithm removes redundant curves to improve interactive visualization, with performance gauged relative to random subsampling. The selection algorithm extracts bundles across a population using a one-class Gaussian classifier derived from an atlas prototype, with performance gauged by scan-rescan reliability and sensitivity to normal aging, as compared to manual mask-based selection. Our results demonstrate how the SCPT enables the novel application of existing vector-space ML algorithms to create effective and efficient tools for tractography processing. Our experimental data is available online, and our software implementation is available in the Quantitative Imaging Toolkit.

Filtering in tractography using autoencoders (FINTA)

Current brain white matter fiber tracking techniques show a number of problems, including: generating large proportions of streamlines that do not accurately describe the underlying anatomy; extracting streamlines that are not supported by the underlying diffusion signal; and under-representing some fiber populations, among others. In this paper, we describe a novel autoencoder-based learning method to filter streamlines from diffusion MRI tractography, and hence, to obtain more reliable tractograms. Our method, dubbed FINTA (Filtering in Tractography using Autoencoders) uses raw, unlabeled tractograms to train the autoencoder, and to learn a robust representation of brain streamlines. Such an embedding is then used to filter undesired streamline samples using a nearest neighbor algorithm. Our experiments on both synthetic and in vivo human brain diffusion MRI tractography data obtain accuracy scores exceeding the 90% threshold on the test set. Results reveal that FINTA has a superior filtering performance compared to conventional, anatomy-based methods, and the RecoBundles state-of-the-art method. Additionally, we demonstrate that FINTA can be applied to partial tractograms without requiring changes to the framework. We also show that the proposed method generalizes well across different tracking methods and datasets, and shortens significantly the computation time for large (>1 M streamlines) tractograms. Together, this work brings forward a new deep learning framework in tractography based on autoencoders, which offers a flexible and powerful method for white matter filtering and bundling that could enhance tractometry and connectivity analyses.