Making connections in the connectome era

Atomic connectomics signatures for characterization and differentiation of mild cognitive impairment

In recent years, functional connectomics signatures have been shown to be a very valuable tool in characterizing and differentiating brain disorders from normal controls. However, if the functional connectivity alterations in a brain disease are localized within sub-networks of a connectome, then accurate identification of such disease-specific sub-networks is critical and this capability entails both fine-granularity definition of connectome nodes and effective clustering of connectome nodes into disease-specific and non-disease-specific sub-networks. In this work, we adopted the recently developed DICCCOL (dense individualized and common connectivity-based cortical landmarks) system as a fine-granularity high-resolution connectome construction method to deal with the first issue, and employed an effective variant of non-negative matrix factorization (NMF) method to pinpoint disease-specific sub-networks, which we called atomic connectomics signatures in this work. We have implemented and applied this novel framework to two mild cognitive impairment (MCI) datasets from two different research centers, and our experimental results demonstrated that the derived atomic connectomics signatures can effectively characterize and differentiate MCI patients from their normal controls. In general, our work contributed a novel computational framework for deriving descriptive and distinctive atomic connectomics signatures in brain disorders.

Construction of multi-scale consistent brain networks: methods and applications

Mapping human brain networks provides a basis for studying brain function and dysfunction, and thus has gained significant interest in recent years. However, modeling human brain networks still faces several challenges including constructing networks at multiple spatial scales and finding common corresponding networks across individuals. As a consequence, many previous methods were designed for a single resolution or scale of brain network, though the brain networks are multi-scale in nature. To address this problem, this paper presents a novel approach to constructing multi-scale common structural brain networks from DTI data via an improved multi-scale spectral clustering applied on our recently developed and validated DICCCOLs (Dense Individualized and Common Connectivity-based Cortical Landmarks). Since the DICCCOL landmarks possess intrinsic structural correspondences across individuals and populations, we employed the multi-scale spectral clustering algorithm to group the DICCCOL landmarks and their connections into sub-networks, meanwhile preserving the intrinsically-established correspondences across multiple scales. Experimental results demonstrated that the proposed method can generate multi-scale consistent and common structural brain networks across subjects, and its reproducibility has been verified by multiple independent datasets. As an application, these multi-scale networks were used to guide the clustering of multi-scale fiber bundles and to compare the fiber integrity in schizophrenia and healthy controls. In general, our methods offer a novel and effective framework for brain network modeling and tract-based analysis of DTI data.

Anatomy-guided Dense Individualized and Common Connectivity-based Cortical Landmarks (A-DICCCOL)

Establishment of structural and functional correspondences of human brain that can be quantitatively encoded and reproduced across different subjects and populations is one of the key issues in brain mapping. As an attempt to address this challenge, our recently developed Dense Individualized and Common Connectivity-based Cortical Landmarks (DICCCOL) system reported 358 connectional landmarks, each of which possesses consistent DTI-derived white matter fiber connection pattern that is reproducible in over 240 healthy brains. However, the DICCCOL system can be substantially improved by integrating anatomical and morphological information during landmark initialization and optimization procedures. In this paper, we present a novel anatomy-guided landmark discovery framework that defines and optimizes landmarks via integrating rich anatomical, morphological, and fiber connectional information for landmark initialization, group-wise optimization and prediction, which are formulated and solved as an energy minimization problem. The framework finally determined 555 consistent connectional landmarks. Validation studies demonstrated that the 555 landmarks are reproducible, predictable, and exhibited reasonably accurate anatomical, connectional, and functional correspondences across individuals and populations and thus are named anatomy-guided DICCCOL or A-DICCCOL. This A-DICCCOL system represents common cortical architectures with anatomical, connectional, and functional correspondences across different subjects and would potentially provide opportunities for various applications in brain science.

Survey of encoding and decoding of visual stimulus via FMRI: an image analysis perspective

A variety of exciting scientific achievements have been made in the last few decades in brain encoding and decoding via functional magnetic resonance imaging (fMRI). This trend continues to rise in recent years, as evidenced by the increasing number of published papers in this topic and several published survey papers addressing different aspects of research issues. Essentially, these survey articles were mainly from cognitive neuroscience and neuroimaging perspectives, although computational challenges were briefly discussed. To complement existing survey articles, this paper focuses on the survey of the variety of image analysis methodologies, such as neuroimage registration, fMRI signal analysis, ROI (regions of interest) selection, machine learning algorithms, reproducibility analysis, structural and functional connectivity, and natural image analysis, which were employed in previous brain encoding/decoding research works. This paper also provides discussions of potential limitations of those image analysis methodologies and possible future improvements. It is hoped that extensive discussions of image analysis issues could contribute to the advancements of the increasingly important brain encoding/decoding field.

Characterizing and Differentiating Brain State Dynamics via Hidden Markov Models

Functional connectivity measured from resting state fMRI (R-fMRI) data has been widely used to examine the brain's functional activities and has been recently used to characterize and differentiate brain conditions. However, the dynamical transition patterns of the brain's functional states have been less explored. In this work, we propose a novel computational framework to quantitatively characterize the brain state dynamics via hidden Markov models (HMMs) learned from the observations of temporally dynamic functional connectomics, denoted as functional connectome states. The framework has been applied to the R-fMRI dataset including 44 post-traumatic stress disorder (PTSD) patients and 51 normal control (NC) subjects. Experimental results show that both PTSD and NC brains were undergoing remarkable changes in resting state and mainly transiting amongst a few brain states. Interestingly, further prediction with the best-matched HMM demonstrates that PTSD would enter into, but could not disengage from, a negative mood state. Importantly, 84% of PTSD patients and 86% of NC subjects are successfully classified via multiple HMMs using majority voting.

Fine-granularity functional interaction signatures for characterization of brain conditions

In the human brain, functional activity occurs at multiple spatial scales. Current studies on functional brain networks and their alterations in brain diseases via resting-state functional magnetic resonance imaging (rs-fMRI) are generally either at local scale (regionally confined analysis and inter-regional functional connectivity analysis) or at global scale (graph theoretic analysis). In contrast, inferring functional interaction at fine-granularity sub-network scale has not been adequately explored yet. Here our hypothesis is that functional interaction measured at fine-granularity sub-network scale can provide new insight into the neural mechanisms of neurological and psychological conditions, thus offering complementary information for healthy and diseased population classification. In this paper, we derived fine-granularity functional interaction (FGFI) signatures in subjects with Mild Cognitive Impairment (MCI) and Schizophrenia by diffusion tensor imaging (DTI) and rs-fMRI, and used patient-control classification experiments to evaluate the distinctiveness of the derived FGFI features. Our experimental results have shown that the FGFI features alone can achieve comparable classification performance compared with the commonly used inter-regional connectivity features. However, the classification performance can be substantially improved when FGFI features and inter-regional connectivity features are integrated, suggesting the complementary information achieved from the FGFI signatures.

Action and language mechanisms in the brain: data, models and neuroinformatics

We assess the challenges of studying action and language mechanisms in the brain, both singly and in relation to each other to provide a novel perspective on neuroinformatics, integrating the development of databases for encoding – separately or together – neurocomputational models and empirical data that serve systems and cognitive neuroscience.

Dynamic functional connectomics signatures for characterization and differentiation of PTSD patients

Functional connectomes (FCs) have been recently shown to be powerful in characterizing brain conditions. However, many previous studies assumed temporal stationarity of FCs, while their temporal dynamics are rarely explored. Here, based on the structural connectomes constructed from diffusion tensor imaging data, FCs are derived from resting-state fMRI (R-fMRI) data and are then temporally divided into quasi-stable segments via a sliding time window approach. After integrating and pooling over a large number of those temporally quasi-stable FC segments from 44 post-traumatic stress disorder (PTSD) patients and 51 healthy controls, common FC (CFC) patterns are derived via effective dictionary learning and sparse coding algorithms. It is found that there are 16 CFC patterns that are reproducible across healthy controls, and interestingly, two additional CFC patterns with altered connectivity patterns [termed signature FC (SFC) here] exist dominantly in PTSD subjects. These two SFC patterns alone can successfully differentiate 80% of PTSD subjects from healthy controls with only 2% false positive. Furthermore, the temporal transition dynamics of CFC patterns in PTSD subjects are substantially different from those in healthy controls. These results have been replicated in separate testing datasets, suggesting that dynamic functional connectomics signatures can effectively characterize and differentiate PTSD patients.

The mind-brain relationship as a mathematical problem

This paper aims to frame certain fundamental aspects of the human mind (content and meaning of mental states) and foundational elements of brain computation (spatial and temporal patterns of neural activity) so as to enable at least in principle their integration within one and the same quantitative representation. Through the history of science, similar approaches have been instrumental to bridge other seemingly mysterious scientific phenomena, such as thermodynamics and statistical mechanics, optics and electromagnetism, or chemistry and quantum physics, among several other examples. Identifying the relevant levels of analysis is important to define proper mathematical formalisms for describing the brain and the mind, such that they could be mapped onto each other in order to explain their equivalence. Based on these premises, we overview the potential of neural connectivity to provide highly informative constraints on brain computational process. Moreover, we outline approaches for representing cognitive and emotional states geometrically with semantic maps. Next, we summarize leading theoretical framework that might serve as an explanatory bridge between neural connectivity and mental space. Furthermore, we discuss the implications of this framework for human communication and our view of reality. We conclude by analyzing the practical requirements to manage the necessary data for solving the mind-brain problem from this perspective.

Detecting brain state changes via fiber-centered functional connectivity analysis

Diffusion tensor imaging (DTI) and functional magnetic resonance imaging (fMRI) have been widely used to study structural and functional brain connectivity in recent years. A common assumption used in many previous functional brain connectivity studies is the temporal stationarity. However, accumulating literature evidence has suggested that functional brain connectivity is under temporal dynamic changes in different time scales. In this paper, a novel and intuitive approach is proposed to model and detect dynamic changes of functional brain states based on multimodal fMRI/DTI data. The basic idea is that functional connectivity patterns of all fiber-connected cortical voxels are concatenated into a descriptive functional feature vector to represent the brain's state, and the temporal change points of brain states are decided by detecting the abrupt changes of the functional vector patterns via the sliding window approach. Our extensive experimental results have shown that meaningful brain state change points can be detected in task-based fMRI/DTI, resting state fMRI/DTI, and natural stimulus fMRI/DTI data sets. Particularly, the detected change points of functional brain states in task-based fMRI corresponded well to the external stimulus paradigm administered to the participating subjects, thus partially validating the proposed brain state change detection approach. The work in this paper provides novel perspective on the dynamic behaviors of functional brain connectivity and offers a starting point for future elucidation of the complex patterns of functional brain interactions and dynamics.

Construction of multi-scale common brain networks based on DICCCOL

Modeling the human brain as a network has been widely considered as a powerful approach to investigating the brain's structural and functional systems. However, many previous approaches focused on a single scale of brain network and the multi-scale nature of brain networks has been rarely explored yet. This paper put forward a novel framework to construct multi-scale common networks of brains via multi-scale spectral clustering of fiber connections among DICCCOLs. Specifically, the recently developed and publicly released DICCCOLs provide the nodal structural and functional correspondence across individuals, and thus the employed multi-scale spectral clustering algorithm divided the DICCCOL landmarks and their connections into sub-networks with correspondences on multiple scales. Experimental results showed the promise of the constructed multi-scale networks in applications of structural and functional connectivity mapping. As an application example, these multi-scale networks are used to guide the identification of multi-scale common fiber bundles across individuals and to facilitate the bundle's functional role analysis, which could enable other tract-based and network-based analyses in the future.

Individual functional ROI optimization via maximization of group-wise consistency of structural and functional profiles

Studying connectivities among functional brain regions and the functional dynamics on brain networks has drawn increasing interest. A fundamental issue that affects functional connectivity and dynamics studies is how to determine the best possible functional brain regions or ROIs (regions of interest) for a group of individuals, since the connectivity measurements are heavily dependent on ROI locations. Essentially, identification of accurate, reliable and consistent corresponding ROIs is challenging due to the unclear boundaries between brain regions, variability across individuals, and nonlinearity of the ROIs. In response to these challenges, this paper presents a novel methodology to computationally optimize ROIs locations derived from task-based fMRI data for individuals so that the optimized ROIs are more consistent, reproducible and predictable across brains. Our computational strategy is to formulate the individual ROI location optimization as a group variance minimization problem, in which group-wise consistencies in functional/structural connectivity patterns and anatomic profiles are defined as optimization constraints. Our experimental results from multimodal fMRI and DTI data show that the optimized ROIs have significantly improved consistency in structural and functional profiles across individuals. These improved functional ROIs with better consistency could contribute to further study of functional interaction and dynamics in the human brain.

DICCCOL: dense individualized and common connectivity-based cortical landmarks

Is there a common structural and functional cortical architecture that can be quantitatively encoded and precisely reproduced across individuals and populations? This question is still largely unanswered due to the vast complexity, variability, and nonlinearity of the cerebral cortex. Here, we hypothesize that the common cortical architecture can be effectively represented by group-wise consistent structural fiber connections and take a novel data-driven approach to explore the cortical architecture. We report a dense and consistent map of 358 cortical landmarks, named Dense Individualized and Common Connectivity-based Cortical Landmarks (DICCCOLs). Each DICCCOL is defined by group-wise consistent white-matter fiber connection patterns derived from diffusion tensor imaging (DTI) data. Our results have shown that these 358 landmarks are remarkably reproducible over more than one hundred human brains and possess accurate intrinsically established structural and functional cross-subject correspondences validated by large-scale functional magnetic resonance imaging data. In particular, these 358 cortical landmarks can be accurately and efficiently predicted in a new single brain with DTI data. Thus, this set of 358 DICCCOL landmarks comprehensively encodes the common structural and functional cortical architectures, providing opportunities for many applications in brain science including mapping human brain connectomes, as demonstrated in this work.

DICCCOL: dense individualized and common connectivity-based cortical landmarks

Is there a common structural and functional cortical architecture that can be quantitatively encoded and precisely reproduced across individuals and populations? This question is still largely unanswered due to the vast complexity, variability, and nonlinearity of the cerebral cortex. Here, we hypothesize that the common cortical architecture can be effectively represented by group-wise consistent structural fiber connections and take a novel data-driven approach to explore the cortical architecture. We report a dense and consistent map of 358 cortical landmarks, named Dense Individualized and Common Connectivity-based Cortical Landmarks (DICCCOLs). Each DICCCOL is defined by group-wise consistent white-matter fiber connection patterns derived from diffusion tensor imaging (DTI) data. Our results have shown that these 358 landmarks are remarkably reproducible over more than one hundred human brains and possess accurate intrinsically established structural and functional cross-subject correspondences validated by large-scale functional magnetic resonance imaging data. In particular, these 358 cortical landmarks can be accurately and efficiently predicted in a new single brain with DTI data. Thus, this set of 358 DICCCOL landmarks comprehensively encodes the common structural and functional cortical architectures, providing opportunities for many applications in brain science including mapping human brain connectomes, as demonstrated in this work.

Workflow and atlas system for brain-wide mapping of axonal connectivity in rat

Detailed knowledge about the anatomical organization of axonal connections is important for understanding normal functions of brain systems and disease-related dysfunctions. Such connectivity data are typically generated in neuroanatomical tract-tracing experiments in which specific axonal connections are visualized in histological sections. Since journal publications typically only accommodate restricted data descriptions and example images, literature search is a cumbersome way to retrieve overviews of brain connectivity. To explore more efficient ways of mapping, analyzing, and sharing detailed axonal connectivity data from the rodent brain, we have implemented a workflow for data production and developed an atlas system tailored for online presentation of axonal tracing data. The system is available online through the Rodent Brain WorkBench (www.rbwb.org; Whole Brain Connectivity Atlas) and holds experimental metadata and high-resolution images of histological sections from experiments in which axonal tracers were injected in the primary somatosensory cortex. We here present the workflow and the data system, and exemplify how the online image repository can be used to map different aspects of the brain-wide connectivity of the rat primary somatosensory cortex, including not only presence of connections but also morphology, densities, and spatial organization. The accuracy of the approach is validated by comparing results generated with our system with findings reported in previous publications. The present study is a contribution to a systematic mapping of rodent brain connections and represents a starting point for further large-scale mapping efforts.

White matter: beyond focal disconnection

The complex phenomenology of white matter dementia and many neuropsychiatric disorders implies that they originate from involvement of distributed neural networks, and white matter neuropathology is increasingly implicated in the pathogenesis of these network disconnection syndromes. White matter disorders produce functional asynchrony of interdependent cerebral regions subserving normal cognitive and emotional functions. Accumulating evidence suggests that white matter dementia primarily reflects disturbed frontal systems connectivity, whereas disruption of frontal and temporal lobe systems is implicated in the pathogenesis of neuropsychiatric disorders. Continued study of normal and abnormal white matter promises to help resolve challenging problems in behavioral neurology and neuropsychiatry.

Human intelligence and brain networks

Intelligence can be defined as a general mental ability for reasoning, problem solving, and learning. Because of its general nature, intelligence integrates cognitive functions such as perception, attention, memory, language, or planning. On the basis of this definition, intelligence can be reliably measured by standardized tests with obtained scores predicting several broad social outcomes such as educational achievement, job performance, health, and longevity. A detailed understanding of the brain mechanisms underlying this general mental ability could provide significant individual and societal benefits. Structural and functional neuroimaging studies have generally supported a frontoparietal network relevant for intelligence. This same network has also been found to underlie cognitive functions related to perception, short-term memory storage, and language. The distributed nature of this network and its involvement in a wide range of cognitive functions fits well with the integrative nature of intelligence. A new key phase of research is beginning to investigate how functional networks relate to structural networks, with emphasis on how distributed brain areas communicate with each other.

Axonal morphometry of hippocampal pyramidal neurons semi-automatically reconstructed after in vivo labeling in different CA3 locations

Axonal arbors of principal neurons form the backbone of neuronal networks in the mammalian cortex. Three-dimensional reconstructions of complete axonal trees are invaluable for quantitative analysis and modeling. However, digital data are still sparse due to labor intensity of reconstructing these complex structures. We augmented conventional tracing techniques with computational approaches to reconstruct fully labeled axonal morphologies. We digitized the axons of three rat hippocampal pyramidal cells intracellularly filled in vivo from different CA3 sub-regions: two from areas CA3b and CA3c, respectively, toward the septal pole, and one from the posterior/ventral area (CA3pv) near the temporal pole. The reconstruction system was validated by comparing the morphology of the CA3c neuron with that traced from the same cell by a different operator on a standard commercial setup. Morphometric analysis revealed substantial differences among neurons. Total length ranged from 200 (CA3b) to 500 mm (CA3c), and axonal branching complexity peaked between 1 (CA3b and CA3pv) and 2 mm (CA3c) of Euclidean distance from the soma. Length distribution was analyzed among sub-regions (CA3a,b,c and CA1a,b,c), cytoarchitectonic layers, and longitudinal extent within a three-dimensional template of the rat hippocampus. The CA3b axon extended thrice more collaterals within CA3 than into CA1. On the contrary, the CA3c projection was double into CA1 than within CA3. Moreover, the CA3b axon extension was equal between strata oriens and radiatum, while the CA3c axon displayed an oriens/radiatum ratio of 1:6. The axonal distribution of the CA3pv neuron was intermediate between those of the CA3b and CA3c neurons both relative to sub-regions and layers, with uniform collateral presence across CA3/CA1 and moderate preponderance of radiatum over oriens. In contrast with the dramatic sub-region and layer differences, the axon longitudinal spread around the soma was similar for the three neurons. To fully characterize the axonal diversity of CA3 principal neurons will require higher-throughput reconstruction systems beyond the threefold speed-up of the method adopted here.