Individual Brain Charting, a high-resolution fMRI dataset for cognitive mapping

Individual Brain Charting dataset extension, third release for movie watching and retinotopy data

The Individual Brain Charting (IBC) is a multi-task functional Magnetic Resonance Imaging dataset acquired at high spatial-resolution and dedicated to the cognitive mapping of the human brain. It consists in the deep phenotyping of twelve individuals, covering a broad range of psychological domains suitable for functional-atlasing applications. Here, we present the inclusion of task data from both naturalistic stimuli and trial-based designs, to uncover structures of brain activation. We rely on the Fast Shared Response Model (FastSRM) to provide a data-driven solution for modelling naturalistic stimuli, typically containing many features. We show that data from left-out runs can be reconstructed using FastSRM, enabling the extraction of networks from the visual, auditory and language systems. We also present the topographic organization of the visual system through retinotopy. In total, six new tasks were added to IBC, wherein four trial-based retinotopic tasks contributed with a mapping of the visual field to the cortex. IBC is open access: source plus derivatives imaging data and meta-data are available in public repositories.

Introducing HiBoP: a Unity-based visualization software for large iEEG datasets

BACKGROUND

Intracranial EEG data offer a unique spatio-temporal precision to investigate human brain functions. Large datasets have become recently accessible thanks to new iEEG data-sharing practices and tighter collaboration with clinicians. Yet, the complexity of such datasets poses new challenges, especially regarding the visualization and anatomical display of iEEG.

NEW METHOD

We introduce HiBoP, a multi-modal visualization software specifically designed for large groups of patients and multiple experiments. Its main features include the dynamic display of iEEG responses induced by tasks/stimulations, the definition of Regions and electrodes Of Interest, and the shift between group-level and individual-level 3D anatomo-functional data.

RESULTS

We provide a use-case with data from 36 patients to reveal the global cortical dynamics following tactile stimulation. We used HiBoP to visualize high-gamma responses [50-150Hz], and define three major response components in primary somatosensory and premotor cortices and parietal operculum. Comparison with Existing Methods(s) Several iEEG softwares are now publicly available with outstanding analysis features. Yet, most were developed in languages (Python/Matlab) chosen to facilitate the inclusion of new analysis by users, rather than the quality of the visualization. HiBoP represents a visualization tool developed with videogame standards (Unity/C#), and performs detailed anatomical analysis rapidly, across multiple conditions, patients, and modalities with an easy export toward third-party softwares.

CONCLUSION

HiBoP provides a user-friendly environment that greatly facilitates the exploration of large iEEG datasets, and helps users decipher subtle structure/function relationships.

Disentangling signal and noise in neural responses through generative modeling

Measurements of neural responses to identically repeated experimental events often exhibit large amounts of variability. This noise is distinct from signal , operationally defined as the average expected response across repeated trials for each given event. Accurately distinguishing signal from noise is important, as each is a target that is worthy of study (many believe noise reflects important aspects of brain function) and it is important not to confuse one for the other. Here, we introduce a principled modeling approach in which response measurements are explicitly modeled as the sum of samples from multivariate signal and noise distributions. In our proposed method-termed Generative Modeling of Signal and Noise (GSN)-the signal distribution is estimated by subtracting the estimated noise distribution from the estimated data distribution. We validate GSN using ground-truth simulations and demonstrate the application of GSN to empirical fMRI data. In doing so, we illustrate a simple consequence of GSN: by disentangling signal and noise components in neural responses, GSN denoises principal components analysis and improves estimates of dimensionality. We end by discussing other situations that may benefit from GSN's characterization of signal and noise, such as estimation of noise ceilings for computational models of neural activity. A code toolbox for GSN is provided with both MATLAB and Python implementations.

Should one go for individual- or group-level brain parcellations? A deep-phenotyping benchmark

The analysis and understanding of brain characteristics often require considering region-level information rather than voxel-sampled data. Subject-specific parcellations have been put forward in recent years, as they can adapt to individual brain organization and thus offer more accurate individual summaries than standard atlases. However, the price to pay for adaptability is the lack of group-level consistency of the data representation. Here, we investigate whether the good representations brought by individualized models are merely an effect of circular analysis, in which individual brain features are better represented by subject-specific summaries, or whether this carries over to new individuals, i.e., whether one can actually adapt an existing parcellation to new individuals and still obtain good summaries in these individuals. For this, we adapt a dictionary-learning method to produce brain parcellations. We use it on a deep-phenotyping dataset to assess quantitatively the patterns of activity obtained under naturalistic and controlled-task-based settings. We show that the benefits of individual parcellations are substantial, but that they vary a lot across brain systems.

Functional connectome through the human life span

The functional connectome of the human brain represents the fundamental network architecture of functional interdependence in brain activity, but its normative growth trajectory across the life course remains unknown. Here, we aggregate the largest, quality-controlled multimodal neuroimaging dataset from 119 global sites, including 33,809 task-free fMRI and structural MRI scans from 32,328 individuals ranging in age from 32 postmenstrual weeks to 80 years. Lifespan growth charts of the connectome are quantified at the whole cortex, system, and regional levels using generalized additive models for location, scale, and shape. We report critical inflection points in the non-linear growth trajectories of the whole-brain functional connectome, particularly peaking in the fourth decade of life. Having established the first fine-grained, lifespan-spanning suite of system-level brain atlases, we generate person-specific parcellation maps and further show distinct maturation timelines for functional segregation within different subsystems. We identify a spatiotemporal gradient axis that governs the life-course growth of regional connectivity, transitioning from primary sensory cortices to higher-order association regions. Using the connectome-based normative model, we demonstrate substantial individual heterogeneities at the network level in patients with autism spectrum disorder and patients with major depressive disorder. Our findings shed light on the life-course evolution of the functional connectome and serve as a normative reference for quantifying individual variation in patients with neurological and psychiatric disorders.

Within-Individual Organization of the Human Cerebral Cortex: Networks, Global Topography, and Function

The human cerebral cortex is populated by specialized regions that are organized into networks. Here we estimated networks using a Multi-Session Hierarchical Bayesian Model (MS-HBM) applied to intensively sampled within-individual functional MRI (fMRI) data. The network estimation procedure was initially developed and tested in two participants (each scanned 31 times) and then prospectively applied to 15 new participants (each scanned 8 to 11 times). Detailed analysis of the networks revealed a global organization. Locally organized first-order sensory and motor networks were surrounded by spatially adjacent second-order networks that also linked to distant regions. Third-order networks each possessed regions distributed widely throughout association cortex. Moreover, regions of distinct third-order networks displayed side-by-side juxtapositions with a pattern that repeated similarly across multiple cortical zones. We refer to these as Supra-Areal Association Megaclusters (SAAMs). Within each SAAM, two candidate control regions were typically adjacent to three separate domain-specialized regions. Independent task data were analyzed to explore functional response properties. The somatomotor and visual first-order networks responded to body movements and visual stimulation, respectively. A subset of the second-order networks responded to transients in an oddball detection task, consistent with a role in orienting to salient or novel events. The third-order networks, including distinct regions within each SAAM, showed two levels of functional specialization. Regions linked to candidate control networks responded to working memory load across multiple stimulus domains. The remaining regions within each SAAM did not track working memory load but rather dissociated across language, social, and spatial / episodic processing domains. These results support a model of the cerebral cortex in which progressively higher-order networks nest outwards from primary sensory and motor cortices. Within the apex zones of association cortex there is specialization of large-scale networks that divides domain-flexible from domain-specialized regions repeatedly across parietal, temporal, and prefrontal cortices. We discuss implications of these findings including how repeating organizational motifs may emerge during development.

Masked features of task states found in individual brain networks

Completing complex tasks requires that we flexibly integrate information across brain areas. While studies have shown how functional networks are altered during different tasks, this work has generally focused on a cross-subject approach, emphasizing features that are common across people. Here we used extended sampling "precision" fMRI data to test the extent to which task states generalize across people or are individually specific. We trained classifiers to decode state using functional network data in single-person datasets across 5 diverse task states. Classifiers were then tested on either independent data from the same person or new individuals. Individualized classifiers were able to generalize to new participants. However, classification performance was significantly higher within a person, a pattern consistent across model types, people, tasks, feature subsets, and even for decoding very similar task conditions. Notably, these findings also replicated in a new independent dataset. These results suggest that individual-focused approaches can uncover robust features of brain states, including features obscured in cross-subject analyses. Individual-focused approaches have the potential to deepen our understanding of brain interactions during complex cognition.

Predicting brain activation maps for arbitrary tasks with cognitive encoding models

A deep understanding of the neural architecture of mental function should enable the accurate prediction of a specific pattern of brain activity for any psychological task, based only on the cognitive functions known to be engaged by that task. Encoding models (EMs), which predict neural responses from known features (e.g., stimulus properties), have succeeded in circumscribed domains (e.g., visual neuroscience), but implementing domain-general EMs that predict brain-wide activity for arbitrary tasks has been limited mainly by availability of datasets that 1) sufficiently span a large space of psychological functions, and 2) are sufficiently annotated with such functions to allow robust EM specification. We examine the use of EMs based on a formal specification of psychological function, to predict cortical activation patterns across a broad range of tasks. We utilized the Multi-Domain Task Battery, a dataset in which 24 subjects completed 32 ten-minute fMRI scans, switching tasks every 35 s and engaging in 44 total conditions of diverse psychological manipulations. Conditions were annotated by a group of experts using the Cognitive Atlas ontology to identify putatively engaged functions, and region-wise cognitive EMs (CEMs) were fit, for individual subjects, on neocortical responses. We found that CEMs predicted cortical activation maps of held-out tasks with high accuracy, outperforming a permutation-based null model while approaching the noise ceiling of the data, without being driven solely by either cognitive or perceptual-motor features. Hierarchical clustering on the similarity structure of CEM generalization errors revealed relationships amongst psychological functions. Spatial distributions of feature importances systematically overlapped with large-scale resting-state functional networks (RSNs), supporting the hypothesis of functional specialization within RSNs while grounding their function in an interpretable data-driven manner. Our implementation and validation of CEMs provides a proof of principle for the utility of formal ontologies in cognitive neuroscience and motivates the use of CEMs in the further testing of cognitive theories.

Person-specific and precision neuroimaging: Current methods and future directions

Most neuroimaging studies of brain function analyze data in normalized space to identify regions of common activation across participants. These studies treat interindividual differences in brain organization as noise, but this approach can obscure important information about the brain's functional architecture. Recently, a number of studies have adopted a person-specific approach that aims to characterize these individual differences and explore their reliability and implications for behavior. A subset of these studies has taken a precision imaging approach that collects multiple hours of data from each participant to map brain function on a finer scale. In this review, we provide a broad overview of how person-specific and precision imaging techniques have used resting-state measures to examine individual differences in the brain's organization and their impact on behavior, followed by how task-based activity continues to add detail to these discoveries. We argue that person-specific and precision approaches demonstrate substantial promise in uncovering new details of the brain's functional organization and its relationship to behavior in many areas of cognitive neuroscience. We also discuss some current limitations in this new field and some new directions it may take.

Closing the mechanistic gap: the value of microarchitecture in understanding cognitive networks

Cognitive neuroscience aims to provide biologically relevant accounts of cognition. Contemporary research linking spatial patterns of neural activity to psychological constructs describes 'where' hypothesised functions occur, but not 'how' these regions contribute to cognition. Technological, empirical, and conceptual advances allow this mechanistic gap to be closed by embedding patterns of functional activity in macro- and microscale descriptions of brain organisation. Recent work on the default mode network (DMN) and the multiple demand network (MDN), for example, highlights a microarchitectural landscape that may explain how activity in these networks integrates varied information, thus providing an anatomical foundation that will help to explain how these networks contribute to many different cognitive states. This perspective highlights emerging insights into how microarchitecture can constrain network accounts of human cognition.

Comprehensive decoding mental processes from Web repositories of functional brain images

Associating brain systems with mental processes requires statistical analysis of brain activity across many cognitive processes. These analyses typically face a difficult compromise between scope-from domain-specific to system-level analysis-and accuracy. Using all the functional Magnetic Resonance Imaging (fMRI) statistical maps of the largest data repository available, we trained machine-learning models that decode the cognitive concepts probed in unseen studies. For this, we leveraged two comprehensive resources: NeuroVault-an open repository of fMRI statistical maps with unconstrained annotations-and Cognitive Atlas-an ontology of cognition. We labeled NeuroVault images with Cognitive Atlas concepts occurring in their associated metadata. We trained neural networks to predict these cognitive labels on tens of thousands of brain images. Overcoming the heterogeneity, imbalance and noise in the training data, we successfully decoded more than 50 classes of mental processes on a large test set. This success demonstrates that image-based meta-analyses can be undertaken at scale and with minimal manual data curation. It enables broad reverse inferences, that is, concluding on mental processes given the observed brain activity.

The effects of repeated brain MRI on chromosomal damage

BACKGROUND

Magnetic resonance imaging (MRI) is currently considered a safe imaging technique because, unlike computed tomography, MRI does not expose patients to ionising radiation. However, conflicting literature reports possible genotoxic effects of MRI. We herein examine the chromosomal effects of repeated MRI scans by performing a longitudinal follow-up of chromosomal integrity in volunteers.

METHODS

This ethically approved study was performed on 13 healthy volunteers (mean age 33 years) exposed to up to 26 3-T MRI sessions. The characterisation of chromosome damage in peripheral blood lymphocytes was performed using the gold-standard biodosimetry technique augmented with telomere and centromere staining.

RESULTS

Cytogenetic analysis showed no detectable effect after a single MRI scan. However, repeated MRI sessions (from 10 to 20 scans) were associated with a small but significant increase in chromosomal breaks with the accumulation of cells with chromosomal terminal deletions with a coefficient of 9.5% (95% confidence interval 6.5-12.5%) per MRI (p < 0.001). Additional exposure did not result in any further increase. This plateauing of damage suggests lymphocyte turnover. Additionally, there was no significant induction of dicentric chromosomes, in contrast to what is observed following exposure to ionising radiation.

CONCLUSIONS

Our study showed that MRI can affect chromosomal integrity. However, the amount of damage per cell might be so low that no chromosomal rearrangement by fusion of two deoxyribonucleic breaks is induced, unlike that seen after exposure to computed tomography. This study confirms that MRI is a safe imaging technique.

Linking Brain Structure, Activity, and Cognitive Function through Computation

Understanding the human brain is a “Grand Challenge” for 21st century research. Computational approaches enable large and complex datasets to be addressed efficiently, supported by artificial neural networks, modeling and simulation. Dynamic generative multiscale models, which enable the investigation of causation across scales and are guided by principles and theories of brain function, are instrumental for linking brain structure and function. An example of a resource enabling such an integrated approach to neuroscientific discovery is the BigBrain, which spatially anchors tissue models and data across different scales and ensures that multiscale models are supported by the data, making the bridge to both basic neuroscience and medicine. Research at the intersection of neuroscience, computing and robotics has the potential to advance neuro-inspired technologies by taking advantage of a growing body of insights into perception, plasticity and learning. To render data, tools and methods, theories, basic principles and concepts interoperable, the Human Brain Project (HBP) has launched EBRAINS, a digital neuroscience research infrastructure, which brings together a transdisciplinary community of researchers united by the quest to understand the brain, with fascinating insights and perspectives for societal benefits.

Scan Once, Analyse Many: Using Large Open-Access Neuroimaging Datasets to Understand the Brain

We are now in a time of readily available brain imaging data. Not only are researchers now sharing data more than ever before, but additionally large-scale data collecting initiatives are underway with the vision that many future researchers will use the data for secondary analyses. Here I provide an overview of available datasets and some example use cases. Example use cases include examining individual differences, more robust findings, reproducibility-both in public input data and availability as a replication sample, and methods development. I further discuss a variety of considerations associated with using existing data and the opportunities associated with large datasets. Suggestions for further readings on general neuroimaging and topic-specific discussions are also provided.

A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence

Extensive sampling of neural activity during rich cognitive phenomena is critical for robust understanding of brain function. Here we present the Natural Scenes Dataset (NSD), in which high-resolution functional magnetic resonance imaging responses to tens of thousands of richly annotated natural scenes were measured while participants performed a continuous recognition task. To optimize data quality, we developed and applied novel estimation and denoising techniques. Simple visual inspections of the NSD data reveal clear representational transformations along the ventral visual pathway. Further exemplifying the inferential power of the dataset, we used NSD to build and train deep neural network models that predict brain activity more accurately than state-of-the-art models from computer vision. NSD also includes substantial resting-state and diffusion data, enabling network neuroscience perspectives to constrain and enhance models of perception and memory. Given its unprecedented scale, quality and breadth, NSD opens new avenues of inquiry in cognitive neuroscience and artificial intelligence.

Predicting Individual Task Contrasts From Resting-state Functional Connectivity using a Surface-based Convolutional Network

Task-based and resting-state represent the two most common experimental paradigms of functional neuroimaging. While resting-state offers a flexible and scalable approach for characterizing brain function, task-based techniques provide superior localization. In this paper, we build on recent deep learning methods to create a model that predicts task-based contrast maps from resting-state fMRI scans. Specifically, we propose BrainSurfCNN, a surface-based fully-convolutional neural network model that works with a representation of the brain's cortical sheet. BrainSurfCNN achieves exceptional predictive accuracy on independent test data from the Human Connectome Project, which is on par with the repeat reliability of the measured subject-level contrast maps. Conversely, our analyses reveal that a previously published benchmark is no better than group-average contrast maps. Finally, we demonstrate that BrainSurfCNN can generalize remarkably well to novel domains with limited training data.

Tackling the Complexity of Lesion-Symptoms Mapping: How to Bridge the Gap Between Data Scientists and Clinicians?

Accurate and predictive lesion-symptoms mapping is a major goal in the field of clinical neurosciences. Recent studies have called for a reappraisal of the results given by the standard univariate voxel-based lesion-symptom mapping technique, emphasizing the need of developing multivariate methods. While the organization of large datasets and their analysis with machine learning (ML) approaches represents an opportunity to increase prediction accuracy, the complexity and dimensionality of the problem remain a major obstacle. Acknowledging the difficulty of inferring individual outcomes from the observation of spatial patterns of lesions, we propose here to base prediction on new individuals on models of brain connectivity, whereby the disruption of a given network predicts the occurrence of selective deficits. Well-suited ML tools are necessary to capture the relevant information from limited datasets and perform reliable inference.

An empirical evaluation of functional alignment using inter-subject decoding

Inter-individual variability in the functional organization of the brain presents a major obstacle to identifying generalizable neural coding principles. Functional alignment-a class of methods that matches subjects' neural signals based on their functional similarity-is a promising strategy for addressing this variability. To date, however, a range of functional alignment methods have been proposed and their relative performance is still unclear. In this work, we benchmark five functional alignment methods for inter-subject decoding on four publicly available datasets. Specifically, we consider three existing methods: piecewise Procrustes, searchlight Procrustes, and piecewise Optimal Transport. We also introduce and benchmark two new extensions of functional alignment methods: piecewise Shared Response Modelling (SRM), and intra-subject alignment. We find that functional alignment generally improves inter-subject decoding accuracy though the best performing method depends on the research context. Specifically, SRM and Optimal Transport perform well at both the region-of-interest level of analysis as well as at the whole-brain scale when aggregated through a piecewise scheme. We also benchmark the computational efficiency of each of the surveyed methods, providing insight into their usability and scalability. Taking inter-subject decoding accuracy as a quantification of inter-subject similarity, our results support the use of functional alignment to improve inter-subject comparisons in the face of variable structure-function organization. We provide open implementations of all methods used.

The OpenNeuro resource for sharing of neuroscience data

The sharing of research data is essential to ensure reproducibility and maximize the impact of public investments in scientific research. Here, we describe OpenNeuro, a BRAIN Initiative data archive that provides the ability to openly share data from a broad range of brain imaging data types following the FAIR principles for data sharing. We highlight the importance of the Brain Imaging Data Structure standard for enabling effective curation, sharing, and reuse of data. The archive presently shares more than 600 datasets including data from more than 20,000 participants, comprising multiple species and measurement modalities and a broad range of phenotypes. The impact of the shared data is evident in a growing number of published reuses, currently totalling more than 150 publications. We conclude by describing plans for future development and integration with other ongoing open science efforts.

A Bayesian optimization approach for rapidly mapping residual network function in stroke

Post-stroke cognitive and linguistic impairments are debilitating conditions, with limited therapeutic options. Domain-general brain networks play an important role in stroke recovery and characterizing their residual function with functional MRI has the potential to yield biomarkers capable of guiding patient-specific rehabilitation. However, this is challenging as such detailed characterization requires testing patients on multitudes of cognitive tasks in the scanner, rendering experimental sessions unfeasibly lengthy. Thus, the current status quo in clinical neuroimaging research involves testing patients on a very limited number of tasks, in the hope that it will reveal a useful neuroimaging biomarker for the whole cohort. Given the great heterogeneity among stroke patients and the volume of possible tasks this approach is unsustainable. Advancing task-based functional MRI biomarker discovery requires a paradigm shift in order to be able to swiftly characterize residual network activity in individual patients using a diverse range of cognitive tasks. Here, we overcome this problem by leveraging neuroadaptive Bayesian optimization, an approach combining real-time functional MRI with machine-learning, by intelligently searching across many tasks, this approach rapidly maps out patient-specific profiles of residual domain-general network function. We used this technique in a cross-sectional study with 11 left-hemispheric stroke patients with chronic aphasia (four female, age ± standard deviation: 59 ± 10.9 years) and 14 healthy, age-matched control subjects (eight female, age ± standard deviation: 55.6 ± 6.8 years). To assess intra-subject reliability of the functional profiles obtained, we conducted two independent runs per subject, for which the algorithm was entirely reinitialized. Our results demonstrate that this technique is both feasible and robust, yielding reliable patient-specific functional profiles. Moreover, we show that group-level results are not representative of patient-specific results. Whereas controls have highly similar profiles, patients show idiosyncratic profiles of network abnormalities that are associated with behavioural performance. In summary, our study highlights the importance of moving beyond traditional 'one-size-fits-all' approaches where patients are treated as one group and single tasks are used. Our approach can be extended to diverse brain networks and combined with brain stimulation or other therapeutics, thereby opening new avenues for precision medicine targeting a diverse range of neurological and psychiatric conditions.

Decoding with confidence: Statistical control on decoder maps

In brain imaging, decoding is widely used to infer relationships between brain and cognition, or to craft brain-imaging biomarkers of pathologies. Yet, standard decoding procedures do not come with statistical guarantees, and thus do not give confidence bounds to interpret the pattern maps that they produce. Indeed, in whole-brain decoding settings, the number of explanatory variables is much greater than the number of samples, hence classical statistical inference methodology cannot be applied. Specifically, the standard practice that consists in thresholding decoding maps is not a correct inference procedure. We contribute a new statistical-testing framework for this type of inference. To overcome the statistical inefficiency of voxel-level control, we generalize the Family Wise Error Rate (FWER) to account for a spatial tolerance δ, introducing the δ-Family Wise Error Rate (δ-FWER). Then, we present a decoding procedure that can control the δ-FWER: the Ensemble of Clustered Desparsified Lasso (EnCluDL), a procedure for multivariate statistical inference on high-dimensional structured data. We evaluate the statistical properties of EnCluDL with a thorough empirical study, along with three alternative procedures including decoder map thresholding. We show that EnCluDL exhibits the best recovery properties while ensuring the expected statistical control.

Multiple b-values improve discrimination of cortical gray matter regions using diffusion MRI: an experimental validation with a data-driven approach

Objective

To investigate whether varied or repeated b-values provide better diffusion MRI data for discriminating cortical areas with a data-driven approach.

Methods

Data were acquired from three volunteers at 1.5T with b-values of 800, 1400, 2000 s/mm² along 64 diffusion-encoding directions. The diffusion signal was sampled from gray matter in seven regions of interest (ROIs). Rotational invariants of the local diffusion profile were extracted as features that characterize local tissue properties. Random forest classification experiments assessed whether classification accuracy improved when data with multiple b-values were used over repeated acquisition of the same (1400 s/mm²) b-value to compare all possible pairs of the seven ROIs. Three data sets from the Human Connectome Project were subjected to similar processing and analysis pipelines in eight ROIs.

Results

Three different b-values showed an average improvement in correct classification rates of 5.6% and 4.6%, respectively, in the local and HCP data over repeated measurements of the same b-value. The improvement in correct classification rate reached as high as 16% for individual binary classification experiments between two ROIs. Often using only two of the available three b-values were adequate to make such an improvement in classification rates.

Conclusion

Acquisitions with varying b-values are more suitable for discriminating cortical areas.

A Complex Systems Perspective on Neuroimaging Studies of Behavior and Its Disorders

The study of complex systems deals with emergent behavior that arises as a result of nonlinear spatiotemporal interactions between a large number of components both within the system, as well as between the system and its environment. There is a strong case to be made that neural systems as well as their emergent behavior and disorders can be studied within the framework of complexity science. In particular, the field of neuroimaging has begun to apply both theoretical and experimental procedures originating in complexity science—usually in parallel with traditional methodologies. Here, we illustrate the basic properties that characterize complex systems and evaluate how they relate to what we have learned about brain structure and function from neuroimaging experiments. We then argue in favor of adopting a complex systems-based methodology in the study of neuroimaging, alongside appropriate experimental paradigms, and with minimal influences from noncomplex system approaches. Our exposition includes a review of the fundamental mathematical concepts, combined with practical examples and a compilation of results from the literature.

Functional annotation of human cognitive states using deep graph convolution

A key goal in neuroscience is to understand brain mechanisms of cognitive functions. An emerging approach is "brain decoding", which consists of inferring a set of experimental conditions performed by a participant, using pattern classification of brain activity. Few works so far have attempted to train a brain decoding model that would generalize across many different cognitive tasks drawn from multiple cognitive domains. To tackle this problem, we proposed a multidomain brain decoder that automatically learns the spatiotemporal dynamics of brain response within a short time window using a deep learning approach. We evaluated the decoding model on a large population of 1200 participants, under 21 different experimental conditions spanning six different cognitive domains, acquired from the Human Connectome Project task-fMRI database. Using a 10s window of fMRI response, the 21 cognitive states were identified with a test accuracy of 90% (chance level 4.8%). Performance remained good when using a 6s window (82%). It was even feasible to decode cognitive states from a single fMRI volume (720ms), with the performance following the shape of the hemodynamic response. Moreover, a saliency map analysis demonstrated that the high decoding performance was driven by the response of biologically meaningful brain regions. Together, we provide an automated tool to annotate human brain activity with fine temporal resolution and fine cognitive granularity. Our model shows potential applications as a reference model for domain adaptation, possibly making contributions in a variety of domains, including neurological and psychiatric disorders.

Brain topography beyond parcellations: Local gradients of functional maps

Functional neuroimaging provides the unique opportunity to characterize brain regions based on their response to tasks or ongoing activity. As such, it holds the premise to capture brain spatial organization. Yet, the conceptual framework to describe this organization has remained elusive: on the one hand, parcellations build implicitly on a piecewise constant organization, i.e. flat regions separated by sharp boundaries; on the other hand, the recently popularized concept of functional gradient hints instead at a smooth structure. Noting that both views converge to a topographic scheme that pieces together local variations of functional features, we perform a quantitative assessment of local gradient-based models. Using as a driving case the prediction of functional Magnetic Resonance Imaging (fMRI) data -concretely, the prediction of task-fMRI from rest-fMRI maps across subjects- we develop a parcel-wise linear regression model based on a dictionary of reference topographies. Our method uses multiple random parcellations -as opposed to a single fixed parcellation- and aggregates estimates across these parcellations to predict functional features in left-out subjects. Our experiments demonstrate the existence of an optimal cardinality of the parcellation to capture local gradients of functional maps.

Subject-specific segregation of functional territories based on deep phenotyping

Functional magnetic resonance imaging (fMRI) has opened the possibility to investigate how brain activity is modulated by behavior. Most studies so far are bound to one single task, in which functional responses to a handful of contrasts are analyzed and reported as a group average brain map. Contrariwise, recent data-collection efforts have started to target a systematic spatial representation of multiple mental functions. In this paper, we leverage the Individual Brain Charting (IBC) dataset-a high-resolution task-fMRI dataset acquired in a fixed environment-in order to study the feasibility of individual mapping. First, we verify that the IBC brain maps reproduce those obtained from previous, large-scale datasets using the same tasks. Second, we confirm that the elementary spatial components, inferred across all tasks, are consistently mapped within and, to a lesser extent, across participants. Third, we demonstrate the relevance of the topographic information of the individual contrast maps, showing that contrasts from one task can be predicted by contrasts from other tasks. At last, we showcase the benefit of contrast accumulation for the fine functional characterization of brain regions within a prespecified network. To this end, we analyze the cognitive profile of functional territories pertaining to the language network and prove that these profiles generalize across participants.

Individual Brain Charting dataset extension, second release of high-resolution fMRI data for cognitive mapping

We present an extension of the Individual Brain Charting dataset -a high spatial-resolution, multi-task, functional Magnetic Resonance Imaging dataset, intended to support the investigation on the functional principles governing cognition in the human brain. The concomitant data acquisition from the same 12 participants, in the same environment, allows to obtain in the long run finer cognitive topographies, free from inter-subject and inter-site variability. This second release provides more data from psychological domains present in the first release, and also yields data featuring new ones. It includes tasks on e.g. mental time travel, reward, theory-of-mind, pain, numerosity, self-reference effect and speech recognition. In total, 13 tasks with 86 contrasts were added to the dataset and 63 new components were included in the cognitive description of the ensuing contrasts. As the dataset becomes larger, the collection of the corresponding topographies becomes more comprehensive, leading to better brain-atlasing frameworks. This dataset is an open-access facility; raw data and derivatives are publicly available in neuroimaging repositories.

Julich-Brain: A 3D probabilistic atlas of the human brain’s cytoarchitecture

Cytoarchitecture is a basic principle of microstructural brain parcellation. We introduce Julich-Brain, a three-dimensional atlas containing cytoarchitectonic maps of cortical areas and subcortical nuclei. The atlas is probabilistic, which enables it to account for variations between individual brains. Building such an atlas was highly data- and labor-intensive and required the development of nested, interdependent workflows for detecting borders between brain areas, data processing, provenance tracking, and flexible execution of processing chains to handle large amounts of data at different spatial scales. Full cortical coverage was achieved by the inclusion of gap maps to complement cortical maps. The atlas is dynamic and will be adapted as mapping progresses; it is openly available to support neuroimaging studies as well as modeling and simulation; and it is interoperable, enabling connection to other atlases and resources.

Fine-grain atlases of functional modes for fMRI analysis

Population imaging markedly increased the size of functional-imaging datasets, shedding new light on the neural basis of inter-individual differences. Analyzing these large data entails new scalability challenges, computational and statistical. For this reason, brain images are typically summarized in a few signals, for instance reducing voxel-level measures with brain atlases or functional modes. A good choice of the corresponding brain networks is important, as most data analyses start from these reduced signals. We contribute finely-resolved atlases of functional modes, comprising from 64 to 1024 networks. These dictionaries of functional modes (DiFuMo) are trained on millions of fMRI functional brain volumes of total size 2.4 ​TB, spanned over 27 studies and many research groups. We demonstrate the benefits of extracting reduced signals on our fine-grain atlases for many classic functional data analysis pipelines: stimuli decoding from 12,334 brain responses, standard GLM analysis of fMRI across sessions and individuals, extraction of resting-state functional-connectomes biomarkers for 2500 individuals, data compression and meta-analysis over more than 15,000 statistical maps. In each of these analysis scenarii, we compare the performance of our functional atlases with that of other popular references, and to a simple voxel-level analysis. Results highlight the importance of using high-dimensional "soft" functional atlases, to represent and analyze brain activity while capturing its functional gradients. Analyses on high-dimensional modes achieve similar statistical performance as at the voxel level, but with much reduced computational cost and higher interpretability. In addition to making them available, we provide meaningful names for these modes, based on their anatomical location. It will facilitate reporting of results.

NeuroQuery, comprehensive meta-analysis of human brain mapping

Reaching a global view of brain organization requires assembling evidence on widely different mental processes and mechanisms. The variety of human neuroscience concepts and terminology poses a fundamental challenge to relating brain imaging results across the scientific literature. Existing meta-analysis methods perform statistical tests on sets of publications associated with a particular concept. Thus, large-scale meta-analyses only tackle single terms that occur frequently. We propose a new paradigm, focusing on prediction rather than inference. Our multivariate model predicts the spatial distribution of neurological observations, given text describing an experiment, cognitive process, or disease. This approach handles text of arbitrary length and terms that are too rare for standard meta-analysis. We capture the relationships and neural correlates of 7547 neuroscience terms across 13 459 neuroimaging publications. The resulting meta-analytic tool, neuroquery.org, can ground hypothesis generation and data-analysis priors on a comprehensive view of published findings on the brain.

Imaging-based parcellations of the human brain

A defining aspect of brain organization is its spatial heterogeneity, which gives rise to multiple topographies at different scales. Brain parcellation - defining distinct partitions in the brain, be they areas or networks that comprise multiple discontinuous but closely interacting regions - is thus fundamental for understanding brain organization and function. The past decade has seen an explosion of in vivo MRI-based approaches to identify and parcellate the brain on the basis of a wealth of different features, ranging from local properties of brain tissue to long-range connectivity patterns, in addition to structural and functional markers. Given the high diversity of these various approaches, assessing the convergence and divergence among these ensuing maps is a challenge. Inter-individual variability adds to this challenge but also provides new opportunities when coupled with cross-species and developmental parcellation studies.

Computational and Informatic Advances for Reproducible Data Analysis in Neuroimaging

The reproducibility of scientific research has become a point of critical concern. We argue that openness and transparency are critical for reproducibility, and we outline an ecosystem for open and transparent science that has emerged within the human neuroimaging community. We discuss the range of open data-sharing resources that have been developed for neuroimaging data, as well as the role of data standards (particularly the brain imaging data structure) in enabling the automated sharing, processing, and reuse of large neuroimaging data sets. We outline how the open source Python language has provided the basis for a data science platform that enables reproducible data analysis and visualization. We also discuss how new advances in software engineering, such as containerization, provide the basis for greater reproducibility in data analysis. The emergence of this new ecosystem provides an example for many areas of science that are currently struggling with reproducibility.

The functional database of the ARCHI project: Potential and perspectives

More than two decades of functional magnetic resonance imaging (fMRI) of the human brain have succeeded to identify, with a growing level of precision, the neural basis of multiple cognitive skills within various domains (perception, sensorimotor processes, language, emotion and social cognition …). Progress has been made in the comprehension of the functional organization of localized brain areas. However, the long time required for fMRI acquisition limits the number of experimental conditions performed in a single individual. As a consequence, distinct brain localizations have mostly been studied in separate groups of participants, and their functional relationships at the individual level remain poorly understood. To address this issue, we report here preliminary results on a database of fMRI data acquired on 78 individuals who each performed a total of 29 experimental conditions, grouped in 4 cross-domains functional localizers. This protocol has been designed to efficiently isolate, in a single session, the brain activity associated with language, numerical representation, social perception and reasoning, premotor and visuomotor representations. Analyses are reported at the group and at the individual level, to establish the ability of our protocol to selectively capture distinct regions of interest in a very short time. Test-retest reliability was assessed in a subset of participants. The activity evoked by the different contrasts of the protocol is located in distinct brain networks that, individually, largely replicate previous findings and, taken together, cover a large proportion of the cortical surface. We provide detailed analyses of a subset of regions of relevance: the left frontal, left temporal and middle frontal cortices. These preliminary analyses highlight how combining such a large set of functional contrasts may contribute to establish a finer-grained brain atlas of cognitive functions, especially in regions of high functional overlap. Detailed structural images (structural connectivity, micro-structures, axonal diameter) acquired in the same individuals in the context of the ARCHI database provide a promising situation to explore functional/structural interdependence. Additionally, this protocol might also be used as a way to establish individual neurofunctional signatures in large cohorts.