Three-dimensional mean-shift edge bundling for the visualization of functional connectivity in the brain

SynCoPa: Visualizing Connectivity Paths and Synapses Over Detailed Morphologies

Brain complexity has traditionally fomented the division of neuroscience into somehow separated compartments; the coexistence of the anatomical, physiological, and connectomics points of view is just a paradigmatic example of this situation. However, there are times when it is important to combine some of these standpoints for getting a global picture, like for fully analyzing the morphological and topological features of a specific neuronal circuit. Within this framework, this article presents SynCoPa, a tool designed for bridging gaps among representations by providing techniques that allow combining detailed morphological neuron representations with the visualization of neuron interconnections at the synapse level. SynCoPa has been conceived for the interactive exploration and analysis of the connectivity elements and paths of simple to medium complexity neuronal circuits at the connectome level. This has been done by providing visual metaphors for synapses and interconnection paths, in combination with the representation of detailed neuron morphologies. SynCoPa could be helpful, for example, for establishing or confirming a hypothesis about the spatial distributions of synapses, or for answering questions about the way neurons establish connections or the relationships between connectivity and morphological features. Last, SynCoPa is easily extendable to include functional data provided, for example, by any of the morphologically-detailed simulators available nowadays, such as Neuron and Arbor, for providing a deep insight into the circuits features prior to simulating it, in particular any analysis where it is important to combine morphology, network topology, and physiology.

ConGen—A Simulator-Agnostic Visual Language for Definition and Generation of Connectivity in Large and Multiscale Neural Networks

An open challenge on the road to unraveling the brain's multilevel organization is establishing techniques to research connectivity and dynamics at different scales in time and space, as well as the links between them. This work focuses on the design of a framework that facilitates the generation of multiscale connectivity in large neural networks using a symbolic visual language capable of representing the model at different structural levels—ConGen. This symbolic language allows researchers to create and visually analyze the generated networks independently of the simulator to be used, since the visual model is translated into a simulator-independent language. The simplicity of the front end visual representation, together with the simulator independence provided by the back end translation, combine into a framework to enhance collaboration among scientists with expertise at different scales of abstraction and from different fields. On the basis of two use cases, we introduce the features and possibilities of our proposed visual language and associated workflow. We demonstrate that ConGen enables the creation, editing, and visualization of multiscale biological neural networks and provides a whole workflow to produce simulation scripts from the visual representation of the model.

Cingulo-opercular control network and disused motor circuits joined in standby mode

Whole-brain resting-state functional MRI (rs-fMRI) during 2 wk of upper-limb casting revealed that disused motor regions became more strongly connected to the cingulo-opercular network (CON), an executive control network that includes regions of the dorsal anterior cingulate cortex (dACC) and insula. Disuse-driven increases in functional connectivity (FC) were specific to the CON and somatomotor networks and did not involve any other networks, such as the salience, frontoparietal, or default mode networks. Censoring and modeling analyses showed that FC increases during casting were mediated by large, spontaneous activity pulses that appeared in the disused motor regions and CON control regions. During limb constraint, disused motor circuits appear to enter a standby mode characterized by spontaneous activity pulses and strengthened connectivity to CON executive control regions.

Engineering a Less Artificial Intelligence

Despite enormous progress in machine learning, artificial neural networks still lag behind brains in their ability to generalize to new situations. Given identical training data, differences in generalization are caused by many defining features of a learning algorithm, such as network architecture and learning rule. Their joint effect, called "inductive bias," determines how well any learning algorithm-or brain-generalizes: robust generalization needs good inductive biases. Artificial networks use rather nonspecific biases and often latch onto patterns that are only informative about the statistics of the training data but may not generalize to different scenarios. Brains, on the other hand, generalize across comparatively drastic changes in the sensory input all the time. We highlight some shortcomings of state-of-the-art learning algorithms compared to biological brains and discuss several ideas about how neuroscience can guide the quest for better inductive biases by providing useful constraints on representations and network architecture.

Cohort-based T-SSIM Visual Computing for Radiation Therapy Prediction and Exploration

We describe a visual computing approach to radiation therapy (RT) planning, based on spatial similarity within a patient cohort. In radiotherapy for head and neck cancer treatment, dosage to organs at risk surrounding a tumor is a large cause of treatment toxicity. Along with the availability of patient repositories, this situation has lead to clinician interest in understanding and predicting RT outcomes based on previously treated similar patients. To enable this type of analysis, we introduce a novel topology-based spatial similarity measure, T-SSIM, and a predictive algorithm based on this similarity measure. We couple the algorithm with a visual steering interface that intertwines visual encodings for the spatial data and statistical results, including a novel parallel-marker encoding that is spatially aware. We report quantitative results on a cohort of 165 patients, as well as a qualitative evaluation with domain experts in radiation oncology, data management, biostatistics, and medical imaging, who are collaborating remotely.

RemBrain: Exploring Dynamic Biospatial Networks with Mosaic Matrices and Mirror Glyphs

We introduce a web-based visual comparison approach for the systematic exploration of dynamic activation networks across biological datasets. Understanding the dynamics of such networks in the context of demographic factors like age is a fundamental problem in computational systems biology and neuroscience. We design visual encodings for the dynamic and community characteristics of these temporal networks. Our multi-scale approach blends nested mosaic matrices that capture temporal characteristics of the data, spatial views of the network data, Kiviat diagrams and mirror glyphs that detail the temporal behavior and community assignment of specific nodes. A top design specifically targeted at pairwise visual comparison further supports the comparative analysis of multiple dataset activations. We demonstrate the effectiveness of this approach through a case study on mouse brain network data. Domain expert feedback indicates this approach can help identify trends and anomalies in the data.

Adapted K-Core Decomposition and Visualization for Functional Magnetic Resonance Imaging Connectivity Networks

Medical imaging modalities, such as functional magnetic resonance imaging (fMRI) are being increasingly used to study the human brain. Analysis of the images has led to findings describing diseases, such as schizophrenia and post-traumatic stress disorder. One of the most widely used methods of analysis involves creating functional connectivity network (FCN) abstractions. These summarize the temporal relationships between regions of interest (ROIs) in the brain and can be used to easily compare subjects, e.g. healthy against schizophrenia. Visual analytics is widely used to facilitate such analysis, with existing approaches designed to enable and simplify detailed interpretation of single networks and pairs of networks in comparison. Prior to such detailed analysis, grouping and aggregation is often performed on the data, which is a time consuming and difficult task. Existing methods for doing this are commonly statistical, while others visualize the cohort without presenting vital network details of the individual FCNs. Thus, there is an opportunity for alternative visual analytics to facilitate the grouping by incorporating the network details. Graph decomposition, such as k-core decomposition, can be used to simplify the representation of networks, while retaining these vital network details. In this study, we propose an adapted k-core decomposition algorithm and visualization, which calculates the connected component information of nodes in the FCNs, a key detail in analysis. Our visualization combines this information with the decomposition to display more details about FCNs at a high-level than contemporary approaches. We present a prototype of our method, demonstrating the ability to group and aggregate the data without the loss of vital network details for further detailed analysis.

Pondering the Concept of Abstraction in (Illustrative) Visualization

We explore the concept of abstraction as it is used in visualization, with the ultimate goal of understanding and formally defining it. Researchers so far have used the concept of abstraction largely by intuition without a precise meaning. This lack of specificity left questions on the characteristics of abstraction, its variants, its control, or its ultimate potential for visualization and, in particular, illustrative visualization mostly unanswered. In this paper we thus provide a first formalization of the abstraction concept and discuss how this formalization affects the application of abstraction in a variety of visualization scenarios. Based on this discussion, we derive a number of open questions still waiting to be answered, thus formulating a research agenda for the use of abstraction for the visual representation and exploration of data. This paper, therefore, is intended to provide a contribution to the discussion of the theoretical foundations of our field, rather than attempting to provide a completed and final theory.

An Information-Theoretic Framework for Evaluating Edge Bundling Visualization

Edge bundling is a promising graph visualization approach to simplifying the visual result of a graph drawing. Plenty of edge bundling methods have been developed to generate diverse graph layouts. However, it is difficult to defend an edge bundling method with its resulting layout against other edge bundling methods as a clear theoretic evaluation framework is absent in the literature. In this paper, we propose an information-theoretic framework to evaluate the visual results of edge bundling techniques. We first illustrate the advantage of edge bundling visualizations for large graphs, and pinpoint the ambiguity resulting from drawing results. Second, we define and quantify the amount of information delivered by edge bundling visualization from the underlying network using information theory. Third, we propose a new algorithm to evaluate the resulting layouts of edge bundling using the amount of the mutual information between a raw network dataset and its edge bundling visualization. Comparison examples based on the proposed framework between different edge bundling techniques are presented.

An Uncertainty Visual Analytics Framework for fMRI Functional Connectivity

Analysis and interpretation of functional magnetic resonance imaging (fMRI) has been used to characterise many neuronal diseases, such as schizophrenia, bipolar disorder and Alzheimer's disease. Functional connectivity networks (FCNs) are widely used because they greatly reduce the amount of data that needs to be interpreted and they provide a common network structure that can be directly compared. However, FCNs contain a range of data uncertainties stemming from inherent limitations, e.g. during acquisition, as well as the loss of voxel-level data, and the use of thresholding in data abstraction. Additionally, human uncertainties arise during interpretation due to the complexity in understanding the data. While existing FCN visual analytics tools have begun to mitigate the human ambiguities, reducing the impact of data limitations is an open problem. In this paper, we propose a novel visual analytics framework with three linked, purpose-designed components to evoke deeper interpretation of the fMRI data: (i) an enhanced FCN abstraction; (ii) a temporal signal viewer; and (iii) the anatomical context. Each component has been specifically designed with novel visual cues and interaction to expose the impact of uncertainties on the data. We augment this with two methods designed for comparing subjects, by using a small multiples and a marker approach. We demonstrate the enhancements enabled by our framework on three case studies of common research scenarios, using clinical schizophrenia data, which highlight the value in interpreting fMRI FCN data with an awareness of the uncertainties. Finally, we discuss our framework in the context of fMRI visual analytics and the extensibility of our approach.

A review and outlook on visual analytics for uncertainties in functional magnetic resonance imaging

Analysis of functional magnetic resonance imaging (fMRI) plays a pivotal role in uncovering an understanding of the brain. fMRI data contain both spatial volume and temporal signal information, which provide a depiction of brain activity. The analysis pipeline, however, is hampered by numerous uncertainties in many of the steps; often seen as one of the last hurdles for the domain. In this review, we categorise fMRI research into three pipeline phases: (i) image acquisition and processing; (ii) image analysis; and (iii) visualisation and human interpretation, to explore the uncertainties that arise in each phase, including the compound effects due to the inter-dependence of steps. Attempts at mitigating uncertainties rely on providing interactive visual analytics that aid users in understanding the effects of the uncertainties and adjusting their analyses. This impetus for visual analytics comes in light of considerable research investigating uncertainty throughout the pipeline. However, to the best of our knowledge, there is yet to be a comprehensive review on the importance and utility of uncertainty visual analytics (UVA) in addressing fMRI concerns, which we term fMRI-UVA. Such techniques have been broadly implemented in related biomedical fields, and its potential for fMRI has recently been explored; however, these attempts are limited in their scope and utility, primarily focussing on addressing small parts of single pipeline phases. Our comprehensive review of the fMRI uncertainties from the perspective of visual analytics addresses the three identified phases in the pipeline. We also discuss the two interrelated approaches for future research opportunities for fMRI-UVA.

Functional Decomposition for Bundled Simplification of Trail Sets

Bundling visually aggregates curves to reduce clutter and help finding important patterns in trail-sets or graph drawings. We propose a new approach to bundling based on functional decomposition of the underling dataset. We recover the functional nature of the curves by representing them as linear combinations of piecewise-polynomial basis functions with associated expansion coefficients. Next, we express all curves in a given cluster in terms of a centroid curve and a complementary term, via a set of so-called principal component functions. Based on the above, we propose a two-fold contribution: First, we use cluster centroids to design a new bundling method for 2D and 3D curve-sets. Secondly, we deform the cluster centroids and generate new curves along them, which enables us to modify the underlying data in a statistically-controlled way via its simplified (bundled) view. We demonstrate our method by applications on real-world 2D and 3D datasets for graph bundling, trajectory analysis, and vector field and tensor field visualization.

ENIGMA-Viewer: interactive visualization strategies for conveying effect sizes in meta-analysis

BACKGROUND

Global scale brain research collaborations such as the ENIGMA (Enhancing Neuro Imaging Genetics through Meta Analysis) consortium are beginning to collect data in large quantity and to conduct meta-analyses using uniformed protocols. It becomes strategically important that the results can be communicated among brain scientists effectively. Traditional graphs and charts failed to convey the complex shapes of brain structures which are essential to the understanding of the result statistics from the analyses. These problems could be addressed using interactive visualization strategies that can link those statistics with brain structures in order to provide a better interface to understand brain research results.

RESULTS

We present ENIGMA-Viewer, an interactive web-based visualization tool for brain scientists to compare statistics such as effect sizes from meta-analysis results on standardized ROIs (regions-of-interest) across multiple studies. The tool incorporates visualization design principles such as focus+context and visual data fusion to enable users to better understand the statistics on brain structures. To demonstrate the usability of the tool, three examples using recent research data are discussed via case studies.

CONCLUSIONS

ENIGMA-Viewer supports presentations and communications of brain research results through effective visualization designs. By linking visualizations of both statistics and structures, users can gain more insights into the presented data that are otherwise difficult to obtain. ENIGMA-Viewer is an open-source tool, the source code and sample data are publicly accessible through the NITRC website ( http://www.nitrc.org/projects/enigmaviewer_20 ). The tool can also be directly accessed online ( http://enigma-viewer.org ).

CUBu: Universal Real-Time Bundling for Large Graphs

Visualizing very large graphs by edge bundling is a promising method, yet subject to several challenges: speed, clutter, level-of-detail, and parameter control. We present CUBu, a framework that addresses the above problems in an integrated way. Fully GPU-based, CUBu bundles graphs of up to a million edges at interactive framerates, being over 50 times faster than comparable state-of-the-art methods, and has a simple and intuitive control of bundling parameters. CUBu extends and unifies existing bundling techniques, offering ways to control bundle shapes, separate bundles by edge direction, and shade bundles to create a level-of-detail visualization that shows both the graph core structure and its details. We demonstrate CUBu on several large graphs extracted from real-life application domains.

Task-Related Edge Density (TED)-A New Method for Revealing Dynamic Network Formation in fMRI Data of the Human Brain

The formation of transient networks in response to external stimuli or as a reflection of internal cognitive processes is a hallmark of human brain function. However, its identification in fMRI data of the human brain is notoriously difficult. Here we propose a new method of fMRI data analysis that tackles this problem by considering large-scale, task-related synchronisation networks. Networks consist of nodes and edges connecting them, where nodes correspond to voxels in fMRI data, and the weight of an edge is determined via task-related changes in dynamic synchronisation between their respective times series. Based on these definitions, we developed a new data analysis algorithm that identifies edges that show differing levels of synchrony between two distinct task conditions and that occur in dense packs with similar characteristics. Hence, we call this approach "Task-related Edge Density" (TED). TED proved to be a very strong marker for dynamic network formation that easily lends itself to statistical analysis using large scale statistical inference. A major advantage of TED compared to other methods is that it does not depend on any specific hemodynamic response model, and it also does not require a presegmentation of the data for dimensionality reduction as it can handle large networks consisting of tens of thousands of voxels. We applied TED to fMRI data of a fingertapping and an emotion processing task provided by the Human Connectome Project. TED revealed network-based involvement of a large number of brain areas that evaded detection using traditional GLM-based analysis. We show that our proposed method provides an entirely new window into the immense complexity of human brain function.

Graph theory analysis of complex brain networks: new concepts in brain mapping applied to neurosurgery

Neuroanatomy has entered a new era, culminating in the search for the connectome, otherwise known as the brain's wiring diagram. While this approach has led to landmark discoveries in neuroscience, potential neurosurgical applications and collaborations have been lagging. In this article, the authors describe the ideas and concepts behind the connectome and its analysis with graph theory. Following this they then describe how to form a connectome using resting state functional MRI data as an example. Next they highlight selected insights into healthy brain function that have been derived from connectome analysis and illustrate how studies into normal development, cognitive function, and the effects of synthetic lesioning can be relevant to neurosurgery. Finally, they provide a précis of early applications of the connectome and related techniques to traumatic brain injury, functional neurosurgery, and neurooncology.

Exploration of the Brain's White Matter Structure through Visual Abstraction and Multi-Scale Local Fiber Tract Contraction

We present a visualization technique for brain fiber tracts from DTI data that provides insight into the structure of white matter through visual abstraction. We achieve this abstraction by analyzing the local similarity of tract segment directions at different scales using a stepwise increase of the search range. Next, locally similar tract segments are moved toward each other in an iterative process, resulting in a local contraction of tracts perpendicular to the local tract direction at a given scale. This not only leads to the abstraction of the global structure of the white matter as represented by the tracts, but also creates volumetric voids. This increase of empty space decreases the mutual occlusion of tracts and, consequently, results in a better understanding of the brain's three-dimensional fiber tract structure. Our implementation supports an interactive and continuous transition between the original and the abstracted representations via various scale levels of similarity. We also support the selection of groups of tracts, which are highlighted and rendered with the abstracted visualization as context.

Comparative analysis of the macroscale structural connectivity in the macaque and human brain

The macaque brain serves as a model for the human brain, but its suitability is challenged by unique human features, including connectivity reconfigurations, which emerged during primate evolution. We perform a quantitative comparative analysis of the whole brain macroscale structural connectivity of the two species. Our findings suggest that the human and macaque brain as a whole are similarly wired. A region-wise analysis reveals many interspecies similarities of connectivity patterns, but also lack thereof, primarily involving cingulate regions. We unravel a common structural backbone in both species involving a highly overlapping set of regions. This structural backbone, important for mediating information across the brain, seems to constitute a feature of the primate brain persevering evolution. Our findings illustrate novel evolutionary aspects at the macroscale connectivity level and offer a quantitative translational bridge between macaque and human research.

What are the commonalities and differences of human brains when compared to the brains of other primates? The brain can be conceived as a complex network. Its topological properties constrain its function. Ethical and technical reasons necessitate the use of animal brains, like the macaque monkey, as models for the human brain. However, evolutionary changes, including “brain rewiring”, might result in unique human features. Hence, a detailed and quantitative comparative analysis of the connectivity of the brains of the two species is needed. Here, we undertake this task by adopting techniques analogous to those used in comparative studies in other scientific fields. Our approach reveals converging but also diverging wiring patterns. The brain of the two species as a whole is similarly wired. The majority of the brain regions appear to have evolutionary conserved connectivity patterns while for certain regions this appears not to be the case. We also uncover an evolutionary conserved “structural backbone” in the brain of the two species. Our findings highlight common and unique “wiring properties” of the brains of these two primate species and offer a quantitative basis for translating findings from macaque research to human research.

Connexel visualization: a software implementation of glyphs and edge-bundling for dense connectivity data using brainGL

The visualization of brain connectivity becomes progressively more challenging as analytic and computational advances begin to facilitate connexel-wise analyses, which include all connections between pairs of voxels. Drawing full connectivity graphs can result in depictions that, rather than illustrating connectivity patterns in more detail, obfuscate patterns owing to the data density. In an effort to expand the possibilities for visualization, we describe two approaches for presenting connexels: edge-bundling, which clarifies structure by grouping geometrically similar connections; and, connectivity glyphs, which depict a condensed connectivity map at each point on the cortical surface. These approaches can be applied in the native brain space, facilitating interpretation of the relation of connexels to brain anatomy. The tools have been implemented as part of brainGL, an extensive open-source software for the interactive exploration of structural and functional brain data.

Dynamic functional connectivity: promise, issues, and interpretations

The brain must dynamically integrate, coordinate, and respond to internal and external stimuli across multiple time scales. Non-invasive measurements of brain activity with fMRI have greatly advanced our understanding of the large-scale functional organization supporting these fundamental features of brain function. Conclusions from previous resting-state fMRI investigations were based upon static descriptions of functional connectivity (FC), and only recently studies have begun to capitalize on the wealth of information contained within the temporal features of spontaneous BOLD FC. Emerging evidence suggests that dynamic FC metrics may index changes in macroscopic neural activity patterns underlying critical aspects of cognition and behavior, though limitations with regard to analysis and interpretation remain. Here, we review recent findings, methodological considerations, neural and behavioral correlates, and future directions in the emerging field of dynamic FC investigations.