A mutual information-based metric for evaluation of fMRI data-processing approaches

Task-related changes in resting state connectivity are affected by temporal interference (TI) stimulation

BACKGROUND

Resting-state metrics, such as brain network activity and functional connectivity (FC), are influenced by preceding cognitive tasks, such as memory formation. Brain stimulation can modulate brain network activity and FC during the resting state. However, it is unknown whether it can acutely modulate activity or FC traces of preceding cognitive tasks.

OBJECTIVES

We evaluated whether non-invasive temporal interference (TI) stimulation of the hippocampus can modulate hippocampal resting-state FC traces induced by a preceding hippocampally-dependent task.

METHODS

We collected resting-state functional magnetic resonance imaging (rsfMRI) in twenty healthy participants before and after the performance of an associative memory task. Theta-band TI stimulation of the medial and anterior hippocampus, and sham stimulation were delivered during post-task resting state. We used permutation tests to assess differences in pairwise mutual information functional connectivity (miFC) between pre-task rsfMRI vs post-task sham. In edges with significantly different pre-vs post-task miFC, permutation tests assessed the effect of TI on post-task miFC.

RESULTS

MiFC was significantly lower in several functional networks during post-task sham compared to pre-task baseline, including the hippocampal-connected and task-related Anterior Temporal (AT) and Posterior Medial (PM) networks. TI stimulation of the hippocampus during post-task resting state increased the miFC in the hippocampal AT and PM networks as well as other functional networks.

CONCLUSIONS

Non-invasive TI stimulation of the hippocampus during the resting state acutely modulated FC traces related to preceding hippocampal-dependent memory tasks.

Planning ahead: Predictable switching recruits task-active and resting-state networks

Switching is a difficult cognitive process characterised by costs in task performance; specifically, slowed responses and reduced accuracy. It is associated with the recruitment of a large coalition of task-positive regions including those referred to as the multiple demand cortex (MDC). The neural correlates of switching not only include the MDC, but occasionally the default mode network (DMN), a characteristically task-negative network. To unpick the role of the DMN during switching we collected fMRI data from 24 participants playing a switching paradigm that perturbed predictability (i.e., cognitive load) across three switch dimensions-sequential, perceptual, and spatial predictability. We computed the activity maps unique to switch vs. stay trials and all switch dimensions, then evaluated functional connectivity under these switch conditions by computing the pairwise mutual information functional connectivity (miFC) between regional timeseries. Switch trials exhibited an expected cost in reaction time while sequential predictability produced a significant benefit to task accuracy. Our results showed that switch trials recruited a broader activity map than stay trials, including regions of the DMN, the MDC, and task-positive networks such as visual, somatomotor, dorsal, salience/ventral attention networks. More sequentially predictable trials recruited increased activity in the somatomotor and salience/ventral attention networks. Notably, changes in sequential and perceptual predictability, but not spatial predictability, had significant effects on miFC. Increases in perceptual predictability related to decreased miFC between control, visual, somatomotor, and DMN regions, whereas increases in sequential predictability increased miFC between regions in the same networks, as well as regions within ventral attention/ salience, dorsal attention, limbic, and temporal parietal networks. These results provide novel clues as to how DMN may contribute to executive task performance. Specifically, the improved task performance, unique activity, and increased miFC associated with increased sequential predictability suggest that the DMN may coordinate more strongly with the MDC to generate a temporal schema of upcoming task events, which may attenuate switching costs.

Evaluation of the Hierarchical Correspondence between the Human Brain and Artificial Neural Networks: A Review

Artificial neural networks (ANNs) that are heavily inspired by the human brain now achieve human-level performance across multiple task domains. ANNs have thus drawn attention in neuroscience, raising the possibility of providing a framework for understanding the information encoded in the human brain. However, the correspondence between ANNs and the brain cannot be measured directly. They differ in outputs and substrates, neurons vastly outnumber their ANN analogs (i.e., nodes), and the key algorithm responsible for most of modern ANN training (i.e., backpropagation) is likely absent from the brain. Neuroscientists have thus taken a variety of approaches to examine the similarity between the brain and ANNs at multiple levels of their information hierarchy. This review provides an overview of the currently available approaches and their limitations for evaluating brain-ANN correspondence.

A statistical framework for neuroimaging data analysis based on mutual information estimated via a gaussian copula

We begin by reviewing the statistical framework of information theory as applicable to neuroimaging data analysis. A major factor hindering wider adoption of this framework in neuroimaging is the difficulty of estimating information theoretic quantities in practice. We present a novel estimation technique that combines the statistical theory of copulas with the closed form solution for the entropy of Gaussian variables. This results in a general, computationally efficient, flexible, and robust multivariate statistical framework that provides effect sizes on a common meaningful scale, allows for unified treatment of discrete, continuous, unidimensional and multidimensional variables, and enables direct comparisons of representations from behavioral and brain responses across any recording modality. We validate the use of this estimate as a statistical test within a neuroimaging context, considering both discrete stimulus classes and continuous stimulus features. We also present examples of analyses facilitated by these developments, including application of multivariate analyses to MEG planar magnetic field gradients, and pairwise temporal interactions in evoked EEG responses. We show the benefit of considering the instantaneous temporal derivative together with the raw values of M/EEG signals as a multivariate response, how we can separately quantify modulations of amplitude and direction for vector quantities, and how we can measure the emergence of novel information over time in evoked responses. Open-source Matlab and Python code implementing the new methods accompanies this article. Hum Brain Mapp 38:1541-1573, 2017. © 2016 Wiley Periodicals, Inc.

Interpretability of Multivariate Brain Maps in Linear Brain Decoding: Definition, and Heuristic Quantification in Multivariate Analysis of MEG Time-Locked Effects

Brain decoding is a popular multivariate approach for hypothesis testing in neuroimaging. Linear classifiers are widely employed in the brain decoding paradigm to discriminate among experimental conditions. Then, the derived linear weights are visualized in the form of multivariate brain maps to further study spatio-temporal patterns of underlying neural activities. It is well known that the brain maps derived from weights of linear classifiers are hard to interpret because of high correlations between predictors, low signal to noise ratios, and the high dimensionality of neuroimaging data. Therefore, improving the interpretability of brain decoding approaches is of primary interest in many neuroimaging studies. Despite extensive studies of this type, at present, there is no formal definition for interpretability of multivariate brain maps. As a consequence, there is no quantitative measure for evaluating the interpretability of different brain decoding methods. In this paper, first, we present a theoretical definition of interpretability in brain decoding; we show that the interpretability of multivariate brain maps can be decomposed into their reproducibility and representativeness. Second, as an application of the proposed definition, we exemplify a heuristic for approximating the interpretability in multivariate analysis of evoked magnetoencephalography (MEG) responses. Third, we propose to combine the approximated interpretability and the generalization performance of the brain decoding into a new multi-objective criterion for model selection. Our results, for the simulated and real MEG data, show that optimizing the hyper-parameters of the regularized linear classifier based on the proposed criterion results in more informative multivariate brain maps. More importantly, the presented definition provides the theoretical background for quantitative evaluation of interpretability, and hence, facilitates the development of more effective brain decoding algorithms in the future.

An Automated, Adaptive Framework for Optimizing Preprocessing Pipelines in Task-Based Functional MRI

BOLD fMRI is sensitive to blood-oxygenation changes correlated with brain function; however, it is limited by relatively weak signal and significant noise confounds. Many preprocessing algorithms have been developed to control noise and improve signal detection in fMRI. Although the chosen set of preprocessing and analysis steps (the “pipeline”) significantly affects signal detection, pipelines are rarely quantitatively validated in the neuroimaging literature, due to complex preprocessing interactions. This paper outlines and validates an adaptive resampling framework for evaluating and optimizing preprocessing choices by optimizing data-driven metrics of task prediction and spatial reproducibility. Compared to standard “fixed” preprocessing pipelines, this optimization approach significantly improves independent validation measures of within-subject test-retest, and between-subject activation overlap, and behavioural prediction accuracy. We demonstrate that preprocessing choices function as implicit model regularizers, and that improvements due to pipeline optimization generalize across a range of simple to complex experimental tasks and analysis models. Results are shown for brief scanning sessions (<3 minutes each), demonstrating that with pipeline optimization, it is possible to obtain reliable results and brain-behaviour correlations in relatively small datasets.

Evaluation of statistical inference on empirical resting state fMRI

Modern statistical inference techniques may be able to improve the sensitivity and specificity of resting state functional magnetic resonance imaging (rs-fMRI) connectivity analysis through more realistic assumptions. In simulation, the advantages of such methods are readily demonstrable. However, quantitative empirical validation remains elusive in vivo as the true connectivity patterns are unknown and noise distributions are challenging to characterize, especially in ultra-high field (e.g., 7T fMRI). Though the physiological characteristics of the fMRI signal are difficult to replicate in controlled phantom studies, it is critical that the performance of statistical techniques be evaluated. The SIMulation EXtrapolation (SIMEX) method has enabled estimation of bias with asymptotically consistent estimators on empirical finite sample data by adding simulated noise . To avoid the requirement of accurate estimation of noise structure, the proposed quantitative evaluation approach leverages the theoretical core of SIMEX to study the properties of inference methods in the face of diminishing data (in contrast to increasing noise). The performance of ordinary and robust inference methods in simulation and empirical rs-fMRI are compared using the proposed quantitative evaluation approach. This study provides a simple, but powerful method for comparing a proxy for inference accuracy using empirical data.

Voxel selection framework in multi-voxel pattern analysis of FMRI data for prediction of neural response to visual stimuli

Multi-voxel pattern analysis (MVPA) of functional magnetic resonance imaging (fMRI) data is an emerging approach for probing the neural correlates of cognition. MVPA allows cognitive states to be modeled as distributed patterns of neural activity and classified according to stimulus conditions. In practice, building a robust, generalizable classification model can be challenging because the number of voxels (features) far exceeds the number of stimulus instances/data observations. To avoid model overfitting, there is a need to select informative voxels before building a classification model. In this paper, we propose a robust feature (voxel) selection framework using mutual information (MI) and partial least square regression (PLS) to establish an informativeness index for prioritizing selection of voxels based on the degree of their association to the experimental conditions. We evaluated the robustness of our proposed framework by assessing performance of standard classification algorithms, when combined with our feature selection approach, in a publicly-available fMRI dataset of object-level representation widely used to benchmark MVPA performance (Haxby, 2001). The computational results suggest that our feature selection framework based on MI and PLS drastically improves the classification accuracy relative to those previously reported in the literature. Our results also suggest that highly informative voxels may provide meaningful insight into the functional-anatomic relationship of brain activity and stimulus conditions.

Quantitative evaluation of statistical inference in resting state functional MRI

Modern statistical inference techniques may be able to improve the sensitivity and specificity of resting state functional MRI (rs-fMRI) connectivity analysis through more realistic characterization of distributional assumptions. In simulation, the advantages of such modern methods are readily demonstrable. However quantitative empirical validation remains elusive in vivo as the true connectivity patterns are unknown and noise/artifact distributions are challenging to characterize with high fidelity. Recent innovations in capturing finite sample behavior of asymptotically consistent estimators (i.e., SIMulation and EXtrapolation - SIMEX) have enabled direct estimation of bias given single datasets. Herein, we leverage the theoretical core of SIMEX to study the properties of inference methods in the face of diminishing data (in contrast to increasing noise). The stability of inference methods with respect to synthetic loss of empirical data (defined as resilience) is used to quantify the empirical performance of one inference method relative to another. We illustrate this new approach in a comparison of ordinary and robust inference methods with rs-fMRI.

Functional magnetic resonance imaging: comparison between activation maps and computation pipelines in a clinical context

In this study new evaluation strategies for comparing different Statistical Parametric Maps computed from fMRI time-series analysis software tools are proposed. The aim of our work is to assess and quantitatively evaluate the statistical agreement of activation maps. Some pre-processing steps are necessary to compare SPMs (Statistical Parametric Maps), including segmentation and co-registration. The study of the statistical agreement is carried out following two ways. The first way considers SPMs as the result of two classification processes and extracts confusion matrix and Cohen's kappa index to assess agreement. Some considerations will be made on the statistical dependence of classes and a new formulation of kappa index will be used for overcoming this problem. The second way considers SPMs as two 3D images, and computes the similarity of SPMs images with a fuzzy formulation of the Jaccard Index. Several experiments were conducted both to assess the performance of the proposed evaluation tools and to compare activation maps computation pipelines from two widely used software tools in a clinical context.