Functional MRI Can Be Highly Reliable, but It Depends on What You Measure: A Commentary on Elliott et al. (2020)

Intergenerational transmission of brain structure and function in humans: a narrative review of designs, methods, and findings

Children often show cognitive and affective traits that are similar to their parents. Although this indicates a transmission of phenotypes from parents to children, little is known about the neural underpinnings of that transmission. Here, we provide a general overview of neuroimaging studies that explore the similarity between parents and children in terms of brain structure and function. We notably discuss the aims, designs, and methods of these so-called intergenerational neuroimaging studies, focusing on two main designs: the parent-child design and the multigenerational design. For each design, we also summarize the major findings, identify the sources of variability between studies, and highlight some limitations and future directions. We argue that the lack of consensus in defining the parent-child transmission of brain structure and function leads to measurement heterogeneity, which is a challenge for future studies. Additionally, multigenerational studies often use measures of family resemblance to estimate the proportion of variance attributed to genetic versus environmental factors, though this estimate is likely inflated given the frequent lack of control for shared environment. Nonetheless, intergenerational neuroimaging studies may still have both clinical and theoretical relevance, not because they currently inform about the etiology of neuromarkers, but rather because they may help identify neuromarkers and test hypotheses about neuromarkers coming from more standard neuroimaging designs.

Impact of analytic decisions on test-retest reliability of individual and group estimates in functional magnetic resonance imaging: a multiverse analysis using the monetary incentive delay task

Empirical studies reporting low test-retest reliability of individual blood oxygen-level dependent (BOLD) signal estimates in functional magnetic resonance imaging (fMRI) data have resurrected interest among cognitive neuroscientists in methods that may improve reliability in fMRI. Over the last decade, several individual studies have reported that modeling decisions, such as smoothing, motion correction and contrast selection, may improve estimates of test-retest reliability of BOLD signal estimates. However, it remains an empirical question whether certain analytic decisions consistently improve individual and group level reliability estimates in an fMRI task across multiple large, independent samples. This study used three independent samples ( N s: 60, 81, 119) that collected the same task (Monetary Incentive Delay task) across two runs and two sessions to evaluate the effects of analytic decisions on the individual (intraclass correlation coefficient [ICC(3,1)]) and group (Jaccard/Spearman rho ) reliability estimates of BOLD activity of task fMRI data. The analytic decisions in this study vary across four categories: smoothing kernel (five options), motion correction (four options), task parameterizing (three options) and task contrasts (four options), totaling 240 different pipeline permutations. Across all 240 pipelines, the median ICC estimates are consistently low, with a maximum median ICC estimate of .43 - .55 across the three samples. The analytic decisions with the greatest impact on the median ICC and group similarity estimates are the Implicit Baseline contrast, Cue Model parameterization and a larger smoothing kernel. Using an Implicit Baseline in a contrast condition meaningfully increased group similarity and ICC estimates as compared to using the Neutral cue. This effect was largest for the Cue Model parameterization, however, improvements in reliability came at the cost of interpretability. This study illustrates that estimates of reliability in the MID task are consistently low and variable at small samples, and a higher test-retest reliability may not always improve interpretability of the estimated BOLD signal.

Complementary benefits of multivariate and hierarchical models for identifying individual differences in cognitive control

Understanding individual differences in cognitive control is a central goal in psychology and neuroscience. Reliably measuring these differences, however, has proven extremely challenging, at least when using standard measures in cognitive neuroscience such as response times or task-based fMRI activity. While prior work has pinpointed the source of the issue - the vast amount of cross-trial variability within these measures - no study has rigorously evaluated potential solutions. Here, we do so with one potential way forward: an analytic framework that combines hierarchical Bayesian modeling with multivariate decoding of trial-level fMRI data. Using this framework and longitudinal data from the Dual Mechanisms of Cognitive Control project, we estimated individuals' neural responses associated with cognitive control within a color-word Stroop task, then assessed the reliability of these individuals' responses across a time interval of several months. We show that in many prefrontal and parietal brain regions, test-retest reliability was near maximal, and that only hierarchical models were able to reveal this state of affairs. Further, when compared to traditional univariate contrasts, multivariate decoding enabled individual-level correlations to be estimated with significantly greater precision. We specifically link these improvements in precision to the optimized suppression of cross-trial variability in decoding. Together, these findings not only indicate that cognitive control-related neural responses individuate people in a highly stable manner across time, but also suggest that integrating hierarchical and multivariate models provides a powerful approach for investigating individual differences in cognitive control, one that can effectively address the issue of high-variability measures.

Distributed neural representations of conditioned threat in the human brain

Detecting and responding to threat engages several neural nodes including the amygdala, hippocampus, insular cortex, and medial prefrontal cortices. Recent propositions call for the integration of more distributed neural nodes that process sensory and cognitive facets related to threat. Integrative, sensitive, and reproducible distributed neural decoders for the detection and response to threat and safety have yet to be established. We combine functional MRI data across varying threat conditioning and negative affect paradigms from 1465 participants with multivariate pattern analysis to investigate distributed neural representations of threat and safety. The trained decoders sensitively and specifically distinguish between threat and safety cues across multiple datasets. We further show that many neural nodes dynamically shift representations between threat and safety. Our results establish reproducible decoders that integrate neural circuits, merging the well-characterized 'threat circuit' with sensory and cognitive nodes, discriminating threat from safety regardless of experimental designs or data acquisition parameters.

Prediction of image interpretation cognitive ability under different mental workloads: a task-state fMRI study

Visual imaging experts play an important role in multiple fields, and studies have shown that the combination of functional magnetic resonance imaging and machine learning techniques can predict cognitive abilities, which provides a possible method for selecting individuals with excellent image interpretation skills. We recorded behavioral data and neural activity of 64 participants during image interpretation tasks under different workloads. Based on the comprehensive image interpretation ability, participants were divided into two groups. general linear model analysis showed that during image interpretation tasks, the high-ability group exhibited higher activation in middle frontal gyrus (MFG), fusiform gyrus, inferior occipital gyrus, superior parietal gyrus, inferior parietal gyrus, and insula compared to the low-ability group. The radial basis function Support Vector Machine (SVM) algorithm shows the most excellent performance in predicting participants' image interpretation abilities (Pearson correlation coefficient = 0.54, R2 = 0.31, MSE = 0.039, RMSE = 0.002). Variable importance analysis indicated that the activation features of the fusiform gyrus and MFG played an important role in predicting this ability. Our study revealed the neural basis related to image interpretation ability when exposed to different mental workloads. Additionally, our results demonstrated the efficacy of machine learning algorithms in extracting neural activation features to predict such ability.

Examination of reward processing dysfunctions in the left dorsal striatum and other brain regions among psychiatric inpatients with substance use

BACKGROUND

Substance misuse is a major public health issue and research has established attenuated reward responses to drug cues in those who misuse substances. Yet, little is known about whether the expectation of natural reinforcers engages distinct brain regions in substance misuse.

METHODS

Using functional magnetic resonance imaging (fMRI), we delivered juice at expected and unexpected times to examine reward processing dysfunctions. We focused on the responses within the left dorsal striatum (DS) in individuals with high-risk substance use (HRU, n = 65), low-risk substance use (psychiatric controls, PC, n = 65), and healthy controls (HC, n = 65). Additionally, we investigated whether the dysfunction in reward processing within the left DS is correlated with other common psychiatric symptoms. Finally, we conducted a comprehensive analysis of the whole brain to investigate other non-hypothesized brain regions.

RESULTS

Compared to HC, HRU displayed lower responses to juice delivery (i.e., reward) in the left DS (p <.05). The whole-brain analysis demonstrated that compared to HC, HRU displayed significantly lower responses to reward stimuli in various brain regions, including the bilateral caudate, temporal gyrus, left frontal gyrus, middle frontal gyrus, and right thalamus.

LIMITATIONS

Participants were individuals with polysubstance use; therefore, we were not able to examine the effects of individual substances.

CONCLUSIONS

Our findings suggest that HRU displays lower responses to reward stimuli within the left DS and other non-hypothesized brain regions. Our findings may help further elucidate reward processing dysfunctions related to substance misuse.

Stressor-evoked brain activity, cardiovascular reactivity, and subclinical atherosclerosis in midlife adults

Background

Cardiovascular responses to psychological stressors have been separately associated with preclinical atherosclerosis and hemodynamic brain activity patterns across different studies and cohorts; however, what has not been established is whether cardiovascular stress responses reliably link indicators of stressor-evoked brain activity and preclinical atherosclerosis that have been measured in the same individuals. Accordingly, the present study used cross-validation and predictive modeling to test for the first time whether stressor-evoked systolic blood pressure (SBP) responses statistically mediated the association between concurrently measured brain activity and a vascular marker of preclinical atherosclerosis in the carotid arteries.

Methods

624 midlife adults (aged 28-56 years, 54.97% female) from two different cohorts underwent two information-conflict fMRI tasks, with concurrent SBP measures collected. Carotid artery intima-media thickness (CA-IMT) was measured by ultrasonography. A mediation framework that included harmonization, cross-validation, and penalized principal component regression was then employed, while significant areas in possible direct and indirect effects were identified through bootstrapping. Sensitivity analysis further tested the robustness of findings after accounting for prevailing levels of cardiovascular disease risk and brain imaging data quality control.

Results

Task-averaged patterns of hemodynamic brain responses exhibited a generalizable association with CA-IMT, which was mediated by an area-under-the-curve measure of aggregate SBP reactivity. Importantly, this effect held in sensitivity analyses. Implicated brain areas in this mediation included the ventromedial prefrontal cortex, anterior cingulate cortex, insula and amygdala.

Conclusions

These novel findings support a link between stressor-evoked brain activity and preclinical atherosclerosis accounted for by individual differences in corresponding levels of stressor-evoked cardiovascular reactivity.

Spinal fMRI demonstrates segmental organisation of functionally connected networks in the cervical spinal cord: A test-retest reliability study

Resting functional magnetic resonance imaging (fMRI) studies have identified intrinsic spinal cord activity, which forms organised motor (ventral) and sensory (dorsal) resting-state networks. However, to facilitate the use of spinal fMRI in, for example, clinical studies, it is crucial to first assess the reliability of the method, particularly given the unique anatomical, physiological, and methodological challenges associated with acquiring the data. Here, we characterise functional connectivity relationships in the cervical cord and assess their between-session test-retest reliability in 23 young healthy volunteers. Resting-state networks were estimated in two ways (1) by estimating seed-to-voxel connectivity maps and (2) by calculating seed-to-seed correlations. Seed regions corresponded to the four grey matter horns (ventral/dorsal and left/right) of C5-C8 segmental levels. Test-retest reliability was assessed using the intraclass correlation coefficient. Spatial overlap of clusters derived from seed-to-voxel analysis between sessions was examined using Dice coefficients. Following seed-to-voxel analysis, we observed distinct unilateral dorsal and ventral organisation of cervical spinal resting-state networks that was largely confined in the rostro-caudal extent to each spinal segmental level, with more sparse connections observed between segments. Additionally, strongest correlations were observed between within-segment ipsilateral dorsal-ventral connections, followed by within-segment dorso-dorsal and ventro-ventral connections. Test-retest reliability of these networks was mixed. Reliability was poor when assessed on a voxelwise level, with more promising indications of reliability when examining the average signal within clusters. Reliability of correlation strength between seeds was highly variable, with the highest reliability achieved in ipsilateral dorsal-ventral and dorso-dorsal/ventro-ventral connectivity. However, the spatial overlap of networks between sessions was excellent. We demonstrate that while test-retest reliability of cervical spinal resting-state networks is mixed, their spatial extent is similar across sessions, suggesting that these networks are characterised by a consistent spatial representation over time.

A precision neuroscience approach to estimating reliability of neural responses during emotion processing: Implications for task-fMRI

Recent work demonstrating low test-retest reliability of neural activation during fMRI tasks raises questions about the utility of task-based fMRI for the study of individual variation in brain function. Two possible sources of the instability in task-based BOLD signal over time are noise or measurement error in the instrument, and meaningful variation across time within-individuals in the construct itself-brain activation elicited during fMRI tasks. Examining the contribution of these two sources of test-retest unreliability in task-evoked brain activity has far-reaching implications for cognitive neuroscience. If test-retest reliability largely reflects measurement error, it suggests that task-based fMRI has little utility in the study of either inter- or intra-individual differences. On the other hand, if task-evoked BOLD signal varies meaningfully over time, it would suggest that this tool may yet be well suited to studying intraindividual variation. We parse these sources of variance in BOLD signal in response to emotional cues over time and within-individuals in a longitudinal sample with 10 monthly fMRI scans. Test-retest reliability was low, reflecting a lack of stability in between-person differences across scans. In contrast, within-person, within-session internal consistency of the BOLD signal was higher, and within-person fluctuations across sessions explained almost half the variance in voxel-level neural responses. Additionally, monthly fluctuations in neural response to emotional cues were associated with intraindividual variation in mood, sleep, and exposure to stressors. Rather than reflecting trait-like differences across people, neural responses to emotional cues may be more reflective of intraindividual variation over time. These patterns suggest that task-based fMRI may be able to contribute to the study of individual variation in brain function if more attention is given to within-individual variation approaches, psychometrics-beginning with improving reliability beyond the modest estimates observed here, and the validity of task fMRI beyond the suggestive associations reported here.

Test-Retest Reliability of Functional Connectivity in Adolescents With Depression

BACKGROUND

The test-retest reliability of functional magnetic resonance imaging is critical to identifying reproducible biomarkers for psychiatric illness. Recent work has shown how reliability limits the observable effect size of brain-behavior associations, hindering detection of these effects. However, while a fast-growing literature has explored both univariate and multivariate reliability in healthy individuals, relatively few studies have explored reliability in populations with psychiatric illnesses or how this interacts with age.

METHODS

Here, we investigated functional connectivity reliability over the course of 1 year in a longitudinal cohort of 88 adolescents (age at baseline = 15.63 ± 1.29 years; 64 female) with major depressive disorder (MDD) and without MDD (healthy volunteers [HVs]). We compared a univariate metric, intraclass correlation coefficient, and 2 multivariate metrics, fingerprinting and discriminability.

RESULTS

Adolescents with MDD had marginally higher mean intraclass correlation coefficient (μMDD = 0.34, 95% CI, 0.12-0.54; μHV = 0.27, 95% CI, 0.05-0.52), but both groups had poor average intraclass correlation coefficients (<0.4). Fingerprinting index was greater than chance and did not differ between groups (fingerprinting indexMDD = 0.75; fingerprinting indexHV = 0.91; Poisson tests p < .001). Discriminability indicated high multivariate reliability in both groups (discriminabilityMDD = 0.80; discriminabilityHV = 0.82; permutation tests p < .01). Neither univariate nor multivariate reliability was associated with symptom severity or edge-level effect size of group differences.

CONCLUSIONS

Overall, we found little evidence for a relationship between depression and reliability of functional connectivity during adolescence. These findings suggest that biomarker identification in depression is not limited due to reliability compared with healthy samples and support the shift toward multivariate analysis for improved power and reliability.

Reliability of task-based fMRI in the dorsal horn of the human spinal cord

The application of functional magnetic resonance imaging (fMRI) to the human spinal cord is still a relatively small field of research and faces many challenges. Here we aimed to probe the limitations of task-based spinal fMRI at 3T by investigating the reliability of spinal cord blood oxygen level dependent (BOLD) responses to repeated nociceptive stimulation across two consecutive days in 40 healthy volunteers. We assessed the test-retest reliability of subjective ratings, autonomic responses, and spinal cord BOLD responses to short heat pain stimuli (1s duration) using the intraclass correlation coefficient (ICC). At the group level, we observed robust autonomic responses as well as spatially specific spinal cord BOLD responses at the expected location, but no spatial overlap in BOLD response patterns across days. While autonomic indicators of pain processing showed good-to-excellent reliability, both β-estimates and z-scores of task-related BOLD responses showed poor reliability across days in the target region (gray matter of the ipsilateral dorsal horn). When taking into account the sensitivity of gradient-echo echo planar imaging (GE-EPI) to draining vein signals by including the venous plexus in the analysis, we observed BOLD responses with good reliability across days. Taken together, these results demonstrate that heat pain stimuli as short as one second are able to evoke a robust and spatially specific BOLD response, which is however strongly variable within participants across time, resulting in low reliability in the dorsal horn gray matter. Further improvements in data acquisition and analysis techniques are thus necessary before event-related spinal cord fMRI as used here can be reliably employed in longitudinal designs or clinical settings.

Debates on the dorsomedial prefrontal/dorsal anterior cingulate cortex: insights for future research

The dorsomedial prefrontal cortex/dorsal anterior cingulate cortex (dmPFC/dACC) is a brain area subject to many theories and debates over its function(s). Even its precise anatomical borders are subject to much controversy. In the past decades, the dmPFC/dACC has been associated with more than 15 different cognitive processes, which sometimes appear quite unrelated (e.g. body perception, cognitive conflict). As a result, understanding what the dmPFC/dACC does has become a real challenge for many neuroscientists. Several theories of this brain area's function(s) have been developed, leading to successive and competitive publications bearing different models, which sometimes contradict each other. During the last two decades, the lively scientific exchanges around the dmPFC/dACC have promoted fruitful research in cognitive neuroscience. In this review, we provide an overview of the anatomy of the dmPFC/dACC, summarize the state of the art of functions that have been associated with this brain area and present the main theories aiming at explaining the dmPFC/dACC function(s). We explore the commonalities and the arguments between the different theories. Finally, we explain what can be learned from these debates for future investigations of the dmPFC/dACC and other brain regions' functions.

Neuroimaging and behavioral evidence that violent video games exert no negative effect on human empathy for pain and emotional reactivity to violence

Influential accounts claim that violent video games (VVGs) decrease players' emotional empathy by desensitizing them to both virtual and real-life violence. However, scientific evidence for this claim is inconclusive and controversially debated. To assess the causal effect of VVGs on the behavioral and neural correlates of empathy and emotional reactivity to violence, we conducted a prospective experimental study using functional magnetic resonance imaging (fMRI). We recruited 89 male participants without prior VVG experience. Over the course of two weeks, participants played either a highly violent video game or a non-violent version of the same game. Before and after this period, participants completed an fMRI experiment with paradigms measuring their empathy for pain and emotional reactivity to violent images. Applying a Bayesian analysis approach throughout enabled us to find substantial evidence for the absence of an effect of VVGs on the behavioral and neural correlates of empathy. Moreover, participants in the VVG group were not desensitized to images of real-world violence. These results imply that short and controlled exposure to VVGs does not numb empathy nor the responses to real-world violence. We discuss the implications of our findings regarding the potential and limitations of experimental research on the causal effects of VVGs. While VVGs might not have a discernible effect on the investigated subpopulation within our carefully controlled experimental setting, our results cannot preclude that effects could be found in settings with higher ecological validity, in vulnerable subpopulations, or after more extensive VVG play.

A systematic review of neuroimaging approaches to mapping language in individuals

Although researchers often rely on group-level fMRI results to draw conclusions about the neurobiology of language, doing so without accounting for the complexities of individual brains may reduce the validity of our findings. Furthermore, understanding brain organization in individuals is critically important for both basic science and clinical translation. To assess the state of single-subject language localization in the functional neuroimaging literature, we carried out a systematic review of studies published through April 2020. Out of 977 papers identified through our search, 121 met our inclusion criteria for reporting single-subject fMRI results (fMRI studies of language in adults that report task-based single-subject statistics). Of these, 20 papers reported using a single-subject test-retest analysis to assess reliability. Thus, we found that a relatively modest number of papers reporting single-subject results quantified single-subject reliability. These varied substantially in acquisition parameters, task design, and reliability measures, creating significant challenges for making comparisons across studies. Future endeavors to optimize the localization of language networks in individuals will benefit from the standardization and broader reporting of reliability metrics for different tasks and acquisition parameters.

Individual Variability of Human Cortical Spontaneous Activity by 3T/7T fMRI

Mapping variability in cortical spontaneous activity (CSA) is an essential goal of understanding various sources of dark brain energy in human neuroscience. CSA was traditionally characterized using resting-state functional MRI (rfMRI) at 1.5T or 3T magnets while recently with 7T-rfMRI. However, the utility and interpretability of 7T-rfMRI must first be established for its variability. By leveraging rfMRI data from the Human Connectome Project (HCP), we derived CSA metrics with 3T-rfMRI and 7T-rfMRI for the same 84 healthy participants (52 females). The 7T-rfMRI produces different CSA metrics at multiple spatial-scales and their variability from the 3T-rfMRI. These differences were spatially dependent and varied according to specific cortical organization. For the amplitude metric, 7T-rfMRI enhanced its spatial contrasts in the anterior cortex but weakened it in the posterior cortex. An opposite pattern was observed for the connectivity metrics. The reliability changes of these metrics were scale dependent, indicating enhanced reliability for connectivity but weakened reliability for amplitude by 7T-rfMRI. These effects were primarily located in the high-order associate cortex, parsing the corresponding changes in individual differences with respect to 7T-rfMRI: (1) higher connectivity variability between participants and the lower connectivity variability within individual participants, and (2) lower amplitude variability between participants and higher amplitude variability within participants. Our work, for the first time, demonstrated the variability of the human CSA across space, rfMRI settings/platforms, and individuals. We discussed the statistical implications of our findings on CSA-based experimental designs and reproducible neuroscience as well as their translational value for personalized applications.

Appetitive and aversive cue reactivities differentiate neural subtypes of alcohol drinkers

Craving reflects the subjective urge to use drugs and can be triggered by both positive and negative emotional states. No studies have systematically investigated the relative roles of these mechanisms in the pathophysiology of substance misuse. Here, we performed meta-analyses of drug cue-elicited reactivity and win and loss processing in the monetary incentive delay task to identify distinct neural correlates of appetitive and aversive responses to drug cues. We then characterized the appetitive and aversive cue responses in seventy-six alcohol drinkers performing a cue craving task during fMRI. Imaging data were processed according to published routines. The appetitive circuit involved medial cortical regions and the ventral striatum, and the aversive circuit involved the insula, caudate and mid-cingulate cortex. We observed a significant correlation of cue-elicited activity (β estimates) of the appetitive and aversive circuit. However, individuals varied in appetitive and aversive cue responses. From the regression of appetitive (y) vs. aversive (x) β, we identified participants in the top 1/3 each of those with positive and negative residuals as "approach" (n = 15) and "avoidance" (n = 11) and the others as the "mixed" (n = 50) subtype. In clinical characteristics, the avoidance subtype showed higher sensitivity to punishment and, in contrast, the approach subtype showed higher levels of sensation seeking and alcohol expectancy for social and physical pressure. The findings highlighted distinct neural underpinnings of appetitive and aversive components of cue-elicited reactivity and provided evidence for potential subtypes of alcohol drinkers.

Enhancing precision in human neuroscience

Human neuroscience has always been pushing the boundary of what is measurable. During the last decade, concerns about statistical power and replicability - in science in general, but also specifically in human neuroscience - have fueled an extensive debate. One important insight from this discourse is the need for larger samples, which naturally increases statistical power. An alternative is to increase the precision of measurements, which is the focus of this review. This option is often overlooked, even though statistical power benefits from increasing precision as much as from increasing sample size. Nonetheless, precision has always been at the heart of good scientific practice in human neuroscience, with researchers relying on lab traditions or rules of thumb to ensure sufficient precision for their studies. In this review, we encourage a more systematic approach to precision. We start by introducing measurement precision and its importance for well-powered studies in human neuroscience. Then, determinants for precision in a range of neuroscientific methods (MRI, M/EEG, EDA, Eye-Tracking, and Endocrinology) are elaborated. We end by discussing how a more systematic evaluation of precision and the application of respective insights can lead to an increase in reproducibility in human neuroscience.

A mesocorticolimbic signature of pleasure in the human brain

Pleasure is a fundamental driver of human behaviour, yet its neural basis remains largely unknown. Rodent studies highlight opioidergic neural circuits connecting the nucleus accumbens, ventral pallidum, insula and orbitofrontal cortex as critical for the initiation and regulation of pleasure, and human neuroimaging studies exhibit some translational parity. However, whether activation in these regions conveys a generalizable representation of pleasure regulated by opioidergic mechanisms remains unclear. Here we use pattern recognition techniques to develop a human functional magnetic resonance imaging signature of mesocorticolimbic activity unique to states of pleasure. In independent validation tests, this signature is sensitive to pleasant tastes and affect evoked by humour. The signature is spatially co-extensive with mu-opioid receptor gene expression, and its response is attenuated by the opioid antagonist naloxone. These findings provide evidence for a basis of pleasure in humans that is distributed across brain systems.

From Classical Methods to Generative Models: Tackling the Unreliability of Neuroscientific Measures in Mental Health Research

Advances in computational statistics and corresponding shifts in funding initiatives over the past few decades have led to a proliferation of neuroscientific measures being developed in the context of mental health research. Although such measures have undoubtedly deepened our understanding of neural mechanisms underlying cognitive, affective, and behavioral processes associated with various mental health conditions, the clinical utility of such measures remains underwhelming. Recent commentaries point toward the poor reliability of neuroscientific measures to partially explain this lack of clinical translation. Here, we provide a concise theoretical overview of how unreliability impedes clinical translation of neuroscientific measures; discuss how various modeling principles, including those from hierarchical and structural equation modeling frameworks, can help to improve reliability; and demonstrate how to combine principles of hierarchical and structural modeling within the generative modeling framework to achieve more reliable, generalizable measures of brain-behavior relationships for use in mental health research.

Adolescent functional network connectivity prospectively predicts adult anxiety symptoms related to perceived COVID-19 economic adversity

BACKGROUND

Stressful events, such as the COVID-19 pandemic, are major contributors to anxiety and depression, but only a subset of individuals develop psychopathology. In a population-based sample (N = 174) with a high representation of marginalized individuals, this study examined adolescent functional network connectivity as a marker of susceptibility to anxiety and depression in the context of adverse experiences.

METHODS

Data-driven network-based subgroups were identified using an unsupervised community detection algorithm within functional neural connectivity. Neuroimaging data collected during emotion processing (age 15) were extracted from a priori regions of interest linked to anxiety and depression. Symptoms were self-reported at ages 15, 17, and 21 (during COVID-19). During COVID-19, participants reported on pandemic-related economic adversity. Differences across subgroup networks were first examined, then subgroup membership and subgroup-adversity interaction were tested to predict change in symptoms over time.

RESULTS

Two subgroups were identified: Subgroup A, characterized by relatively greater neural network variation (i.e., heterogeneity) and density with more connections involving the amygdala, subgenual cingulate, and ventral striatum; and the more homogenous Subgroup B, with more connections involving the insula and dorsal anterior cingulate. Accounting for initial symptoms, subgroup A individuals had greater increases in symptoms across time (β = .138, p = .042), and this result remained after adjusting for additional covariates (β = .194, p = .023). Furthermore, there was a subgroup-adversity interaction: compared with Subgroup B, Subgroup A reported greater anxiety during the pandemic in response to reported economic adversity (β = .307, p = .006), and this remained after accounting for initial symptoms and many covariates (β = .237, p = .021).

CONCLUSIONS

A subgrouping algorithm identified young adults who were susceptible to adversity using their personalized functional network profiles derived from a priori brain regions. These results highlight potential prospective neural signatures involving heterogeneous emotion networks that predict individuals at the greatest risk for anxiety when experiencing adverse events.

The Nature and Neurobiology of Fear and Anxiety: State of the Science and Opportunities for Accelerating Discovery

Fear and anxiety play a central role in mammalian life, and there is considerable interest in clarifying their nature, identifying their biological underpinnings, and determining their consequences for health and disease. Here we provide a roundtable discussion on the nature and biological bases of fear- and anxiety-related states, traits, and disorders. The discussants include scientists familiar with a wide variety of populations and a broad spectrum of techniques. The goal of the roundtable was to take stock of the state of the science and provide a roadmap to the next generation of fear and anxiety research. Much of the discussion centered on the key challenges facing the field, the most fruitful avenues for future research, and emerging opportunities for accelerating discovery, with implications for scientists, funders, and other stakeholders. Understanding fear and anxiety is a matter of practical importance. Anxiety disorders are a leading burden on public health and existing treatments are far from curative, underscoring the urgency of developing a deeper understanding of the factors governing threat-related emotions.

Stability, change, and reliable individual differences in electroencephalography measures: a lifespan perspective on progress and opportunities

Electroencephalographic (EEG) methods have great potential to serve both basic and clinical science approaches to understand individual differences in human neural function. Importantly, the psychometric properties of EEG data, such as internal consistency and test-retest reliability, constrain their ability to differentiate individuals successfully. Rapid and recent technological and computational advancements in EEG research make it timely to revisit the topic of psychometric reliability in the context of individual difference analyses. Moreover, pediatric and clinical samples provide some of the most salient and urgent opportunities to apply individual difference approaches, but the changes these populations experience over time also provide unique challenges from a psychometric perspective. Here we take a developmental neuroscience perspective to consider progress and new opportunities for parsing the reliability and stability of individual differences in EEG measurements across the lifespan. We first conceptually map the different profiles of measurement reliability expected for different types of individual difference analyses over the lifespan. Next, we summarize and evaluate the state of the field's empirical knowledge and need for testing measurement reliability, both internal consistency and test-retest reliability, across EEG measures of power, event-related potentials, nonlinearity, and functional connectivity across ages. Finally, we highlight how standardized pre-processing software for EEG denoising and empirical metrics of individual data quality may be used to further improve EEG-based individual differences research moving forward. We also include recommendations and resources throughout that individual researchers can implement to improve the utility and reproducibility of individual differences analyses with EEG across the lifespan.

Structured memory representations develop at multiple time scales in hippocampal-cortical networks

Influential views of systems memory consolidation posit that the hippocampus rapidly forms representations of specific events, while neocortical networks extract regularities across events, forming the basis of schemas and semantic knowledge. Neocortical extraction of schematic memory representations is thought to occur on a protracted timescale of months, especially for information that is unrelated to prior knowledge. However, this theorized evolution of memory representations across extended timescales, and differences in the temporal dynamics of consolidation across brain regions, lack reliable empirical support. To examine the temporal dynamics of memory representations, we repeatedly exposed human participants to structured information via sequences of fractals, while undergoing longitudinal fMRI for three months. Sequence-specific activation patterns emerged in the hippocampus during the first 1-2 weeks of learning, followed one week later by high-level visual cortex, and subsequently the medial prefrontal and parietal cortices. Schematic, sequence-general representations emerged in the prefrontal cortex after 3 weeks of learning, followed by the medial temporal lobe and anterior temporal cortex. Moreover, hippocampal and most neocortical representations showed sustained rather than time-limited dynamics, suggesting that representations tend to persist across learning. These results show that specific hippocampal representations emerge early, followed by both specific and schematic representations at a gradient of timescales across hippocampal-cortical networks as learning unfolds. Thus, memory representations do not exist only in specific brain regions at a given point in time, but are simultaneously present at multiple levels of abstraction across hippocampal-cortical networks.

Neural representations of vicarious rewards are linked to interoception and prosocial behaviour

Every day we constantly observe other people receiving rewards. Theoretical accounts posit that vicarious reward processing might be linked to people's sensitivity to internal body states (interoception) and facilitates a tendency to act prosocially. However, the neural processes underlying the links between vicarious reward processing, interoception, and prosocial behaviour are poorly understood. Previous research has linked vicarious reward processing to the anterior cingulate gyrus (ACCg) and the anterior insula (AI). Can we predict someone's propensity to be prosocial or to be aware of interoceptive signals from variability in how the ACCg and AI process rewards? Here, participants monitored rewards being delivered to themselves or a stranger during functional magnetic resonance imaging. Later, they performed a task measuring their willingness to exert effort to obtain rewards for others, and a task measuring their propensity to be aware and use interoceptive respiratory signals. Using multivariate similarity analysis, we show that people's willingness to be prosocial is predicted by greater similarity between self and other representations in the ACCg. Moreover, greater dissimilarity in self-other representations in the AI is linked to interoceptive propensity. These findings highlight that vicarious reward is linked to bodily signals in AI, and foster prosocial tendencies through the ACCg.

Explainable machine learning approach to predict and explain the relationship between task-based fMRI and individual differences in cognition

Despite decades of costly research, we still cannot accurately predict individual differences in cognition from task-based functional magnetic resonance imaging (fMRI). Moreover, aiming for methods with higher prediction is not sufficient. To understand brain-cognition relationships, we need to explain how these methods draw brain information to make the prediction. Here we applied an explainable machine-learning (ML) framework to predict cognition from task-based fMRI during the n-back working-memory task, using data from the Adolescent Brain Cognitive Development (n = 3,989). We compared 9 predictive algorithms in their ability to predict 12 cognitive abilities. We found better out-of-sample prediction from ML algorithms over the mass-univariate and ordinary least squares (OLS) multiple regression. Among ML algorithms, Elastic Net, a linear and additive algorithm, performed either similar to or better than nonlinear and interactive algorithms. We explained how these algorithms drew information, using SHapley Additive explanation, eNetXplorer, Accumulated Local Effects, and Friedman's H-statistic. These explainers demonstrated benefits of ML over the OLS multiple regression. For example, ML provided some consistency in variable importance with a previous study and consistency with the mass-univariate approach in the directionality of brain-cognition relationships at different regions. Accordingly, our explainable-ML framework predicted cognition from task-based fMRI with boosted prediction and explainability over standard methodologies.

Within-subject reliability of concurrent TMS-fMRI during a single session

Concurrent transcranial magnetic stimulation with functional MRI (concurrent TMS-fMRI) allows real-time causative probing of brain connectivity. However, technical challenges, safety, and tolerability may limit the number of trials employed during a concurrent TMS-fMRI experiment. We leveraged an existing data set with 100 trials of active TMS compared to a sub-threshold control condition to assess the reliability of the evoked BOLD response during concurrent TMS-fMRI. This data will permit an analysis of the minimum number of trials that should be employed in a concurrent TMS-fMRI protocol in order to achieve reliable spatial changes in activity. Single-subject maps of brain activity were created by splitting the trials within the same experimental session into groups of 50, 40, 30, 25, 20, 15, or 10 trials, correlations (R) between t-maps derived from paired subsets of trials within the same individual were calculated as reliability. R was moderate-high for 50 trials (mean R = .695) and decreased as the number of trials decreased. Consistent with previous findings of high individual variability in the spatial patterns of evoked neuronal changes following a TMS pulse, the spatial pattern of Rs differed across participants, but regional R was correlated with the magnitude of TMS-evoked activity. These results demonstrate concurrent TMS-fMRI produces a reliable pattern of activity at the individual level at higher trial numbers, particularly within localized regions. The spatial pattern of reliability is individually idiosyncratic and related to the individual pattern of evoked changes.

The Role of fMRI in Drug Development: An Update

Functional magnetic resonance imaging (fMRI) of the brain is a technology that holds great potential for increasing the efficiency of drug development for the central nervous system (CNS). In preclinical studies and both early- and late-phase human trials, fMRI has the potential to improve cross-species translation of drug effects, help to de-risk compounds early in development, and contribute to the portfolio of evidence for a compound's efficacy and mechanism of action. However, to date, the utilization of fMRI in the CNS drug development process has been limited. The purpose of this chapter is to explore this mismatch between potential and utilization. This chapter provides introductory material related to fMRI and drug development, describes what is required of fMRI measurements for them to be useful in a drug development setting, lists current capabilities of fMRI in this setting and challenges faced in its utilization, and ends with directions for future development of capabilities in this arena. This chapter is the 5-year update of material from a previously published workshop summary (Carmichael et al., Drug DiscovToday 23(2):333-348, 2018).

Long-term learning transforms prefrontal cortex representations during working memory

The role of the lateral prefrontal cortex (lPFC) in working memory (WM) is debated. Non-human primate (NHP) electrophysiology shows that the lPFC stores WM representations, but human neuroimaging suggests that the lPFC controls WM content in sensory cortices. These accounts are confounded by differences in task training and stimulus exposure. We tested whether long-term training alters lPFC function by densely sampling WM activity using functional MRI. Over 3 months, participants trained on both a WM and serial reaction time (SRT) task, wherein fractal stimuli were embedded within sequences. WM performance improved for trained (but not novel) fractals and, neurally, delay activity increased in distributed lPFC voxels across learning. Item-level WM representations became detectable within lPFC patterns, and lPFC activity reflected sequence relationships from the SRT task. These findings demonstrate that human lPFC develops stimulus-selective responses with learning, and WM representations are shaped by long-term experience, which could reconcile competing accounts of WM functioning.

The expanding horizons of network neuroscience: From description to prediction and control

The field of network neuroscience has emerged as a natural framework for the study of the brain and has been increasingly applied across divergent problems in neuroscience. From a disciplinary perspective, network neuroscience originally emerged as a formal integration of graph theory (from mathematics) and neuroscience (from biology). This early integration afforded marked utility in describing the interconnected nature of neural units, both structurally and functionally, and underscored the relevance of that interconnection for cognition and behavior. But since its inception, the field has not remained static in its methodological composition. Instead, it has grown to use increasingly advanced graph-theoretic tools and to bring in several other disciplinary perspectives-including machine learning and systems engineering-that have proven complementary. In doing so, the problem space amenable to the discipline has expanded markedly. In this review, we discuss three distinct flavors of investigation in state-of-the-art network neuroscience: (i) descriptive network neuroscience, (ii) predictive network neuroscience, and (iii) a perturbative network neuroscience that draws on recent advances in network control theory. In considering each area, we provide a brief summary of the approaches, discuss the nature of the insights obtained, and highlight future directions.

Capturing Brain-Cognition Relationship: Integrating Task-Based fMRI Across Tasks Markedly Boosts Prediction and Test-Retest Reliability

Capturing individual differences in cognition is central to human neuroscience. Yet our ability to estimate cognitive abilities via brain MRI is still poor in both prediction and reliability. Our study tested if this inability can be improved by integrating MRI signals across the whole brain and across modalities, including task-based functional MRI (tfMRI) of different tasks along with other non-task MRI modalities, such as structural MRI, resting-state functional connectivity. Using the Human Connectome Project (n=873, 473 females, after quality control), we directly compared predictive models comprising different sets of MRI modalities (e.g., seven tasks vs. non-task modalities). We applied two approaches to integrate multimodal MRI, stacked vs. flat models, and implemented 16 combinations of machine-learning algorithms. The stacked model integrating all modalities via stacking Elastic Net provided the best prediction (r=.57), relatively to other models tested, as well as excellent test-retest reliability (ICC=∼.85) in capturing general cognitive abilities. Importantly, compared to the stacked model integrating across non-task modalities (r=.27), the stacked model integrating tfMRI across tasks led to significantly higher prediction (r=.56) while still providing excellent test-retest reliability (ICC=∼.83). The stacked model integrating tfMRI across tasks was driven by frontal and parietal areas and by tasks that are cognition-related (working-memory, relational processing, and language). This result is consistent with the parieto-frontal integration theory of intelligence. Accordingly, our results contradict the recently popular notion that tfMRI is not reliable enough to capture individual differences in cognition. Instead, our study suggests that tfMRI, when used appropriately (i.e., by drawing information across the whole brain and across tasks and by integrating with other modalities), provides predictive and reliable sources of information for individual differences in cognitive abilities, more so than non-task modalities.

Age-related change in task-evoked amygdala-prefrontal circuitry: A multiverse approach with an accelerated longitudinal cohort aged 4-22 years

The amygdala and its connections with medial prefrontal cortex (mPFC) play central roles in the development of emotional processes. While several studies have suggested that this circuitry exhibits functional changes across the first two decades of life, findings have been mixed - perhaps resulting from differences in analytic choices across studies. Here we used multiverse analyses to examine the robustness of task-based amygdala-mPFC function findings to analytic choices within the context of an accelerated longitudinal design (4-22 years-old; N = 98; 183 scans; 1-3 scans/participant). Participants recruited from the greater Los Angeles area completed an event-related emotional face (fear, neutral) task. Parallel analyses varying in preprocessing and modeling choices found that age-related change estimates for amygdala reactivity were more robust than task-evoked amygdala-mPFC functional connectivity to varied analytical choices. Specification curves indicated evidence for age-related decreases in amygdala reactivity to faces, though within-participant changes in amygdala reactivity could not be differentiated from between-participant differences. In contrast, amygdala-mPFC functional connectivity results varied across methods much more, and evidence for age-related change in amygdala-mPFC connectivity was not consistent. Generalized psychophysiological interaction (gPPI) measurements of connectivity were especially sensitive to whether a deconvolution step was applied. Our findings demonstrate the importance of assessing the robustness of findings to analysis choices, although the age-related changes in our current work cannot be overinterpreted given low test-retest reliability. Together, these findings highlight both the challenges in estimating developmental change in longitudinal cohorts and the value of multiverse approaches in developmental neuroimaging for assessing robustness of results.

A benchmark for prediction of psychiatric multimorbidity from resting EEG data in a large pediatric sample

Psychiatric disorders are among the most common and debilitating illnesses across the lifespan and begin usually during childhood and adolescence, which emphasizes the importance of studying the developing brain. Most of the previous pediatric neuroimaging studies employed traditional univariate statistics on relatively small samples. Multivariate machine learning approaches have a great potential to overcome the limitations of these approaches. On the other hand, the vast majority of existing multivariate machine learning studies have focused on differentiating between children with an isolated psychiatric disorder and typically developing children. However, this line of research does not reflect the real-life situation as the majority of children with a clinical diagnosis have multiple psychiatric disorders (multimorbidity), and consequently, a clinician has the task to choose between different diagnoses and/or the combination of multiple diagnoses. Thus, the goal of the present benchmark is to predict psychiatric multimorbidity in children and adolescents. For this purpose, we implemented two kinds of machine learning benchmark challenges: The first challenge targets the prediction of the seven most prevalent DSM-V psychiatric diagnoses for the available data set, of which each individual can exhibit multiple ones concurrently (i.e. multi-task multi-label classification). Based on behavioral and cognitive measures, a second challenge focuses on predicting psychiatric symptom severity on a dimensional level (i.e. multiple regression task). For the present benchmark challenges, we will leverage existing and future data from the biobank of the Healthy Brain Network (HBN) initiative, which offers a unique large-sample dataset (N = 2042) that provides a wide array of different psychiatric developmental disorders and true hidden data sets. Due to limited real-world practicability and economic viability of MRI measurements, the present challenge will permit only resting state EEG data and demographic information to derive predictive models. We believe that a community driven effort to derive predictive markers from these data using advanced machine learning algorithms can help to improve the diagnosis of psychiatric developmental disorders.

Multivariate Brain Activity while Viewing and Reappraising Affective Scenes Does Not Predict the Multiyear Progression of Preclinical Atherosclerosis in Otherwise Healthy Midlife Adults

Cognitive reappraisal is an emotion regulation strategy that is postulated to reduce risk for atherosclerotic cardiovascular disease (CVD), particularly the risk due to negative affect. At present, however, the brain systems and vascular pathways that may link reappraisal to CVD risk remain unclear. This study thus tested whether brain activity evoked by using reappraisal to reduce negative affect would predict the multiyear progression of a vascular marker of preclinical atherosclerosis and CVD risk: carotid artery intima-media thickness (CA-IMT). Participants were 176 otherwise healthy adults (50.6% women; aged 30-51 years) who completed a functional magnetic resonance imaging task involving the reappraisal of unpleasant scenes from the International Affective Picture System. Ultrasonography was used to compute CA-IMT at baseline and a median of 2.78 (interquartile range, 2.67 to 2.98) years later among 146 participants. As expected, reappraisal engaged brain systems implicated in emotion regulation. Reappraisal also reduced self-reported negative affect. On average, CA-IMT progressed over the follow-up period. However, multivariate and cross-validated machine-learning models demonstrated that brain activity during reappraisal failed to predict CA-IMT progression. Contrary to hypotheses, brain activity during cognitive reappraisal to reduce negative affect does not appear to forecast the progression of a vascular marker of CVD risk.

Supplementary Information

The online version contains supplementary material available at 10.1007/s42761-021-00098-y.

Brain connectivity at rest predicts individual differences in normative activity during movie watching

When exposed to the same sensory event, some individuals are bound to have less typical experiences than others. Previous research has investigated this phenomenon by showing that the typicality of one's sensory experience is associated with the typicality of their stimulus-evoked brain activity (as measured by intersubject correlation, or ISC). Individual differences in ISC have recently been attributed to variability in focal neural processing. However, the extent to which these differences reflect purely intra-regional variability versus variation in the brain's baseline ability to transmit information between regions has yet to be established. Here, we show that an individual's degree and spatial distribution of ISC are closely related to their brain's functional organization at rest. Using resting state and movie watching fMRI data from the Human Connectome Project, we reveal that resting state functional connectivity (RSFC) profiles can be used to predict cortex-wide ISC. Similar region-level analyses demonstrate that the levels of ISC exhibited by brain regions during movie watching are associated with their connectivity to other regions at rest, and that the nature of these connectivity-activity relationships varies as a function of regional roles in sensory information processing. Finally, we show that an individual's unique spatial distribution of ISC, independent of its magnitude, is also related to their RSFC profile. These findings contextualize reports of localized individual differences in ISC as potentially reflecting larger, network-level alterations in resting brain function and detail how the brain's ability to process complex sensory information is linked to its baseline functional organization.

Decision neuroscience and neuroeconomics: Recent progress and ongoing challenges

In the past decade, decision neuroscience and neuroeconomics have developed many new insights in the study of decision making. This review provides an overarching update on how the field has advanced in this time period. Although our initial review a decade ago outlined several theoretical, conceptual, methodological, empirical, and practical challenges, there has only been limited progress in resolving these challenges. We summarize significant trends in decision neuroscience through the lens of the challenges outlined for the field and review examples where the field has had significant, direct, and applicable impacts across economics and psychology. First, we review progress on topics including reward learning, explore-exploit decisions, risk and ambiguity, intertemporal choice, and valuation. Next, we assess the impacts of emotion, social rewards, and social context on decision making. Then, we follow up with how individual differences impact choices and new exciting developments in the prediction and neuroforecasting of future decisions. Finally, we consider how trends in decision-neuroscience research reflect progress toward resolving past challenges, discuss new and exciting applications of recent research, and identify new challenges for the field. This article is categorized under: Psychology > Reasoning and Decision Making Psychology > Emotion and Motivation.

An open-access accelerated adult equivalent of the ABCD Study neuroimaging dataset (a-ABCD)

As public access to longitudinal developmental datasets like the Adolescent Brain Cognitive Development Study^SM (ABCD Study®) increases, so too does the need for resources to benchmark time-dependent effects. Scan-to-scan changes observed with repeated imaging may reflect development but may also reflect practice effects, day-to-day variability in psychological states, and/or measurement noise. Resources that allow disentangling these time-dependent effects will be useful in quantifying actual developmental change. We present an accelerated adult equivalent of the ABCD Study dataset (a-ABCD) using an identical imaging protocol to acquire magnetic resonance imaging (MRI) structural, diffusion-weighted, resting-state and task-based data from eight adults scanned five times over five weeks. We report on the task-based imaging data (n = 7). In-scanner stop-signal (SST), monetary incentive delay (MID), and emotional n-back (EN-back) task behavioral performance did not change across sessions. Post-scan recognition memory for emotional n-back stimuli, however, did improve as participants became more familiar with the stimuli. Functional MRI analyses revealed that patterns of task-based activation reflecting inhibitory control in the SST, reward success in the MID task, and working memory in the EN-back task were more similar within individuals across repeated scan sessions than between individuals. Within-subject, activity was more consistent across sessions during the EN-back task than in the SST and MID task, demonstrating differences in fMRI data reliability as a function of task. The a-ABCD dataset provides a unique testbed for characterizing the reliability of brain function, structure, and behavior across imaging modalities in adulthood and benchmarking neurodevelopmental change observed in the open-access ABCD Study.

Limits of decoding mental states with fMRI

A growing number of studies claim to decode mental states using multi-voxel decoders of brain activity. It has been proposed that the fixed, fine-grained, multi-voxel patterns in these decoders are necessary for discriminating between and identifying mental states. Here, we present evidence that the efficacy of these decoders might be overstated. Across various tasks, decoder patterns were spatially imprecise, as decoder performance was unaffected by spatial smoothing; 90% redundant, as selecting a random 10% of a decoder's constituent voxels recovered full decoder performance; and performed similarly to brain activity maps used as decoders. We distinguish decoder performance in discriminating between mental states from performance in identifying a given mental state, and show that even when discrimination performance is adequate, identification can be poor. Finally, we demonstrate that simple and intuitive similarity metrics explain 91% and 62% of discrimination performance within- and across-subjects, respectively. These findings indicate that currently used across-subject decoders of mental states are superfluous and inappropriate for decision-making.

A methodological checklist for fMRI drug cue reactivity studies: development and expert consensus

Cue reactivity is one of the most frequently used paradigms in functional magnetic resonance imaging (fMRI) studies of substance use disorders (SUDs). Although there have been promising results elucidating the neurocognitive mechanisms of SUDs and SUD treatments, the interpretability and reproducibility of these studies is limited by incomplete reporting of participants' characteristics, task design, craving assessment, scanning preparation and analysis decisions in fMRI drug cue reactivity (FDCR) experiments. This hampers clinical translation, not least because systematic review and meta-analysis of published work are difficult. This consensus paper and Delphi study aims to outline the important methodological aspects of FDCR research, present structured recommendations for more comprehensive methods reporting and review the FDCR literature to assess the reporting of items that are deemed important. Forty-five FDCR scientists from around the world participated in this study. First, an initial checklist of items deemed important in FDCR studies was developed by several members of the Enhanced NeuroImaging Genetics through Meta-Analyses (ENIGMA) Addiction working group on the basis of a systematic review. Using a modified Delphi consensus method, all experts were asked to comment on, revise or add items to the initial checklist, and then to rate the importance of each item in subsequent rounds. The reporting status of the items in the final checklist was investigated in 108 recently published FDCR studies identified through a systematic review. By the final round, 38 items reached the consensus threshold and were classified under seven major categories: 'Participants' Characteristics', 'General fMRI Information', 'General Task Information', 'Cue Information', 'Craving Assessment Inside Scanner', 'Craving Assessment Outside Scanner' and 'Pre- and Post-Scanning Considerations'. The review of the 108 FDCR papers revealed significant gaps in the reporting of the items considered important by the experts. For instance, whereas items in the 'General fMRI Information' category were reported in 90.5% of the reviewed papers, items in the 'Pre- and Post-Scanning Considerations' category were reported by only 44.7% of reviewed FDCR studies. Considering the notable and sometimes unexpected gaps in the reporting of items deemed to be important by experts in any FDCR study, the protocols could benefit from the adoption of reporting standards. This checklist, a living document to be updated as the field and its methods advance, can help improve experimental design, reporting and the widespread understanding of the FDCR protocols. This checklist can also provide a sample for developing consensus statements for protocols in other areas of task-based fMRI.

Reliability and stability challenges in ABCD task fMRI data

Trait stability of measures is an essential requirement for individual differences research. Functional MRI has been increasingly used in studies that rely on the assumption of trait stability, such as attempts to relate task related brain activation to individual differences in behavior and psychopathology. However, recent research using adult samples has questioned the trait stability of task-fMRI measures, as assessed by test-retest correlations. To date, little is known about trait stability of task fMRI in children. Here, we examined within-session reliability and long-term stability of individual differences in task-fMRI measures using fMRI measures of brain activation provided by the adolescent brain cognitive development (ABCD) Study Release v4.0 as an individual's average regional activity, using its tasks focused on reward processing, response inhibition, and working memory. We also evaluated the effects of factors potentially affecting reliability and stability. Reliability and stability (quantified as the ratio of non-scanner related stable variance to all variances) was poor in virtually all brain regions, with an average value of 0.088 and 0.072 for short term (within-session) reliability and long-term (between-session) stability, respectively, in regions of interest (ROIs) historically-recruited by the tasks. Only one reliability or stability value in ROIs exceeded the 'poor' cut-off of 0.4, and in fact rarely exceeded 0.2 (only 4.9%). Motion had a pronounced effect on estimated reliability/stability, with the lowest motion quartile of participants having a mean reliability/stability 2.5 times higher (albeit still 'poor') than the highest motion quartile. Poor reliability and stability of task-fMRI, particularly in children, diminishes potential utility of fMRI data due to a drastic reduction of effect sizes and, consequently, statistical power for the detection of brain-behavior associations. This essential issue urgently needs to be addressed through optimization of task design, scanning parameters, data acquisition protocols, preprocessing pipelines, and data denoising methods.

Intra-individual Reliability of Voice- and Music-elicited Responses and their Modulation by Expertise

A growing number of functional neuroimaging studies have identified regions within the temporal lobe, particularly along the planum polare and planum temporale, that respond more strongly to music than other types of acoustic stimuli, including voice. This "music preferred" regions have been reported using a variety of stimulus sets, paradigms and analysis approaches and their consistency across studies confirmed through meta-analyses. However, the critical question of intra-subject reliability of these responses has received less attention. Here, we directly assessed this important issue by contrasting brain responses to musical vs. vocal stimuli in the same subjects across three consecutive fMRI runs, using different types of stimuli. Moreover, we investigated whether these music- and voice-preferred responses were reliably modulated by expertise. Results demonstrated that music-preferred activity previously reported in temporal regions, and its modulation by expertise, exhibits a high intra-subject reliability. However, we also found that activity in some extra-temporal regions, such as the precentral and middle frontal gyri, did depend on the particular stimuli employed, which may explain why these are less consistently reported in the literature. Taken together, our findings confirm and extend the notion that specific regions in the brain consistently respond more strongly to certain socially-relevant stimulus categories, such as faces, voices and music, but that some of these responses appear to depend, at least to some extent, on the specific features of the paradigm employed.

Effect sizes and test-retest reliability of the fMRI-based neurologic pain signature

Identifying biomarkers that predict mental states with large effect sizes and high test-retest reliability is a growing priority for fMRI research. We examined a well-established multivariate brain measure that tracks pain induced by nociceptive input, the Neurologic Pain Signature (NPS). In N = 295 participants across eight studies, NPS responses showed a very large effect size in predicting within-person single-trial pain reports (d = 1.45) and medium effect size in predicting individual differences in pain reports (d = 0.49). The NPS showed excellent short-term (within-day) test-retest reliability (ICC = 0.84, with average 69.5 trials/person). Reliability scaled with the number of trials within-person, with ≥60 trials required for excellent test-retest reliability. Reliability was tested in two additional studies across 5-day (N = 29, ICC = 0.74, 30 trials/person) and 1-month (N = 40, ICC = 0.46, 5 trials/person) test-retest intervals. The combination of strong within-person correlations and only modest between-person correlations between the NPS and pain reports indicate that the two measures have different sources of between-person variance. The NPS is not a surrogate for individual differences in pain reports but can serve as a reliable measure of pain-related physiology and mechanistic target for interventions.

Intrauterine Device Use: A New Frontier for Behavioral Neuroendocrinology

Intrauterine devices (IUDs) are the most-used reversible contraceptive method for women in the world, but little is known about their potential modulation of brain function, cognition, and behavior. This is disconcerting because research on other hormonal contraceptives, especially oral contraceptives (OCs), increasingly shows that exogenous sex hormones have behavioral neuroendocrine consequences, especially for gendered cognition, including spatial skills. Effects are small and nuanced, however, partially reflecting heterogeneity. The goal of this paper is to introduce IUD use as a new frontier for basic and applied research, and to offer key considerations for studying it, emphasizing the importance of multimodal investigations and person-specific analyses. The feasibility and utility of studying IUD users is illustrated by: scanning women who completed a functional magnetic resonance imaging mental rotations task; taking an individualized approach to mapping functional connectivity during the task using network analyses containing connections common across participants and unique to individual women, focusing on brain regions in putative mental rotations and default mode networks; and linking metrics of brain connectivity from the individualized networks to both mental rotations task performance and circulating hormone levels. IUD users provide a promising natural experiment for the interplay between exogenous and endogenous sex hormones, and they are likely qualitatively different from OC users with whom they are often grouped in hormonal contraceptive research. This paper underscores how future research on IUD users can advance basic neuroendocrinological knowledge and women's health.

Appetitive aggression is associated with lateralized activation in nucleus accumbens

Aggression can have a hedonistic aspect in predisposed individuals labeled as appetitive aggression. The present study investigates the neurobiological correlates of this appetitive type of aggression in non-clinical samples from community. Applying functional magnet resonance imaging (fMRI), we tested whether 20 martial artists compared to 26 controls had a higher activation in the nucleus accumbens (NAcc), a central part of the dopaminergic, mesolimbic reward system. Subjects had to watch violent vs. neutral pictures representing appetitive aggression. The affinity towards hedonistic violence was assessed by the Appetitive and Facilitative Aggression Scale (AFAS). Furthermore, the subjects rated all the pictures with regard to how pleasant and violent they were. The martial artists reported a higher AFAS-score and a more positive perception of violent pictures. On the neural level, across all subjects, there was a significant positive correlation between the AFAS-score and the activation in the left NAcc and an inverse association with the activation of the right NAcc when watching violent compared to neutral pictures. This lateralization effect indicates a different processing of hedonistic aspects of aggression in the two hemispheres.

Globally Aging Cortical Spontaneous Activity Revealed by Multiple Metrics and Frequency Bands Using Resting-State Functional MRI

Most existing aging studies using functional MRI (fMRI) are based on cross-sectional data but misinterpreted their findings (i.e., age-related differences) as longitudinal outcomes (i.e., aging-related changes). To delineate aging-related changes the of human cerebral cortex, we employed the resting-state fMRI (rsfMRI) data from 24 healthy elders in the PREVENT-AD cohort, obtaining five longitudinal scans per subject. Cortical spontaneous activity is measured globally with three rsfMRI metrics including its amplitude, homogeneity, and homotopy at three different frequency bands (slow-5: 0.02-0.03 Hz, slow-4: 0.03-0.08 Hz, and slow-3 band: 0.08-0.22 Hz). General additive mixed models revealed a universal pattern of the aging-related changes for the global cortical spontaneous activity, indicating increases of these rsfMRI metrics during aging. This aging pattern follows specific frequency and spatial profiles where higher slow bands show more non-linear curves and the amplitude exhibits more extensive and significant aging-related changes than the connectivity. These findings provide strong evidence that cortical spontaneous activity is aging globally, inspiring its clinical utility as neuroimaging markers for neruodegeneration disorders.

Homogenization of face neural representation during development

Extensive studies have demonstrated that face processing ability develops gradually during development until adolescence. However, the underlying mechanism is unclear. One hypothesis is that children and adults represent faces in qualitatively different fashions with different group templates. An alternative hypothesis emphasizes the development as a quantitative change with a decrease of variation in representations. To test these hypotheses, we used between-participant correlation to measure activation pattern similarity both within and between late-childhood children and adults. We found that activation patterns for faces in the fusiform face area and occipital face area were less similar within the children group than within the adults group, indicating children had a greater variation in representing faces. Interestingly, the activation pattern similarity of children to their own group template was not significantly larger than that to adults' template, suggesting children and adults shared a template in representing faces. Further, the decrease in representation variance was likely a general principle in the ventral visual cortex, as a similar result was observed in a scene-selective region when perceiving scenes. Taken together, our study provides evidence that development of object representation may result from a homogenization process that shifts from greater variance in late-childhood to homogeneity in adults.

Cross-dataset reproducibility of human retinotopic maps

Population receptive field (pRF) models fit to fMRI data are used to non-invasively measure retinotopic maps in human visual cortex, and these maps are a fundamental component of visual neuroscience experiments. Here, we examined the reproducibility of retinotopic maps across two datasets: a newly acquired retinotopy dataset from New York University (NYU) (n = 44) and a public dataset from the Human Connectome Project (HCP) (n = 181). Our goal was to assess the degree to which pRF properties are similar across datasets, despite substantial differences in their experimental protocols. The two datasets simultaneously differ in their stimulus apertures, participant pool, fMRI protocol, MRI field strength, and preprocessing pipeline. We assessed the cross-dataset reproducibility of the two datasets in terms of the similarity of vertex-wise pRF estimates and in terms of large-scale polar angle asymmetries in cortical magnification. Within V1, V2, V3, and hV4, the group-median NYU and HCP vertex-wise polar angle estimates were nearly identical. Both eccentricity and pRF size estimates were also strongly correlated between the two datasets, but with a slope different from 1; the eccentricity and pRF size estimates were systematically greater in the NYU data. Next, to compare large-scale map properties, we quantified two polar angle asymmetries in V1 cortical magnification previously identified in the HCP data. The NYU dataset confirms earlier reports that more cortical surface area represents horizontal than vertical visual field meridian, and lower than upper vertical visual field meridian. Together, our findings show that the retinotopic properties of V1, V2, V3, and hV4 can be reliably measured across two datasets, despite numerous differences in their experimental design. fMRI-derived retinotopic maps are reproducible because they rely on an explicit computational model of the fMRI response. In the case of pRF mapping, the model is grounded in physiological evidence of how visual receptive fields are organized, allowing one to quantitatively characterize the BOLD signal in terms of stimulus properties (i.e., location and size). The new NYU Retinotopy Dataset will serve as a useful benchmark for testing hypotheses about the organization of visual areas and for comparison to the HCP 7T Retinotopy Dataset.

Importance of test-retest reliability for promoting fMRI based screening and interventions in major depressive disorder

Proponents of personalized medicine have promoted neuroimaging in three areas of clinical application for major depression: clinical prediction, outcome evaluation, and treatment, via neurofeedback. Whereas psychometric considerations such as test-retest reliability are basic precursors to clinical adoption for most clinical instruments, we show, in this article, that basic psychometrics have not been regularly attended to in fMRI of depression. For instance, no fMRI neurofeedback study has included measures of test-retest reliability, despite the implicit assumption that brain signals are stable enough to train. We consider several factors that could be useful to aid clinical translation, including (1) attending to how the BOLD response is parameterized, (2) identifying and promoting regions or voxels with stronger psychometric properties, (3) accounting for within-individual changes (e.g., in symptomatology) across time, and (4) focusing on tasks and clinical populations that are relevant for the intended clinical application. We apply these principles to published prognostic and neurofeedback data sets. The broad implication of this work is that attention to psychometrics is important for clinical adoption of mechanistic assessment, is feasible, and may improve the underlying science.

Test-retest reliability of approach-avoidance conflict decision-making during functional magnetic resonance imaging in healthy adults

Neural and behavioral mechanisms during approach-avoidance conflict decision-making are relevant across various psychiatric disorders, particularly anxiety disorders. Studies using approach-avoidance conflict paradigms in healthy adults have identified preliminary neural mechanisms, but findings must be replicated and demonstrated as reliable before further application. This study sought to replicate previous findings and examine test-retest reliability of behavioral (approach behavior, reaction time) and neural (regions of interest [ROIs]) responses during an approach-avoidance conflict task conducted during functional magnetic resonance imaging (fMRI). Thirty healthy adults completed an approach-avoidance conflict task during fMRI on two occasions (mean interval: 17 days; range: 11-32). Effects of task condition during three task phases (decision-making, affective outcome and monetary reward) and intraclass correlation coefficients (ICCs) were calculated across time points. Results replicated that approach behavior was modulated by conflict during decision-making. ROI activations were replicated such that dorsal anterior cingulate cortex (dACC) was modulated by conflict during decision-making, and dACC, striatum, and anterior insula were modulated by valence during affective outcomes (p's <.0083). Approach behavior during conflict demonstrated excellent reliability (ICCs ≥.77). Activation of dACC during conflict decision-making and anterior insula during negative outcomes demonstrated fair reliability (ICCs = .51 and .54), and dACC and striatum activation demonstrated good reliability during negative outcomes (ICCs = .63 and .69). Two additional ROIs (amygdala, left dorsolateral prefrontal cortex) showed good reliability during negative outcomes (ICCs ≥.60). These results characterize several specific behavioral and neuroimaging responses that are replicable and sufficiently reliable during approach-avoidance conflict decision-making to support future utility.