Principles of Temporal Processing Across the Cortical Hierarchy

Relationships and representations of brain structures, connectivity, dynamics and functions

The review explores the complex interplay between brain structures and their associated functions, presenting a diversity of hierarchical models that enhances our understanding of these relationships. Central to this approach are structure-function flow diagrams, which offer a visual representation of how specific neuroanatomical structures are linked to their functional roles. These diagrams are instrumental in mapping the intricate connections between different brain regions, providing a clearer understanding of how functions emerge from the underlying neural architecture. The study details innovative attempts to develop new functional hierarchies that integrate structural and functional data. These efforts leverage recent advancements in neuroimaging techniques such as fMRI, EEG, MEG, and PET, as well as computational models that simulate neural dynamics. By combining these approaches, the study seeks to create a more refined and dynamic hierarchy that can accommodate the brain's complexity, including its capacity for plasticity and adaptation. A significant focus is placed on the overlap of structures and functions within the brain. The manuscript acknowledges that many brain regions are multifunctional, contributing to different cognitive and behavioral processes depending on the context. This overlap highlights the need for a flexible, non-linear hierarchy that can capture the brain's intricate functional landscape. Moreover, the study examines the interdependence of these functions, emphasizing how the loss or impairment of one function can impact others. Another crucial aspect discussed is the brain's ability to compensate for functional deficits following neurological diseases or injuries. The investigation explores how the brain reorganizes itself, often through the recruitment of alternative neural pathways or the enhancement of existing ones, to maintain functionality despite structural damage. This compensatory mechanism underscores the brain's remarkable plasticity, demonstrating its ability to adapt and reconfigure itself in response to injury, thereby ensuring the continuation of essential functions. In conclusion, the study presents a system of brain functions that integrates structural, functional, and dynamic perspectives. It offers a robust framework for understanding how the brain's complex network of structures supports a wide range of cognitive and behavioral functions, with significant implications for both basic neuroscience and clinical applications.

Connecting brain and mind through temporo-spatial dynamics: Towards a theory of common currency

Despite major progress in our understanding of the brain, the connection of neural and mental features, that is, brain and mind, remains yet elusive. In our 2020 target paper ("Is temporospatial dynamics the 'common currency' of brain and mind? Spatiotemporal Neuroscience") we proposed the "Common currency hypothesis": temporo-spatial dynamics are shared by neural and mental features, providing their connection. The current paper aims to further support and extend the original description of such common currency into a first outline of a "Common currency theory" (CCT) of neuro-mental relationship. First, we extend the range of examples to thoughts, meditation, depression and attention all lending support that temporal characteristics, (i.e. dynamics) are shared by both neural and mental features. Second, we now also show empirical examples of how spatial characteristics, i.e., topography, are shared by neural and mental features; this is illustrated by topographic reorganization of both neural and mental states in depression and meditation. Third, considering the neuro-mental connection in theoretical terms, we specify their relationship by distinct forms of temporospatial correspondences, ranging on a continuum from simple to complex. In conclusion, we extend our initial hypothesis about the key role of temporo-spatial dynamics in neuro-mental relationship into a first outline of an integrated mind-brain theory, the "Common currency theory" (CCT).

Narrative 'twist' shifts within-individual neural representations of dissociable story features

Given the same external input, one's understanding of that input can differ based on internal contextual knowledge. Where and how does the brain represent latent belief frameworks that interact with incoming sensory information to shape subjective interpretations? In this study, participants listened to the same auditory narrative twice, with a plot twist in the middle that dramatically shifted their interpretations of the story. Using a robust within-subject whole-brain approach, we leveraged shifts in neural activity between the two listens to identify where latent interpretations are represented in the brain. We considered the narrative in terms of its hierarchical structure, examining how global situation models and their subcomponents-namely, episodes and characters-are represented, finding that they rely on partially distinct sets of brain regions. Results suggest that our brains represent narratives hierarchically, with individual narrative elements being distinct and dynamically updated as a part of changing interpretations of incoming information.

The brain hierarchically represents the past and future during multistep anticipation

Memory for temporal structure enables both planning of future events and retrospection of past events. We investigated how the brain flexibly represents extended temporal sequences into the past and future during anticipation. Participants learned sequences of environments in immersive virtual reality. Pairs of sequences had the same environments in a different order, enabling context-specific learning. During fMRI, participants anticipated upcoming environments multiple steps into the future in a given sequence. Temporal structure was represented in the hippocampus and across higher-order visual regions (1) bidirectionally, with graded representations into the past and future and (2) hierarchically, with further events into the past and future represented in successively more anterior brain regions. In hippocampus, these bidirectional representations were context-specific, and suppression of far-away environments predicted response time costs in anticipation. Together, this work sheds light on how we flexibly represent sequential structure to enable planning over multiple timescales.

Dendrites contribute to the gradient of intrinsic timescales encompassing cortical and subcortical brain networks

Introduction

Cytoarchitectonic studies have uncovered a correlation between higher levels of cortical hierarchy and reduced dendritic size. This hierarchical organization extends to the brain's timescales, revealing longer intrinsic timescales at higher hierarchical levels. However, estimating the contribution of single-neuron dendritic morphology to the hierarchy of timescales, which is typically characterized at a macroscopic level, remains challenging.

Method

Here we mapped the intrinsic timescales of six functional networks using functional magnetic resonance imaging (fMRI) data, and characterized the influence of neuronal dendritic size on intrinsic timescales of brain regions, utilizing a multicompartmental neuronal modeling approach based on digitally reconstructed neurons.

Results

The fMRI results revealed a hierarchy of intrinsic timescales encompassing both cortical and subcortical brain regions. The neuronal modeling indicated that neurons with larger dendritic structures exhibit shorter intrinsic timescales. Together these findings highlight the contribution of dendrites at the neuronal level to the hierarchy of intrinsic timescales at the whole-brain level.

Discussion

This study sheds light on the intricate relationship between neuronal structure, cytoarchitectonic maps, and the hierarchy of timescales in the brain.

Intrinsic neural timescales exhibit different lengths in distinct meditation techniques

Meditation encompasses a range of practices employing diverse induction techniques, each characterized by a distinct attentional focus. In Mantra meditation, for instance, practitioners direct their attention narrowly to a given sentence that is recursively repeated, while other forms of meditation such as Shoonya meditation are induced by a wider attentional focus. Here we aimed to identify the neural underpinnings and correlates associated with this spectrum of distinct attentional foci. To accomplish this, we used EEG data to estimate the brain's intrinsic neural timescales (INTs), that is, its temporal windows of activity, by calculating the Autocorrelation Window (ACW) of the EEG signal. The autocorrelation function measures the similarity of a timeseries with a time-lagged version of itself by correlating the signal with itself on different time lags, consequently providing an estimation of INTs length. Therefore, through using the ACW metric, our objective was to explore whether there is a correspondence between the length of the brain's temporal windows of activity and the width of the attentional scope during various meditation techniques. This was performed on three groups of highly proficient practitioners belonging to different meditation traditions, as well as a meditation-naïve control group. Our results indicated that practices with a wider attentional focus, like Shoonya meditation, exhibit longer ACW durations compared to practices requiring a narrower attentional focus, such as Mantra meditation or body-scanning Vipassana meditation. Together, we demonstrated that distinct meditation techniques with varying widths of attentional foci exhibit unique durations in their brain's INTs. This may suggest that the width of the attentional scope during meditation relates and corresponds to the width of the brain's temporal windows in its neural activity. SIGNIFICANCE STATEMENT: Our research uncovered the neural mechanisms that underpin the attentional foci in various meditation techniques. We revealed that distinct meditation induction techniques, featured by their range of attentional widths, are characterized by varying lengths of intrinsic neural timescales (INTs) within the brain, as measured by the Autocorrelation Window function. This finding may bridge the gap between the width of attentional windows (subjective) and the width of the temporal windows in the brain's neural activity (objective) during different meditation techniques, offering a new understanding of how cognitive and neural processes are related to each other. This work holds significant implications, especially in the context of the increasing use of meditation in mental health and well-being interventions. By elucidating the distinct neural foundations of different meditation techniques, our research aims to pave the way for developing more tailored and effective meditation-based treatments.

Intracortical recordings reveal vision-to-action cortical gradients driving human exogenous attention

Exogenous attention, the process that makes external salient stimuli pop-out of a visual scene, is essential for survival. How attention-capturing events modulate human brain processing remains unclear. Here we show how the psychological construct of exogenous attention gradually emerges over large-scale gradients in the human cortex, by analyzing activity from 1,403 intracortical contacts implanted in 28 individuals, while they performed an exogenous attention task. The timing, location and task-relevance of attentional events defined a spatiotemporal gradient of three neural clusters, which mapped onto cortical gradients and presented a hierarchy of timescales. Visual attributes modulated neural activity at one end of the gradient, while at the other end it reflected the upcoming response timing, with attentional effects occurring at the intersection of visual and response signals. These findings challenge multi-step models of attention, and suggest that frontoparietal networks, which process sequential stimuli as separate events sharing the same location, drive exogenous attention phenomena such as inhibition of return.

Decreased intrinsic neural timescale in treatment-naïve adolescent depression

BACKGROUND

Major depressive disorder (MDD) is mainly characterized by its core dysfunction in higher-order brain cortices involved in emotional and cognitive processes, whose neurobiological basis remains unclear. In this study, we applied a relatively new developed resting-state functional magnetic resonance imaging (rs-fMRI) method of intrinsic neural timescale (INT), which reflects how long neural information is stored in a local brain area and reflects an ability of information integration, to investigate the local intrinsic neural dynamics using univariate and multivariate analyses in adolescent depression.

METHOD

Based on the rs-fMRI data of sixty-six treatment-naïve adolescents with MDD and fifty-two well-matched healthy controls (HCs), we calculated an INT by assessing the magnitude of autocorrelation of the resting-state brain activity, and then compared the difference of INT between the two groups. Correlation between abnormal INT and clinical features was performed. We also utilized multivariate pattern analysis to determine whether INT could differentiate MDD patients from HCs at the individual level.

RESULT

Compared with HCs, patients with MDD showed shorter INT widely distributed in cortical and partial subcortical regions. Interestingly, the decreased INT in the left hippocampus was related to disease severity of MDD. Furthermore, INT can distinguish MDD patients from HCs with the most discriminative regions located in the dorsolateral prefrontal cortex, angular, middle occipital gyrus, and cerebellar posterior lobe.

CONCLUSION

Our research aids in advancing understanding the brain abnormalities of treatment-naïve adolescents with MDD from the perspective of the local neural dynamics, highlighting the significant role of INT in understanding neurophysiological mechanisms. This study shows that the altered intrinsic timescales of local neural signals widely distributed in higher-order brain cortices regions may be the neurodynamic basis of cognitive and emotional disturbances in MDD patients, and provides preliminary support for the suggestion that these could be used to aid the identification of MDD patients in clinical practice.

Evidence for Multiscale Multiplexed Representation of Visual Features in EEG

Distinct neural processes such as sensory and memory processes are often encoded over distinct timescales of neural activations. Animal studies have shown that this multiscale coding strategy is also implemented for individual components of a single process, such as individual features of a multifeature stimulus in sensory coding. However, the generalizability of this encoding strategy to the human brain has remained unclear. We asked if individual features of visual stimuli were encoded over distinct timescales. We applied a multiscale time-resolved decoding method to electroencephalography (EEG) collected from human subjects presented with grating visual stimuli to estimate the timescale of individual stimulus features. We observed that the orientation and color of the stimuli were encoded in shorter timescales, whereas spatial frequency and the contrast of the same stimuli were encoded in longer timescales. The stimulus features appeared in temporally overlapping windows along the trial supporting a multiplexed coding strategy. These results provide evidence for a multiplexed, multiscale coding strategy in the human visual system.

Cortical timescales and the modular organization of structural and functional brain networks

Recent years have seen growing interest in characterizing the properties of regional brain dynamics and their relationship to other features of brain structure and function. In particular, multiple studies have observed regional differences in the "timescale" over which activity fluctuates during periods of quiet rest. In the cerebral cortex, these timescales have been associated with both local circuit properties as well as patterns of inter-regional connectivity, including the extent to which each region exhibits widespread connectivity to other brain areas. In the current study, we build on prior observations of an association between connectivity and dynamics in the cerebral cortex by investigating the relationship between BOLD fMRI timescales and the modular organization of structural and functional brain networks. We characterize network community structure across multiple scales and find that longer timescales are associated with greater within-community functional connectivity and diverse structural connectivity. We also replicate prior observations of a positive correlation between timescales and structural connectivity degree. Finally, we find evidence for preferential functional connectivity between cortical areas with similar timescales. We replicate these findings in an independent dataset. These results contribute to our understanding of functional brain organization and structure-function relationships in the human brain, and support the notion that regional differences in cortical dynamics may in part reflect the topological role of each region within macroscale brain networks.

Intrinsic timescales and predictive allostatic interoception in brain health and disease

The cognitive neuroscience of brain diseases faces challenges in understanding the complex relationship between brain structure and function, the heterogeneity of brain phenotypes, and the lack of dimensional and transnosological explanations. This perspective offers a framework combining the predictive coding theory of allostatic interoceptive overload (PAIO) and the intrinsic neural timescales (INT) theory to provide a more dynamic understanding of brain health in psychiatry and neurology. PAIO integrates allostasis and interoception to assess the interaction between internal patterns and environmental stressors, while INT shows that different brain regions operate on different intrinsic timescales. The allostatic overload can be understood as a failure of INT, which involves a breakdown of proper temporal integration and segregation. This can lead to dimensional disbalances between exteroceptive/interoceptive inputs across brain and whole-body levels (cardiometabolic, cardiovascular, inflammatory, immune). This approach offers new insights, presenting novel perspectives on brain spatiotemporal hierarchies and interactions. By integrating these theories, the paper opens innovative paths for studying brain health dynamics, which can inform future research in brain health and disease.

Intrinsic neural timescales relate to the dynamics of infraslow neural waves

The human brain is a highly dynamic organ that operates across a variety of timescales, the intrinsic neural timescales (INT). In addition to the INT, the neural waves featured by its phase-related processes including their cycles with peak/trough and rise/fall play a key role in shaping the brain's neural activity. However, the relationship between the brain's ongoing wave dynamics and INT remains yet unclear. In this study, we utilized functional magnetic resonance imaging (fMRI) rest and task data from the Human Connectome Project (HCP) to investigate the relationship of infraslow wave dynamics [as measured in terms of speed by changes in its peak frequency (PF)] with INT. Our findings reveal that: (i) the speed of phase dynamics (PF) is associated with distinct parts of the ongoing phase cycles, namely higher PF in peak/trough and lower PF in rise/fall; (ii) there exists a negative correlation between phase dynamics (PF) and INT such that slower PF relates to longer INT; (iii) exposure to a movie alters both PF and INT across the different phase cycles, yet their negative correlation remains intact. Collectively, our results demonstrate that INT relates to infraslow phase dynamics during both rest and task states.

Decreased intrinsic neural timescales in obsessive compulsive disorder and two distinct subtypes revealed by heterogeneity through discriminative analysis

BACKGROUND

OCD is featured as the destruction of information storage and processing. The cognition of neurobiological and clinical heterogeneity is in suspense and poorly studied.

METHODS

Ninety-nine patients and matched HCs(n = 104) were recruited and underwent resting-state functional MRI scans. We applied INT to evaluate altered local neural dynamics representing the ability of information integration. Moreover, considering OCD was a highly heterogeneous disorder, we investigated putative OCD subtypes from INT using a novel semi-supervised machine learning, named HYDRA.

RESULTS

Compared with HCs, patients with OCD showed decreased INTs in extensive brain regions, including bilateral cerebellum and precuneus, STG/MTG and PCC, hippocampus in DMN; right IFG/MFG/SFG, SPL and bilateral angular gyrus in CEN and insula, SMA in SN. Moreover, many other regions involved in visual processing also had disrupted dynamics of local neural organization, consisting of bilateral CUN, LING and fusiform gyrus and occipital lobe. HYDRA divided patients into two distinct neuroanatomical subtypes from INT. Subtype 1 showed decreased INTs in distributed networks, while subtype 2 presented increased in several common regions which were also found to be decreased in subtype 1, such as STG, IPL, postcentral gyrus and left insula, supramarginal gyrus.

CONCLUSION

This study showed distinct abnormalities from the perspective of dynamics of local neural organization in OCD. Such alteration and dimensional approach may provide a new insight into the prior traditional cognition of this disorder and to some extent do favor of more precise diagnosis and treatment response in the future.

Frequency of adapting events affects face aftereffects but not blur aftereffects

The dynamics of visual adaptation remain poorly understood. Recent studies have found that the strength of adaptation aftereffects in the perception of numerosity depends more strongly on the number of adaptation events than on the duration of the adaptation. We investigated whether such effects can be observed for other visual attributes. We measured blur (perceived focus-sharp vs blurred adapt) and face (perceived race- Asian vs. White adapt) aftereffects by varying the number of adaptation events (4 or 16) and the duration of each adaptation event (0.25 s or 1 s). We found evidence for an effect of event number on face but not on blur adaptation, though the effect for faces was significant for only one of the two face adapt conditions (Asian). Our results suggest that different perceptual dimensions may vary in how adaptation effects accrue, potentially because of differences in factors such as the sites (early or late) of the sensitivity changes or nature of the stimulus. These differences may impact how and how rapidly the visual system can adjust to different visual properties.

Brain-optimized deep neural network models of human visual areas learn non-hierarchical representations

Deep neural networks (DNNs) optimized for visual tasks learn representations that align layer depth with the hierarchy of visual areas in the primate brain. One interpretation of this finding is that hierarchical representations are necessary to accurately predict brain activity in the primate visual system. To test this interpretation, we optimized DNNs to directly predict brain activity measured with fMRI in human visual areas V1-V4. We trained a single-branch DNN to predict activity in all four visual areas jointly, and a multi-branch DNN to predict each visual area independently. Although it was possible for the multi-branch DNN to learn hierarchical representations, only the single-branch DNN did so. This result shows that hierarchical representations are not necessary to accurately predict human brain activity in V1-V4, and that DNNs that encode brain-like visual representations may differ widely in their architecture, ranging from strict serial hierarchies to multiple independent branches.

As without, so within: how the brain's temporo-spatial alignment to the environment shapes consciousness

Consciousness is constituted by a structure that includes contents as foreground and the environment as background. This structural relation between the experiential foreground and background presupposes a relationship between the brain and the environment, often neglected in theories of consciousness. The temporo-spatial theory of consciousness addresses the brain-environment relation by a concept labelled 'temporo-spatial alignment'. Briefly, temporo-spatial alignment refers to the brain's neuronal activity's interaction with and adaption to interoceptive bodily and exteroceptive environmental stimuli, including their symmetry as key for consciousness. Combining theory and empirical data, this article attempts to demonstrate the yet unclear neuro-phenomenal mechanisms of temporo-spatial alignment. First, we suggest three neuronal layers of the brain's temporo-spatial alignment to the environment. These neuronal layers span across a continuum from longer to shorter timescales. (i) The background layer comprises longer and more powerful timescales mediating topographic-dynamic similarities between different subjects' brains. (ii) The intermediate layer includes a mixture of medium-scaled timescales allowing for stochastic matching between environmental inputs and neuronal activity through the brain's intrinsic neuronal timescales and temporal receptive windows. (iii) The foreground layer comprises shorter and less powerful timescales for neuronal entrainment of stimuli temporal onset through neuronal phase shifting and resetting. Second, we elaborate on how the three neuronal layers of temporo-spatial alignment correspond to their respective phenomenal layers of consciousness. (i) The inter-subjectively shared contextual background of consciousness. (ii) An intermediate layer that mediates the relationship between different contents of consciousness. (iii) A foreground layer that includes specific fast-changing contents of consciousness. Overall, temporo-spatial alignment may provide a mechanism whose different neuronal layers modulate corresponding phenomenal layers of consciousness. Temporo-spatial alignment can provide a bridging principle for linking physical-energetic (free energy), dynamic (symmetry), neuronal (three layers of distinct time-space scales) and phenomenal (form featured by background-intermediate-foreground) mechanisms of consciousness.

From local properties to brain-wide organization: A review of intraregional temporal features in functional magnetic resonance imaging data

Based on the fluctuations ensembled over neighbouring neurons, blood oxygen level-dependent (BOLD) signal is a mesoscale measurement of brain signals. Intraregional temporal features (IRTFs) of BOLD signal, extracted from regional neural activities, are utilized to investigate how the brain functions in local brain areas. This literature highlights four types of IRTFs and their representative calculations including variability in the temporal domain, variability in the frequency domain, entropy, and intrinsic neural timescales, which are tightly related to cognitions. In the brain-wide spatial organization, these brain features generally organized into two spatial hierarchies, reflecting structural constraints of regional dynamics and hierarchical functional processing workflow in brain. Meanwhile, the spatial organization gives rise to the link between neuronal properties and cognitive performance. Disrupted or unbalanced spatial conditions of IRTFs emerge with suboptimal cognitive states, which improved our understanding of the aging process and/or neuropathology of brain disease. This review concludes that IRTFs are important properties of the brain functional system and IRTFs should be considered in a brain-wide manner.

Prolonged Intrinsic Neural Timescales Dissociate from Phase Coherence in Schizophrenia

Input processing in the brain is mediated by phase synchronization and intrinsic neural timescales, both of which have been implicated in schizophrenia. Their relationship remains unclear, though. Recruiting a schizophrenia EEG sample from the B-SNIP consortium dataset (n = 134, 70 schizophrenia patients, 64 controls), we investigate phase synchronization, as measured by intertrial phase coherence (ITPC), and intrinsic neural timescales, as measured by the autocorrelation window (ACW) during both the rest and oddball-task states. The main goal of our paper was to investigate whether reported shifts from shorter to longer timescales are related to decreased ITPC. Our findings show (i) decreases in both theta and alpha ITPC in response to both standard and deviant tones; and (iii) a negative correlation of ITPC and ACW in healthy subjects while such correlation is no longer present in SCZ participants. Together, we demonstrate evidence of abnormally long intrinsic neural timescales (ACW) in resting-state EEG of schizophrenia as well as their dissociation from phase synchronization (ITPC). Our data suggest that, during input processing, the resting state's abnormally long intrinsic neural timescales tilt the balance of temporal segregation and integration towards the latter. That results in temporal imprecision with decreased phase synchronization in response to inputs. Our findings provide further evidence for a basic temporal disturbance in schizophrenia on the different timescales (longer ACW and shorter ITPC), which, in the future, might be able to explain common symptoms related to the temporal experience in schizophrenia, for example temporal fragmentation.

Intrinsic neural timescales in autism spectrum disorder and schizophrenia. A replication and direct comparison study

Intrinsic neural timescales (INT) reflect the duration for which brain areas store information. A posterior-anterior hierarchy of increasingly longer INT has been revealed in both typically developed individuals (TD), as well as persons diagnosed with autism spectrum disorder (ASD) and schizophrenia (SZ), though INT are, overall, shorter in both patient groups. In the present study, we aimed to replicate previously reported group differences by comparing INT of TD to ASD and SZ. We partially replicated the previously reported result, showing reduced INT in the left lateral occipital gyrus and the right post-central gyrus in SZ compared to TD. We also directly compared the INT of the two patient groups and found that these same two areas show significantly reduced INT in SZ compared to ASD. Previously reported correlations between INT and symptom severity were not replicated in the current project. Our findings serve to circumscribe the brain areas that can potentially play a determinant role in observed sensory peculiarities in ASD and SZ.

Intrinsic neural timescales mediate the cognitive bias of self - temporal integration as key mechanism

Our perceptions and decisions are not always objectively correct as they are featured by a bias related to our self. What are the behavioral, neural, and computational mechanisms of such cognitive bias? Addressing this yet unresolved question, we here investigate whether the cognitive bias is related to temporal integration and segregation as mediated by the brain's Intrinsic neural timescales (INT). Using Signal Detection Theory (SDT), we operationalize the cognitive bias by the Criterion C as distinguished from the sensitivity index d'. This was probed in a self-task based on morphed self- and other faces. Behavioral data demonstrate clear cognitive bias, i.e., Criterion C. That was related to the EEG-based INT as measured by the autocorrelation window (ACW) in especially the transmodal regions dorsolateral prefrontal cortex (dlPFC) and default-mode network (DMN) as distinct from unimodal visual cortex. Finally, simulation of the same paradigm in a large-scale network model shows high degrees of temporal integration of temporally distinct inputs in CMS/DMN and dlPFC while temporal segregation predominates in visual cortex. Together, we demonstrate a key role of INT-based temporal integration in CMS/DMN and dlPFC including its relation to the brain's uni-transmodal topographical organization in mediating the cognitive bias of our self.

Multi-view manifold learning of human brain-state trajectories

The complexity of the human brain gives the illusion that brain activity is intrinsically high-dimensional. Nonlinear dimensionality-reduction methods such as uniform manifold approximation and t-distributed stochastic neighbor embedding have been used for high-throughput biomedical data. However, they have not been used extensively for brain activity data such as those from functional magnetic resonance imaging (fMRI), primarily due to their inability to maintain dynamic structure. Here we introduce a nonlinear manifold learning method for time-series data-including those from fMRI-called temporal potential of heat-diffusion for affinity-based transition embedding (T-PHATE). In addition to recovering a low-dimensional intrinsic manifold geometry from time-series data, T-PHATE exploits the data's autocorrelative structure to faithfully denoise and unveil dynamic trajectories. We empirically validate T-PHATE on three fMRI datasets, showing that it greatly improves data visualization, classification, and segmentation of the data relative to several other state-of-the-art dimensionality-reduction benchmarks. These improvements suggest many potential applications of T-PHATE to other high-dimensional datasets of temporally diffuse processes.

Signal denoising through topographic modularity of neural circuits

Information from the sensory periphery is conveyed to the cortex via structured projection pathways that spatially segregate stimulus features, providing a robust and efficient encoding strategy. Beyond sensory encoding, this prominent anatomical feature extends throughout the neocortex. However, the extent to which it influences cortical processing is unclear. In this study, we combine cortical circuit modeling with network theory to demonstrate that the sharpness of topographic projections acts as a bifurcation parameter, controlling the macroscopic dynamics and representational precision across a modular network. By shifting the balance of excitation and inhibition, topographic modularity gradually increases task performance and improves the signal-to-noise ratio across the system. We demonstrate that in biologically constrained networks, such a denoising behavior is contingent on recurrent inhibition. We show that this is a robust and generic structural feature that enables a broad range of behaviorally relevant operating regimes, and provide an in-depth theoretical analysis unraveling the dynamical principles underlying the mechanism.

Disrupted relationship between intrinsic neural timescales and alpha peak frequency during unconscious states - A high-density EEG study

Our brain processes the different timescales of our environment's temporal input stochastics. Is such a temporal input processing mechanism key for consciousness? To address this research question, we calculated measures of input processing on shorter (alpha peak frequency, APF) and longer (autocorrelation window, ACW) timescales on resting-state high-density EEG (256 channels) recordings and compared them across different consciousness levels (awake/conscious, ketamine and sevoflurane anaesthesia, unresponsive wakefulness, minimally conscious state). We replicate and extend previous findings of: (i) significantly longer ACW values, consistently over all states of unconsciousness, as measured with ACW-0 (an unprecedented longer version of the well-know ACW-50); (ii) significantly slower APF values, as measured with frequency sliding, in all four unconscious states. Most importantly, we report a highly significant correlation of ACW-0 and APF in the conscious state, while their relationship is disrupted in the unconscious states. In sum, we demonstrate the relevance of the brain's capacity for input processing on shorter (APF) and longer (ACW) timescales - including their relationship - for consciousness. Albeit indirectly, e.g., through the analysis of electrophysiological activity at rest, this supports the mechanism of temporo-spatial alignment to the environment's temporal input stochastics, through relating different neural timescales, as one key predisposing factor of consciousness.

A Computational Complexity Perspective on Segmentation as a Cognitive Subcomputation

Computational feasibility is a widespread concern that guides the framing and modeling of natural and artificial intelligence. The specification of cognitive system capacities is often shaped by unexamined intuitive assumptions about the search space and complexity of a subcomputation. However, a mistaken intuition might make such initial conceptualizations misleading for what empirical questions appear relevant later on. We undertake here computational-level modeling and complexity analyses of segmentation - a widely hypothesized subcomputation that plays a requisite role in explanations of capacities across domains, such as speech recognition, music cognition, active sensing, event memory, action parsing, and statistical learning - as a case study to show how crucial it is to formally assess these assumptions. We mathematically prove two sets of results regarding computational hardness and search space size that may run counter to intuition, and position their implications with respect to existing views on the subcapacity.

Neural event segmentation of continuous experience in human infants

How infants experience the world is fundamental to understanding their cognition and development. A key principle of adult experience is that, despite receiving continuous sensory input, we perceive this input as discrete events. Here we investigate such event segmentation in infants and how it differs from adults. Research on event cognition in infants often uses simplified tasks in which (adult) experimenters help solve the segmentation problem for infants by defining event boundaries or presenting discrete actions/vignettes. This presupposes which events are experienced by infants and leaves open questions about the principles governing infant segmentation. We take a different, data-driven approach by studying infant event segmentation of continuous input. We collected whole-brain functional MRI (fMRI) data from awake infants (and adults, for comparison) watching a cartoon and used a hidden Markov model to identify event states in the brain. We quantified the existence, timescale, and organization of multiple-event representations across brain regions. The adult brain exhibited a known hierarchical gradient of event timescales, from shorter events in early visual regions to longer events in later visual and associative regions. In contrast, the infant brain represented only longer events, even in early visual regions, with no timescale hierarchy. The boundaries defining these infant events only partially overlapped with boundaries defined from adult brain activity and behavioral judgments. These findings suggest that events are organized differently in infants, with longer timescales and more stable neural patterns, even in sensory regions. This may indicate greater temporal integration and reduced temporal precision during dynamic, naturalistic perception.

Modulation of Spectral Representation and Connectivity Patterns in Response to Visual Narrative in the Human Brain

The regional brain networks and the underlying neurophysiological mechanisms subserving the cognition of visual narrative in humans have largely been studied with non-invasive brain recording. In this study, we specifically investigated how regional and cross-regional cortical activities support visual narrative interpretation using intracranial stereotactic electroencephalograms recordings from thirteen human subjects (6 females, and 7 males). Widely distributed recording sites across the brain were sampled while subjects were explicitly instructed to observe images from fables presented in “sequential” order, and a set of images drawn from multiple fables presented in “scrambled” order. Broadband activity mainly within the frontal and temporal lobes were found to encode if a presented image is part of a visual narrative (sequential) or random image set (scrambled). Moreover, the temporal lobe exhibits strong activation in response to visual narratives while the frontal lobe is more engaged when contextually novel stimuli are presented. We also investigated the dynamics of interregional interactions between visual narratives and contextually novel series of images. Interestingly, the interregional connectivity is also altered between sequential and scrambled sequences. Together, these results suggest that both changes in regional neuronal activity and cross-regional interactions subserve visual narrative and contextual novelty processing.

High-Level Visual Encoding Model Framework with Hierarchical Ventral Stream-Optimized Neural Networks

Visual encoding models based on deep neural networks (DNN) show good performance in predicting brain activity in low-level visual areas. However, due to the amount of neural data limitation, DNN-based visual encoding models are difficult to fit for high-level visual areas, resulting in insufficient encoding performance. The ventral stream suggests that higher visual areas receive information from lower visual areas, which is not fully reflected in the current encoding models. In the present study, we propose a novel visual encoding model framework which uses the hierarchy of representations in the ventral stream to improve the model’s performance in high-level visual areas. Under the framework, we propose two categories of hierarchical encoding models from the voxel and the feature perspectives to realize the hierarchical representations. From the voxel perspective, we first constructed an encoding model for the low-level visual area (V1 or V2) and extracted the voxel space predicted by the model. Then we use the extracted voxel space of the low-level visual area to predict the voxel space of the high-level visual area (V4 or LO) via constructing a voxel-to-voxel model. From the feature perspective, the feature space of the first model is extracted to predict the voxel space of the high-level visual area. The experimental results show that two categories of hierarchical encoding models effectively improve the encoding performance in V4 and LO. In addition, the proportion of the best-encoded voxels for different models in V4 and LO show that our proposed models have obvious advantages in prediction accuracy. We find that the hierarchy of representations in the ventral stream has a positive effect on improving the performance of the existing model in high-level visual areas.

From temporal to spatial topography: hierarchy of neural dynamics in higher- and lower-order networks shapes their complexity

The brain shows a topographical hierarchy along the lines of lower- and higher-order networks. The exact temporal dynamics characterization of this lower-higher-order topography at rest and its impact on task states remains unclear, though. Using 2 functional magnetic resonance imaging data sets, we investigate lower- and higher-order networks in terms of the signal compressibility, operationalized by Lempel-Ziv complexity (LZC). As we assume that this degree of complexity is related to the slow-fast frequency balance, we also compute the median frequency (MF), an estimation of frequency distribution. We demonstrate (i) topographical differences at rest between higher- and lower-order networks, showing lower LZC and MF in the former; (ii) task-related and task-specific changes in LZC and MF in both lower- and higher-order networks; (iii) hierarchical relationship between LZC and MF, as MF at rest correlates with LZC rest-task change along the lines of lower- and higher-order networks; and (iv) causal and nonlinear relation between LZC at rest and LZC during task, with MF at rest acting as mediator. Together, results show that the topographical hierarchy of lower- and higher-order networks converges with their temporal hierarchy, with these neural dynamics at rest shaping their range of complexity during task states in a nonlinear way.

Temporo-spatial Theory of Consciousness (TTC) - Bridging the gap of neuronal activity and phenomenal states

Consciousness and its neural mechanisms remain a mystery. Current neuroscientific theories focus predominantly on the external input/stimulus and the associated stimulus-related activity during conscious contents. Despite all progress, we encounter two gaps: (i) a gap between spontaneous and stimulus-related activity; (ii) a gap between neuronal and phenomenal features. A novel, different, and unique approach, Temporo-spatial theory of consciousness (TTC) aims to bridge both gaps. The TTC focuses on the brain's spontaneous activity and how its spatial topography and temporal dynamic shape stimulus-related activity and resurface in the corresponding spatial and temporal features of consciousness, i.e., 'common currency'. The TTC introduces four temporo-spatial mechanisms: expansion, globalization, alignment, and nestedness. These are associated with distinct dimensions of consciousness including phenomenal content, access, form/structure, and level/state, respectively. Following up on the first introduction of the TTC in 2017, we review updates, further develop these temporo-spatial mechanisms, and postulate specific neurophenomenal hypotheses. We conclude that the TTC offers a viable approach for (i) linking spontaneous and stimulus-related activity in conscious states; (ii) determining specific neuronal and neurophenomenal mechanisms for the distinct dimensions of consciousness; (iii) an integrative and unifying framework of different neuroscientific theories of consciousness; and (iv) offers novel empirically grounded conceptual assumptions about the biological and ontological nature of consciousness and its relation to the brain.

Intrinsic neural timescales: temporal integration and segregation

We are continuously bombarded by external inputs of various timescales from the environment. How does the brain process this multitude of timescales? Recent resting state studies show a hierarchy of intrinsic neural timescales (INT) with a shorter duration in unimodal regions (e.g., visual cortex and auditory cortex) and a longer duration in transmodal regions (e.g., default mode network). This unimodal-transmodal hierarchy is present across acquisition modalities [electroencephalogram (EEG)/magnetoencephalogram (MEG) and fMRI] and can be found in different species and during a variety of different task states. Together, this suggests that the hierarchy of INT is central to the temporal integration (combining successive stimuli) and segregation (separating successive stimuli) of external inputs from the environment, leading to temporal segmentation and prediction in perception and cognition.

Cortical activity during naturalistic music listening reflects short-range predictions based on long-term experience

Expectations shape our experience of music. However, the internal model upon which listeners form melodic expectations is still debated. Do expectations stem from Gestalt-like principles or statistical learning? If the latter, does long-term experience play an important role, or are short-term regularities sufficient? And finally, what length of context informs contextual expectations? To answer these questions, we presented human listeners with diverse naturalistic compositions from Western classical music, while recording neural activity using MEG. We quantified note-level melodic surprise and uncertainty using various computational models of music, including a state-of-the-art transformer neural network. A time-resolved regression analysis revealed that neural activity over fronto-temporal sensors tracked melodic surprise particularly around 200ms and 300-500ms after note onset. This neural surprise response was dissociated from sensory-acoustic and adaptation effects. Neural surprise was best predicted by computational models that incorporated long-term statistical learning-rather than by simple, Gestalt-like principles. Yet, intriguingly, the surprise reflected primarily short-range musical contexts of less than ten notes. We present a full replication of our novel MEG results in an openly available EEG dataset. Together, these results elucidate the internal model that shapes melodic predictions during naturalistic music listening.

Predicting speech from a cortical hierarchy of event-based time scales

How do predictions in the brain incorporate the temporal unfolding of context in our natural environment? We here provide evidence for a neural coding scheme that sparsely updates contextual representations at the boundary of events. This yields a hierarchical, multilayered organization of predictive language comprehension. Training artificial neural networks to predict the next word in a story at five stacked time scales and then using model-based functional magnetic resonance imaging, we observe an event-based “surprisal hierarchy” evolving along a temporoparietal pathway. Along this hierarchy, surprisal at any given time scale gated bottom-up and top-down connectivity to neighboring time scales. In contrast, surprisal derived from continuously updated context influenced temporoparietal activity only at short time scales. Representing context in the form of increasingly coarse events constitutes a network architecture for making predictions that is both computationally efficient and contextually diverse.

The Self and Its Right Insula-Differential Topography and Dynamic of Right vs. Left Insula

Various studies demonstrate a special role of the right compared to the left anterior insula in mediating our self. However, the neural features of the right insula that allow for its special role remain unclear. Presupposing a spatiotemporal model of self—“Basis model of self-specificity” (BMSS)—we here address the following question: what spatial-topographic and temporal-dynamic features render neural activity in the right insula to be more suitable in mediating self-specificity than the left insula? First, applying fMRI, we demonstrate that the right insula (i) exhibits higher degrees of centrality in rest, and (ii) higher context-dependent functional connectivity in a self-specific task among regions of distinct layers of self (intero-, extero-proprioceptive, and mental). Second, using EEG in rest and task, we show that the right insula shows longer autocorrelation window (ACW) in its neural activity than both left insula and other regions of the different layers of self. Together, we demonstrate special topographic, i.e., high functional connectivity, and dynamic, i.e., long ACW, neural features of the right insula compared to both left insula and other regions of the distinct layers of self. This suits neural activity in the right insula ideally for high functional integration and temporal continuity as key features of the self including its intero-, extero-proprioceptive, and mental layers.

The brain and its time: intrinsic neural timescales are key for input processing

We process and integrate multiple timescales into one meaningful whole. Recent evidence suggests that the brain displays a complex multiscale temporal organization. Different regions exhibit different timescales as described by the concept of intrinsic neural timescales (INT); however, their function and neural mechanisms remains unclear. We review recent literature on INT and propose that they are key for input processing. Specifically, they are shared across different species, i.e., input sharing. This suggests a role of INT in encoding inputs through matching the inputs' stochastics with the ongoing temporal statistics of the brain's neural activity, i.e., input encoding. Following simulation and empirical data, we point out input integration versus segregation and input sampling as key temporal mechanisms of input processing. This deeply grounds the brain within its environmental and evolutionary context. It carries major implications in understanding mental features and psychiatric disorders, as well as going beyond the brain in integrating timescales into artificial intelligence.

Temporal stability of stimulus representation increases along rodent visual cortical hierarchies

Cortical representations of brief, static stimuli become more invariant to identity-preserving transformations along the ventral stream. Likewise, increased invariance along the visual hierarchy should imply greater temporal persistence of temporally structured dynamic stimuli, possibly complemented by temporal broadening of neuronal receptive fields. However, such stimuli could engage adaptive and predictive processes, whose impact on neural coding dynamics is unknown. By probing the rat analog of the ventral stream with movies, we uncovered a hierarchy of temporal scales, with deeper areas encoding visual information more persistently. Furthermore, the impact of intrinsic dynamics on the stability of stimulus representations grew gradually along the hierarchy. A database of recordings from mouse showed similar trends, additionally revealing dependencies on the behavioral state. Overall, these findings show that visual representations become progressively more stable along rodent visual processing hierarchies, with an important contribution provided by intrinsic processing.

Wiring of higher-order cortical areas: Spatiotemporal development of cortical hierarchy

A hierarchical development of cortical areas was suggested over a century ago, but the diversity and complexity of cortical hierarchy properties have so far prevented a formal demonstration. The aim of this review is to clarify the similarities and differences in the developmental processes underlying cortical development of primary and higher-order areas. We start by recapitulating the historical and recent advances underlying the biological principle of cortical hierarchy in adults. We then revisit the arguments for a hierarchical maturation of cortical areas, and further integrate the principles of cortical areas specification during embryonic and postnatal development. We highlight how the dramatic expansion in cortical size might have contributed to the increased number of association areas sustaining cognitive complexification in evolution. Finally, we summarize the recent observations of an alteration of cortical hierarchy in neuropsychiatric disorders and discuss their potential developmental origins.

The metastable brain associated with autistic-like traits of typically developing individuals

Metastability in the brain is thought to be a mechanism involved in the dynamic organization of cognitive and behavioral functions across multiple spatiotemporal scales. However, it is not clear how such organization is realized in underlying neural oscillations in a high-dimensional state space. It was shown that macroscopic oscillations often form phase-phase coupling (PPC) and phase-amplitude coupling (PAC), which result in synchronization and amplitude modulation, respectively, even without external stimuli. These oscillations can also make spontaneous transitions across synchronous states at rest. Using resting-state electroencephalographic signals and the autism-spectrum quotient scores acquired from healthy humans, we show experimental evidence that the PAC combined with PPC allows amplitude modulation to be transient, and that the metastable dynamics with this transient modulation is associated with autistic-like traits. In individuals with a longer attention span, such dynamics tended to show fewer transitions between states by forming delta-alpha PAC. We identified these states as two-dimensional metastable states that could share consistent patterns across individuals. Our findings suggest that the human brain dynamically organizes inter-individual differences in a hierarchy of macroscopic oscillations with multiple timescales by utilizing metastability.

The human brain organizes cognitive and behavioral functions dynamically. For decades, the dynamic organization of underlying neural oscillations has been a fundamental topic in neuroscience research. Even without external stimuli, macroscopic oscillations often form phase-phase coupling and phase-amplitude coupling (PAC) that result in synchronization and amplitude modulation, respectively, and can make spontaneous transitions across synchronous states at rest. Using resting-state electroencephalography signals acquired from healthy humans, we show evidence that these two neural couplings enable amplitude modulation to be transient, and that this transient modulation can be viewed as the transition among oscillatory states with different PAC strengths. We also demonstrate that such transition dynamics are associated with the ability to maintain attention to detail and to switch attention, as measured by autism-spectrum quotient scores. These individual dynamics were visualized as a trajectory among states with attracting tendencies, and involved consistent brain states across individuals. Our findings have significant implications for unraveling the variability in the individual brains showing typical and atypical development.

Temporal hierarchy of intrinsic neural timescales converges with spatial core-periphery organization

The human cortex exhibits intrinsic neural timescales that shape a temporal hierarchy. Whether this temporal hierarchy follows the spatial hierarchy of its topography, namely the core-periphery organization, remains an open issue. Using magnetoencephalography data, we investigate intrinsic neural timescales during rest and task states; we measure the autocorrelation window in short (ACW-50) and, introducing a novel variant, long (ACW-0) windows. We demonstrate longer ACW-50 and ACW-0 in networks located at the core compared to those at the periphery with rest and task states showing a high ACW correlation. Calculating rest-task differences, i.e., subtracting the shared core-periphery organization, reveals task-specific ACW changes in distinct networks. Finally, employing kernel density estimation, machine learning, and simulation, we demonstrate that ACW-0 exhibits better prediction in classifying a region's time window as core or periphery. Overall, our findings provide fundamental insight into how the human cortex's temporal hierarchy converges with its spatial core-periphery hierarchy.

Are intrinsic neural timescales related to sensory processing? Evidence from abnormal behavioral states

The brain exhibits a complex temporal structure which translates into a hierarchy of distinct neural timescales. An open question is how these intrinsic timescales are related to sensory or motor information processing and whether these dynamics have common patterns in different behavioral states. We address these questions by investigating the brain's intrinsic timescales in healthy controls, motor (amyotrophic lateral sclerosis, locked-in syndrome), sensory (anesthesia, unresponsive wakefulness syndrome), and progressive reduction of sensory processing (from awake states over N1, N2, N3). We employed a combination of measures from EEG resting-state data: auto-correlation window (ACW), power spectral density (PSD), and power-law exponent (PLE). Prolonged neural timescales accompanied by a shift towards slower frequencies were observed in the conditions with sensory deficits, but not in conditions with motor deficits. Our results establish that the spontaneous activity's intrinsic neural timescale is related to the neural capacity that specifically supports sensory rather than motor information processing in the healthy brain.

Effect of age on the gap-prepulse inhibition of the cortical N1-P2 complex in humans as a step towards an objective measure of tinnitus

The gap-prepulse inhibition of the acoustic startle reflex has been widely used as a behavioral method for tinnitus screening in animal studies. The cortical-evoked potential gap-induced inhibition has also been investigated in animals as well as in human subjects. The present study aimed to investigate the effect of age on the cortical N1-P2 complex in the gap-prepulse inhibition paradigm. Fifty-seven subjects, aged 20 to 68 years, without continuous tinnitus, were tested with two effective gap conditions (embedded gap of 50- or 20-ms duration). Retest sessions were performed within one month. A significant gap-induced inhibition of the N1-P2 complex was found in both gap durations. Age differently affected the inhibition, depending on gap duration. With a 50-ms gap, the inhibition decreased significantly with the increase in age. This age-inhibition relationship was not found when using a 20-ms gap. The results were reproducible in the retest session. Our findings suggest that the interaction between age and gap duration should be considered when applying the gap-induced inhibition of the cortical-evoked potential as an objective measure of tinnitus in human subjects. Further studies with tinnitus patients are warranted to identify gap duration that would minimize the effects of age and maximize the difference in the inhibition between those with and without tinnitus.

Temporal integration as "common currency" of brain and self-scale-free activity in resting-state EEG correlates with temporal delay effects on self-relatedness

The self is a multifaceted phenomenon that integrates information and experience across multiple time scales. How temporal integration on the psychological level of the self is related to temporal integration on the neuronal level remains unclear. To investigate temporal integration on the psychological level, we modified a well-established self-matching paradigm by inserting temporal delays. On the neuronal level, we indexed temporal integration in resting-state EEG by two related measures of scale-free dynamics, the power law exponent and autocorrelation window. We hypothesized that the previously established self-prioritization effect, measured as decreased response times or increased accuracy for self-related stimuli, would change with the insertion of different temporal delays between the paired stimuli, and that these changes would be related to temporal integration on the neuronal level. We found a significant self-prioritization effect on accuracy in all conditions with delays, indicating stronger temporal integration of self-related stimuli. Further, we observed a relationship between temporal integration on psychological and neuronal levels: higher degrees of neuronal integration, that is, higher power-law exponent and longer autocorrelation window, during resting-state EEG were related to a stronger increase in the self-prioritization effect across longer temporal delays. We conclude that temporal integration on the neuronal level serves as a template for temporal integration of the self on the psychological level. Temporal integration can thus be conceived as the "common currency" of neuronal and psychological levels of self.

Crossmodal Language Grounding in an Embodied Neurocognitive Model

Human infants are able to acquire natural language seemingly easily at an early age. Their language learning seems to occur simultaneously with learning other cognitive functions as well as with playful interactions with the environment and caregivers. From a neuroscientific perspective, natural language is embodied, grounded in most, if not all, sensory and sensorimotor modalities, and acquired by means of crossmodal integration. However, characterizing the underlying mechanisms in the brain is difficult and explaining the grounding of language in crossmodal perception and action remains challenging. In this paper, we present a neurocognitive model for language grounding which reflects bio-inspired mechanisms such as an implicit adaptation of timescales as well as end-to-end multimodal abstraction. It addresses developmental robotic interaction and extends its learning capabilities using larger-scale knowledge-based data. In our scenario, we utilize the humanoid robot NICO in obtaining the EMIL data collection, in which the cognitive robot interacts with objects in a children's playground environment while receiving linguistic labels from a caregiver. The model analysis shows that crossmodally integrated representations are sufficient for acquiring language merely from sensory input through interaction with objects in an environment. The representations self-organize hierarchically and embed temporal and spatial information through composition and decomposition. This model can also provide the basis for further crossmodal integration of perceptually grounded cognitive representations.

Movies and narratives as naturalistic stimuli in neuroimaging

Using movies and narratives as naturalistic stimuli in human neuroimaging studies has yielded significant advances in understanding of cognitive and emotional functions. The relevant literature was reviewed, with emphasis on how the use of naturalistic stimuli has helped advance scientific understanding of human memory, attention, language, emotions, and social cognition in ways that would have been difficult otherwise. These advances include discovering a cortical hierarchy of temporal receptive windows, which supports processing of dynamic information that accumulates over several time scales, such as immediate reactions vs. slowly emerging patterns in social interactions. Naturalistic stimuli have also helped elucidate how the hippocampus supports segmentation and memorization of events in day-to-day life and have afforded insights into attentional brain mechanisms underlying our ability to adopt specific perspectives during natural viewing. Further, neuroimaging studies with naturalistic stimuli have revealed the role of the default-mode network in narrative-processing and in social cognition. Finally, by robustly eliciting genuine emotions, these stimuli have helped elucidate the brain basis of both basic and social emotions apparently manifested as highly overlapping yet distinguishable patterns of brain activity.

No evidence for differences among language regions in their temporal receptive windows

The "core language network" consists of left frontal and temporal regions that are selectively engaged in linguistic processing. Whereas functional differences among these regions have long been debated, many accounts propose distinctions in terms of representational grain-size-e.g., words vs. phrases/sentences-or processing time-scale, i.e., operating on local linguistic features vs. larger spans of input. Indeed, the topography of language regions appears to overlap with a cortical hierarchy reported by Lerner et al. (2011) wherein mid-posterior temporal regions are sensitive to low-level features of speech, surrounding areas-to word-level information, and inferior frontal areas-to sentence-level information and beyond. However, the correspondence between the language network and this hierarchy of "temporal receptive windows" (TRWs) is difficult to establish because the precise anatomical locations of language regions vary across individuals. To directly test this correspondence, we first identified language regions in each participant with a well-validated task-based localizer, which confers high functional resolution to the study of TRWs (traditionally based on stereotactic coordinates); then, we characterized regional TRWs with the naturalistic story listening paradigm of Lerner et al. (2011), which augments task-based characterizations of the language network by more closely resembling comprehension "in the wild". We find no region-by-TRW interactions across temporal and inferior frontal regions, which are all sensitive to both word-level and sentence-level information. Therefore, the language network as a whole constitutes a unique stage of information integration within a broader cortical hierarchy.

In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia

Treatment of schizophrenia has had limited success in treating core cognitive symptoms. The evidence of multi-gene involvement suggests that multi-target therapy may be needed. Meanwhile, the complexity of schizophrenia pathophysiology and psychopathology, coupled with the species-specificity of much of the symptomatology, places limits on analysis via animal models, in vitro assays, and patient assessment. Multiscale computer modeling complements these traditional modes of study. Using a hippocampal CA3 computer model with 1200 neurons, we examined the effects of alterations in NMDAR, HCN (Ih current), and GABAAR on information flow (measured with normalized transfer entropy), and in gamma activity in local field potential (LFP). We found that altering NMDARs, GABAAR, Ih, individually or in combination, modified information flow in an inverted-U shape manner, with information flow reduced at low and high levels of these parameters. Theta-gamma phase-amplitude coupling also had an inverted-U shape relationship with NMDAR augmentation. The strong information flow was associated with an intermediate level of synchrony, seen as an intermediate level of gamma activity in the LFP, and an intermediate level of pyramidal cell excitability. Our results are consistent with the idea that overly low or high gamma power is associated with pathological information flow and information processing. These data suggest the need for careful titration of schizophrenia pharmacotherapy to avoid extremes that alter information flow in different ways. These results also identify gamma power as a potential biomarker for monitoring pathology and multi-target pharmacotherapy.

The frequency gradient of human resting-state brain oscillations follows cortical hierarchies

The human cortex is characterized by local morphological features such as cortical thickness, myelin content, and gene expression that change along the posterior-anterior axis. We investigated if some of these structural gradients are associated with a similar gradient in a prominent feature of brain activity - namely the frequency of oscillations. In resting-state MEG recordings from healthy participants (N = 187) using mixed effect models, we found that the dominant peak frequency in a brain area decreases significantly along the posterior-anterior axis following the global hierarchy from early sensory to higher order areas. This spatial gradient of peak frequency was significantly anticorrelated with that of cortical thickness, representing a proxy of the cortical hierarchical level. This result indicates that the dominant frequency changes systematically and globally along the spatial and hierarchical gradients and establishes a new structure-function relationship pertaining to brain oscillations as a core organization that may underlie hierarchical specialization in the brain.

The Self and Its Prolonged Intrinsic Neural Timescale in Schizophrenia

Schizophrenia (SCZ) can be characterized as a basic self-disorder that is featured by abnormal temporal integration on phenomenological (experience) and psychological (information processing) levels. Temporal integration on the neuronal level can be measured by the brain's intrinsic neural timescale using the autocorrelation window (ACW) and power-law exponent (PLE). Our goal was to relate intrinsic neural timescales (ACW, PLE), as a proxy of temporal integration on the neuronal level, to temporal integration related to self-disorder on psychological (Enfacement illusion task in electroencephalography) and phenomenological (Examination of Anomalous Self-Experience [EASE]) levels. SCZ participants exhibited prolonged ACW and higher PLE during the self-referential task (Enfacement illusion), but not during the non-self-referential task (auditory oddball). The degree of ACW/PLE change during task relative to rest was significantly reduced in self-referential task in SCZ. A moderation model showed that low and high ACW/PLE exerted differential impact on the relationship of self-disorder (EASE) and negative symptoms (PANSS). In sum, we demonstrate abnormal prolongation in intrinsic neural timescale during self-reference in SCZ including its relation to basic self-disorder and negative symptoms. Our results point to abnormal relation of self and temporal integration at the core of SCZ constituting a "common currency" of neuronal, psychological, and phenomenological levels.

Constructing and Forgetting Temporal Context in the Human Cerebral Cortex

How does information from seconds earlier affect neocortical responses to new input? We found that when two groups of participants heard the same sentence in a narrative, preceded by different contexts, the neural responses of each group were initially different but gradually fell into alignment. We observed a hierarchical gradient: sensory cortices aligned most quickly, followed by mid-level regions, while some higher-order cortical regions took more than 10 seconds to align. What computations explain this hierarchical temporal organization? Linear integration models predict that regions that are slower to integrate new information should also be slower to forget old information. However, we found that higher-order regions could rapidly forget prior context. The data from the cortical hierarchy were instead captured by a model in which each region maintains a temporal context representation that is nonlinearly integrated with input at each moment, and this integration is gated by local prediction error.

Atypical intrinsic neural timescale in autism

How long neural information is stored in a local brain area reflects functions of that region and is often estimated by the magnitude of the autocorrelation of intrinsic neural signals in the area. Here, we investigated such intrinsic neural timescales in high-functioning adults with autism and examined whether local brain dynamics reflected their atypical behaviours. By analysing resting-state fMRI data, we identified shorter neural timescales in the sensory/visual cortices and a longer timescale in the right caudate in autism. The shorter intrinsic timescales in the sensory/visual areas were correlated with the severity of autism, whereas the longer timescale in the caudate was associated with cognitive rigidity. These observations were confirmed from neurodevelopmental perspectives and replicated in two independent cross-sectional datasets. Moreover, the intrinsic timescale was correlated with local grey matter volume. This study shows that functional and structural atypicality in local brain areas is linked to higher-order cognitive symptoms in autism.

Autism is a brain disorder that affects how people interact with others. It occupies a spectrum, with severe autism at one end and high-functioning autism at the other. People with severe autism usually have intellectual impairments and little spoken language. Those with high-functioning autism have average or above average IQ, but struggle with more subtle aspects of communication, such as body language. As well as social difficulties, many individuals with autism show repetitive behaviors and have narrow interests.

The brains of people with autism process information differently to those of people without autism. The brain as a whole shows less coordinated activity in autism, for example. But whether individual brain regions themselves also work differently in autism is unclear. Watanabe et al. set out to answer this question by using a brain scanner to compare the resting brain activity of high-functioning people with autism to that of people without autism.

In both groups, networks of brain regions increased and decreased their activity in predictable patterns. But in individuals with autism, sensory areas of the brain showed more random activity than in individuals without autism. The most random activity occurred in those with the most severe autism. This suggests that the brains of people with autism cannot hold onto and process sensory input for as long as those of neurotypical people. By contrast, a brain region called the caudate showed the opposite pattern, being more predictable in individuals with autism. The most predictable caudate activity occurred in those individuals with the most inflexible, repetitive behaviors. These differences in this neural randomness appear to result from changes in the structure of the individual brain regions.

The findings of Watanabe et al. suggest that changes in the structure and activity of small brain regions give rise to complex symptoms in autism. If these differences also exist in young children, they could help doctors diagnose autism earlier. Future studies should investigate whether the differences in brain activity cause the symptoms of autism. If so, it may be possible to treat the symptoms by changing brain activity, for example, by applying magnetic stimulation to the scalp.