Hierarchical process memory: memory as an integral component of information processing

Time-dependent scale-free brain dynamics during naturalistic inputs

Environmental processes, such as auditory and visual inputs, often follow power-law distributions with a time-dependent and constantly changing spectral exponent, β(t). However, it remains unclear how the brain's scale-free dynamics continuously respond to naturalistic inputs, such as by potentially alternating instead of static levels of the spectral exponent. Our fMRI study investigates the brain's dynamic, time-dependent spectral exponent, β(t), during movie-watching, and uses time-varying inter-subject correlation, ISC(t), to assess the extent to which input dynamics are reflected as shared brain activity across subjects in early sensory regions. Notably, we investigate the level of ISC particularly based on the modulation by time-dependent scale-free dynamics or β(t). We obtained three key findings: First, the brain's β(t) showed a distinct temporal structure in visual and auditory regions during naturalistic inputs compared to the resting-state, investigated in the 7 Tesla Human Connectome Project dataset. Second, β(t) and ISC(t) were positively correlated during naturalistic inputs. Third, grouping subjects based on the Rest-to-Movie standard deviation change of the time-dependent spectral exponent β(t) revealed that the brain's relative shift from intrinsic to stimulus-driven scale-free dynamics modulates the level of shared brain activity, or ISC(t), and thus the imprinting of inputs on brain activity. This modulation was further supported by the observation that the two groups displayed significantly different β(t)-ISC(t) correlations, where the group with a higher mean of ISC(t) during inputs also exhibited a higher β(t)-ISC(t) correlation in visual and auditory regions. In summary, our fMRI study underscores a positive relationship between time-dependent scale-free dynamics and ISC, where higher spectral exponents correspond to higher degrees of shared brain activity during ongoing audiovisual inputs.

Bridging the gap of brain and experience - Converging Neurophenomenology with Spatiotemporal Neuroscience

Neuroscience faces the challenge of connecting brain and mind, with the mind manifesting in first-person experience while the brain's neural activity can only be investigated in third-person perspective. To connect neural and mental states, Neurophenomenology provides a methodological toolkit for systematically linking first-person subjective experience with third-person objective observations of the brain's neural activity. However, beyond providing a systematic methodological strategy ('disciplined circularity'), it leaves open how neural activity and subjective experience are related among themselves, independent of our methodological strategy. The recently introduced Spatiotemporal Neuroscience suggests that neural activity and subjective experience share a commonly underlying feature as their "common currency", notably analogous spatiotemporal dynamics. Can Spatiotemporal Neuroscience inform Neurophenomenology to allow for a deeper and more substantiative connection of first-person experience and third-person neural activity? The goal of our paper is to show how Spatiotemporal Neuroscience and Neurophenomenology can be converged and integrated with each other to gain better understanding of the brain-mind connection. We describe their convergence on theoretical grounds which, subsequently, is illustrated by empirical examples like self, meditation, and depression. In conclusion, we propose that the integration of Neurophenomenology and Spatiotemporal Neuroscience can provide complementary insights, enrich both fields, allows for deeper understanding of brain-mind connection, and opens the door for developing novel methodological approaches in their empirical investigation.

Inferring neural population codes for Drosophila acoustic communication

Social communication between animals is often mediated by sequences of acoustic signals, sometimes spanning long timescales. How auditory neural circuits respond to extended input sequences to guide behavior is not understood. We address this problem using Drosophila acoustic communication, a behavior involving the male's production of and female's response to long, highly variable courtship songs. Here we ask whether female neural and behavioral responses to song are better described by a linear-nonlinear feature detection model vs. a nonlinear accumulation model. Comparing both models against head-fixed neural recordings and pure-behavioral recordings of unrestrained courtship, we found that while both models could explain the neural data, the accumulation model better predicted female locomotion during courtship, outperforming several alternative predictors. To understand how the accumulation model encoded song to predict locomotion, we analyzed the relationship between neural activity simulated by the model and female locomotion during courtship-this revealed the model's reliance on heterogeneous nonlinear adaptation and slow integration. Finally, we asked how adaptation and integration processes could cooperate across the model neural population to encode temporal patterns in song. Simulations revealed how adaptation can transform song inputs prior to integration, allowing fine-scale song information to be retained in the population code for long periods. Thus, modeling fly auditory responses as a nonlinearly adaptive, accumulating population code accounts for female locomotor responses to song during courtship and suggests a biologically plausible mechanism for the online encoding of extended communication sequences.

Event cache: An independent component in working memory

Working memory (WM) has been a major focus of cognitive science and neuroscience for the past 50 years. While most WM research has centered on the mechanisms of objects, there has been a lack of investigation into the cognitive and neural mechanisms of events, which are the building blocks of our experience. Using confirmatory factor analysis, psychophysical experiments, and resting-state and task functional magnetic resonance imaging methods, our study demonstrated that events have an independent storage space within WM, named as event cache, with distinct neural correlates compared to object storage in WM. We found the cerebellar network to be the most essential network for event cache, with the left cerebellum Crus I being particularly involved in encoding and maintaining events. Our findings shed critical light on the neuropsychological mechanism of WM by revealing event cache as an independent component of WM and encourage the reconsideration of theoretical models for WM.

Selective control of prefrontal neural timescales by parietal cortex

Intrinsic neural timescales quantify how long spontaneous neuronal activity patterns persist, reflecting dynamics of endogenous fluctuations. We measured intrinsic timescales of frontal eye field (FEF) neurons and examined their changes during posterior parietal cortex (PPC) inactivation. We observed two distinct classes of FEF neurons based on their intrinsic timescales: short-timescale neurons (∼25 ms) or long-timescale neurons (∼100 ms). Short-timescale neurons showed stronger transient visual responses, suggesting their role in rapid visual processing, whereas long-timescale neurons exhibited pronounced sustained attentional modulation, suggesting their role in maintaining stimulus-driven attention. During PPC inactivation, intrinsic timescales increased in both neuron types, with a significantly larger effect in short-timescale neurons. In addition, PPC inactivation reduced attentional modulation, particularly in long-timescale neurons. Our findings provide the first causal evidence linking intrinsic local neural timescales to long-range inter-area communications. These findings also suggest the presence of at least two distinct network motifs that support different neuronal dynamics and functional computations within the FEF.

A unified acoustic-to-speech-to-language embedding space captures the neural basis of natural language processing in everyday conversations

This study introduces a unified computational framework connecting acoustic, speech and word-level linguistic structures to study the neural basis of everyday conversations in the human brain. We used electrocorticography to record neural signals across 100 h of speech production and comprehension as participants engaged in open-ended real-life conversations. We extracted low-level acoustic, mid-level speech and contextual word embeddings from a multimodal speech-to-text model (Whisper). We developed encoding models that linearly map these embeddings onto brain activity during speech production and comprehension. Remarkably, this model accurately predicts neural activity at each level of the language processing hierarchy across hours of new conversations not used in training the model. The internal processing hierarchy in the model is aligned with the cortical hierarchy for speech and language processing, where sensory and motor regions better align with the model's speech embeddings, and higher-level language areas better align with the model's language embeddings. The Whisper model captures the temporal sequence of language-to-speech encoding before word articulation (speech production) and speech-to-language encoding post articulation (speech comprehension). The embeddings learned by this model outperform symbolic models in capturing neural activity supporting natural speech and language. These findings support a paradigm shift towards unified computational models that capture the entire processing hierarchy for speech comprehension and production in real-world conversations.

Embedding emotion concepts in cognitive maps

Emotion knowledge is organized in a two-dimensional space known as the affective circumplex, which is thought to develop from core affective feelings and the co-occurrence of emotional events. Neural studies reveal that emotion concepts and cognitive maps of space and abstract concepts are represented in hippocampal-prefrontal systems. We propose that the circumplex is formed by learning the transitions between emotion concepts, a process mediated by a reciprocal network involving hippocampal cells that encode emotion concepts and grid cells in medial entorhinal and ventral prefrontal cortices that encode the relations between them. We anticipate that testing this hypothesis will shed light on the debate about whether emotions are biologically basic or constructed from core affective dimensions.

On the origin of memory neurons in the human hippocampus

The hippocampus is essential for episodic memory, yet its coding mechanism remains debated. In humans, two main theories have been proposed: one suggests that concept neurons represent specific elements of an episode, while another posits a conjunctive code, where index neurons code the entire episode. Here, we integrate new findings of index neurons in humans and other animals with the concept-specific memory framework, proposing that concept neurons evolve from index neurons through overlapping memories. This process is supported by engram literature, which posits that neurons are allocated to a memory trace based on excitability and that reactivation induces excitability. By integrating these insights, we connect two historically disparate fields of neuroscience: engram research and human single neuron episodic memory research.

Disentangling sources of variability in decision-making

Even the most highly-trained observers presented with identical choice-relevant stimuli will reliably exhibit substantial trial-to-trial variability in the timing and accuracy of their choices. Despite being a pervasive feature of choice behaviour and a prominent phenotype for numerous clinical disorders, the capability to disentangle the sources of such intra-individual variability (IIV) remains limited. In principle, computational models of decision-making offer a means of parsing and estimating these sources, but methodological limitations have prevented this potential from being fully realized in practice. In this Review, we first discuss current limitations of algorithmic models for understanding variability in decision-making behaviour. We then highlight recent advances in behavioural paradigm design, novel analyses of cross-trial behavioural and neural dynamics, and the development of neurally grounded computational models that are now making it possible to link distinct components of IIV to well-defined neural processes. Taken together, we demonstrate how these methods are opening up new avenues for systematically analysing the neural origins of IIV, paving the way for a more refined, holistic understanding of decision-making in health and disease.

The cortical architecture representing the linguistic hierarchy of the conversational speech

Recent studies demonstrate that the brain parses natural language into smaller units represented in lower-order regions and larger units in higher-order regions. Most of these studies, however, have been conducted on unidirectional narrative speech, leaving the linguistic hierarchy and its cortical representation in bidirectional conversational speech unexplored. To address this gap, we simultaneously measured brain activity from two individuals using functional near-infrared spectroscopy (fNIRS) hyperscanning while they engaged in a naturalistic conversation. Using a Pre-trained Language Model (PLM) and Representational Similarity Analysis (RSA), we demonstrated that conversational speech, jointly produced by two interlocutors in a turn-taking manner, exhibits a linguistic hierarchy, characterized by a boundary effect between linguistic units and an incremental context effect. Furthermore, a gradient pattern of shared cortical representation of the linguistic hierarchy was identified at the dyadic rather than the individual level. Interpersonal neural synchronization (INS) in the left superior temporal cortex was associated with turn representation, whereas INS in the medial prefrontal cortex was linked to topic representation. These findings further validated the distinctiveness of linguistic units of different sizes. Together, our results provide original evidence for the linguistic hierarchy and the underlying cortical architecture during a naturalistic conversation, extending the hierarchical nature of natural language from unidirectional narrative speech to bidirectional conversational speech.

Context modulates brain state dynamics and behavioral responses during narrative comprehension

Narrative comprehension is inherently context-sensitive, yet the brain and cognitive mechanisms by which brief contextual priming shapes story interpretation remain unclear. Using hidden Markov modeling (HMM) of fMRI data, we identified dynamic brain states as participants listened to an ambiguous spoken story under two distinct narrative contexts (affair vs. paranoia). We uncovered both context-invariant states-engaging auditory, language, and default mode networks-and context-specific states characterized by differential recruitment of control, salience, and visual networks. Narrative context selectively modulated the influence of character speech and linguistic features on brain state expression, with the central character's speech enhancing activation in shared states but suppressing activation in context-specific ones. Independent behavioral analyses revealed parallel context-dependent effects, with character-driven features exerting strong, selectively modulated influences on participants' judgments of narrative evidence. These findings demonstrate that brief narrative priming actively reshapes brain state dynamics and feature sensitivity during story comprehension, revealing how context guides moment-by-moment interpretive processing in naturalistic settings.

Default mode network tau predicts future clinical decline in atypical early Alzheimer's disease

Identifying individuals with early-stage Alzheimer's disease (AD) at greater risk of steeper clinical decline would enable better-informed medical, support and life planning decisions. Despite accumulating evidence on the clinical prognostic value of tau PET in typical late-onset amnestic AD, its utility in predicting clinical decline in individuals with atypical forms of AD remains unclear. Across heterogeneous clinical phenotypes, patients with atypical AD consistently exhibit abnormal tau accumulation in the posterior nodes of the default mode network of the cerebral cortex. This evidence suggests that tau burden in this functional network could be a common imaging biomarker for prognostication across the syndromic spectrum of AD. Here, we examined the relationship between baseline tau PET signal and the rate of subsequent clinical decline in a sample of 48 A+/T+/N+ patients with mild cognitive impairment or mild dementia due to AD with atypical clinical phenotypes: Posterior Cortical Atrophy (n = 16); logopenic variant Primary Progressive Aphasia (n = 15); and amnestic syndrome with multi-domain impairment and young age of onset < 65 years (n = 17). All patients underwent MRI, tau PET and amyloid PET scans at baseline. Each patient's longitudinal clinical decline was assessed by calculating the annualized change in the Clinical Dementia Rating Sum-of-Boxes (CDR-SB) scores from baseline to follow-up (mean time interval = 14.55 ± 3.97 months). Atypical early AD patients showed an increase in CDR-SB by 1.18 ± 1.25 points per year: t(47) = 6.56, P < 0.001, Cohen's d = 0.95. Across clinical phenotypes, baseline tau in the default mode network was the strongest predictor of clinical decline (R2 = 0.30), outperforming a simpler model with baseline clinical impairment and demographic variables (R2 = 0.10), tau in other functional networks (R2 = 0.11-0.26) and the magnitude of cortical atrophy (R2 = 0.20) and amyloid burden (R2 = 0.09) in the default mode network. Overall, these findings point to the contribution of default mode network tau to predicting the magnitude of clinical decline in atypical early AD patients 1 year later. This simple measure could aid the development of a personalized prognostic, monitoring and treatment plan, which would help clinicians not only predict the natural evolution of the disease but also estimate the effect of disease-modifying therapies on slowing subsequent clinical decline given the patient's tau burden while still early in the disease course.

Memory updating and the structure of event representations

People form memories of specific events and use those memories to make predictions about similar new experiences. Living in a dynamic environment presents a challenge: How does one represent valid prior events in memory while encoding new experiences when things change? There is evidence for two seemingly contradictory classes of mechanism: One differentiates outdated event features by making them less similar or less accessible than updated event features. The other integrates updated features of new events with outdated memories, and the relationship between them, into a structured representation. Integrative encoding may occur when changed events trigger inaccurate predictions based on remembered prior events. We propose that this promotes subsequent recollection of events and their order, enabling adaptation to environmental changes.

Medium Spiny Neurons Mediate Timing Perception in Coordination with Prefrontal Neurons in Primates

Timing perception is a fundamental cognitive function that allows organisms to navigate their environment effectively, encompassing both prospective and retrospective timing. Despite significant advancements in understanding how the brain processes temporal information, the neural mechanisms underlying these two forms of timing remain largely unexplored. In this study, it aims to bridge this knowledge gap by elucidating the functional roles of various neuronal populations in the striatum and prefrontal cortex (PFC) in shaping subjective experiences of time. Utilizing a large-scale electrode array, it recorded responses from over 3000 neurons in the striatum and PFC of macaque monkeys during timing tasks. The analysis classified neurons into distinct groups and revealed that retrospective and prospective timings are governed by separate neural processes. Specifically, this study demonstrates that medium spiny neurons (MSNs) in the striatum play a crucial role in facilitating these timing processes. Through cell-type-specific manipulation, it identified D2-MSNs as the primary contributors to both forms of timing. Additionally, the findings indicate that effective processing of timing requires coordination between the PFC and the striatum. In summary, this study advances the understanding of the neural foundations of timing perception and highlights its behavioral implications.

Temporal patterns in the complexity of child-directed song lyrics reflect their functions

Content produced for young audiences is structured to present opportunities for learning and social interactions. This research examines multi-scale temporal changes in predictability in Child-directed songs. We developed a technique based on Kolmogorov complexity to quantify the rate of change of textual information content over time. This method was applied to a corpus of 922 English, Spanish, and French publicly available child and adult-directed texts. Child-directed song lyrics (CDSongs) showed overall lower complexity compared to Adult-directed songs (ADsongs), and lower complexity was associated with a higher number of YouTube views. CDSongs showed a relatively higher information rate at the beginning and end compared to ADSongs. CDSongs and ADSongs showed a non-uniform information rate, but these periodic oscillatory patterns were more predictable in CDSongs compared to ADSongs. These findings suggest that the optimal balance between predictability and expressivity in information content differs between child- and adult-directed content, but also changes over timescales to potentially support multiple children's needs.

Comprehensive profiling of anaesthetised brain dynamics across phylogeny

The intrinsic dynamics of neuronal circuits shape information processing and cognitive function. Combining non-invasive neuroimaging with anaesthetic-induced suppression of information processing provides a unique opportunity to understand how local dynamics mediate the link between neurobiology and the organism's functional repertoire. To address this question, we compile a unique dataset of multi-scale neural activity during wakefulness and anesthesia encompassing human, macaque, marmoset, mouse and nematode. We then apply massive feature extraction to comprehensively characterize local neural dynamics across > 6 000 time-series features. Using dynamics as a common space for comparison across species, we identify a phylogenetically conserved dynamical profile of anaesthesia that encompasses multiple features, including reductions in intrinsic timescales. This dynamical signature has an evolutionarily conserved spatial layout, covarying with transcriptional profiles of excitatory and inhibitory neurotransmission across human, macaque and mouse cortex. At the network level, anesthetic-induced changes in local dynamics manifest as reductions in inter-regional synchrony. This relationship between local dynamics and global connectivity can be recapitulated in silico using a connectome-based computational model. Finally, this dynamical regime of anaesthesia is experimentally reversed in vivo by deep-brain stimulation of the centromedian thalamus in the macaque, resulting in restored arousal and behavioural responsiveness. Altogether, comprehensive dynamical phenotyping reveals that spatiotemporal isolation of local neural activity during anesthesia is conserved across species and anesthetics.

Uncovering a Timescale Hierarchy by Studying the Brain in a Natural Context

As we train multiple generations of students to narrowly design clever, carefully controlled experiments in our confined lab spaces, we may fail to notice, as a field, that we have overlooked fundamental aspects of human cognition. This is a first-person account of how our research and understanding of the neural code were forever transformed when we decided to open the lab's door to the natural world. This journey started with the decision to shift from controlled stimuli to natural dynamic and "messy" stimuli. This transition enabled us to focus on how information is accumulated and processed over time. As a result, we have discovered a new topographic mapping of the hierarchy of cortical processing timescales. I will conclude with a general observation of the paradigm shift occurring in the field as it increasingly emphasizes the study of the neural processes that underlie human behavior in natural, everyday contexts. I am excited to share this journey with you.

Local Differences in Network Organization in the Auditory and Parietal Cortex, Revealed with Single Neuron Activation

The structure of local circuits is highly conserved across the cortex, yet the spatial and temporal properties of population activity differ fundamentally in sensory-level and association-level areas. In the sensory cortex, population activity has a shorter timescale and decays sharply over distance, supporting a population code for the fine-scale features of sensory stimuli. In the association cortex, population activity has a longer timescale and spreads over wider distances, a code that is suited to holding information in memory and driving behavior. We tested whether these differences in activity dynamics could be explained by differences in network structure. We targeted photostimulations to single excitatory neurons of layer 2/3, while monitoring surrounding population activity using two-photon calcium imaging. Experiments were performed in the auditory (AC) and posterior parietal cortex (PPC) within the same mice of both sexes, which also expressed a red fluorophore in somatostatin-expressing interneurons (SOM). In both cortical regions, photostimulations resulted in a spatially restricted zone of positive influence on neurons closely neighboring the targeted neuron and a more spatially diffuse zone of negative influence affecting more distant neurons (akin to a network-level "suppressive surround"). However, the relative spatial extents of positive and negative influence were different in AC and PPC. In PPC, the central zone of positive influence was wider, but the negative suppressive surround was more narrow than in AC, which could account for the larger-scale network dynamics in PPC. The more narrow central positive influence zone and wider suppressive surround in AC could serve to sharpen sensory representations.

Connecting brain and mind through temporo-spatial dynamics: Towards a theory of common currency

Despite major progress in our understanding of the brain, the connection of neural and mental features, that is, brain and mind, remains yet elusive. In our 2020 target paper ("Is temporospatial dynamics the 'common currency' of brain and mind? Spatiotemporal Neuroscience") we proposed the "Common currency hypothesis": temporo-spatial dynamics are shared by neural and mental features, providing their connection. The current paper aims to further support and extend the original description of such common currency into a first outline of a "Common currency theory" (CCT) of neuro-mental relationship. First, we extend the range of examples to thoughts, meditation, depression and attention all lending support that temporal characteristics, (i.e. dynamics) are shared by both neural and mental features. Second, we now also show empirical examples of how spatial characteristics, i.e., topography, are shared by neural and mental features; this is illustrated by topographic reorganization of both neural and mental states in depression and meditation. Third, considering the neuro-mental connection in theoretical terms, we specify their relationship by distinct forms of temporospatial correspondences, ranging on a continuum from simple to complex. In conclusion, we extend our initial hypothesis about the key role of temporo-spatial dynamics in neuro-mental relationship into a first outline of an integrated mind-brain theory, the "Common currency theory" (CCT).

Schemas, reinforcement learning and the medial prefrontal cortex

Schemas are rich and complex knowledge structures about the typical unfolding of events in a context; for example, a schema of a dinner at a restaurant. In this Perspective, we suggest that reinforcement learning (RL), a computational theory of learning the structure of the world and relevant goal-oriented behaviour, underlies schema learning. We synthesize literature about schemas and RL to offer that three RL principles might govern the learning of schemas: learning via prediction errors, constructing hierarchical knowledge using hierarchical RL, and dimensionality reduction through learning a simplified and abstract representation of the world. We then suggest that the orbitomedial prefrontal cortex is involved in both schemas and RL due to its involvement in dimensionality reduction and in guiding memory reactivation through interactions with posterior brain regions. Last, we hypothesize that the amount of dimensionality reduction might underlie gradients of involvement along the ventral-dorsal and posterior-anterior axes of the orbitomedial prefrontal cortex. More specific and detailed representations might engage the ventral and posterior parts, whereas abstraction might shift representations towards the dorsal and anterior parts of the medial prefrontal cortex.

Stimulus Selection Influences Prediction of Individual Phenotypes in Naturalistic Conditions

While the use of naturalistic stimuli such as movie clips for understanding individual differences and brain-behaviour relationships attracts increasing interest, the influence of stimulus selection remains largely unclear. By using machine learning to predict individual traits (phenotypes) from brain activity evoked during various movie clips, we show that different movie stimuli can result in distinct prediction performances. In brain regions related to lower-level processing of the stimulus, prediction to a certain degree benefits from stronger synchronisation of brain activity across subjects. By contrast, better predictions in frontoparietal brain regions are mainly associated with larger inter-subject variability. Furthermore, we demonstrate that while movie clips with rich social content in general achieve better predictions, the importance of specific movie features for prediction highly depends on the phenotype under investigation. Overall, our findings underscore the importance of careful stimulus selection and provide novel insights into stimulus selection for phenotype prediction in naturalistic conditions, opening new avenues for future research.

Individual differences in wellbeing are supported by separable sets of co-active self- and visual-attention-related brain networks

How does the brain support 'wellbeing'? Because it is a multidimensional construct, it is likely the product of multiple co-active brain networks that vary across individuals. This is perhaps why prior neuroimaging studies have found inconsistent anatomical associations with wellbeing. Furthermore, these used 'laboratory-style' or 'resting-state' methods not amenable to finding manifold networks. To address these issues, we had participants watch a full-length romantic comedy-drama film during functional magnetic resonance imaging. We hypothesised that individual differences in wellbeing measured before scanning would be correlated with individual differences in brain networks associated with 'embodied' and 'narrative' self-related processing. Indeed, searchlight spatial inter-participant representational similarity and subsequent analyses revealed seven sets of co-activated networks associated with individual differences in wellbeing. Two were 'embodied self' related, including brain regions associated with autonomic and affective processing. Three sets were 'narrative self' related, involving speech, language, and autobiographical memory-related regions. Finally, two sets of visual-attention-related networks emerged. These results suggest that the neurobiology of wellbeing in the real world is supported by diverse but functionally definable and separable sets of networks. This has implications for psychotherapy where individualised interventions might target, e.g., neuroplasticity in language-related narrative over embodied self or visual-attentional related processes.

Mapping and modeling age-related changes in intrinsic neural timescales

Intrinsic timescales of brain regions exhibit heterogeneity, escalating with hierarchical levels, and are crucial for the temporal integration of external stimuli. Aging, often associated with cognitive decline, involves progressive neuronal and synaptic loss, reshaping brain structure and dynamics. However, the impact of these structural changes on temporal coding in the aging brain remains unclear. We mapped intrinsic timescales and gray matter volume (GMV) using magnetic resonance imaging (MRI) in young and elderly adults. We found shorter intrinsic timescales across multiple large-scale functional networks in the elderly cohort, and a significant positive association between intrinsic timescales and GMV. Additionally, age-related decline in performance on visual discrimination tasks was linked to a reduction in intrinsic timescales in the cuneus. To explain these age-related shifts, we developed an age-dependent spiking neuron network model. In younger subjects, brain regions were near a critical branching regime, while regions in elderly subjects had fewer neurons and synapses, pushing the dynamics toward a subcritical regime. The model accurately reproduced the empirical results, showing longer intrinsic timescales in young adults due to critical slowing down. Our findings reveal how age-related structural brain changes may drive alterations in brain dynamics, offering testable predictions and informing possible interventions targeting cognitive decline.

Foraging and inertia: Understanding the developmental dynamics of overt visual attention

During early life, we develop the ability to choose what we focus on and what we ignore, allowing us to regulate perception and action in complex environments. But how does this change influence how we spontaneously allocate attention to real-world objects during free behaviour? Here, in this narrative review, we examine this question by considering the time dynamics of spontaneous overt visual attention, and how these develop through early life. Even in early childhood, visual attention shifts occur both periodically and aperiodically. These reorientations become more internally controlled as development progresses. Increasingly with age, attention states also develop self-sustaining attractor dynamics, known as attention inertia, in which the longer an attention episode lasts, the more the likelihood increases of its continuing. These self-sustaining dynamics are driven by amplificatory interactions between engagement, comprehension, and distractibility. We consider why experimental measures show decline in sustained attention over time, while real-world visual attention often demonstrates the opposite pattern. Finally, we discuss multi-stable attention states, where both hypo-arousal (mind-wandering) and hyper-arousal (fragmentary attention) may also show self-sustaining attractor dynamics driven by moment-by-moment amplificatory child-environment interactions; and we consider possible applications of this work, and future directions.

Two-dimensional neural geometry underpins hierarchical organization of sequence in human working memory

Working memory (WM) is constructive in nature. Instead of passively retaining information, WM reorganizes complex sequences into hierarchically embedded chunks to overcome capacity limits and facilitate flexible behaviour. Here, to investigate the neural mechanisms underlying hierarchical reorganization in WM, we performed two electroencephalography and one magnetoencephalography experiments, wherein humans retain in WM a temporal sequence of items, that is, syllables, which are organized into chunks, that is, multisyllabic words. We demonstrate that the one-dimensional sequence is represented by two-dimensional neural representational geometry in WM arising from left prefrontal and temporoparietal regions, with separate dimensions encoding item position within a chunk and chunk position in the sequence. Critically, this two-dimensional geometry is observed consistently in different experimental settings, even during tasks not encouraging hierarchical reorganization in WM and correlates with WM behaviour. Overall, these findings strongly support that complex sequences are reorganized into factorized multidimensional neural representational geometry in WM, which also speaks to general structure-based organizational principles given WM's involvement in many cognitive functions.

Uncovering narrative aging: an underlying neural mechanism compensated through spatial constructional ability

"The narrative" is a complex cognitive process that has sparked a debate on whether its features age through maintenance or decline. To address this question, we attempted to uncover the narrative aging and its underlying neural characteristics with a cross-validation based cognitive neuro-decoding statistical framework. This framework used a total of 740 healthy older participants with completed narrative and extensive neuropsychological tests and MRI scans. The results indicated that narrative comprises macro and micro structures, with the macrostructure involving complex cognitive processes more relevant to aging. For the brain functional basis, brain hub nodes contributing to macrostructure were predominantly found in the angular gyrus and medial frontal lobe, while microstructure hub nodes were located in the supramarginal gyrus and middle cingulate cortex. Moreover, networks enriched by macrostructure included the default mode network and fronto-parietal network, indicating a higher functional gradient compared to the microstructure-enriched dorsal attention network. Additionally, an interesting finding showed that macrostructure increases in spatial contribution with age, suggesting a compensatory interaction where brain regions related to spatial-constructional ability have a greater impact on macrostructure. These results, supported by neural-level validation and multimodal structural MRI, provide detailed insights into the compensatory effect in the narrative aging process.

Tripartite organization of brain state dynamics underlying spoken narrative comprehension

Speech comprehension involves the dynamic interplay of multiple cognitive processes, from basic sound perception, to linguistic encoding, and finally to complex semantic-conceptual interpretations. How the brain handles the diverse streams of information processing remains poorly understood. Applying Hidden Markov Modeling to fMRI data obtained during spoken narrative comprehension, we reveal that the whole brain networks predominantly oscillate within a tripartite latent state space. These states are, respectively, characterized by high activities in the sensory-motor (State #1), bilateral temporal (State #2), and default mode networks (DMN; State #3) regions, with State #2 acting as a transitional hub. The three states are selectively modulated by the acoustic, word-level semantic, and clause-level semantic properties of the narrative. Moreover, the alignment with both the best performer and the group-mean in brain state expression can predict participants' narrative comprehension scores measured from the post-scan recall. These results are reproducible with different brain network atlas and generalizable to two datasets consisting of young and older adults. Our study suggests that the brain underlies narrative comprehension by switching through a tripartite state space, with each state probably dedicated to a specific component of language faculty, and effective narrative comprehension relies on engaging those states in a timely manner.

Oxidative and Excitatory Neurotoxic Stresses in CRISPR/Cas9-Induced Kynurenine Aminotransferase Knockout Mice: A Novel Model for Despair-Based Depression and Post-Traumatic Stress Disorder

BACKGROUNDS

Memory and emotion are especially vulnerable to psychiatric disorders such as post-traumatic stress disorder (PTSD), which is linked to disruptions in serotonin (5-HT) metabolism. Over 90% of the 5-HT precursor tryptophan (Trp) is metabolized via the Trp-kynurenine (KYN) metabolic pathway, which generates a variety of bioactive molecules. Dysregulation of KYN metabolism, particularly low levels of kynurenic acid (KYNA), appears to be linked to neuropsychiatric disorders. The majority of KYNA is produced by the aadat (kat2) gene-encoded mitochondrial kynurenine aminotransferase (KAT) isotype 2. Little is known about the consequences of deleting the KYN enzyme gene.

METHODS

In CRISPR/Cas9-induced aadat knockout (kat2-/-) mice, we examined the effects on emotion, memory, motor function, Trp and its metabolite levels, enzyme activities in the plasma and urine of 8-week-old males compared to wild-type mice.

RESULTS

Transgenic mice showed more depressive-like behaviors in the forced swim test, but not in the tail suspension, anxiety, or memory tests. They also had fewer center field and corner entries, shorter walking distances, and fewer jumping counts in the open field test. Plasma metabolite levels are generally consistent with those of urine: antioxidant KYNs, 5-hydroxyindoleacetic acid, and indole-3-acetic acid levels were lower; enzyme activities in KATs, kynureninase, and monoamine oxidase/aldehyde dehydrogenase were lower, but kynurenine 3-monooxygenase was higher; and oxidative stress and excitotoxicity indices were higher. Transgenic mice displayed depression-like behavior in a learned helplessness model, emotional indifference, and motor deficits, coupled with a decrease in KYNA, a shift of Trp metabolism toward the KYN-3-hydroxykynurenine pathway, and a partial decrease in the gut microbial Trp-indole pathway metabolite.

CONCLUSIONS

This is the first evidence that deleting the aadat gene induces depression-like behaviors uniquely linked to experiences of despair, which appear to be associated with excitatory neurotoxic and oxidative stresses. This may lead to the development of a double-hit preclinical model in despair-based depression, a better understanding of these complex conditions, and more effective therapeutic strategies by elucidating the relationship between Trp metabolism and PTSD pathogenesis.

Incremental accumulation of linguistic context in artificial and biological neural networks

Large Language Models (LLMs) have shown success in predicting neural signals associated with narrative processing, but their approach to integrating context over large timescales differs fundamentally from that of the human brain. In this study, we show how the brain, unlike LLMs that process large text windows in parallel, integrates short-term and long-term contextual information through an incremental mechanism. Using fMRI data from 219 participants listening to spoken narratives, we first demonstrate that LLMs predict brain activity effectively only when using short contextual windows of up to a few dozen words. Next, we introduce an alternative LLM-based incremental-context model that combines incoming short-term context with an aggregated, dynamically updated summary of prior context. This model significantly enhances the prediction of neural activity in higher-order regions involved in long-timescale processing. Our findings reveal how the brain's hierarchical temporal processing mechanisms enable the flexible integration of information over time, providing valuable insights for both cognitive neuroscience and AI development.

Coordinated representations for naturalistic memory encoding and retrieval in hippocampal neural subspaces

Our naturalistic experiences are organized into memories through multiple processes, including novelty encoding, memory formation, and retrieval. However, the neural mechanisms coordinating these processes remain elusive. Using fMRI data acquired during movie viewing and subsequent narrative recall, we examine hippocampal neural subspaces associated with distinct memory processes and characterized their relationships. We quantify novelty in character co-occurrences and the valence of relationships and estimate event memorability. Within the hippocampus, the novelty subspaces encoding each type exhibit partial overlap, and these overlapping novelty subspaces align with the subspace involved in memorability. Notably, following event boundaries, hippocampal states within these subspaces align inversely along a shared coding axis, predicting subsequent recall performance. This novelty-memorability alignment is selectively observed during encoding but not during retrieval. Finally, the identified functional subspaces reflect the intrinsic functional organization of the hippocampus. Our findings offer insights into how the hippocampus dynamically coordinates representations underlying memory encoding and retrieval at the population level to transform ongoing experiences into enduring memories.

Narrative 'twist' shifts within-individual neural representations of dissociable story features

Given the same external input, one's understanding of that input can differ based on internal contextual knowledge. Where and how does the brain represent latent belief frameworks that interact with incoming sensory information to shape subjective interpretations? In this study, participants listened to the same auditory narrative twice, with a plot twist in the middle that dramatically shifted their interpretations of the story. Using a robust within-subject whole-brain approach, we leveraged shifts in neural activity between the two listens to identify where latent interpretations are represented in the brain. We considered the narrative in terms of its hierarchical structure, examining how global situation models and their subcomponents-namely, episodes and characters-are represented, finding that they rely on partially distinct sets of brain regions. Results suggest that our brains represent narratives hierarchically, with individual narrative elements being distinct and dynamically updated as a part of changing interpretations of incoming information.

Aberrant neural event segmentation during a continuous social narrative in trauma-exposed older adolescents and young adults

Post-traumatic stress and major depressive disorders are associated with "overgeneral" autobiographical memory, or impaired recall of specific life events. Interpersonal trauma exposure, a risk factor for both conditions, may influence how symptomatic trauma-exposed (TE) individuals segment everyday events. The ability to parse experience into units (event segmentation) supports memory. Neural state transitions occur within a cortical hierarchy and play a key role in event segmentation, with regions like the occipital cortex, angular gyrus, and striatum involved in parsing event structure. We examined whether interpersonal trauma exposure was associated with alterations in the cortical hierarchy and striatal activity at neural state transitions in symptomatic TE versus healthy control (HC) individuals. Fifty older adolescents and young adults (29 TE, 21 HC) viewed the film "Partly Cloudy" during functional magnetic resonance imaging. A greedy-state boundary search algorithm assessed the optimal number of events, quality, and segmentation agreement of neural state transitions in the occipital cortex and angular gyrus. Striatal (nucleus accumbens, caudate, and putamen) activity was assessed at occipital and angular gyrus-evoked state transitions. Compared to HCs, TE participants displayed less occipital and greater angular gyrus-evoked optimal number of neural state transitions. TE participants also displayed lower quality of neural state segmentation solutions in occipital and angular cortices compared to HCs. Additionally, TE participants had less putamen activity at angular gyrus-evoked state transitions than HCs. This investigation provides neurobiological insights into aberrant event segmentation in symptomatic TE individuals, shedding light on mechanisms influencing overgeneral memory in trauma-related disorders.

A long look at Copley's A Boy with a Flying Squirrel: implications for the default mode network

What happens in the brain when a person spends three hours viewing a single painting? Geoffrey Schott examines the account of an art history professor who did just that, and considers what their observations reveal about the differences between seeing and looking, and between looking and perceiving.

Neural Correlates of Narrative Reading Development: A Comparative fMRI Study of Adults and Children Using Time-Locked Inter-Subject Correlation Analyses

The naturalistic paradigm and analytical methods present new approaches that are particularly suitable for research concentrating on narrative reading development. We analyzed fMRI data from 44 adults and 42 children engaged in story reading using time-locked inter-subject correlation (ISC), inter-subject representation similarity analysis (IS-RSA), and inter-subject functional correlation (ISFC). The ISC results indicated that for both children and adults, narrative reading recruited not only traditional reading areas but also regions that are sensitive to long-time-scale information, such as the medial prefrontal cortex and hippocampus, which increased involvement from children to adults. The results of the IS-RSA indicated that during narrative reading, children exhibited greater uniqueness in neural patterns, while adults demonstrated greater similarity. The analysis of reading-level subgroups with the ISC and ISFC reveals differences in narrative reading development that span from children to adults, especially for regions sensitive to long-time-scale semantic processing. These results indicate that the maturity and experience play a crucial role in narrative reading development.

Flexibility of intrinsic neural timescales during distinct behavioral states

Recent neuroimaging studies demonstrate a heterogeneity of timescales prevalent in the brain's ongoing spontaneous activity, labeled intrinsic neural timescales (INT). At the same time, neural timescales also reflect stimulus- or task-related activity. The relationship of the INT during the brain's spontaneous activity with their involvement in task states including behavior remains unclear. To address this question, we combined calcium imaging data of spontaneously behaving mice and human electroencephalography (EEG) during rest and task states with computational modeling. We obtained four primary findings: (i) the distinct behavioral states can be accurately predicted from INT, (ii) INT become longer during behavioral states compared to rest, (iii) INT change from rest to task is correlated negatively with the variability of INT during rest, (iv) neural mass modeling shows a key role of recurrent connections in mediating the rest-task change of INT. Extending current findings, our results show the dynamic nature of the brain's INT in reflecting continuous behavior through their flexible rest-task modulation possibly mediated by recurrent connections.

Decoding cortical chronotopy-Comparing the influence of different cortical organizational schemes

The brain's diverse intrinsic timescales enable us to perceive stimuli with varying temporal persistency. This study aimed to uncover the cortical organizational schemes underlying these variations, revealing the neural architecture for processing a wide range of sensory experiences. We collected resting-state fMRI, task-fMRI, and diffusion-weighted imaging data from 47 individuals. Based on this data, we extracted six organizational schemes: (1) the structural Rich Club (RC) architecture, shown to synchronize the connectome; (2) the structural Diverse Club architecture, as an alternative to the RC based on the network's module structure; (3) the functional uni-to-multimodal gradient, reflected in a wide range of structural and functional features; and (4) the spatial posterior/lateral-to-anterior/medial gradient, established for hierarchical levels of cognitive control. Also, we explored the effects of (5) structural graph theoretical measures of centrality and (6) cytoarchitectural differences. Using Bayesian model comparison, we contrasted the impact of these organizational schemes on (1) intrinsic resting-state timescales and (2) inter-subject correlation (ISC) from a task involving hierarchically nested digit sequences. As expected, resting-state timescales were slower in structural network hubs, hierarchically higher areas defined by the functional and spatial gradients, and thicker cortical regions. ISC analysis demonstrated hints for the engagement of higher cortical areas with more temporally persistent stimuli. Finally, the model comparison identified the uni-to-multimodal gradient as the best organizational scheme for explaining the chronotopy in both task and rest. Future research should explore the microarchitectural features that shape this gradient, elucidating how our brain adapts and evolves across different modes of processing.

Distinct patterns of connectivity with the motor cortex reflect different components of sensorimotor learning

Sensorimotor learning is supported by multiple competing processes that operate concurrently, making it a challenge to elucidate their neural underpinnings. Here, using human functional MRI, we identify 3 distinct axes of connectivity between the motor cortex and other brain regions during sensorimotor adaptation. These 3 axes uniquely correspond to subjects' degree of implicit learning, performance errors and explicit strategy use, and involve different brain networks situated at increasing levels of the cortical hierarchy. We test the generalizability of these neural axes to a separate form of motor learning known to rely mainly on explicit processes and show that it is only the Explicit neural axis, composed of higher-order areas in transmodal cortex, that predicts learning in this task. Together, our study uncovers multiple distinct patterns of functional connectivity with motor cortex during sensorimotor adaptation, the component processes that these patterns support, and how they generalize to other forms of motor learning.

How sturdy is your memory palace? Reliable room representations predict subsequent reinstatement of placed objects

Our autobiographical experiences typically occur within the context of familiar spatial locations. When we encode these experiences into memory, we can use our spatial map of the world to help organize these memories and later retrieve their episodic details. However, it is still not well understood what psychological and neural factors make spatial contexts an effective scaffold for storing and accessing memories. We hypothesized that spatial locations with distinctive and stable neural representations would best support the encoding and robust reinstatement of new episodic memories. We developed a novel paradigm that allowed us to quantify the within-participant reliability of a spatial context ("room reliability") prior to memory encoding, which could then be used to predict the degree of successful re-activation of item memories. To do this, we constructed a virtual reality (VR) "memory palace", a custom-built environment made up of 23 distinct rooms that participants explored using a head-mounted VR display. The day after learning the layout of the environment, participants underwent whole-brain fMRI while being presented with videos of the rooms in the memory palace, allowing us to measure the reliability of the neural activity pattern associated with each room. Participants were taken back to VR and asked to memorize the locations of 23 distinct objects randomly placed within each of the 23 rooms, and then returned to the scanner as they recalled the objects and the rooms in which they appeared. We found that our room reliability measure was predictive of object reinstatement across cortex, and further showed that this was driven not only by the group-level reliability of a room across participants, but also the idiosyncratic reliability of rooms within each participant. Together, these results showcase how the quality of the neural representation of a spatial context can be quantified and used to 'audit' its utility as a memory scaffold for future experiences.

Beyond the episodic-semantic continuum: the multidimensional model of mental representations

Tulving's concept of mental time travel (MTT), and the related distinction of episodic and semantic memory, have been highly influential contributions to memory research, resulting in a wealth of findings and a deeper understanding of the neurocognitive correlates of memory and future thinking. Many models have conceptualized episodic and semantic representations as existing on a continuum that can help to account for various hybrid forms. Nevertheless, in most theories, MTT remains distinctly associated with episodic representations. In this article, we review existing models of memory and future thinking, and critically evaluate whether episodic representations are distinct from other types of explicit representations, including whether MTT as a neurocognitive capacity is uniquely episodic. We conclude by proposing a new framework, the Multidimensional Model of Mental Representations (MMMR), which can parsimoniously account for the range of past, present and future representations the human mind is capable of creating. This article is part of the theme issue 'Elements of episodic memory: lessons from 40 years of research'.

The Relationship between Event Boundary Strength and Pattern Shifts across the Cortical Hierarchy during Naturalistic Movie-viewing

Our continuous experience is spontaneously segmented by the brain into discrete events. However, the beginning of a new event (an event boundary) is not always sharply identifiable: Phenomenologically, event boundaries vary in salience. How are the response profiles of cortical areas at event boundaries modulated by boundary strength during complex, naturalistic movie-viewing? Do cortical responses scale in a graded manner with boundary strength, or do they merely detect boundaries in a binary fashion? We measured "cortical boundary shifts" as transient changes in multivoxel patterns at event boundaries with different strengths (weak, moderate, and strong), determined by across-participant agreement. Cortical regions with different processing timescales were examined. In auditory areas, which have short timescales, cortical boundary shifts exhibited a clearly graded profile in both group-level and individual-level analyses. In cortical areas with long timescales, including the default mode network, boundary strength modulated pattern shift magnitude at the individual participant level. We also observed a positive relationship between boundary strength and the extent of temporal alignment of boundary shifts across different levels of the cortical hierarchy. In addition, hippocampal activity was highest at event boundaries for which cortical boundary shifts were most aligned across hierarchical levels. Overall, we found that event boundary strength modulated cortical pattern shifts strongly in sensory areas and more weakly in higher-level areas and that stronger boundaries were associated with greater alignment of these shifts across the cortical hierarchy.

Sequential syntactic knowledge supports item but not order recall in verbal working memory

Previous studies have shown that psycholinguistic effects such as lexico-semantic knowledge effects mainly determine item recall in verbal working memory (WM). However, we may expect that syntactic knowledge, involving knowledge about word-level sequential aspects of language, should also impact serial-order aspects of recall in WM. Evidence for this assumption is scarce and inconsistent and has been conducted in language with deterministic syntactic rules. In languages such as French, word position is determined in a probabilistic manner: an adjective is placed before or after a noun, depending on its lexico-semantic properties. We exploited this specificity of the French language for examining the impact of syntactic positional knowledge on both item and serial order recall in verbal WM. We presented lists with adjective-noun pairs for immediate serial recall, the adjectives being in regular or irregular position relative to the nouns. We observed increased recall performance when adjectives occurred in regular position; this effect was observed for item recall but not order recall scores. We propose an integration of verbal WM and syntactic processing models to account for this finding by assuming that the impact of syntactic knowledge on serial-order WM recall is indirect and mediated via syntax-dependent item-retrieval processes.

An Active-Inference Approach to Second-Person Neuroscience

Social neuroscience has often been criticized for approaching the investigation of the neural processes that enable social interaction and cognition from a passive, detached, third-person perspective, without involving any real-time social interaction. With the emergence of second-person neuroscience, investigators have uncovered the unique complexity of neural-activation patterns in actual, real-time interaction. Social cognition that occurs during social interaction is fundamentally different from that unfolding during social observation. However, it remains unclear how the neural correlates of social interaction are to be interpreted. Here, we leverage the active-inference framework to shed light on the mechanisms at play during social interaction in second-person neuroscience studies. Specifically, we show how counterfactually rich mutual predictions, real-time bodily adaptation, and policy selection explain activation in components of the default mode, salience, and frontoparietal networks of the brain, as well as in the basal ganglia. We further argue that these processes constitute the crucial neural processes that underwrite bona fide social interaction. By placing the experimental approach of second-person neuroscience on the theoretical foundation of the active-inference framework, we inform the field of social neuroscience about the mechanisms of real-life interactions. We thereby contribute to the theoretical foundations of empirical second-person neuroscience.

Rapid Learning of Temporal Dependencies at Multiple Timescales

Our environment contains temporal information unfolding simultaneously at multiple timescales. How do we learn and represent these dynamic and overlapping information streams? We investigated these processes in a statistical learning paradigm with simultaneous short and long timescale contingencies. Human participants (n = 96) played a game where they learned to quickly click on a target image when it appeared in one of nine locations, in eight different contexts. Across contexts, we manipulated the order of target locations: at a short timescale, the order of pairs of sequential locations in which the target appeared; at a longer timescale, the set of locations that appeared in the first versus the second half of the game. Participants periodically predicted the upcoming target location, and later performed similarity judgments comparing the games based on their order properties. Participants showed context-dependent sensitivity to order information at both short and long timescales, with evidence of stronger learning for short timescales. We modeled the learning paradigm using a gated recurrent network trained to make immediate predictions, which demonstrated multilevel learning timecourses and patterns of sensitivity to the similarity structure of the games that mirrored human participants. The model grouped games with matching rule structure and dissociated games based on low-level order information more so than high-level order information. The work shows how humans and models can rapidly and concurrently acquire order information at different timescales.

Recall as a Window into Hippocampally Defined Events

We experience the present as a continuous stream of information, but often experience the past in parcels of unique events or episodes. Decades of research have helped to articulate how we perform this event segmentation in the moment, as well as how events and their boundaries influence what we later remember. More recently, neuroscientific research has suggested that the hippocampus plays a role at critical moments during event formation alongside its established role in enabling subsequent recall. Here, we review and explore the relationship between event processing and recall with the perspective that it can be uniquely characterized by the contributions of the hippocampus and its interactions with the rest of the brain. Specifically, we highlight a growing number of empirical studies suggesting that the hippocampus is important for processing events that have just ended, bridging the gap between the prior and current event, and influencing the contents and trajectories of recalled information. We also catalogue and summarize the multifaceted sets of findings concerning how recall is influenced by event structure. Lastly, we discuss several exciting directions for future research and how our understanding of events might be enriched by characterizing them in terms of the operations of different regions of the brain.

Strategies for motion- and respiration-robust estimation of fMRI intrinsic neural timescales

Intrinsic neural timescales (INT) reflect the time window of neural integration within a brain region and can be measured via resting-state functional magnetic resonance imaging (rs-fMRI). Despite the potential relevance of INT to cognition, brain organization, and neuropsychiatric illness, the influences of physiological artifacts on rs-fMRI INT have not been systematically considered. Two artifacts, head motion and respiration, pose serious issues in rs-fMRI studies. Here, we described their impact on INT estimation and tested the ability of two denoising strategies for mitigating these artifacts, high-motion frame censoring and global signal regression (GSR). We used a subset of the Human Connectome Project Young Adult (HCP-YA) dataset with runs annotated for breathing patterns (Lynch et al., 2020) and at least one "clean" (reference) run that had minimal head motion and no respiration artifacts; other runs from the same participants ( n = 46 ) were labeled as "non-clean." We found that non-clean runs exhibited brain-wide increases in INT compared with their respective clean runs and that the magnitude of error in INT between non-clean and clean runs correlated with the amount of head motion. Importantly, effect sizes were comparable with INT effects reported in the clinical literature. GSR and high-motion frame censoring improved the similarity between INT maps from non-clean runs and their respective clean run. Using a pseudo-random frame-censoring approach, we uncovered a relationship between the number of censored frames and both the mean INT and mean error, suggesting that frame censoring itself biases INT estimation. A group-level correction procedure reduced this bias and improved similarity between non-clean runs and their respective clean run. Based on our findings, we offer recommendations for rs-fMRI INT studies, which include implementing GSR and high-motion frame censoring with Lomb-Scargle interpolation of censored frames, and performing group-level correction of the bias introduced by frame censoring.

The brain hierarchically represents the past and future during multistep anticipation

Memory for temporal structure enables both planning of future events and retrospection of past events. We investigated how the brain flexibly represents extended temporal sequences into the past and future during anticipation. Participants learned sequences of environments in immersive virtual reality. Pairs of sequences had the same environments in a different order, enabling context-specific learning. During fMRI, participants anticipated upcoming environments multiple steps into the future in a given sequence. Temporal structure was represented in the hippocampus and across higher-order visual regions (1) bidirectionally, with graded representations into the past and future and (2) hierarchically, with further events into the past and future represented in successively more anterior brain regions. In hippocampus, these bidirectional representations were context-specific, and suppression of far-away environments predicted response time costs in anticipation. Together, this work sheds light on how we flexibly represent sequential structure to enable planning over multiple timescales.

Top-down attention shifts behavioral and neural event boundaries in narratives with overlapping event scripts

Understanding and remembering the complex experiences of everyday life relies critically on prior schematic knowledge about how events in our world unfold over time. How does the brain construct event representations from a library of schematic scripts, and how does activating a specific script impact the way that events are segmented in time? We developed a novel set of 16 audio narratives, each of which combines one of four location-relevant event scripts (restaurant, airport, grocery store, and lecture hall) with one of four socially relevant event scripts (breakup, proposal, business deal, and meet cute), and presented them to participants in an fMRI study and a separate online study. Responses in the angular gyrus, parahippocampal gyrus, and subregions of the medial prefrontal cortex (mPFC) were driven by scripts related to both location and social information, showing that these regions can track schematic sequences from multiple domains. For some stories, participants were primed to attend to one of the two scripts by training them to listen for and remember specific script-relevant episodic details. Activating a location-related event script shifted the timing of subjective event boundaries to align with script-relevant changes in the narratives, and this behavioral shift was mirrored in the timing of neural responses, with mPFC event boundaries (identified using a hidden Markov model) aligning to location-relevant rather than socially relevant boundaries when participants were location primed. Our findings demonstrate that neural event dynamics are actively modulated by top-down goals and provide new insight into how narrative event representations are constructed through the activation of temporally structured prior knowledge.

Classifying disorders of consciousness using a novel dual-level and dual-modal graph learning model

BACKGROUND

Disorders of consciousness (DoC) are a group of conditions that affect the level of awareness and communication in patients. While neuroimaging techniques can provide useful information about the brain structure and function in these patients, most existing methods rely on a single modality for analysis and rarely account for brain injury. To address these limitations, we propose a novel method that integrates two neuroimaging modalities, functional magnetic resonance imaging (fMRI) and diffusion tensor imaging (DTI), to enhance the classification of subjects into different states of consciousness.

METHOD AND RESULTS

The main contributions of our work are threefold: first, after constructing a dual-model individual graph using functional magnetic resonance imaging (fMRI) and diffusion tensor imaging (DTI), we introduce a brain injury mask mechanism that consolidates damaged brain regions into a single graph node, enhancing the modeling of brain injuries and reducing deformation effects. Second, to address over-smoothing, we construct a dual-level graph that dynamically construct a population-level graph with node features from individual graphs, to promote the clustering of similar subjects while distinguishing dissimilar ones. Finally, we employ a subgraph exploration model with task-fMRI data to validate the interpretability of our model, confirming that the selected brain regions are task-relevant in cognition. Our experimental results on data from 89 healthy participants and 204 patients with DoC from Huashan Hospital, Fudan University, demonstrate that our method achieves high accuracy in classifying patients into unresponsive wakefulness syndrome (UWS), minimally conscious state (MCS), or normal conscious state, outperforming current state-of-the-art methods. The explainability results of our method identified a subset of brain regions that are important for consciousness, such as the default mode network, the salience network, the dorsal attention network, and the visual network. Our method also revealed the relationship between brain networks and language processing in consciousness, and showed that language-related subgraphs can distinguish MCS from UWS patients.

CONCLUSION

We proposed a novel graph learning method for classifying DoC based on fMRI and DTI data, introducing a brain injury mask mechanism to effectively handle damaged brains. The classification results demonstrate the effectiveness of our method in distinguishing subjects across different states of consciousness, while the explainability results identify key brain regions relevant to this classification. Our study provides new evidence for the role of brain networks and language processing in consciousness, with potential implications for improving the diagnosis and prognosis of patients with DoC.

How a speaker herds the audience: multibrain neural convergence over time during naturalistic storytelling

Storytelling-an ancient way for humans to share individual experiences with others-has been found to induce neural alignment among listeners. In exploring the dynamic fluctuations in listener-listener (LL) coupling throughout stories, we uncover a significant correlation between LL coupling and lagged speaker-listener (lag-SL) coupling over time. Using the analogy of neural pattern (dis)similarity as distances between participants, we term this phenomenon the "herding effect." Like a shepherd guiding a group of sheep, the more closely listeners mirror the speaker's preceding brain activity patterns (higher lag-SL similarity), the more tightly they cluster (higher LL similarity). This herding effect is particularly pronounced in brain regions where neural alignment among listeners tracks with moment-by-moment behavioral ratings of narrative content engagement. By integrating LL and SL neural coupling, this study reveals a dynamic, multibrain functional network between the speaker and the audience, with the unfolding narrative content playing a mediating role in network configuration.

Hierarchical neural processing in γ oscillations for syntactic and semantic operations accounts for first- and second-language epistemology

Introduction

We discuss event-related power differences (ERPDs) in low- and broadband-γ oscillations as the embedded-clause edge is processed in wh-dependencies such as Which decision regarding/about him/her did Paul say that Lydie rejected without hesitation? in first (L1) and second language (L2) French speakers.

Methods

The experimental conditions manipulated whether pronouns appeared in modifiers (Mods; regarding him/her) or in noun complements (Comps; about him/her) and whether they matched or mismatched a matrix-clause subject in gender.

Results

Across L1 and L2 speakers, we found that anaphora-linked ERPDs for Mods vs. Comps in evoked power first arose in low γ and then in broadband γ. Referential elements first seem to be retrieved from working memory by narrowband processes in low γ and then referential identification seems to be computed in broadband-γ output. Interactions between discourse- and syntax-based referential processes for the Mods vs. Comps in these ERPDs furthermore suggest that multidomain γ-band processing enables a range of elementary operations for discourse and semantic interpretation.

Discussion

We argue that a multidomain mechanism enabling operations conditioned by the syntactic and semantic nature of the elements processed interacts with local brain microcircuits representing features and feature sets that have been established in L1 or L2 acquisition, accounting for a single language epistemology across learning contexts.