Rapid adaptation of predictive models during language comprehension: Aperiodic EEG slope, individual alpha frequency and idea density modulate individual differences in real-time model updating

How predictability and individual alpha frequency shape memory: Insights from an event-related potential investigation

Prediction and memory are strongly intertwined, with predictions relying on memory retrieval, whilst also influencing memory encoding. However, it is unclear how predictability influences explicit memory performance, and how individual neural factors may modulate this relationship. The current study sought to investigate the effect of predictability on memory processing with an analysis of the N400 event-related potential in a context extending beyond language. Participants (N = 48, females = 33) completed a study-test paradigm where they first viewed predictable and unpredictable four-item 'ABCD' sequences of outdoor scene images, whilst their brain activity was recorded using electroencephalography. Subsequently, their memory for the images was tested, and N400 patterns during learning were compared with memory outcomes. Behavioural results revealed better memory for images in predictable sequences in contrast to unpredictable sequences. Memory was also strongest for predictable images in the 'B' position, suggesting that when processing longer sequences, the brain may prioritise the data deemed most informative. Strikingly, greater N400 amplitudes during learning were associated with enhanced memory at test for individuals with low versus high individual alpha frequencies. In light of the relationship between the N400 and stimulus predictability, this finding may imply that predictive processing differs between individuals to influence the extent of memory encoding. Finally, exploratory analyses provided evidence for a later positivity that was predictive of subsequent memory performance. Ultimately, the results highlight the complex and interconnected relationship between predictive processing and memory, whilst shedding light on the accumulation of predictions across longer sequences.

The development of aperiodic neural activity in the human brain

The neurophysiological mechanisms supporting brain maturation are fundamental to attention and memory capacity across the lifespan. Human brain regions develop at different rates, with many regions developing into the third and fourth decades of life. Here, in this preregistered study (https://osf.io/gsru7), we analyzed intracranial EEG (iEEG) recordings from widespread brain regions in a large developmental cohort. Using task-based (i.e., attention to-be-remembered visual stimuli) and task-free (resting-state) data from 101 children and adults (5.93 - 54.00 years, 63 males; n electrodes = 5691), we mapped aperiodic (1/ƒ-like) activity, a proxy of excitation:inhibition (E:I) balance with steeper slopes indexing inhibition and flatter slopes indexing excitation. We reveal that aperiodic slopes flatten with age into young adulthood in both association and sensorimotor cortices, challenging models of early sensorimotor development based on brain structure. In prefrontal cortex (PFC), attentional state modulated age effects, revealing steeper task-based than task-free slopes in adults and the opposite in children, consistent with the development of cognitive control. Age-related differences in task-based slopes also explained age-related gains in memory performance, linking the development of PFC cognitive control to the development of memory. Last, with additional structural imaging measures, we reveal that age-related differences in gray matter volume are differentially associated with aperiodic slopes in association and sensorimotor cortices. Our findings establish developmental trajectories of aperiodic activity in localized brain regions and illuminate the development of PFC inhibitory control during adolescence in the development of attention and memory.

Mindfulness Training in High-Demand Cohorts Alters Resting-State Electroencephalography: An Exploratory Investigation of Individual Alpha Frequency, Aperiodic 1/f Activity, and Microstates

Background

Mindfulness training (MT) programs have demonstrated utility as cognitive training tools, but there is little consensus on the neurophysiological processes that may underlie its benefits. It has been posited that intrinsic brain activity recorded at rest reflects the functional connectivity of large-scale brain networks and may provide insight into neuroplastic changes that support MT. In the current study, we indexed changes in several resting-state electroencephalography (EEG) parameters to investigate the neurophysiological underpinnings of MT.

Methods

Resting-state EEG data were collected from active-duty U.S. military personnel (N = 80) at 2 testing sessions: before (time [T] 1) and after (T2) engaging in an 8-week MT or active comparison intervention (positivity training). We examined longitudinal and/or groupwise differences in several EEG parameters through parameterization of power spectra (individual alpha frequency and 1/f activity) and microstate analysis.

Results

While no significant group × time differences were observed in individual alpha frequency, significant group × time effects were observed in several EEG parameters from T1 to T2. Compared with MT, positivity training was associated with a steepening of the 1/f slope and higher 1/f intercepts together with decreased duration and increased global field power of microstates.

Conclusions

Taken together, these results suggest that the effects of interventions may be differentiated in resting-state brain activity in a sample of military personnel. Such findings provide insight into the neural underpinnings of MT-related brain changes, but more research is required to elucidate how these may relate to task-related neural and performance changes with MT and whether results generalize to other mindfulness interventions in alternative cohorts and contexts.

Prior Context and Individual Alpha Frequency Influence Predictive Processing during Language Comprehension

The extent to which the brain predicts upcoming information during language processing remains controversial. To shed light on this debate, the present study reanalyzed Nieuwland and colleagues' (2018) [Nieuwland, M. S., Politzer-Ahles, S., Heyselaar, E., Segaert, K., Darley, E., Kazanina, N., et al. Large-scale replication study reveals a limit on probabilistic prediction in language comprehension. eLife, 7, e33468, 2018] replication of DeLong and colleagues (2015) [DeLong, K. A., Urbach, T. P., & Kutas, M. Probabilistic word pre-activation during language comprehension inferred from electrical brain activity. Nature Neuroscience, 8, 1117-1121, 2005]. Participants (n = 356) viewed sentences containing articles and nouns of varying predictability, while their EEG was recorded. We measured ERPs preceding the critical words (namely, the semantic prediction potential), in conjunction with postword N400 patterns and individual neural metrics. ERP activity was compared with two measures of word predictability: cloze probability and lexical surprisal. In contrast to prior literature, semantic prediction potential amplitudes did not increase as cloze probability increased, suggesting that the component may not reflect prediction during natural language processing. Initial N400 results at the article provided evidence against phonological prediction in language, in line with Nieuwland and colleagues' findings. Strikingly, however, when the surprisal of the prior words in the sentence was included in the analysis, increases in article surprisal were associated with increased N400 amplitudes, consistent with prediction accounts. This relationship between surprisal and N400 amplitude was not observed when the surprisal of the two prior words was low, suggesting that expectation violations at the article may be overlooked under highly predictable conditions. Individual alpha frequency also modulated the relationship between article surprisal and the N400, emphasizing the importance of individual neural factors for prediction. The present study extends upon existing neurocognitive models of language and prediction more generally, by illuminating the flexible and subject-specific nature of predictive processing.

An electrophysiological investigation of referential communication

A key aspect of linguistic communication involves semantic reference to objects. Presently, we investigate neural responses at objects when reference is disrupted, e.g., "The connoisseur tasted *that wine"… vs. "…*that roof…" Without any previous linguistic context or visual gesture, use of the demonstrative determiner "that" renders interpretation at the noun as incoherent. This incoherence is not based on knowledge of how the world plausibly works but instead is based on grammatical rules of reference. Whereas Event-Related Potential (ERP) responses to sentences such as "The connoisseur tasted the wine …" vs. "the roof" would result in an N400 effect, it is unclear what to expect for doubly incoherent "…*that roof…". Results revealed an N400 effect, as expected, preceded by a P200 component (instead of predicted P600 effect). These independent ERP components at the doubly violated condition support the notion that semantic interpretation can be partitioned into grammatical vs. contextual constructs.

Auditory Processing of Intonational Rises and Falls in German: Rises Are Special in Attention Orienting

This article investigates the processing of intonational rises and falls when presented unexpectedly in a stream of repetitive auditory stimuli. It examines the neurophysiological correlates (ERPs) of attention to these unexpected stimuli through the use of an oddball paradigm where sequences of repetitive stimuli are occasionally interspersed with a deviant stimulus, allowing for elicitation of an MMN. Whereas previous oddball studies on attention toward unexpected sounds involving pitch rises were conducted on nonlinguistic stimuli, the present study uses as stimuli lexical items in German with naturalistic intonation contours. Results indicate that rising intonation plays a special role in attention orienting at a pre-attentive processing stage, whereas contextual meaning (here a list of items) is essential for activating attentional resources at a conscious processing stage. This is reflected in the activation of distinct brain responses: Rising intonation evokes the largest MMN, whereas falling intonation elicits a less pronounced MMN followed by a P3 (reflecting a conscious processing stage). Subsequently, we also find a complex interplay between the phonological status (i.e., accent/head marking vs. boundary/edge marking) and the direction of pitch change in their contribution to attention orienting: Attention is not oriented necessarily toward a specific position in prosodic structure (head or edge). Rather, we find that the intonation contour itself and the appropriateness of the contour in the linguistic context are the primary cues to two core mechanisms of attention orienting, pre-attentive and conscious orientation respectively, whereas the phonological status of the pitch event plays only a supplementary role.

Augmenting complex and dynamic performance through mindfulness-based cognitive training: An evaluation of training adherence, trait mindfulness, personality and resting-state EEG

Human performance applications of mindfulness-based training have demonstrated its utility in enhancing cognitive functioning. Previous studies have illustrated how these interventions can improve performance on traditional cognitive tests, however, little investigation has explored the extent to which mindfulness-based training can optimise performance in more dynamic and complex contexts. Further, from a neuroscientific perspective, the underlying mechanisms responsible for performance enhancements remain largely undescribed. With this in mind, the following study aimed to investigate how a short-term mindfulness intervention (one week) augments performance on a dynamic and complex task (target motion analyst task; TMA) in young, healthy adults (n = 40, age range = 18-38). Linear mixed effect modelling revealed that increased adherence to the web-based mindfulness-based training regime (ranging from 0-21 sessions) was associated with improved performance in the second testing session of the TMA task, controlling for baseline performance. Analyses of resting-state electroencephalographic (EEG) metrics demonstrated no change across testing sessions. Investigations of additional individual factors demonstrated that enhancements associated with training adherence remained relatively consistent across varying levels of participants' resting-state EEG metrics, personality measures (i.e., trait mindfulness, neuroticism, conscientiousness), self-reported enjoyment and timing of intervention adherence. Our results thus indicate that mindfulness-based cognitive training leads to performance enhancements in distantly related tasks, irrespective of several individual differences. We also revealed nuances in the magnitude of cognitive enhancements contingent on the timing of adherence, regardless of total volume of training. Overall, our findings suggest that mindfulness-based training could be used in a myriad of settings to elicit transferable performance enhancements.

Surprisal From Language Models Can Predict ERPs in Processing Predicate-Argument Structures Only if Enriched by an Agent Preference Principle

Language models based on artificial neural networks increasingly capture key aspects of how humans process sentences. Most notably, model-based surprisals predict event-related potentials such as N400 amplitudes during parsing. Assuming that these models represent realistic estimates of human linguistic experience, their success in modeling language processing raises the possibility that the human processing system relies on no other principles than the general architecture of language models and on sufficient linguistic input. Here, we test this hypothesis on N400 effects observed during the processing of verb-final sentences in German, Basque, and Hindi. By stacking Bayesian generalised additive models, we show that, in each language, N400 amplitudes and topographies in the region of the verb are best predicted when model-based surprisals are complemented by an Agent Preference principle that transiently interprets initial role-ambiguous noun phrases as agents, leading to reanalysis when this interpretation fails. Our findings demonstrate the need for this principle independently of usage frequencies and structural differences between languages. The principle has an unequal force, however. Compared to surprisal, its effect is weakest in German, stronger in Hindi, and still stronger in Basque. This gradient is correlated with the extent to which grammars allow unmarked NPs to be patients, a structural feature that boosts reanalysis effects. We conclude that language models gain more neurobiological plausibility by incorporating an Agent Preference. Conversely, theories of human processing profit from incorporating surprisal estimates in addition to principles like the Agent Preference, which arguably have distinct evolutionary roots.

Trial-by-trial fluctuations of pre-stimulus alpha power predict language ERPs

Anticipatory mechanisms are known to play a key role in language, but they have been mostly investigated with violation paradigms, which only consider what happens after predictions have been (dis)confirmed. Relatively few studies focused on the pre-stimulus interval and found that stronger expectations are associated with lower pre-stimulus alpha power. However, alpha power also fluctuates spontaneously, in the absence of experimental manipulations; and in the attention and perception domains, spontaneously low pre-stimulus power is associated with better behavioral performance and with event-related potential (ERPs) with shorter latencies and higher amplitudes. Importantly, little is known about the role of alpha fluctuations in other domains, as it is in language. To this aim, we investigated whether spontaneous fluctuations in pre-stimulus alpha power modulate language-related ERPs in a semantic congruence task. Electrophysiology data were analyzed using Generalized Additive Mixed Models to model nonlinear interactions between pre-stimulus alpha power and EEG amplitude, at the single-trial level. We found that the N400 and the late posterior positivity/P600 were larger in the case of lower pre-stimulus alpha power. Still, while the N400 was observable regardless of the level of pre-stimulus power, a late posterior positivity/P600 effect was only observable for low pre-stimulus alpha power. We discuss these findings in light of the different, albeit connected, functional interpretations of pre-stimulus alpha and the ERPs according to both a nonpredictive interpretation focused on attentional mechanisms and under a predictive processing framework.

Prediction during language comprehension: what is next?

Prediction is often regarded as an integral aspect of incremental language comprehension, but little is known about the cognitive architectures and mechanisms that support it. We review studies showing that listeners and readers use all manner of contextual information to generate multifaceted predictions about upcoming input. The nature of these predictions may vary between individuals owing to differences in language experience, among other factors. We then turn to unresolved questions which may guide the search for the underlying mechanisms. (i) Is prediction essential to language processing or an optional strategy? (ii) Are predictions generated from within the language system or by domain-general processes? (iii) What is the relationship between prediction and memory? (iv) Does prediction in comprehension require simulation via the production system? We discuss promising directions for making progress in answering these questions and for developing a mechanistic understanding of prediction in language.

Individual differences in information processing during sleep and wake predict sleep-based memory consolidation of complex rules

Memory is critical for many cognitive functions, from remembering facts, to learning complex environmental rules. While memory encoding occurs during wake, memory consolidation is associated with sleep-related neural activity. Further, research suggests that individual differences in alpha frequency during wake (∼7 - 13 Hz) modulate memory processes, with higher individual alpha frequency (IAF) associated with greater memory performance. However, the relationship between wake-related EEG individual differences, such as IAF, and sleep-related neural correlates of memory consolidation has been largely unexplored, particularly in a complex rule-based memory context. Here, we aimed to investigate whether wake-derived IAF and sleep neurophysiology interact to influence rule learning in a sample of 35 healthy adults (16 males; mean age = 25.4, range: 18 - 40). Participants learned rules of a modified miniature language prior to either 8hrs of sleep or wake, after which they were tested on their knowledge of the rules in a grammaticality judgement task. Results indicate that sleep neurophysiology and wake-derived IAF do not interact but modulate memory for complex linguistic rules separately. Phase-amplitude coupling between slow oscillations and spindles during non-rapid eye-movement (NREM) sleep also promoted memory for rules that were analogous to the canonical English word order. As an exploratory analysis, we found that rapid eye-movement (REM) sleep theta power at posterior regions interacts with IAF to predict rule learning and proportion of time in REM sleep predicts rule learning differentially depending on grammatical rule type. Taken together, the current study provides behavioural and electrophysiological evidence for a complex role of NREM and REM sleep neurophysiology and wake-derived IAF in the consolidation of rule-based information.

Prediction underlying comprehension of human motion: an analysis of Deaf signer and non-signer EEG in response to visual stimuli

Introduction

Sensory inference and top-down predictive processing, reflected in human neural activity, play a critical role in higher-order cognitive processes, such as language comprehension. However, the neurobiological bases of predictive processing in higher-order cognitive processes are not well-understood.

Methods

This study used electroencephalography (EEG) to track participants' cortical dynamics in response to Austrian Sign Language and reversed sign language videos, measuring neural coherence to optical flow in the visual signal. We then used machine learning to assess entropy-based relevance of specific frequencies and regions of interest to brain state classification accuracy.

Results

EEG features highly relevant for classification were distributed across language processing-related regions in Deaf signers (frontal cortex and left hemisphere), while in non-signers such features were concentrated in visual and spatial processing regions.

Discussion

The results highlight functional significance of predictive processing time windows for sign language comprehension and biological motion processing, and the role of long-term experience (learning) in minimizing prediction error.

Neural and cognitive correlates of performance in dynamic multi-modal settings

The endeavour to understand human cognition has largely relied upon investigation of task-related brain activity. However, resting-state brain activity can also offer insights into individual information processing and performance capabilities. Previous research has identified electroencephalographic resting-state characteristics (most prominently: the individual alpha frequency; IAF) that predict cognitive function. However, it has largely overlooked a second component of electrophysiological signals: aperiodic 1/ƒ activity. The current study examined how both oscillatory and aperiodic resting-state EEG measures, alongside traditional cognitive tests, can predict performance in a dynamic and complex, semi-naturalistic cognitive task. Participants' resting-state EEG was recorded prior to engaging in a Target Motion Analysis (TMA) task in a simulated submarine control room environment (CRUSE), which required participants to integrate dynamically changing information over time. We demonstrated that the relationship between IAF and cognitive performance extends from simple cognitive tasks (e.g., digit span) to complex, dynamic measures of information processing. Further, our results showed that individual 1/ƒ parameters (slope and intercept) differentially predicted performance across practice and testing sessions, whereby flatter slopes and higher intercepts were associated with improved performance during learning. In addition to the EEG predictors, we demonstrate a link between cognitive skills most closely related to the TMA task (i.e., spatial imagery) and subsequent performance. Overall, the current study highlights (1) how resting-state metrics - both oscillatory and aperiodic - have the potential to index higher-order cognitive capacity, while (2) emphasising the importance of examining these electrophysiological components within more dynamic settings and over time.