The contingent negative variation (CNV): timing isn’t everything

Intentionally versus spontaneously prolonged Gaze: A MEG study of active gaze-based interaction

Eye fixations are increasingly employed to control computers through gaze-sensitive interfaces, yet the brain mechanisms supporting this non-visual use of gaze remain poorly understood. In this study, we employed 306-channel magnetoencephalography (MEG) to find out what is specific to brain activity when gaze is used voluntarily for control. MEG was recorded while participants played a video game controlled by their eye movements. Each move required object selection by fixating it for at least 500 msec. Gaze dwells were classified as intentional if followed by a confirmation gaze on a designated location and as spontaneous otherwise. We identified both induced oscillatory and sustained phase-locked MEG activity differentiating intentional and spontaneous gaze dwells. Induced power analysis revealed prominent alpha-beta band synchronization (8-30 Hz) localized in the frontal cortex, with location broadly consistent with the frontal eye fields. This synchronization began 500-750 msec before intentional fixation onset and peaked shortly after it, suggesting proactive inhibition of saccadic activity. Sustained evoked responses further distinguished the two conditions, showing gradually rising cortical activation with a maximum at 200 msec post-onset in the inferior temporal cortex during intentional fixations, likely indicative of focused attentional engagement on spatial targets. These findings illuminate the neural dynamics underlying intentional gaze control, shedding light on the roles of proactive inhibitory mechanisms and attentional processes in voluntary behavior. By leveraging a naturalistic gaze-based interaction paradigm, this study offers a novel framework for investigating voluntary control under free behavior conditions and holds potential applications for enhancing hybrid eye-brain-computer interfaces.

The neural dynamics of integrating prior and kinematic information during action anticipation in sport

Effective action anticipation in sports hinges on the integration of prior knowledge and kinematic cues, enabling athletes to respond swiftly and accurately in real-time scenarios. However, the neural mechanisms supporting this integrative process remain insufficiently understood. This study addressed this gap by using electroencephalography (EEG), combined with both multivariate and univariate analyses, to investigate how expert basketball players and non-athlete controls process prior and kinematic information during a sport-specific action anticipation task. Eighty-five participants (44 experts and 41 controls) were asked to predict the outcomes of basketball free throws presented via video clips, either with or without outcome-based prior information cues. Multivariate pattern classification and contingent negative variation (CNV) analyses revealed distinct anticipatory strategies between groups, with experts predominantly relying on kinematic information, whereas controls showed greater sensitivity to prior information. Additionally, time-frequency analysis of alpha-band activity indicated stronger desynchronization in experts, reflecting enhanced cortical engagement during kinematic processing. Notably, alpha ERD was significantly stronger for incongruent trials in the later phase of the task, suggesting increased cortical engagement when resolving conflicts between prior expectations and observed actions. These findings advance our understanding of the temporal dynamics and neural mechanisms underlying action anticipation, and highlight the value of combining EEG with multivariate decoding approaches to characterize individual differences in predictive processing.

Neurocomputational Mechanisms of Sense of Agency: Literature Review for Integrating Predictive Coding and Adaptive Control in Human-Machine Interfaces

BACKGROUND

The sense of agency (SoA)-the subjective experience of controlling one's own actions and their consequences-is a fundamental aspect of human cognition, volition, and motor control. Understanding how the SoA arises and is disrupted in neuropsychiatric disorders has significant implications for human-machine interface (HMI) design for neurorehabilitation. Traditional cognitive models of agency often fail to capture its full complexity, especially in dynamic and uncertain environments.

OBJECTIVE

This review synthesizes computational models-particularly predictive coding, Bayesian inference, and optimal control theories-to provide a unified framework for understanding the SoA in both healthy and dysfunctional brains. It aims to demonstrate how these models can inform the design of adaptive HMIs and therapeutic tools by aligning with the brain's own inference and control mechanisms.

METHODS

I reviewed the foundational and contemporary literature on predictive coding, Kalman filtering, the Linear-Quadratic-Gaussian (LQG) control framework, and active inference. I explored their integration with neurophysiological mechanisms, focusing on the somato-cognitive action network (SCAN) and its role in sensorimotor integration, intention encoding, and the judgment of agency. Case studies, simulations, and XR-based rehabilitation paradigms using robotic haptics were used to illustrate theoretical concepts.

RESULTS

The SoA emerges from hierarchical inference processes that combine top-down motor intentions with bottom-up sensory feedback. Predictive coding frameworks, especially when implemented via Kalman filters and LQG control, provide a mechanistic basis for modeling motor learning, error correction, and adaptive control. Disruptions in these inference processes underlie symptoms in disorders such as functional movement disorder. XR-based interventions using robotic interfaces can restore the SoA by modulating sensory precision and motor predictions through adaptive feedback and suggestion. Computer simulations demonstrate how internal models, and hypnotic suggestions influence state estimation, motor execution, and the recovery of agency.

CONCLUSIONS

Predictive coding and active inference offer a powerful computational framework for understanding and enhancing the SoA in health and disease. The SCAN system serves as a neural hub for integrating motor plans with cognitive and affective processes. Future work should explore the real-time modulation of agency via biofeedback, simulation, and SCAN-targeted non-invasive brain stimulation.

Perception of short, but not long, time intervals is modality specific: EEG evidence using vibrotactile stimuli

A longstanding debate in cognitive neuroscience questions whether temporal processing is modality-specific or governed by a "central clock" mechanism. We propose that this debate stems from neglecting the duration of the intervals processed, as studies supporting modality-specific models of time perception often focus on below 1.2-s intervals. To address this, we examined the neuronal dynamics underlying the perception of time intervals shorter and longer than 1.2-s using vibrotactile stimuli. Twenty participants underwent electroencephalogram recordings during a passive tactile oddball paradigm. We compared brain responses to standard and deviant intervals, with deviants occurring either earlier or later than the standard in both below and above 1.2-s conditions. Event-related potentials revealed distinct deviance-related components: a P250 for deviance detection of short deviants and an N400 long deviants. Generators lied in a modality-specific network for short intervals, while long intervals activated a broader, higher-level network. We found no evidence of the contingent negative variation in the tactile modality, questioning its role as a universal marker of temporal accumulation. Our findings suggest that short intervals involve modality-specific circuits, while longer intervals engage distributed networks, shedding light on whether temporal processing is centralized or distributed.

Rhythm-based Temporal Expectations: Unique Contributions of Predictability and Periodicity

Anticipating events and focusing attention accordingly are crucial for navigating our dynamic environment. Rhythmic patterns of sensory input offer valuable cues for temporal expectations and facilitate perceptual processing. Rhythm-based temporal expectations may rely on oscillatory entrainment, where neural activity and perceptual sensitivity synchronize with periodic stimuli. However, whether entrainment models can account for aperiodic predictable rhythms remains unclear. Our study aimed to delineate the distinct roles of predictability and periodicity in rhythm-based expectations. Participants performed a pitch-identification task preceded by periodic predictable, aperiodic predictable, or aperiodic unpredictable temporal sequences. By manipulating the temporal position of the target sound, we observed how auditory perceptual performance was modulated by the target position's relative phase relationship to the preceding sequences. Results revealed a significant performance advantage for predictable sequences, both periodic and aperiodic, compared with unpredictable ones. However, only the periodic sequence induced an entrained modulation pattern, with performance peaking in synchrony with the inherent sequence continuation. Event-related brain potentials corroborated these findings. The target-evoked P3b, possibly a neural marker of attention allocation, mirrored the behavioral performance patterns. This supports our hypothesis that temporal attention guided by rhythm-based expectations modulates perceptual performance. Furthermore, the predictive sequences were associated with enhanced target-preceding negativity (akin to the contingent negative variation), indicating enhanced target preparation. The periodic-specific modulation likely reflects more precise temporal expectations, potentially involving neural entrainment and/or more focused attention. Our findings suggest that predictability and periodicity influence perception through distinct mechanisms.

Patterns of brain activity in choice or instructed go and no-go tasks

The goal of this study was to investigate the decision making process for choosing what movements to make. We used electroencephalography (EEG) to investigate patterns of the contingent negative variation (CNV) associated with free-choice decisions to move or abstain, comparing them to conditions where actions were commanded. Our primary hypothesis was that choice tasks would differ significantly from each other and exhibit EEG patterns akin to their command-driven counterparts after the decisions were made, at least, in the 50 ms block of time prior to movement. A secondary analysis evaluated post hoc comparisons of time, in 50 ms blocks, to understand the temporal development of the CNV for each condition. We also conducted an exploratory analysis of EEG event-related desynchronization (ERD) to identify patterns of brain activity associated with the decision-making process. This approach was taken due to the exploratory nature of our hypotheses concerning the spatial and temporal characteristics of EEG activity during these free-choice versus commanded tasks. We studied 12 right-handed healthy volunteers (7 women, mean age 53 years, range 39-73 years) with no prior history of neurological or major psychiatric illness. A CNV paradigm encompassing commanded and choice tasks was devised, with a 2500 ms interval between S1 and S2, while recording EEG and electromyography (EMG). S1 provided full information about the upcoming task, which was to be executed at the time of S2. We assessed CNV and explored whole scalp EEG activity, including both voltage as well as power in the alpha and beta frequency ranges. Clear and similar CNVs were observed for command and choice go tasks prior to the movements, contrasting with near-zero CNVs for the command and choice no-go tasks. Separation of CNVs for command go and no-go tasks occurred around 1600 ms post-S1, and choice CNVs separated about 2150 ms post-S1. Exploratory analysis revealed that beta power provided information about decision and preparation processes much earlier. The left dorsolateral prefrontal cortex (DLPFC) exhibited the initial sign of decision approximately 500 ms post-S1 for all tasks, with subsequent preparation for movement or restraint involving distinct activity in various brain regions. The localization of effects in the left DLPFC was determined by visual analysis of the informative electrode sites. The CNVs separate about 2 s after S1, and it appears that this process represents preparation for movement (or no movement). Exploration of the beta activity suggests an earlier decision process which leads eventually to subsequent task preparation and activation. Choice decisions lag slightly behind command decisions, with the CNV apparently reflecting motor implementation rather than the decision-making process. In a simple motor task with an exploratory analysis, both commanded and choice-based decisions are rapidly initiated in the left DLPFC. While the CNV distinguishes between go and no-go conditions, it primarily appears to signify preparation for implementation of the task following the earlier decision. Further controlled studies will be needed to confirm these results.

Task-specific temporal prediction mechanisms revealed by motor and electroencephalographic indicators

Time prediction is pervasive, and it is unclear whether it is supra-modal or task-specific. This study aimed to investigate the role of motor temporal prediction in preparing to stop a movement following a sensory stimulus. Participants performed a straight-line movement with their finger until a target signal, which occurred after a short or long foreperiod. In one task, participants changed movement direction between trials (multidirectional task), while in the other, they always moved in the same direction (unidirectional task). The motor trajectory and EEG signals were continuously recorded. During the foreperiod, participants slowed down their movement, reflecting preparation to stop. To assess the influence of motor temporal prediction we examined how a given trial influences performance on the subsequent trial (sequential effect) when the movement changes or stays the same (multi- vs. unidirectional). In the unidirectional task, but not in the multidirectional task we found sequential effects on several behavioural parameters. In contrast, sequential effects were observed in both tasks on EEG results. This study revealed a temporal prediction related to motor movement (behavioural indicators), and a temporal preparation while waiting for the target (EEG indicator). These findings highlight the importance of considering various temporal prediction mechanisms.

Tennis experience impacts time estimation within different timing processes: An ERP study

Elite tennis players demonstrate an outstanding ability to predict the timing of their shots during matches, especially during prolonged rallies. Exploring the characteristics of this temporal perception advantage and its cognitive processing mechanisms may help explain the influence of sports experience on temporal perception abilities. We recruited 28 tennis athletes and 28 controls with no sports experience and measured their behavioral performance and brain neural activity characteristics using a time-to-contact paradigm under different temporal context conditions. The results indicated that in the time estimation task, tennis athletes had significantly smaller absolute bias and lower delayed response ratios than non-athlete controls. Performance of both groups in the timing task without a beat context was significantly better than that with a rhythmic context. During the timing process, the amplitude of the contingent negative variation (CNV) was most closely associated with the processing of temporal information, where tennis athletes were significantly greater than that of non-athletes. The CNV amplitude induced in the left brain area was significantly smaller than that in the midline brain area and the right brain area. Overall, we found that tennis players showed a distinct advantage in timing accuracy, characterized by earlier prediction preparation and higher utilization of temporal information.

The effect of performance contingent reward prospects flexibly adapts to more versus less specific task goals

In some situations, for example, when we expect to gain a reward in case of good performance, goal-driven top-down attention is particularly strong. Little is known about the task specificity of such increases of top-down attention due to environmental factors. To understand to what extent performance-contingent reward prospects can result in specific and unspecific changes in cognitive processing, we here investigate reward effects under different levels of task specification. Thirty-two participants performed a visual or an auditory discrimination task cued by two consecutive visual stimuli: First, a reward cue indicated if good performance was rewarded. Second, a task cue announced either which of the two tasks would follow (precise cue) or that both tasks would follow equally likely (imprecise cue). Reward and task cue preciseness both significantly improved performance. Moreover, the response time difference between precisely and imprecisely cued trials was significantly stronger in rewarded than in unrewarded trials. These effects were reflected in event-related potential (ERP) slow wave amplitudes: Reward and preciseness both significantly enhanced the contingent negative variation (CNV) prior to the task stimulus. In an early CNV time interval, both factors also showed an interaction. A negative slow wave prior to the task cue was also significantly enhanced for rewarded trials. This effect correlated with the reward difference in response times. These results indicate that reward prospects trigger task-specific changes in preparatory top-down attention which can flexibly adapt over time and across different task requirements. This highlights that a reward-induced increase of cognitive control can occur on different specificity levels.

Common neural mechanisms supporting time judgements in humans and monkeys

There has been an increasing interest in identifying the biological underpinnings of human time perception, for which purpose research in non-human primates (NHP) is common. Although previous work, based on behaviour, suggests that similar mechanisms support time perception across species, the neural correlates of time estimation in humans and NHP have not been directly compared. In this study, we assess whether brain evoked responses during a time categorization task are similar across species. Specifically, we assess putative differences in post-interval evoked potentials as a function of perceived duration in human EEG (N = 24) and local field potential (LFP) and spike recordings in pre-supplementary motor area (pre-SMA) of one monkey. Event-related potentials (ERPs) differed significantly after the presentation of the temporal interval between "short" and "long" perceived durations in both species, even when the objective duration of the stimuli was the same. Interestingly, the polarity of the reported ERPs was reversed for incorrect trials (i.e., the ERP of a "long" stimulus looked like the ERP of a "short" stimulus when a time categorization error was made). Hence, our results show that post-interval potentials reflect the perceived (rather than the objective) duration of the presented time interval in both NHP and humans. In addition, firing rates in monkey's pre-SMA also differed significantly between short and long perceived durations and were reversed in incorrect trials. Together, our results show that common neural mechanisms support time categorization in NHP and humans, thereby suggesting that NHP are a good model for investigating human time perception.

Frontal midline theta power during the cue-target-interval reflects increased cognitive effort in rewarded task-switching

Cognitive performance largely depends on how much effort is invested during task-execution. This also means that we rarely perform as good as we could. Cognitive effort is adjusted to the expected outcome of performance, meaning that it is driven by motivation. The results from recent studies suggest that the expenditure of cognitive control is particularly prone to being affected by modulations of cognitive effort. Although recent EEG studies investigated the neural underpinnings of the interaction of effort and control, reports on how cognitive effort is reflected by oscillatory activity of the EEG are quite sparse. It is the goal of the present study to bridge this gap by performing an exploratory analysis of high-density EEG data from a switching-task using manipulations of monetary incentives. A beamformer approach is used to localize the sensor-level effects in source-space. The results indicate that the manipulation of cognitive effort was successful. The participants reported significantly higher motivation and cognitive effort in high versus low reward trials. Performance was also significantly increased. The analysis of the EEG data revealed that the increase of cognitive effort was reflected by an increased mid-frontal theta activity during the cue-target interval, suggesting an increased use of proactive control. This interpretation is supported by the result from a regression analysis performed on single-trial data, showing higher mid-frontal theta power prior to target-onset being associated with faster responses. Alpha-desynchronization throughout the trial was also more pronounced in high reward trials, signaling a bias of attention towards the processing of external stimuli. Source reconstruction suggests that these effects are located in areas related to cognitive control, and visual processing.

Neurocognitive dynamics of preparatory and adaptive cognitive control: Insights from mass-univariate and multivariate pattern analysis of EEG data

Cognitive control refers to humans' ability to willingly align thoughts and actions with internally represented goals. Research indicates that cognitive control is not one-dimensional but rather integrates multiple sub-processes to cope with task demands successfully. In particular, the dynamic interplay between preparatory (i.e., prior to goal-relevant events) and adaptive (i.e., in response to unexpected demands) recruitment of neural resources is believed to facilitate successful behavioural performance. However, whether preparatory and adaptive processes draw from independent or shared neural resources, and how these align in the information processing stream, remains unclear. To address these issues, we recorded electroencephalographic data from 52 subjects while they performed a computerised task. Using a combination of mass-univariate and multivariate pattern analysis procedures, we found that different types of control triggered distinct sequences of brain activation patterns, and that the order and temporal extent of these patterns were dictated by the type of control used by the participants. Stimuli that fostered preparatory recruitment of control evoked a sequence of transient occipital-parietal, sustained central-parietal, and sustained fronto-central responses. In contrast, stimuli that indicated the need for quick behavioural adjustments triggered a sequence of transient occipital-parietal, fronto-central, and central parietal responses. There was also a considerable degree of overlap in the temporal evolution of these brain activation patterns, with behavioural performance being mainly related to the magnitude of the central-parietal and fronto-central responses. Our results demonstrate how different neurocognitive mechanisms, such as early attentional allocation and subsequent behavioural selection processes, are likely to contribute to cognitive control. Moreover, our findings extend prior work by showing that these mechanisms are engaged (at least partly) in parallel, rather than independently of each other.

Musical Expertise Influences the Processing of Short and Long Auditory Time Intervals: An Electroencephalography Study

Musical expertise has been proven to be beneficial for time perception abilities, with musicians outperforming nonmusicians in several explicit timing tasks. However, it is unclear how musical expertise impacts implicit time perception. Twenty nonmusicians and 15 expert musicians participated in an EEG recording during a passive auditory oddball paradigm with 0.8- and 1.6-sec standard time intervals and deviant intervals that were either played earlier or delayed relative to the standard interval. We first confirmed that, as was the case for nonmusicians, musicians use different neurofunctional processes to support the perception of short (below 1.2 sec) and long (above 1.2 sec) time intervals: Whereas deviance detection for long intervals elicited a N1 component, P2 was associated with deviance detection for short time intervals. Interestingly, musicians did not elicit a contingent negative variation (CNV) for longer intervals but show additional components of deviance detection such as (i) an attention-related N1 component, even for deviants occurring during short intervals; (ii) a N2 component for above and below 1.2-sec deviance detection, and (iii) a P2 component for above 1.2-sec deviance detection. We propose that the N2 component is a marker of explicit deviance detection and acts as an inhibitory/conflict monitoring of the deviance. This hypothesis was supported by a positive correlation between CNV and N2 amplitudes: The CNV reflects the temporal accumulator and can predict explicit detection of the deviance. In expert musicians, a N2 component is observable without CNV, suggesting that deviance detection is optimized and does not require the temporal accumulator. Overall, this study suggests that musical expertise is associated with optimized implicit time perception.

Blocked versus interleaved: How range contexts modulate time perception and its EEG signatures

Accurate time perception is a crucial element in a wide range of cognitive tasks, including decision-making, memory, and motor control. One commonly observed phenomenon is that when given a range of time intervals to consider, people's estimates often cluster around the midpoint of those intervals. Previous studies have suggested that the range of these intervals can also influence our judgments, but the neural mechanisms behind this "range effect" are not yet understood. We used both behavioral tests and electroencephalographic (EEG) measures to understand how the range of sample time intervals affects the accuracy of people's subsequent time estimates. Study participants were exposed to two different setups: In the "blocked-range" (BR) session, short and long intervals were presented in separate blocks, whereas in the "interleaved-range" (IR) session, intervals of various lengths were presented randomly. Our findings indicated that the BR context led to more accurate time estimates compared to the IR context. In terms of EEG data, the BR context resulted in quicker buildup of contingent negative variation (CNV), which also reached higher amplitude levels and dissolved more rapidly during the encoding stage. We also observed an enhanced amplitude in the offset P2 component of the EEG signal. Overall, our results suggest that the variability in time intervals, as defined by their range, influences the neural processes that underlie time estimation.

Aberrant effort-based reward dynamics in anhedonia

Anhedonia is a transdiagnostic symptom and associated with a spectrum of reward deficits among which the motivational dysfunction is poorly understood. Previous studies have established the abnormal cost-benefit trade-off as a contributor to motivational deficits in anhedonia and its relevant psychiatric diseases. However, it remains elusive how the anhedonic neural dynamics underlying reward processing are modulated by effort expenditure. Using an effort-based monetary incentive delay task, the current event-related potential study examined the neural dynamics underlying the effort-reward interplay in anhedonia using a nonclinical sample who scored high or low on an anhedonia questionnaire. We found that effort prospectively decreased reward effect on the contingent variation negativity and the target-P3 but retrospectively enhanced outcome effect on the feedback-P3 following effort expenditure. Compared to the low-anhedonia group, the high-anhedonia group displayed a diminished effort effect on the target-P3 during effort expenditure and an increased effort-enhancement effect for neutral trials during the feedback-P3 period following effort expenditure. Our findings suggest that anhedonia is associated with an inefficient control and motivation allocation along the efforted-based reward dynamics from effort preparation to effort production.

Dynamic alpha power modulations and slow negative potentials track natural shifts of spatio-temporal attention

Alpha power modulations and slow negative potentials have previously been associated with anticipatory processes in spatial and temporal top-down attention. In typical experimental designs, however, neural responses triggered by transient stimulus onsets can interfere with attention-driven activity patterns and our interpretation of such. Here, we investigated these signatures of spatio-temporal attention in a dynamic paradigm free from potentially confounding stimulus-driven activity using electroencephalography. Participants attended the cued side of a bilateral stimulus rotation and mentally counted how often one of two remembered sample orientations (i.e., the target) was displayed while ignoring the uncued side and non-target orientation. Afterwards, participants performed a delayed match-to-sample task, in which they indicated if the orientation of a probe stimulus matched the corresponding sample orientation (previously target or non-target). We observed dynamic alpha power reductions and slow negative waves around task-relevant points in space and time (i.e., onset of the target orientation in the cued hemifield) over posterior electrodes contralateral to the locus of attention. In contrast to static alpha power lateralization, these dynamic signatures correlated with subsequent memory performance (primarily detriments for matching probes of the non-target orientation), suggesting a preferential allocation of attention to task-relevant locations and time points at the expense of reduced resources and impaired performance for information outside the current focus of attention. Our findings suggest that humans can naturally and dynamically focus their attention at relevant points in space and time and that such spatio-temporal attention shifts can be reflected by dynamic alpha power modulations and slow negative potentials.

Common neural mechanisms supporting time judgements in humans and monkeys

There has been an increasing interest in identifying the biological underpinnings of human time perception, for which purpose research in non-human primates (NHP) is common. Although previous work, based on behaviour, suggests that similar mechanisms support time perception across species, the neural correlates of time estimation in humans and NHP have not been directly compared. In this study, we assess whether brain evoked responses during a time categorization task are similar across species. Specifically, we assess putative differences in post-interval evoked potentials as a function of perceived duration in human EEG (N = 24) and local field potential (LFP) and spike recordings in pre-supplementary motor area (pre-SMA) of one monkey. Event-related potentials (ERPs) differed significantly after the presentation of the temporal interval between "short" and "long" perceived durations in both species, even when the objective duration of the stimuli was the same. Interestingly, the polarity of the reported ERPs was reversed for incorrect trials (i.e., the ERP of a "long" stimulus looked like the ERP of a "short" stimulus when a time categorization error was made). Hence, our results show that post-interval potentials reflect the perceived (rather than the objective) duration of the presented time interval in both NHP and humans. In addition, firing rates in monkey's pre-SMA also differed significantly between short and long perceived durations and were reversed in incorrect trials. Together, our results show that common neural mechanisms support time categorization in NHP and humans, thereby suggesting that NHP are a good model for investigating human time perception.

Effort discounts reward-based control allocation: A neurodynamic perspective

The amount of cognitive and neural resources allocated to a task is largely determined by the reward we can expect. However, it remains under-appreciated how this reward-expectation-based control allocation is modulated by effort expenditure. The present event-related potential study investigated this issue through the lens of neural dynamics. Thirty-four participants completed an effort-based monetary incentive delay task while their EEG was recorded. Effort demand was manipulated by adding no (low effort) or much (high effort) noise to the target. Behaviorally, participants exhibited reward-related speeding regardless of effort expenditure, as revealed by faster RTs for reward than neutral trials. Our ERP results demonstrated a widespread facilitatory influence of reward expectation on neural dynamics extending from cue evaluation as indexed by the cue-P3, to control preparation as indexed by the contingent negative variation (CNV), and finally to control engagement as indexed by the target-P3. Critically, the neural facilitation was discounted by effort expenditure during both the control-preparation and control-engagement stages instead of the cue-evaluation stage. Overall, this study provides neurodynamic evidence that control allocation is determined by reward and effort via a cost-benefit analysis.

Temporal deployment of attention in musicians: Evidence from an attentional blink paradigm

The generalization of music training to unrelated nonmusical domains is well established and may reflect musicians' superior ability to regulate attention. We investigated the temporal deployment of attention in musicians and nonmusicians using scalp-recording of event-related potentials in an attentional blink (AB) paradigm. Participants listened to rapid sequences of stimuli and identified target and probe sounds. The AB was defined as a probe identification deficit when the probe closely follows the target. The sequence of stimuli was preceded by a neutral or informative cue about the probe position within the sequence. Musicians outperformed nonmusicians in identifying the target and probe. In both groups, cueing improved target and probe identification and reduced the AB. The informative cue elicited a sustained potential, which was more prominent in musicians than nonmusicians over left temporal areas and yielded a larger N1 amplitude elicited by the target. The N1 was larger in musicians than nonmusicians, and its amplitude over the left frontocentral cortex of musicians correlated with accuracy. Together, these results reveal musicians' superior ability to regulate attention, allowing them to prepare for incoming stimuli, thereby improving sound object identification. This capacity to manage attentional resources to optimize task performance may generalize to nonmusical activities.

Electrophysiological signatures of temporal context in the bisection task

Despite having relatively accurate timing, subjective time can be influenced by various contexts, such as stimulus spacing and sample frequency. Several electroencephalographic (EEG) components have been associated with timing, including the contingent negative variation (CNV), offset P2, and late positive component of timing (LPCt). However, the specific role of these components in the contextual modulation of perceived time remains unclear. In this study, we conducted two temporal bisection experiments to investigate this issue. Participants had to judge whether a test duration was close to a short or long standard. Unbeknownst to them, we manipulated the stimulus spacing (Experiment 1) and sample frequency (Experiment 2) to create short and long contexts while maintaining consistent test ranges and standards across different sessions. The results revealed that the bisection threshold shifted towards the ensemble mean, and both CNV and LPCt were sensitive to context modulation. In the short context, the CNV exhibited an increased climbing rate compared to the long context, whereas the LPCt displayed reduced amplitude and latency. These findings suggest that the CNV represents an expectancy wave preceding a temporal decision process, while the LPCt reflects the decision-making process itself, with both components influenced by the temporal context.

Contingent negative variation to tactile stimuli - differences in anticipatory and preparatory processes between participants with and without blindness

People who are blind demonstrate remarkable abilities within the spared senses and compensatory enhancement of cognitive skills, underscored by substantial plastic reorganization in relevant neural areas. However, little is known about whether people with blindness form top-down models of the world on short timescales more efficiently to guide goal-oriented behavior. This electroencephalography study investigates this hypothesis at the neurophysiological level, focusing on contingent negative variation (CNV) as a marker of anticipatory and preparatory processes prior to expected events. In sum, 20 participants with blindness and 27 sighted participants completed a classic CNV task and a memory CNV task, both containing tactile stimuli to exploit the expertise of the former group. Although the reaction times in the classic CNV task did not differ between groups, participants who are blind reached higher performance rates in the memory task. This superior performance co-occurred with a distinct neurophysiological profile, relative to controls: greater late CNV amplitudes over central areas, suggesting enhanced stimulus expectancy and motor preparation prior to key events. Controls, in contrast, recruited more frontal sites, consistent with inefficient sensory-aligned control. We conclude that in more demanding cognitive contexts exploiting the spared senses, people with blindness efficiently generate task-relevant internal models to facilitate behavior.

What came before: Assimilation effects in the categorization of time intervals

Assimilation is the process by which one judgment tends to approach some aspect of another stimulus or judgment. This effect has been known for over half a century in various domains such as the judgment of weight or sound intensity. However, the assimilation of judgments of durations have been relatively unexplored. In the current article, we present the results of five experiments in which participant s were required to judge the duration of a visual stimulus on each trial. In each experiment, we manipulated the pattern of durations they experienced in order to systematically separate the effects of the objective and subjective duration of stimuli on subsequent judgments. We found that duration judgments were primarily driven by prior judgments, with little, if any, effect of the prior objective stimulus duration. This is in contrast to the findings previously reported in regards to non-temporal judgments. We propose two mechanist explanations of this effect; a representational account in which judgments represent the speed of an underlying pacemaker, and an assimilation account in which judgment is based in prior experience. We further discuss results in terms of predictive coding, in which the previous rating is representative of a prior expectation, which is modified by current experience.

Conventionality determines the time course of indirect replies comprehension: An ERP study

Indirect language comprehension requires decoding both the literal meaning and the intended meaning of an utterance, in which pragmatic inference is involved. This study tests the role of conventionality in the time course of indirect reply processing by comparing conventional and non-conventional indirect replies with direct reply, respectively. We constructed discourses which consist of a context and a dialogue with one question (e.g., May I buy a necklace for you) and one reply (e.g., I really have too many). The reply utterance was segmented into three phrases and presented orderly for EEG recording, e.g., with the subject as the first phrase (e.g., I), the adverbial as the second phrase (e.g., really), and the predicate as the third phrase (e.g., have too many). Our results showed that for conventional indirect replies, the second phrase elicited a larger anterior negativity, and the third phrase elicited a larger anterior N400 compared with those in direct replies. By contrast, for the non-conventional indirect reply, only the third phrase elicited a larger late negativity than the direct replies. These findings suggest that conventionality determines the time course of the pragmatic inferences for the most relevant interpretation during indirect replies comprehension.

Evolving changes in cortical and subcortical excitability during movement preparation: A study of brain potentials and eye-blink reflexes during loud acoustic stimulation

During preparation for action, the presentation of loud acoustic stimuli (LAS) can trigger movements at very short latencies in a phenomenon called the StartReact effect. It was initially proposed that a special, separate subcortical mechanism that bypasses slower cortical areas could be involved. We sought to examine the evidence for a separate mechanism against the alternative that responses to LAS can be explained by a combination of stimulus intensity effects and preparatory states. To investigate whether cortically mediated preparatory processes are involved in mediating reactions to LAS, we used an auditory reaction task where we manipulated the preparation level within each trial by altering the conditional probability of the imperative stimulus. We contrasted responses to non-intense tones and LAS and examined whether cortical activation and subcortical excitability and motor responses were influenced by preparation levels. Increases in preparation levels were marked by gradual reductions in reaction time (RT) coupled with increases in cortical activation and subcortical excitability - at both condition and trial levels. Interestingly, changes in cortical activation influenced motor and auditory but not visual areas - highlighting the widespread yet selective nature of preparation. RTs were shorter to LAS than tones, but the overall pattern of preparation level effects was the same for both stimuli. Collectively, the results demonstrate that LAS responses are indeed shaped by cortically mediated preparatory processes. The concurrent changes observed in brain and behavior with increasing preparation reinforce the notion that preparation is marked by evolving brain states which shape the motor system for action.

Effects of Natural Scene Inversion on Visual-evoked Brain Potentials and Pupillary Responses: A Matter of Effortful Processing of Unfamiliar Configurations

The inversion of a picture of a face hampers the accuracy and speed at which observers can perceptually process it. Event-related potentials and pupillary responses, successfully used as biomarkers of face inversion in the past, suggest that the perception of visual features, that are organized in an unfamiliar manner, recruits demanding additional processes. However, it remains unclear whether such inversion effects generalize beyond face stimuli and whether indeed more mental effort is needed to process inverted images. Here we aimed to study the effects of natural scene inversion on visual evoked potentials and pupil dilations. We simultaneously measured responses of 47 human participants to presentations of images showing upright or inverted natural scenes. For inverted scenes, we observed relatively stronger occipito-temporo-parietal N1 peak amplitudes and larger pupil dilations (on top of an initial orienting response) than for upright scenes. This study revealed neural and physiological markers of natural scene inversion that are in line with inversion effects of other stimulus types and demonstrates the robustness and generalizability of the phenomenon that unfamiliar configurations of visual content require increased processing effort.

Subjective time is predicted by local and early visual processing

Time is as pervasive as it is elusive to study, and how the brain keeps track of millisecond time is still unclear. Here we addressed the mechanisms underlying duration perception by looking for a neural signature of subjective time distortion induced by motion adaptation. We recorded electroencephalographic signals in human participants while they were asked to discriminate the duration of visual stimuli after different types of translational motion adaptation. Our results show that perceived duration can be predicted by the amplitude of the N200 event-related potential evoked by the adapted stimulus. Moreover, we show that the distortion of subjective time can be predicted by the activity in the Beta band frequency spectrum, at the offset of the adaptor and during the presentation of the subsequent adapted stimulus. Both effects were observed from posterior electrodes contralateral to the adapted stimulus. Overall, our findings suggest that local and low-level perceptual processes are involved in generating a subjective sense of time.

A Guided Tutorial on Modelling Human Event-Related Potentials with Recurrent Neural Networks

In cognitive neuroscience research, computational models of event-related potentials (ERP) can provide a means of developing explanatory hypotheses for the observed waveforms. However, researchers trained in cognitive neurosciences may face technical challenges in implementing these models. This paper provides a tutorial on developing recurrent neural network (RNN) models of ERP waveforms in order to facilitate broader use of computational models in ERP research. To exemplify the RNN model usage, the P3 component evoked by target and non-target visual events, measured at channel Pz, is examined. Input representations of experimental events and corresponding ERP labels are used to optimize the RNN in a supervised learning paradigm. Linking one input representation with multiple ERP waveform labels, then optimizing the RNN to minimize mean-squared-error loss, causes the RNN output to approximate the grand-average ERP waveform. Behavior of the RNN can then be evaluated as a model of the computational principles underlying ERP generation. Aside from fitting such a model, the current tutorial will also demonstrate how to classify hidden units of the RNN by their temporal responses and characterize them using principal component analysis. Statistical hypothesis testing can also be applied to these data. This paper focuses on presenting the modelling approach and subsequent analysis of model outputs in a how-to format, using publicly available data and shared code. While relatively less emphasis is placed on specific interpretations of P3 response generation, the results initiate some interesting discussion points.

Tics: neurological disorders determined by a deficit in sensorimotor gating processes

Tic related disorders affect 4–20% of the population, mostly idiopathic, can be grouped in a wide spectrum of severity, where the most severe end is Tourette Syndrome (TS). Tics are arrhythmic hyperkinesias to whom execution the subject is forced by a “premonitory urge” that can be classified as sensory tic, just-right experience or urge without obsession. If an intact volitional inhibition allows patients to temporarily suppress tics, a lack or deficit in automatic inhibition is involved in the genesis of the disorder. Studies have assessed the presence of intrinsic microscopic and macroscopic anomalies in striatal circuits and relative cortical areas in association with a hyperdopaminergic state in the basal forebrain. Prepulse inhibition (PPI) of the startle reflex is a measure of inhibitory functions by which a weak sensory stimulus inhibits the elicitation of a startle response determined by a sudden intense stimulus. It is considered an operation measure of sensorimotor gating, a neural process by which unnecessary stimuli are eliminated from awareness. Evidence points out that the limbic domain of the CSTC loops, dopamine and GABA receptors within the striatum play an important role in PPI modulation. It is conceivable that a sensorimotor gating deficit may be involved in the genesis of premonitory urge and symptoms. Therefore, correcting the sensorimotor gating deficit may be considered a target for tic-related disorders therapies; in such case PPI (as well as other indirect estimators of sensorimotor gating) could represent therapeutic impact predictors.

The effect of ambiguous and unambiguous stimuli on target processing in less creative and more creative groups

In the present study our aim was to examine how the processing of task-irrelevant stimuli changes with creativity and aging, and how this processing influences task-relevant responding. We hypothesized that the degree in which irrelevant stimuli attract attention and occupy cognitive capacity, thereby interfering with the motor task, depends not only on the stimuli's saliency, but also on the participants' creativity and age. We investigated event-related potentials (ERP) and behavioural data in four groups - more creative and less creative younger (18-30 years) and older (60-75 years) adults - by presenting unambiguous and ambiguous portrait paintings and photos of faces in equal proportions before and after the target stimuli. Our results showed that aging affected behavioural and ERP responses, but there were no interactions between age groups, creativity and the three types of stimuli. Older adults were not more exposed to the interference caused by distractor stimuli as they compensated with bilateral activity to reach a similar performance to the younger group. The reaction time was faster for targets when they followed the faces rather than the portrait paintings, so, faces may have been less salient to the participants than paintings. The three types of stimuli were differentiated in all the processing stages. Creativity had a measured effect in the earliest (P1) stage with more creative groups being able to distinguish between unambiguous and ambiguous stimuli; and also, in the last processing stage (CNV), in which task-irrelevant stimuli, particularly photos of faces, were less distracting for more creative participants in task preparation. The results show that creativity in general has an influence even at the earliest stage of visual perception.

Influence of the number of trials on evoked motor cortical activity in EEG recordings

OBJECTIVE

Improvements in electroencephalography enable the study of the localization of active brain regions during motor tasks. Movement-related cortical potentials (MRCPs), and event-related desynchronization (ERD) and synchronization (ERS) are the main motor-related cortical phenomena/neural correlates observed when a movement is elicited. When assessing neurological diseases, averaging techniques are commonly applied to characterize motor related processes better. In this case, a large number of trials is required to obtain a motor potential that is representative enough of the subject's condition. This study aimed to assess the effect of a limited number of trials on motor-related activity corresponding to different upper limb movements (elbow flexion/extension, pronation/supination and hand open/close).

APPROACH

An open dataset consisting on 15 healthy subjects was used for the analysis. A Monte Carlo simulation approach was applied to analyse, in a robust way, different typical time- and frequency-domain features, topography, and low-resolution tomography (LORETA).

MAIN RESULTS

Grand average potentials, and topographic and tomographic maps showed few differences when using fewer trials, but shifts in the localization of motor-related activity were found for several individuals. MRCP and beta ERD features were more robust to a limited number of trials, yielding differences lower than 20% for cases with 50 trials or more. Strong correlations between features were obtained for subsets above 50 trials. However, the inter-subject variability increased as the number of trials decreased. The elbow flexion/extension movement showed a more robust performance for a limited number of trials, both in population and in individual-based analysis.

SIGNIFICANCE

Our findings suggested that 50 trials can be an appropriate number to obtain stable motor-related features in terms of differences in the averaged motor features, correlation, and changes in topography and tomography.

Differentiating the abnormalities of social and monetary reward processing associated with depressive symptoms

BACKGROUND

Reward dysfunction is a major dimension of depressive symptomatology, but it remains obscure if that dysfunction varies across different reward types. In this study, we focus on the abnormalities in anticipatory/consummatory processing of monetary and social reward associated with depressive symptoms.

METHODS

Forty participants with depressive symptoms and forty normal controls completed the monetary incentive delay (MID) and social incentive delay (SID) tasks with event-related potential (ERP) recording.

RESULTS

In the SID but not the MID task, both the behavioral hit rate and the ERP component contingent negative variation (CNV; indicating reward anticipation) were sensitive to the interaction between the grouping factor and reward magnitude; that is, the depressive group showed a lower hit rate and a smaller CNV to large-magnitude (but not small-magnitude) social reward cues compared to the control group. Further, these two indexes were correlated with each other. Meanwhile, the ERP components feedback-related negativity and P3 (indicating reward consumption) were sensitive to the main effect of depression across the MID and SID tasks, though this effect was more prominent in the SID task.

CONCLUSIONS

Overall, we suggest that depressive symptoms are associated with deficits in both the reward anticipation and reward consumption stages, particularly for social rewards. These findings have a potential to characterize the profile of functional impairment that comprises and maintains depression.

Face specific neural anticipatory activity in infants 4 and 9 months old

The possibility of predicting the specific features of forthcoming environmental events is fundamental for our survival since it allows us to proactively regulate our behaviour, enhancing our chance of survival. This is particularly crucial for stimuli providing socially relevant information for communication and interaction, such as faces. While it has been consistently demonstrated that the human brain shows preferential and ontogenetically early face-evoked activity, it is unknown whether specialized neural routes are engaged by face-predictive activity early in life. In this study, we recorded high-density electrophysiological (ERP) activity in adults and 9- and 4-month-old infants undergoing an audio-visual paradigm purposely designed to predict the appearance of faces or objects starting from congruent auditory cues (i.e., human voice vs nonhuman sounds). Contingent negative variation or CNV was measured to investigate anticipatory activity as a reliable marker of stimulus expectancy even in the absence of explicit motor demand. The results suggest that CNV can also be reliably elicited in the youngest group of 4-month-old infants, providing further evidence that expectation-related anticipatory activity is an intrinsic, early property of the human cortex. Crucially, the findings also indicate that the predictive information provided by the cue (i.e., human voice vs nonhuman sounds) turns into the recruitment of different anticipatory neural dynamics for faces and objects.

Oscillation/Coincidence-Detection Models of Reward-Related Timing in Corticostriatal Circuits

The major tenets of beat-frequency/coincidence-detection models of reward-related timing are reviewed in light of recent behavioral and neurobiological findings. This includes the emphasis on a core timing network embedded in the motor system that is comprised of a corticothalamic-basal ganglia circuit. Therein, a central hub provides timing pulses (i.e., predictive signals) to the entire brain, including a set of distributed satellite regions in the cerebellum, cortex, amygdala, and hippocampus that are selectively engaged in timing in a manner that is more dependent upon the specific sensory, behavioral, and contextual requirements of the task. Oscillation/coincidence-detection models also emphasize the importance of a tuned ‘perception’ learning and memory system whereby target durations are detected by striatal networks of medium spiny neurons (MSNs) through the coincidental activation of different neural populations, typically utilizing patterns of oscillatory input from the cortex and thalamus or derivations thereof (e.g., population coding) as a time base. The measure of success of beat-frequency/coincidence-detection accounts, such as the Striatal Beat-Frequency model of reward-related timing (SBF), is their ability to accommodate new experimental findings while maintaining their original framework, thereby making testable experimental predictions concerning diagnosis and treatment of issues related to a variety of dopamine-dependent basal ganglia disorders, including Huntington’s and Parkinson’s disease.

Towards high-accuracy classifying attention-deficit/hyperactivity disorders using CNN-LSTM model

OBJECTIVE

The neurocognitive attention functions involve the cooperation of multiple brain regions, and the defects in the cooperation will lead to attention-deficit/hyperactivity disorder (ADHD), which is one of the most common neuropsychiatric disorders for children. The current ADHD diagnosis is mainly based on a subjective evaluation that is easily biased by the experience of the clinicians and lacks the support of objective indicators. The purpose of this study is to propose a method that can effectively identify children with ADHD.

APPROACH

In this study, we proposed a CNN-LSTM model to solve the three-class problems of classifying ADHD, attention deficit disorder (ADD) and healthy children, based on a public EEG dataset that includes event-related potential (ERP) EEG signals of 144 children. The convolution visualization and saliency map methods were used to observe the features automatically extracted by the proposed model, which could intuitively explain how the model distinguished different groups.

MAIN RESULTS

The results showed that our CNN-LSTM model could achieve an accuracy as high as 98.23% in a 5-fold cross-validation method, which was significantly better than the current state-of-the-art CNN models. The features extracted by the proposed model were mainly located in the frontal and central areas, with significant differences in the time period mappings among the three different groups. The P300 and contingent negative variation (CNV) in the frontal lobe had the largest decrease in the healthy control (HC) group, and the ADD group had the smallest decrease. In the central area, only the HC group had a significant negative oscillation of CNV waves.

SIGNIFICANCE

The results of this study suggest that the CNN-LSTM model can effectively identify children with ADHD and its subtypes. The visualized features automatically extracted by this model could better explain the differences in the ERP response among different groups, which is more convincing than previous studies, and it could be used as more reliable neural biomarkers to help with more accurate diagnosis in the clinics.

Impulsivity Moderates the Effect of Neurofeedback Training on the Contingent Negative Variation in Autism Spectrum Disorder

Background

The contingent negative variation (CNV) is a well-studied indicator of attention- and expectancy-related processes in the human brain. An abnormal CNV amplitude has been found in diverse neurodevelopmental psychiatric disorders. However, its role as a potential biomarker of successful clinical interventions in autism spectrum disorder (ASD) remains unclear.

Methods

In this randomized controlled trial, we investigated how the CNV changes following an intensive neurofeedback training. Therefore, twenty-one adolescents with ASD underwent 24 sessions of slow cortical potential (SCP) neurofeedback training. Twenty additional adolescents with ASD formed a control group and received treatment as usual. CNV waveforms were obtained from a continuous performance test (CPT), which all adolescents performed before and after the corresponding 3-month long training period. In order to utilize all available neural time series, trial-based area under the curve values for all four electroencephalogram (EEG) channels were analyzed with a hierarchical Bayesian model. In addition, the model included impulsivity, inattention, and hyperactivity as potential moderators of change in CNV.

Results

Our model implies that impulsivity moderates the effects of neurofeedback training on CNV depending on group. In the control group, the average CNV amplitude decreased or did not change after treatment as usual. In the experimental group, the CNV changed depending on the severity of comorbid impulsivity symptoms. The average CNV amplitude of participants with low impulsivity scores decreased markedly, whereas the average CNV amplitude of participants with high impulsivity increased.

Conclusion

The degree of impulsivity seems to play a crucial role in the changeability of the CNV following an intensive neurofeedback training. Therefore, comorbid symptomatology should be recorded and analyzed in future EEG-based brain training interventions.

Clinical Trial Registration

https://www.drks.de, identifier DRKS00012339.

Late N1 and Post Imperative Negative Variation analysis depending on the previous trial history in paradigms of increasing auditory complexity

Predictive coding reflects the ability of the human brain to extract environmental patterns in order to reformulate previous expectations. The present report analyzes through the late N1 auditory component and the post imperative negative variation (PINV) the updating of predictions regarding the characteristics of a new trial, depending on the previous trial history, complexity, and type of trial (standard or deviant). Data were obtained from 31 healthy subjects recorded in a previous study, based on two paradigms composed of stimulus sequences of decreasing or increasing frequencies intermingled with the sporadic appearance of unexpected tone endings. Our results showed a higher amplitude for the most complex condition and deviant trials for both the late N1 and the PINV components. Additionally, the N1 and PINV presented a different amplitude response to the standard and deviant trials as a function of previous trial history, suggesting a continuous updating of trial categorization. The results suggest that the late N1 and PINV components are involved in the generation of an internal model about the rules of external auditory stimulation.

ERP signatures of auditory awareness in cross-modal distractor-induced deafness

Previous research showed that dual-task processes such as the attentional blink are not always transferable from unimodal to cross-modal settings. This study investigated whether such a transfer can be stated for a distractor-induced impairment of target detection established in vision (distractor-induced blindness, DIB) and recently observed in the auditory modality (distractor-induced deafness, DID). A cross-modal DID effect was confirmed: The detection of an auditory target indicated by a visual cue was impaired if multiple auditory distractors preceded the target. Event-related potentials (ERPs) were used to identify psychophysiological correlates of target detection. A frontal negativity about 200 ms succeeded by a sustained, widespread negativity was associated with auditory target awareness. In contrast to unimodal findings, P3 amplitude was not enhanced for hits. The results support the notion that early frontal attentional processes are linked to auditory awareness, whereas the P3 does not seem to be a reliable indicator of target access.

Similar CNV Neurodynamic Patterns between Sub- and Supra-Second Time Perception

In the field of time psychology, the functional significance of the contingent negative variation (CNV) component in time perception and whether the processing mechanisms of sub- and supra-second are similar or different still remain unclear. In the present study, event-related potential (ERP) technology and classical temporal discrimination tasks were used to explore the neurodynamic patterns of sub- and supra-second time perception. In Experiment 1, the standard interval (SI) was fixed at 500 ms, and the comparison interval (CI) ranged from 200 ms to 800 ms. In Experiment 2, the SI was fixed at 2000 ms, and the CI ranged from 1400 ms to 2600 ms. Participants were required to judge whether the CI was longer or shorter than the SI. The ERP results showed similar CNV activity patterns in the two experiments. Specifically, CNV amplitude would be more negative when the CI was longer or closer to the memorized SI. CNV peak latency increased significantly until the CI reached the memorized SI. We propose that CNV amplitude might reflect the process of temporal comparison, and CNV peak latency might represent the process of temporal decision-making. To our knowledge, it is the first ERP task explicitly testing the two temporal scales, sub- and supra-second timing, in one study. Taken together, the present study reveals a similar functional significance of CNV between sub- and supra-second time perception.

Electroencephalography, Magnetoencephalography, and Cognitive Reserve: A Systematic Review

OBJECTIVE

Cognitive reserve (CR) is the capacity to adapt to (future) brain damage without any or only minimal clinical symptoms. The underlying neuroplastic mechanisms remain unclear. Electrocorticography (ECOG), electroencephalography (EEG), and magnetoencephalography (MEG) may help elucidate the brain mechanisms underlying CR, as CR is thought to be related to efficient utilization of remaining brain resources. The purpose of this systematic review is to collect, evaluate, and synthesize the findings on neural correlates of CR estimates using ECOG, EEG, and MEG.

METHOD

We examined articles that were published from the first standardized definition of CR. Eleven EEG and five MEG cross-sectional studies met the inclusion criteria: They concerned original research, analyzed (M)EEG in humans, used a validated CR estimate, and related (M)EEG to CR. Quality assessment was conducted using an adapted form of the Newcastle-Ottawa scale. No ECOG study met the inclusion criteria.

RESULTS

A total of 1383 participants from heterogeneous patient, young and older healthy groups were divided into three categories by (M)EEG methodology: Eight (M)EEG studies employed event-related fields or potentials, six studies analyzed brain oscillations at rest (of which one also analyzed a cognitive task), and three studies analyzed brain connectivity. Various CR estimates were employed and all studies compared different (M)EEG measures and CR estimates. Several associations between (M)EEG measures and CR estimates were observed.

CONCLUSION

Our findings support that (M)EEG measures are related to CR estimates, particularly in healthy individuals. However, the character of this relationship is dependent on the population and task studied, warranting further studies.

I, robot: depression plays different roles in human-human and human-robot interactions

Socially engaging robots have been increasingly applied to alleviate depressive symptoms and to improve the quality of social life among different populations. Seeing that depression negatively influences social reward processing in everyday interaction, we investigate this influence during simulated interactions with humans or robots. In this study, 35 participants with mild depression and 35 controls (all from nonclinical populations) finished the social incentive delay task with event-related potential recording, in which they received performance feedback from other persons or from a robot. Compared to the controls, the mild depressive symptom (MDS) group represented abnormalities of social reward processing in the human feedback condition: first, the MDS group showed a lower hit rate and a smaller contingent-negative variation (correlated with each other) during reward anticipation; second, depression level modulated both the early phase (indexed by the feedback-related negativity (FRN)) and the late phase (indexed by the P3) of reward consumption. In contrast, the effect of depression was evident only on FRN amplitude in the robot feedback condition. We suggest that compared to human-human interaction, the rewarding properties of human-robot interaction are less likely to be affected by depression. These findings have implications for the utilization of robot-assisted intervention in clinical practice.

Intact Proactive Motor Inhibition after Unilateral Prefrontal Cortex or Basal Ganglia Lesions

Previous research provided evidence for the critical importance of the PFC and BG for reactive motor inhibition, that is, when actions are cancelled in response to external signals. Less is known about the role of the PFC and BG in proactive motor inhibition, referring to preparation for an upcoming stop signal. In this study, patients with unilateral lesions to the BG or lateral PFC performed in a cued go/no-go task, whereas their EEG was recorded. The paradigm called for cue-based preparation for upcoming, lateralized no-go signals. Based on previous findings, we focused on EEG indices of cognitive control (prefrontal beta), motor preparation (sensorimotor mu/beta, contingent negative variation [CNV]), and preparatory attention (occipital alpha, CNV). On a behavioral level, no differences between patients and controls were found, suggesting an intact ability to proactively prepare for motor inhibition. Patients showed an altered preparatory CNV effect, but no other differences in electrophysiological activity related to proactive and reactive motor inhibition. Our results suggest a context-dependent role of BG and PFC structures in motor inhibition, being critical in reactive, unpredictable contexts, but less so in situations where one can prepare for stopping on a short timescale.

Do congruent lip movements facilitate speech processing in a dynamic audiovisual multi-talker scenario? An ERP study with older and younger adults

In natural conversations, visible mouth and lip movements play an important role in speech comprehension. There is evidence that visual speech information improves speech comprehension, especially for older adults and under difficult listening conditions. However, the neurocognitive basis is still poorly understood. The present EEG experiment investigated the benefits of audiovisual speech in a dynamic cocktail-party scenario with 22 (aged 20-34 years) younger and 20 (aged 55-74 years) older participants. We presented three simultaneously talking faces with a varying amount of visual speech input (still faces, visually unspecific and audiovisually congruent). In a two-alternative forced-choice task, participants had to discriminate target words ("yes" or "no") among two distractors (one-digit number words). In half of the experimental blocks, the target was always presented from a central position, in the other half, occasional switches to a lateral position could occur. We investigated behavioral and electrophysiological modulations due to age, location switches and the content of visual information, analyzing response times and accuracy as well as the P1, N1, P2, N2 event-related potentials (ERPs) and the contingent negative variation (CNV) in the EEG. We found that audiovisually congruent speech information improved performance and modulated ERP amplitudes in both age groups, suggesting enhanced preparation and integration of the subsequent auditory input. In the older group, larger amplitude measures were found in early phases of processing (P1-N1). Here, amplitude measures were reduced in response to audiovisually congruent stimuli. In later processing phases (P2-N2) we found decreased amplitude measures in the older group, while an amplitude reduction for audiovisually congruent compared to visually unspecific stimuli was still observable. However, these benefits were only observed as long as no location switches occurred, leading to enhanced amplitude measures in later processing phases (P2-N2). To conclude, meaningful visual information in a multi-talker setting, when presented from the expected location, is shown to be beneficial for both younger and older adults.

Mapping Tonal Hierarchy in the Brain

In Western tonal music, pitches are organized hierarchically based on their perceived fit in a specific tonal context. This hierarchy forms scales that are commonly used in Western tonal music. The hierarchical nature of tonal structure is well established behaviourally; however, the neural underpinnings are largely unknown. In this study, EEG data and goodness-of-fit ratings were collected from 34 participants who listened to an arpeggio followed by a probe tone, where the probe tone could be any chromatic scale degree and the context any of the major keys. Goodness-of-fit ratings corresponded to the classic tonal hierarchy. N1, P2 and the Early Right Anterior Negativity (ERAN) were significantly modulated by scale degree. Furthermore, neural marker amplitudes and latencies were significantly correlated with similar magnitude to both pitch height and goodness-of-fit ratings. This is different from the clearer divide between pitch height correlating with early neural markers (100-200 ms) and tonal hierarchy correlating with late neural markers (200-1000 ms) reported by Sankaran et al. (2020) and Quiroga-Martinez et al. (2019). Finally, individual differences were greater than any main effects detected when pooling participants and brain-behavior correlations vary widely (i.e. r = -0.8 to 0.8).

Electrophysiological correlates of the somatotopically organized tactile duration aftereffect

Adaptation to sensory events of long or short duration leads to a negative aftereffect, in which a new target event (of median duration) following the adaptation will be perceived to be shorter or longer than is actually the case. This illusion has been observed in visual, auditory, and tactile modalities. This study used event-related potentials (ERPs) to examine the tactile duration aftereffect, using the contingent negative variation (CNV) and the late positive component (LPC) as a way to characterize the temporal processes. The tactile duration adaptation was found to induce a significant aftereffect within a somatotopic framework. Moreover, the CNV in the contralateral scalp and the LPC in the fronto-central scalp were both modulated by the tactile duration adaptation. Specifically, adaptation to a short tactile duration increased the CNV and LPC amplitudes, whereas adaptation to a long tactile duration decreased them. This modulation was contingent on the topographic distance between fingers, which was only observed when the adapting and test fingers were consistent or adjacent, but not homologous. In sum, these results reveal a coherent behavioral-electrophysiological link in the somatotopically organized tactile duration aftereffect.

Implicit anticipation of probabilistic regularities: Larger CNV emerges for unpredictable events

Anticipation of upcoming events plays a crucial role in automatic behaviors. It is, however, still unclear whether the event-related brain potential (ERP) markers of anticipation could track the implicit acquisition of probabilistic regularities that can be considered as building blocks of automatic behaviors. Therefore, in a four-choice reaction time (RT) task performed by young adults (N = 36), the contingent negative variation (CNV) as an ERP marker of anticipation was measured from the onset of a cue stimulus until the presentation of a target stimulus. Due to the probability structure of the task, target stimuli were either predictable or unpredictable, but this was unknown to participants. The cue did not contain predictive information on the upcoming target. Results showed that the CNV amplitude during response preparation was larger before the unpredictable than before the predictable target stimuli. In addition, although RTs increased, the P3 amplitude decreased for the unpredictable as compared with the predictable target stimuli, possibly due to the stronger response preparation that preceded stimulus presentation. These results suggest that enhanced attentional resources are allocated to the implicit anticipation and processing of unpredictable events. This might originate from the formation of internal models on the probabilistic regularities of the stimulus stream, which primarily facilitates the processing of predictable events. Overall, we provide ERP evidence that supports the role of implicit anticipation and predictive processes in the acquisition of probabilistic regularities.

Stimulus-response learning and expected reward value enhance stimulus cognitive processing: An ERP study

Reward affects our attention to stimuli, prioritizing those that lead to high-value outcomes. Recently, it has been suggested that such reward-related cognitive prioritization might be associated with the process of learning new stimulus-response (S-R) associations, because both are acquired through extended reward training, and once established, they are hard to overcome. We used event-related potentials (ERP) to analyze the contribution of S-R links to the formation of reward-related cognitive prioritization during reinforcement learning. Reward-related cognitive prioritization was measured by comparing the ERP signals for stimuli predicting high-value and low-value outcomes. In addition, we compared a strong S-R link (same stimulus, same response), with a weak S-R link condition (same stimulus, two different responses). The participants' performance was more accurate and faster when the procedure allowed for establishing strong S-R links and for high-value outcomes. Furthermore, those stimuli associated with strong S-R links showed a larger P3 amplitude at parietal sites. Value effects (larger ERP activity for those stimuli predicting a high-value outcome) were obtained at parietal and occipital sites in the P3 time window. However, value effects did not benefit from strong S-R links in either the P1 or the P3 components. These results suggest that strong S-R learning is not necessary to develop reward-related modulations of ERP activity.

The Influence of Visual Attention on The Performance of A Novel Tactile P300 Brain-Computer Interface with Cheeks-Stim Paradigm

Tactile P300 brain-computer interface (BCI) generally has a worse accuracy and information transfer rate (ITR) than the visual-based BCI. It may be due to the fact that human beings have a relatively poor tactile perception. This study investigated the influence of visual attention on the performance of a tactile P300 BCI. We designed our paradigms based on a novel cheeks-stim paradigm which attached the stimulators on the subject's cheeks. Two paradigms were designed as follows: a paradigm with no visual attention and another paradigm with visual attention to the target position. Eleven subjects were invited to perform the two paradigms. We also recorded and analyzed the eyeball movement data during the paradigm with visual attention to explore whether the eyeball movement would have an effect on the BCI classification. The average online accuracy was 89.09% for the paradigm with visual attention, which was significantly higher than that of the paradigm with no visual attention (70.45%). Significant difference in ITR was also found between the two paradigms ([Formula: see text]). The results demonstrated that visual attention was an effective method to improve the performance of tactile P300 BCI. Our findings suggested that it may be feasible to complete an efficient tactile BCI system by adding visual attention.

Dissociable neural indices for time and space estimates during virtual distance reproduction

The perception and measurement of spatial and temporal dimensions have been widely studied. Yet, whether these two dimensions are processed independently is still being debated. Additionally, whether EEG components are uniquely associated with time or space, or whether they reflect a more general measure of magnitude quantity remains unknown. While undergoing EEG, subjects performed a virtual distance reproduction task, in which they were required to first walk forward for an unknown distance or time, and then reproduce that distance or time. Walking speed was varied between estimation and reproduction phases, to prevent interference between distance or time in each estimate. Behaviorally, subject performance was more variable when reproducing time than when reproducing distance, but with similar patterns of accuracy. During estimation, EEG data revealed the contingent negative variation (CNV), a measure previously associated with timing and expectation, tracked the probability of the upcoming interval, for both time and distance. However, during reproduction, the CNV exclusively oriented to the upcoming temporal interval at the start of reproduction, with no change across spatial distances. Our findings indicate that time and space are neurally separable dimensions, with the CNV both serving a supramodal role in temporal and spatial expectation, yet an exclusive role in preparing duration reproduction.