Decoding Stimulus-Response Representations and Their Stability Using EEG-Based Multivariate Pattern Analysis

Metacontrol instructions lead to adult-like event segmentation in adolescents

Event segmentation, which involves dividing continuous information into meaningful units, changes as children develop into adolescents. Adolescents tend to segment events more coarsely than adults. This study explores whether adolescents could adjust their segmentation style to resemble that of adults when provided with explicit metacontrol-related instructions. We compared event segmentation in two adolescent groups and one adult group, while simultaneously recording EEG data. One adolescent group was instructed to perform segmentation as finely as possible, whereas the other adolescent group and adults received no specific instructions on segmentation granularity. EEG data were analyzed using multivariate pattern analysis and source reconstruction. The findings revealed that adolescents given fine-grained instructions adjusted their segmentation probability closer to adult levels, although they did not fully match adults in processing multiple simultaneous changes. Neurophysiological results indicated that adolescents with fine-grained instructions exhibited neural decoding performance more similar to adults. Increased activity in the inferior frontal gyrus in these adolescents compared to adults related to this. The results suggest that adolescents with fine-grained instructions demonstrated more persistent cognitive control and enhanced top-down attention than their peers and adults. The study shows that adolescent cognitive processes can be shifted toward adult-like performance through instructions.

Directed connectivity in theta networks supports action-effect integration

The ability to plan and carry out goal-directed behavior presupposes knowledge about the contingencies between movements and their effects. Ideomotor accounts of action control assume that agents integrate action-effect contingencies by creating action-effect bindings, which associate movement patterns with their sensory consequences. However, the neurophysiological underpinnings of action-effect binding are not yet well understood. Given that theta band activity has been linked to information integration, we thus studied action-effect integration in an electrophysiological study with N = 31 healthy individuals with a strong focus on theta band activity. We examined how information between functional neuroanatomical structures is exchanged to enable action planning. We show that theta band activity in a network encompassing the insular cortex (IC), the anterior temporal lobe (ATL), and the inferior frontal cortex (IFC) supports the establishment of action-effect bindings. All regions revealed bi-directional effective connectivities, indicating information transfer between these regions. The IC and ATL create a loop for information integration and the conceptual abstraction of it. The involvement of anterior regions of the IFC, particularly during the acquisition phase of the action-effect, likely reflects episodic control mechanisms in which a past event defines a "template" of what action-effect is to be expected. Taken together, the current findings connect well with major cognitive concepts. Our study suggests a functional relevance of theta band activity in an IC-ATL-IFC network, which in turn implies that basic ideomotor action-effect integration is implemented through theta band activity and effective connectivities between temporo-frontal structures.

Neurophysiological principles underlying predictive coding during dynamic perception-action integration

A major concept in cognitive neuroscience is that brains are "prediction machines". Yet, conceptual frameworks on how perception and action become integrated still lack the concept of predictability and it is unclear how neural processes may implement predictive coding during dynamic perception-action integration. We show that distinct neurophysiological mechanisms of nonlinearly directed connectivities in the theta and alpha band between cortical structures underlie these processes. During the integration of perception and motor codes, especially theta band activity in the insular cortex and temporo-hippocampal structures is modulated by the predictability of upcoming information. Here, the insular cortex seems to guide processes. Conversely, the retrieval of such integrated perception-action codes during actions heavily relies on alpha band activity. Here, directed top-down influence of alpha band activity from inferior frontal structures on insular and temporo-hippocampal structures is key. This suggests that these top-down effects reflect attentional shielding of retrieval processes operating in the same neuroanatomical structures previously involved in the integration of perceptual and motor codes. Through neurophysiology, the present study connects predictive coding mechanisms with frameworks specifying the dynamic integration of perception and action.

Neural mechanisms of adaptive behavior: Dissociating local cortical modulations and interregional communication patterns

Adaptive behavior is based on flexibly managing and integrating perceptual and motor processes, and the reconfiguration thereof. Such adaptive behavior is also relevant during inhibitory control. Although research has demonstrated local activity modulations in theta and alpha frequency bands during behavioral adaptation, the communication of brain regions is insufficiently studied. Examining directed connectivity between brain regions using a machine learning approach, a generally increased activity, but decreased connectivity within a temporo-occipital theta band network was revealed during the reconfiguration of perception-action associations during inhibitory control. Additionally, a fronto-occipital alpha-theta interplay yielded a decrease in directed connectivity during reconfiguration processes, which was associated with lower error rates in behavior. Thus, adaptive behavior relies on both local increases and decreases of activity depending on the frequency band, and concomitant decreases in communication between frontal and sensory cortices. The findings reframe common conceptualizations about how adaptive behavior is supported by neural processes.

Increased beta synchronization underlies perception-action hyperbinding in functional movement disorders

Functional movement disorders are amongst the most common and disabling neurological conditions, placing a significant burden on the healthcare system. Despite the frequency and importance of functional movement disorders, our understanding of the underlying pathophysiology is limited, hindering the development of causal treatment options. Traditionally, functional movement disorders were considered as a psychiatric condition, associated with involuntary movements triggered by psychological stressors. Recent neurophysiological studies have unveiled cognitive alterations in affected individuals, suggesting that functional movement disorders might be better characterized by overarching neural principles governing cognitive functions. For instance, recent research has shown that the retrieval of stimulus-response bindings is altered in patients with functional movement disorders. Building upon these recent findings, our study delves into whether the initial integration of stimulus and response information is also disrupted in patients with functional movement disorders. To accomplish this, we reanalysed previously collected EEG data using refined analysis methods that provide insights into oscillatory activity and functional neuroanatomy associated with the integration of stimulus-response bindings. Our results demonstrate that post-movement beta synchronization (i) predicts behavioural stimulus-response binding and (ii) is significantly increased in patients with functional movement disorders compared to healthy controls. Utilizing beamformer analysis, we localized the difference effect to a cluster centred around the left supplementary motor area and the correlation effect to the right supplementary motor area. Extending beyond recent research that focused on the retrieval of stimulus-response bindings, our present findings reveal that the integration of stimulus and response information is already impaired in patients with functional movement disorders. These results uncover a phenomenon of hyperbinding between perception and action, which may represent a fundamental mechanism contributing to the movement impairments in patients with functional movement disorders.

Decoding cognition in neurodevelopmental, psychiatric and neurological conditions with multivariate pattern analysis of EEG data

Multivariate pattern analysis (MVPA) of electroencephalographic (EEG) data represents a revolutionary approach to investigate how the brain encodes information. By considering complex interactions among spatio-temporal features at the individual level, MVPA overcomes the limitations of univariate techniques, which often fail to account for the significant inter- and intra-individual neural variability. This is particularly relevant when studying clinical populations, and therefore MVPA of EEG data has recently started to be employed as a tool to study cognition in brain disorders. Here, we review the insights offered by this methodology in the study of anomalous patterns of neural activity in conditions such as autism, ADHD, schizophrenia, dyslexia, neurological and neurodegenerative disorders, within different cognitive domains (perception, attention, memory, consciousness). Despite potential drawbacks that should be attentively addressed, these studies reveal a peculiar sensitivity of MVPA in unveiling dysfunctional and compensatory neurocognitive dynamics of information processing, which often remain blind to traditional univariate approaches. Such higher sensitivity in characterizing individual neurocognitive profiles can provide unique opportunities to optimise assessment and promote personalised interventions.

The metacontrol of event segmentation-A neurophysiological and behavioral perspective

During our everyday life, the constant flow of information is divided into discrete events, a process conceptualized in Event Segmentation Theory (EST). How people perform event segmentation and the resulting granularity of encapsulated segments likely depends on their metacontrol style. Yet, the underlying neural mechanisms remain undetermined. The current study examines how the metacontrol style affects event segmentation through the analysis of EEG data using multivariate pattern analysis (MVPA) and source localization analysis. We instructed two groups of healthy participants to either segment a movie as fine-grained as possible (fine-grain group) or provided no such instruction (free-segmentation group). The fine-grain group showed more segments and a higher likelihood to set event boundaries upon scene changes, which supports the notion that cognitive control influences segmentation granularity. On a neural level, representational dynamics were decodable 400 ms prior to the decision to close a segment and open a new one, and especially fronto-polar regions (BA10) were associated with this representational dynamic. Groups differed in their use of this representational dynamics to guide behavior and there was a higher sensitivity to incoming information in the Fine-grain group. Moreover, a higher likelihood to set event boundaries was reflected by activity increases in the insular cortex suggesting an increased monitoring of potentially relevant upcoming events. The study connects the EST with the metacontrol framework and relates these to overarching neural concepts of prefrontal cortex function.

Attenuated conflict self-referential information facilitating conflict resolution

Self-referential information can reduce the congruency effect by acting as a signal to enhance cognitive control. However, it cannot be denied that self-referential information can attract and hold attention. To investigate this issue, the study used a revised Stroop task and recorded behavioral and electrophysiological data from thirty-three participants. We combined event-related potential (ERP) and multivariate pattern analysis (MVPA) to examine the neural correlates of self-referential processing and conflict processing. In the behavioral results, self-referential information reduced the congruency effect. Specifically, self-reference stimuli elicited smaller N2 amplitude than non-self-reference stimuli, indicating that self-referential information was promptly identified and reduced top-down cognitive resource consumption. Self-referential information could be reliably decoded from ERP signals in the early-to-mid stage. Moreover, self-reference conditions exhibited earlier congruency decoding than non-self-reference conditions, facilitating conflict monitoring. In the late stage, under the incongruent condition, self-reference stimuli elicited smaller sustained potential amplitude than non-self-reference stimuli, indicating that cognitive control in the self-reference condition required fewer cognitive resources for conflict resolution. Together, these findings revealed that self-referential information was identified and facilitated conflict monitoring, leading to more effective conflict resolution.

Neural representations of statistical and rule-based predictions in Gilles de la Tourette syndrome

Gilles de la Tourette syndrome (GTS) is a disorder characterised by motor and vocal tics, which may represent habitual actions as a result of enhanced learning of associations between stimuli and responses (S-R). In this study, we investigated how adults with GTS and healthy controls (HC) learn two types of regularities in a sequence: statistics (non-adjacent probabilities) and rules (predefined order). Participants completed a visuomotor sequence learning task while EEG was recorded. To understand the neurophysiological underpinnings of these regularities in GTS, multivariate pattern analyses on the temporally decomposed EEG signal as well as sLORETA source localisation method were conducted. We found that people with GTS showed superior statistical learning but comparable rule-based learning compared to HC participants. Adults with GTS had different neural representations for both statistics and rules than HC adults; specifically, adults with GTS maintained the regularity representations longer and had more overlap between them than HCs. Moreover, over different time scales, distinct fronto-parietal structures contribute to statistical learning in the GTS and HC groups. We propose that hyper-learning in GTS is a consequence of the altered sensitivity to encode complex statistics, which might lead to habitual actions.

Response stopping under conflict: The integrative role of representational dynamics associated with the insular cortex

Coping with distracting inputs during goal-directed behavior is a common challenge, especially when stopping ongoing responses. The neural basis for this remains debated. Our study explores this using a conflict-modulation Stop Signal task, integrating group independent component analysis (group-ICA), multivariate pattern analysis (MVPA), and EEG source localization analysis. Consistent with previous findings, we show that stopping performance is better in congruent (nonconflicting) trials than in incongruent (conflicting) trials. Conflict effects in incongruent trials compromise stopping more due to the need for the reconfiguration of stimulus-response (S-R) mappings. These cognitive dynamics are reflected by four independent neural activity patterns (ICA), each coding representational content (MVPA). It is shown that each component was equally important in predicting behavioral outcomes. The data support an emerging idea that perception-action integration in action-stopping involves multiple independent neural activity patterns. One pattern relates to the precuneus (BA 7) and is involved in attention and early S-R processes. Of note, three other independent neural activity patterns were associated with the insular cortex (BA13) in distinct time windows. These patterns reflect a role in early attentional selection but also show the reiterated processing of representational content relevant for stopping in different S-R mapping contexts. Moreover, the insular cortex's role in automatic versus complex response selection in relation to stopping processes is shown. Overall, the insular cortex is depicted as a brain hub, crucial for response selection and cancellation across both straightforward (automatic) and complex (conditional) S-R mappings, providing a neural basis for general cognitive accounts on action control.

The neural dynamics of conflict adaptation induced by conflict observation: Evidence from univariate and multivariate analysis

Conflict adaptation can be expressed as greater performance (shorter response time and lower error rate) after incongruent trials when compared to congruent trials. It has been observed in designs that minimize confounding factors, i.e., feature integration, contingency learning, and temporal learning. Our current study aimed to further elucidate the temporal evolution mechanisms of conflict adaptation. To address this issue, the current study employed a combination of behavioral, univariate, and multivariate analysis (MVPA) methods in a modified color-word Stroop task, where half of the trials required button presses (DO trials), and the other half only required observation (LOOK trials). Both behavioral and the ERP results (N450 and SP) in the LOOK-DO transition trials revealed significant conflict adaptation without feature integration, contingency learning, and temporal learning, providing support for the conflict monitoring theory. Furthermore, during the LOOK trials, significant Stroop effect in the N450 and SP components were observed, indicating that conflict monitoring occurred at the stimulus level and triggered reactive control adjustments. The MVPA results decoded the congruent-incongruent and incongruent-incongruent conditions during the conflict adjustment phase but not during the conflict monitoring phase, emphasizing the unique contribution of conflict adjustment to conflict adaptation. The current research findings provided more compelling supporting evidence for the conflict monitoring theory, while also indicating that future studies should employ the present design to elucidate the specific processes of conflict adaptation.

The Ability to Voluntarily Regulate Theta Band Activity Affects How Pharmacological Manipulation of the Catecholaminergic System Impacts Cognitive Control

BACKGROUND

The catecholaminergic system influences response inhibition, but the magnitude of the impact of catecholaminergic manipulation is heterogeneous. Theoretical considerations suggest that the voluntary modulability of theta band activity can explain this variance. The study aimed to investigate to what extent interindividual differences in catecholaminergic effects on response inhibition depend on voluntary theta band activity modulation.

METHODS

A total of 67 healthy adults were tested in a randomized, double-blind, cross-over study design. At each appointment, they received a single dose of methylphenidate or placebo and performed a Go/Nogo task with stimuli of varying complexity. Before the first appointment, the individual's ability to modulate theta band activity was measured. Recorded EEG data were analyzed using temporal decomposition and multivariate pattern analysis.

RESULTS

Methylphenidate effects and voluntary modulability of theta band activity showed an interactive effect on the false alarm rates of the different Nogo conditions. The multivariate pattern analysis revealed that methylphenidate effects interacted with voluntary modulability of theta band activity at a stimulus processing level, whereas during response selection methylphenidate effects interacted with the complexity of the Nogo condition.

CONCLUSIONS

The findings reveal that the individual's theta band modulability affects the responsiveness of an individual's catecholaminergic system to pharmacological modulation. Thus, the impact of pharmacological manipulation of the catecholaminergic system on cognitive control most likely depends on the existing ability to self-modulate relevant brain oscillatory patterns underlying the cognitive processes being targeted by pharmacological modulations.

Preserved perception-action integration in adolescents after a COVID-19 infection

Evidence is accumulating that the Coronavirus disease (COVID-19) can bring forth deficits in executive functioning via alterations in the dopaminergic system. Importantly, dopaminergic pathways have been shown to modulate how actions and perceptions are integrated within the brain. Such alterations in event file binding could thus underlie the cognitive deficits developing after a COVID-19 infection. We examined action-perception integration in a group of young people (11-19 years of age) that had been infected with COVID-19 before study participation (n = 34) and compared them to a group of uninfected healthy controls (n = 29) on the behavioral (i.e., task accuracy, reaction time) and neurophysiological (EEG) level using an established event file binding paradigm. Groups did not differ from each other regarding demographic variables or in reporting psychiatric symptoms. Overall, multiple lines of evidence (behavioral and neurophysiological) suggest that action-perception integration is preserved in adolescents who suffered from COVID-19 prior to study participation. Event file binding processes were intact in both groups on all levels. While cognitive impairments can occur following a COVID-19 infection, the study demonstrates that action-perception integration as one of the basic building blocks of cognition seems to be largely unaffected in adolescents with a rather mild course of the disease.

Perception-Action Integration Is Altered in Functional Movement Disorders

BACKGROUND

Although functional neurological movement disorders (FMD) are characterized by motor symptoms, sensory processing has also been shown to be disturbed. However, how the integration of perception and motor processes, essential for the control of goal-directed behavior, is altered in patients with FMD is less clear. A detailed investigation of these processes is crucial to foster a better understanding of the pathophysiology of FMD and can systematically be achieved in the framework of the theory of event coding (TEC).

OBJECTIVE

The aim was to investigate perception-action integration processes on a behavioral and neurophysiological level in patients with FMD.

METHODS

A total of 21 patients and 21 controls were investigated with a TEC-related task, including concomitant electroencephalogram (EEG) recording. We focused on EEG correlates established to reflect perception-action integration processes. Temporal decomposition allowed to distinguish between EEG codes reflecting sensory (S-cluster), motor (R-cluster), and integrated sensory-motor processing (C-cluster). We also applied source localization analyses.

RESULTS

Behaviorally, patients revealed stronger binding between perception and action, as evidenced by difficulties in reconfiguring previously established stimulus-response associations. Such hyperbinding was paralleled by a modulation of neuronal activity clusters, including reduced C-cluster modulations of the inferior parietal cortex and altered R-cluster modulations in the inferior frontal gyrus. Correlations of these modulations with symptom severity were also evident.

CONCLUSIONS

Our study shows that FMD is characterized by altered integration of sensory information with motor processes. Relations between clinical severity and both behavioral performance and neurophysiological abnormalities indicate that perception-action integration processes are central and a promising concept for the understanding of FMD. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.

Cognitive and Neural Mechanisms of Behavior Therapy for Tics: A Perception-Action Integration Approach

European clinical guidelines recommend the use of Exposure and Response Prevention (ERP) and Comprehensive Behavioral Intervention for Tics (CBIT) as first-line treatments for tic disorders. Although ongoing efforts in research are being made to understand the mechanisms underlying these behavioral approaches, as of yet, the neurophysiological mechanisms behind behavioral interventions are poorly understood. However, this is essential to tailor interventions to individual patients in order to increase compliance and efficacy. The Theory of Event Coding (TEC) and its derivative BRAC (Binding and Retrieval in Action Control) provide a theoretical framework to investigate cognitive and neural processes in the context of tic disorders. In this context, tics are conceptualized as a phenomenon of enhanced perception-action binding, with premonitory urges constituting the perceptual and the motor or vocal expression constituting the action part of an event file. Based on this, CBIT is assumed to strongly affect stimulus-response binding in the context of response selection, whereas the effects of ERP presumably unfold during stimulus-response binding in the response inhibition context. Further studies are needed to clarify the neurophysiological processes underlying behavioral interventions to enable the individualization and further development of therapeutic approaches for tic disorders.

Interplay between alpha and theta band activity enables management of perception-action representations for goal-directed behavior

Goal-directed behavior requires integrated mental representations of perceptions and actions. The neurophysiological underpinnings of these processes, however, are not yet understood. It is particularly undetermined, which oscillatory activities in which brain regions are involved in the management of perception-action representations. We examine this question with a focus on response inhibition processes and show that the dynamics of perception-action representations reflected in theta band activity (TBA) are particularly evident in the supplementary motor area and the occipito-temporal cortex. Mental representations coded in alpha band activity (ABA) during perception-action integration are associated with the occipito-temporal cortex. Crucially, perception-action representations are exchanged between theta and alpha frequency bands. The results imply that ABA functions as dynamic top-down control over binding, retrieval and reconfiguration processes during response inhibition, which in turn are reflected by TBA. Our study thus highlights how the interplay of oscillatory activity enables the management of perception-action representations for goal-directed behavior.

Towards a systematization of brain oscillatory activity in actions

Information processing in the brain is governed by oscillatory activity. Activity oscillations in specific frequency bands (theta, alpha, beta and gamma) have been associated with various cognitive functions. A drawback of this is that the plethora of findings led to considerable uncertainty as to the functional relevance of activity in different frequency bands and their interrelation. Here, we use a novel cognitive-science theoretical framework to better understand and conceptually harmonize neurophysiological research on human action control. We outline how this validated starting point can systematize and probably reframe the functional relevance of oscillatory activity relevant for action control and beyond.

Perception-action integration during inhibitory control is reflected in a concomitant multi-region processing of specific codes in the neurophysiological signal

The integration of perception and action has long been studied in psychological science using overarching cognitive frameworks. Despite these being very successful in explaining perception-action integration, little is known about its neurophysiological and especially the functional neuroanatomical foundations. It is unknown whether distinct brain structures are simultaneously involved in the processing of perception-action integration codes and also to what extent demands on perception-action integration modulate activities in these structures. We investigate these questions in an EEG study integrating temporal and ICA-based EEG signal decomposition with source localization. For this purpose, we used data from 32 healthy participants who performed a 'TEC Go/Nogo' task. We show that the EEG signal can be decomposed into components carrying different informational aspects or processing codes relevant for perception-action integration. Importantly, these specific codes are processed independently in different brain structures, and their specific roles during the processing of perception-action integration differ. Some regions (i.e., the anterior cingulate and insular cortex) take a 'default role' because these are not modulated in their activity by demands or the complexity of event file coding processes. In contrast, regions in the motor cortex, middle frontal, temporal, and superior parietal cortices were not activated by 'default' but revealed modulations depending on the complexity of perception-action integration (i.e., whether an event file has to be reconfigured). Perception-action integration thus reflects a multi-region processing of specific fractions of information in the neurophysiological signal. This needs to be taken into account when further developing a cognitive science framework detailing perception-action integration.

Neurophysiological principles of inhibitory control processes during cognitive flexibility

Inhibitory control plays an indispensable role in cognitive flexibility. Nevertheless, the neurophysiological principles underlying this are incompletely understood. This owes to the fact that the representational dynamics, as coded in oscillatory neural activity of different frequency bands has not been considered until now-despite being of conceptual relevance. Moreover, it is unclear in how far distinct functional neuroanatomical regions are concomitantly involved in the processing of representational dynamics. We examine these questions using a combination of EEG methods. We show that theta-band activity plays an essential role for inhibitory control processes during cognitive flexibility across informational aspects coded in distinct fractions of the neurophysiological signal. It is shown that posterior parietal structures and the inferior parietal cortex seem to be the most important cortical region for inhibitory control processes during cognitive flexibility. Theta-band activity plays an essential role in processes of retrieving the previously inhibited representations related to the current task during cognitive flexibility. The representational content relevant for inhibitory processes during cognitive flexibility is coded in the theta frequency band. We outline how the observed neural mechanisms inform recent overarching cognitive frameworks on how flexible action control is accomplished.

On the Role of Stimulus-Response Context in Inhibitory Control in Alcohol Use Disorder

The behavioral and neural dynamics of response inhibition deficits in alcohol use disorder (AUD) are still largely unclear, despite them possibly being key to the mechanistic understanding of the disorder. Our study investigated the effect of automatic vs. controlled processing during response inhibition in participants with mild-to-moderate AUD and matched healthy controls. For this, a Simon Nogo task was combined with EEG signal decomposition, multivariate pattern analysis (MVPA), and source localization methods. The final sample comprised n = 59 (32♂) AUD participants and n = 64 (28♂) control participants. Compared with the control group, AUD participants showed overall better response inhibition performance. Furthermore, the AUD group was less influenced by the modulatory effect of automatic vs. controlled processes during response inhibition (i.e., had a smaller Simon Nogo effect). The neurophysiological data revealed that the reduced Simon Nogo effect in the AUD group was associated with reduced activation differences between congruent and incongruent Nogo trials in the inferior and middle frontal gyrus. Notably, the drinking frequency (but not the number of AUD criteria we had used to distinguish groups) predicted the extent of the Simon Nogo effect. We suggest that the counterintuitive advantage of participants with mild-to-moderate AUD over those in the control group could be explained by the allostatic model of drinking effects.

Evidence for independent representational contents in inhibitory control subprocesses associated with frontoparietal cortices

Inhibitory control processes have intensively been studied in cognitive science for the past decades. Even though the neural dynamics underlying these processes are increasingly better understood, a critical open question is how the representational dynamics of the inhibitory control processes are modulated when engaging in response inhibition in a relatively automatic or a controlled mode. Against the background of an overarching theory of perception-action integration, we combine temporal and spatial EEG signal decomposition methods with multivariate pattern analysis and source localization to obtain fine-grained insights into the neural dynamics of the representational content of response inhibition. For this purpose, we used a sample of N = 40 healthy adult participants. The behavioural data suggest that response inhibition was better in a more controlled than a more automated response execution mode. Regarding neural dynamics, effects of response inhibition modes relied on a concomitant coding of stimulus-related information and rules of how stimulus information is related to the appropriate motor programme. Crucially, these fractions of information, which are encoded at the same time in the neurophysiological signal, are based on two independent spatial neurophysiological activity patterns, also showing differences in the temporal stability of the representational content. Source localizations revealed that the precuneus and inferior parietal cortex regions are more relevant than prefrontal areas for the representation of stimulus-response selection codes. We provide a blueprint how a concatenation of EEG signal analysis methods, capturing distinct aspects of neural dynamics, can be connected to cognitive science theory on the importance of representations in action control.

A ventral stream-prefrontal cortex processing cascade enables working memory gating dynamics

The representation of incoming information, goals and the flexible processing of these are required for cognitive control. Efficient mechanisms are needed to decide when it is important that novel information enters working memory (WM) and when these WM 'gates' have to be closed. Compared to neural foundations of maintaining information in WM, considerably less is known about what neural mechanisms underlie the representational dynamics during WM gating. Using different EEG analysis methods, we trace the path of mental representations along the human cortex during WM gate opening and closing. We show temporally nested representational dynamics during WM gate opening and closing depending on multiple independent neural activity profiles. These activity profiles are attributable to a ventral stream-prefrontal cortex processing cascade. The representational dynamics start in the ventral stream during WM gate opening and WM gate closing before prefrontal cortical regions are modulated. A regional specific activity profile is shown within the prefrontal cortex depending on whether WM gates are opened or closed, matching overarching concepts of prefrontal cortex functions. The study closes an essential conceptual gap detailing the neural dynamics underlying how mental representations drive the WM gate to open or close to enable WM functions such as updating and maintenance.

Cognitive science theory-driven pharmacology elucidates the neurobiological basis of perception-motor integration

An efficient integration of sensory and motor processes is crucial to goal-directed behavior. Despite this high relevance, and although cognitive theories provide clear conceptual frameworks, the neurobiological basis of these processes remains insufficiently understood. In a double-blind, randomized placebo-controlled pharmacological study, we examine the relevance of catecholamines for perception-motor integration processes. Using EEG data, we perform an in-depth analysis of the underlying neurophysiological mechanisms, focusing on sensorimotor integration processes during response inhibition. We show that the catecholaminergic system affects sensorimotor integration during response inhibition by modulating the stability of the representational content. Importantly, catecholamine levels do not affect the stability of all aspects of information processing during sensorimotor integration, but rather-as suggested by cognitive theory-of specific codes in the neurophysiological signal. Particularly fronto-parietal cortical regions are associated with the identified mechanisms. The study shows how cognitive science theory-driven pharmacology can shed light on the neurobiological basis of perception-motor integration and how catecholamines affect specific information codes relevant to cognitive control.

Decoding the Specificity of Post-Error Adjustments Using EEG-Based Multivariate Pattern Analysis

Errors can elicit post-error adjustments that serve to optimize performance by preventing further errors. An essential but unsolved issue is that whether post-error adjustments are domain-general or domain-specific, which was investigated in the present study through eliciting different types of errors. Behavioral and electrophysiological data were recorded when male and female subjects performed the Eriksen flanker task. For this study, we examined the aforementioned issue by combining event-related potential and multivariate pattern analysis. The results indicated that post-error slowing, error-related negativity, and error positivity were comparable between congruent and incongruent errors, indicating that errors triggered domain-general interference mechanisms, whereas post-error accuracy and late positive potential elicited by incongruent errors were larger than those elicited by congruent errors, exhibiting domain-specific control adjustment mechanisms. Importantly, no successful decoding soon after errors was found between congruent and incongruent errors, but above-chance decoding was observed between these two types of errors with increasing time, which further support that domain-general adjustments occurred in the early stage, whereas domain-specific adjustments appeared in the late stage. Furthermore, brain-behavior correlation results suggested that the late post-error adjustments predicted subsequent behavior performance. Together, this study revealed that early domain-general interference adjustments induced by errors are reflected in error detection and error awareness, which are independent of error types; on the contrary, late domain-specific control adjustments are reflected in attentional adjustments, which are modulated by error types.SIGNIFICANCE STATEMENT To date, clear evidence on the specificity of post-error adjustments is lacking. The present study provides neurophysiological evidence that post-error adjustments simultaneously rely on both domain-general and domain-specific mechanisms. Event-related potential results indicated that domain-general adjustments were accompanied by the interference of error detection and error awareness. In contrast, domain-specific adjustments were associated with attentional adjustments. Multivariate pattern analysis further decoded the two features of post-error adjustments in the early stage matching the time patterns of error-related negativity and error positivity and in the late stage corresponding to the late positive potential. Temporal generalization analysis showed that domain-specific processing appeared stably in late post-error adjustments. Hence, we propose that post-error different stages may determine the specificity of post-error adjustments.

Processing of embedded response plans is modulated by an interplay of fronto-parietal theta and beta activity

Even simple actions like opening a door require integration/binding and flexible re-activation of different motor elements. Yet, the neural mechanisms underlying the processing of such 'embedded response plans' are largely elusive, despite theoretical frameworks, such as the Theory of Event Coding, describing the involved cognitive processes. In a sample of N = 40 healthy participants we combine time-frequency decomposition and various beamforming methods to examine neurophysiological dynamics of such action plans - with special emphasis on the interplay of theta and beta frequency activity during the processing of these plans. We show that the integration and rule-guided reactivation of embedded response plans is modulated by a complex interplay of theta and beta activity. Pre-trial BBA is related to different functional neuroanatomical structures which are activated in a consecutive fashion. Enhanced preparatory activity is positively associated with higher binding-related BBA in the precuneus/parietal areas, indicating that activity in the precuneus/parietal cortex facilitates the execution of an embedded action sequence. Increased preparation subsequently leads to reduced working memory retrieval demands. A cascading pattern of interactions between pre-trial and within-trial activity indicates the importance of preparatory brain activity. The study shows that there are multiple roles of beta and theta oscillations associated with different functional neuroanatomical structures during the integration and reactivation of motor elements during actions.

The neural stability of perception-motor representations affects action outcomes and behavioral adaptation

Actions can fail - even though this is well known, little is known about what distinguishes neurophysiological processes preceding errors and correct actions. In this study, relying on the Theory of Event Coding, we test the assumption that only specific aspects of information coded in EEG activity are relevant for understanding processes leading to response errors. We examined N = 69 healthy participants who performed a mental rotation task and combined temporal EEG signal decomposition with multivariate pattern analysis (MVPA) and source localization analyses. We show that fractions of the EEG signal, primarily representing stimulus-response translation (event file) processes and motor response representations, are essential. Stimulus representations were less critical. The source localization results revealed widespread activity modulations in structures including the frontopolar, the middle and superior frontal, the anterior cingulate cortex, the cuneus, the inferior parietal cortex, and the ventral stream regions. These are associated with differential effects of the neural dynamics preceding correct/erroneous responses. The temporal-generalization MVPA showed that event file representations and representations of the motor response were already distinct 200 ms after stimulus presentation and this lasted till around 700 ms. The stability of this representational content was predictive for the magnitude of posterror slowing, which was particularly strong when there was no clear distinction between the neural activity profile of event file representations associated with a correct or an erroneous response. The study provides a detailed analysis of the dynamics leading to an error/correct response in connection to an overarching framework on action control.

On the Role of Memory Representations in Action Control: Neurophysiological Decoding Reveals the Reactivation of Integrated Stimulus-Response Feature Representations

Efficient response selection is essential to flexible, goal-directed behavior. Prominent theoretical frameworks such as the Theory of Event Coding and Binding and Retrieval in Action Control have provided insights regarding the dynamics of perception-action integration processes. According to Theory of Event Coding and Binding and Retrieval in Action Control, encoded representations of stimulus-response bindings influence later retrieval processes of these bindings. However, this concept still lacks conclusive empirical evidence. In the current study, we applied representational decoding to EEG data. On the behavioral level, the findings replicated binding effects that have been established in previous studies: The task performance was impaired when an event file had to be reconfigured. The EEG-decoding results showed that retrieval processes of stimulus-response bindings could be decoded using the representational content developed after the initial establishment of these stimulus-response bindings. We showed that stimulus-related properties became immediately reactivated when re-encountering the respective stimulus-response association. These reactivations were temporally stable. In contrast, representations of stimulus-response mappings revealed a transient pattern of activity and could not successfully be decoded directly after stimulus-response binding. Information detailing the bindings between stimuli and responses were also retrieved, but only after having been loaded into a memory system. The current study supports the notion that stimulus-response integration and memory processes are intertwined at multiple levels.

Protocol to decode representations from EEG data with intermixed signals using temporal signal decomposition and multivariate pattern-analysis

The electroencephalogram (EEG) is one of the most widely used techniques in cognitive neuroscience. We present a protocol showing how to combine a temporal signal decomposition approach (RIDE, Residue iteration decomposition) with multivariate pattern analysis (MVPA) to obtain insights into the temporal stability of representations coded in distinct informational fractions of the EEG signal. In this protocol, we describe pre-processing of human EEG data, followed by the set-up and use of MATLAB-based toolboxes for RIDE and MVPA analysis.

For complete details on the use and execution of this protocol, please refer to Petruo et al. (2021).

•

A protocol for decoding temporally decomposed EEG signal

•

Steps for Residue iteration decomposition (RIDE) and handling the decomposed data

•

Steps for subsequent multivariate pattern analysis (MVPA) with different toolboxes

•

Recommendations for combined RIDE-MVPA research applications

Publisher’s note: Undertaking any experimental protocol requires adherence to local institutional guidelines for laboratory safety and ethics.

Alpha and Theta Bands Dynamics Serve Distinct Functions during Perception-Action Integration in Response Inhibition

The ability to inhibit responses is central for situational behavior. However, the mechanisms how sensory information is used to inform inhibitory control processes are incompletely understood. In the current study, we examined neurophysiological processes of perception-action integration in response inhibition using the theory of event coding as a conceptual framework. Based on theoretical considerations, we focused on theta and alpha band activity in close connection to the functional neuroanatomical level using EEG beamforming. Moreover, we performed a network-based analysis of theta and alpha band activity. We show a seesaw-like relationship between medial and superior frontal cortex theta band activity and frontoparietal cortex alpha band activity during perception-action integration in response inhibition, depending on the necessity to reconfigure perception-action associations. When perception-action integration was more demanding, because perception-action associations (bindings) have to be reconfigured, there was an increase of theta and a decrease of alpha band activity. Vice versa, when there was no need to reconfigure perception-action bindings, theta band activity was low and alpha band activity was high. However, theta band processes seem to be most important for perception-action integration in response inhibition, because only the sensor-level network organization of theta band activity showed variations depending on the necessity to reconfigure perception-action associations. When no reconfiguration was necessary, the network architecture was more small-world-like, likely enabling efficient processing. When reconfigurations were necessary, the network organization becomes more random. These differences were particularly strong for fractions of the neurophysiological signal supposed to reflect response selection processes.

Linking the Brain with Behavior: The Neural Dynamics of Success and Failure in Goal-directed Behavior

The human brain is extremely flexible and capable of rapidly selecting relevant information in accordance with task goals. Regions of frontoparietal cortex flexibly represent relevant task information such as task rules and stimulus features when participants perform tasks successfully, but less is known about how information processing breaks down when participants make mistakes. This is important for understanding whether and when information coding recorded with neuroimaging is directly meaningful for behavior. Here, we used magnetoencephalography to assess the temporal dynamics of information processing and linked neural responses with goal-directed behavior by analyzing how they changed on behavioral error. Participants performed a difficult stimulus–response task using two stimulus–response mapping rules. We used time-resolved multivariate pattern analysis to characterize the progression of information coding from perceptual information about the stimulus, cue and rule coding, and finally, motor response. Response-aligned analyses revealed a ramping up of perceptual information before a correct response, suggestive of internal evidence accumulation. Strikingly, when participants made a stimulus-related error, and not when they made other types of errors, patterns of activity initially reflected the stimulus presented, but later reversed, and accumulated toward a representation of the “incorrect” stimulus. This suggests that the patterns recorded at later time points reflect an internally generated stimulus representation that was used to make the (incorrect) decision. These results illustrate the orderly and overlapping temporal dynamics of information coding in perceptual decision-making and show a clear link between neural patterns in the late stages of processing and behavior.

A role of the norepinephrine system or effort in the interplay of different facets of inhibitory control

Inhibitory control has multiple facets, and one possible distinction can be made between 'inhibition of interferences' and the 'inhibition of actions'. Both facets of inhibitory control show an interdependency. Even though some neurophysiological processes underlying this interdependency have been examined, the role of neuro-modulatory processes in their interplay are not understood. In the current study, we examine the role of the norepinephrine (NE) system in these processes. We did so by combining a Go/Nogo and Simon task. We recorded the EEG and pupil diameter data as an indirect index of NE system activity during the task. EEG theta band activity data and pupil diameter data were then integrated after conducting a temporal signal decomposition of the EEG data. We show that particularly theta band activity coding stimulus-response translation processes associated with middle frontal cortices, but not stimulus-driven processes are modulated by the interplay between the 'inhibition of interferences' and the 'inhibition of actions'. Modulations in stimulus-response translation processes were systematically correlated with pupil-diameter responses. The pattern of correlations suggests that phasic NE system activity particularly modulates stimulus-response mapping processes during conflict monitoring in incongruent Nogo trials, which may explain behavioral performance effects. Phasic NE system activity reflects essential modulators of the interplay between the 'inhibition of interferences' and the 'inhibition of actions'.

Neural correlates of abnormal cognitive conflict resolution in major depression: An event-related potential study

Abnormal cognitive conflict resolution has been considered as a critical element of executive dysfunctions inpatient with major depression (MD). Further clarifying whether there was a deficit at perceptual encoding stage or the early response-execution stage in conflict control function by event-related potential (ERP) technique in MD would be helpful in understanding the neural mechanism of MD. Participants included twenty-six depressed patients and twenty-six healthy controls (HCs). All participants measured with Hamilton Depression Scale (17-item edition, HAMD) and a Simon task. Electroencephalograms were synchronously recorded when performing the Simon task. The method of residue iteration decomposition was used to analyze the lateralized readiness potential (LRP) and P300 components, which contributed to divides ERP components into a stimulus-locked component (S-cluster), a response-locked component (R-cluster) and an intermediate component cluster (C-cluster) by using latency variability and time markers. Results showed that reactive times (RTs) for both groups were fastest in congruent trials, and slowest in incongruent trials; however, there is no difference in RTs under the three conditions between two groups. Accuracy Rate (ACC) for both groups were the highest in neutral trials, and the lowest in incongruent trials; ACC in MD group were all lower than that of HC group under three conditions. ERP data analyses showed that depressed patients had a deficit in activating the correct response, as reflected by reduced amplitudes of R-LRP, but no abnormality in LRP-S and P300-C. In conclusion, patients with MD present conflict control dysfunction (i.e., abnormal cognitive conflict resolution) at the early response-execution stage, not at perceptual encoding stage, which may be reflected by the reduced R-LRP amplitudes. The abnormal cognitive conflict resolution in activating the correct response might constitute an interesting treatment target.

Multi-level decoding of task sets in neurophysiological data during cognitive flexibility

Cognitive flexibility is essential to achieve higher level goals. Cognitive theories assume that the activation/deactivation of goals and task rules is central to understand cognitive flexibility. However, how this activation/deactivation dynamic is implemented on a neurophysiological level is unclear. Using EEG-based multivariate pattern analysis (MVPA) methods, we show that activation of relevant information occurs parallel in time at multiple levels in the neurophysiological signal containing aspects of stimulus-related processing, response selection, and motor response execution, and relates to different brain regions. The intensity with which task sets are activated and processed dynamically decreases and increases. The temporal stability of these activations could, however, hardly explain behavioral performance. Instead, task set deactivation processes associated with left orbitofrontal regions and inferior parietal regions selectively acting on motor response task sets are relevant. The study shows how propositions from cognitive theories stressing the importance task set activation/deactivation during cognitive flexibility are implemented on a neurophysiological level.

•

Stimulus-related, motor, and response selection aspects of task set were decoded

•

Activation of task rule information occurs at multiple neurophysiological levels

•

Activation and deactivation of rule sets contributes to cognitive flexibility

Distinguishing Multiple Coding Levels in Theta Band Activity During Working Memory Gating Processes

Cognitive control and working memory (WM) processes are essential for goal-directed behaviour. Cognitive control and WM are probably based on overlapping neurophysiological mechanisms. For example, theta-band activity (TBA) plays an important role in both functions. For cognitive control processes, it is known that different aspects of information about stimulus content, motor processes and stimulus-response relationships are encoded simultaneously in the TBA. All this information is probably processed during WM gating processes and must be controlled during them. However, direct data for this are lacking. This question is investigated in this study by combining methods of EEG temporal signal decomposition, time-frequency decomposition and beamforming. We show that portions of stimulus-related information, motor response-related information and information related to the interaction between the stimulus and motor responses in the TBA are influenced in parallel and to a similar extent by WM gate opening and gate closing processes. Nevertheless, it is stimulus-related information in the theta signal in particular that modulates behavioural performance in WM-gating. The data suggest that the identified processes are implemented in specific neuroanatomical structures. In particular, the medial frontal cortex, temporal cortical regions and insular cortex are involved in these dynamics. The study shows that principles of information coding relevant to cognitive control processes are also crucial for understanding WM gating.

Increased scale-free and aperiodic neural activity during sensorimotor integration-a novel facet in Tourette syndrome

Tourette syndrome is a common neurodevelopmental disorder defined by multiple motor and phonic tics. Tics in Tourette syndrome resemble spontaneously occurring movements in healthy controls and are therefore sometimes difficult to distinguish from these. Tics may in fact be mis-interpreted as a meaningful action, i.e. a signal with social content, whereas they lack such information and could be conceived a surplus of action or 'motor noise'. These and other considerations have led to a 'neural noise account' of Tourette syndrome suggesting that the processing of neural noise and adaptation of the signal-to-noise ratio during information processing is relevant for the understanding of Tourette syndrome. So far, there is no direct evidence for this. Here, we tested the 'neural noise account' examining 1/f noise, also called scale-free neural activity as well as aperiodic activity, in n = 74 children, adolescents and adults with Tourette syndrome and n = 74 healthy controls during task performance using EEG data recorded during a sensorimotor integration task. In keeping with results of a previous study in adults with Tourette syndrome, behavioural data confirmed that sensorimotor integration was also stronger in this larger Tourette syndrome cohort underscoring the relevance of perceptual-action processes in this disorder. More importantly, we show that 1/f noise and aperiodic activity during sensorimotor processing is increased in patients with Tourette syndrome supporting the 'neural noise account'. This implies that asynchronous/aperiodic neural activity during sensorimotor integration is stronger in patients with Tourette syndrome compared to healthy controls, which is probably related to abnormalities of GABAergic and dopaminergic transmission in these patients. Differences in 1/f noise and aperiodic activity between patients with Tourette syndrome and healthy controls were driven by high-frequency oscillations and not lower-frequency activity currently discussed to be important in the pathophysiology of tics. This and the fact that Bayesian statistics showed that there is evidence for the absence of a correlation between neural noise and clinical measures of tics, suggest that increased 1/f noise and aperiodic activity are not directly related to tics but rather represents a novel facet of Tourette syndrome.

Dissociable Components of Information Encoding in Human Perception

Brain decoding can predict visual perception from non-invasive electrophysiological data by combining information across multiple channels. However, decoding methods typically conflate the composite and distributed neural processes underlying perception that are together present in the signal, making it unclear what specific aspects of the neural computations involved in perception are reflected in this type of macroscale data. Using MEG data recorded while participants viewed a large number of naturalistic images, we analytically decomposed the brain signal into its oscillatory and non-oscillatory components, and used this decomposition to show that there are at least three dissociable stimulus-specific aspects to the brain data: a slow, non-oscillatory component, reflecting the temporally stable aspect of the stimulus representation; a global phase shift of the oscillation, reflecting the overall speed of processing of specific stimuli; and differential patterns of phase across channels, likely reflecting stimulus-specific computations. Further, we show that common cognitive interpretations of decoding analysis, in particular about how representations generalize across time, can benefit from acknowledging the multicomponent nature of the signal in the study of perception.

Perception-action integration in young age-A cross-sectional EEG study

Humans differ in their capacity for integrating perceived events and related actions. The "Theory of event coding" (TEC) conceptualizes how stimuli and actions are cognitively bound into a common functional representation (or "code"), known as the "event file". To date, however, the neural processes underlying the development of event file coding mechanisms across age are largely unclear. We investigated age-related neural changes of event file coding from late childhood to early adulthood, using EEG signal decompositions methods. We included a group of healthy participants (n = 91) between 10 and 30 years, performing an event file paradigm. Results of this study revealed age-related effects on event file coding processes both at the behavioural and the neurophysiological level. Performance accuracy data showed that event file unbinding und rebinding processes become more efficient from late childhood to early adulthood. These behavioural effects are reflected by age-related effects in two neurophysiological subprocesses associated with the superior parietal cortex (BA7) as revealed in the analyses using EEG signal decomposition. The first process entails mapping and association processes between stimulus and response; whereas, the second comprises inhibitory control subprocesses subserving the selection of the relevant motor programme amongst competing response options.

Distinct Brain-Oscillatory Neuroanatomical Architecture of Perception-Action Integration in Adolescents With Tourette Syndrome

Background

Gilles de la Tourette Syndrome (GTS) is a neurodevelopmental disorder with a peak of symptom severity around late childhood and early adolescence. Previous findings in adult GTS suggest that changes in perception-action integration, as conceptualized in the theory of event coding framework, are central for the understanding of GTS. However, the neural mechanisms underlying these processes in adolescence are elusive.

Methods

A total of 59 children/adolescents aged 9 to 18 years (n = 32 with GTS, n = 27 typically developing youths) were examined using a perception-action integration task (event file task) derived from the theory of event coding. Event-related electroencephalogram recordings (theta and beta band activity) were analyzed using electroencephalogram–beamforming methods.

Results

Behavioral data showed robust event file binding effects in both groups without group differences. Neurophysiological data showed that theta and beta band activity were involved in event file integration in both groups. However, the functional neuroanatomical organization was markedly different for theta band activity between the groups. The typically developing group mainly relied on superior frontal regions, whereas the GTS group engaged parietal and inferior frontal regions. A more consistent functional neuroanatomical activation pattern was observed for the beta band, engaging inferior parietal and temporal regions in both groups.

Conclusions

Perception-action integration processes lag behind in persisting GTS but not in the GTS population as a whole, underscoring differences in developmental trajectories and the importance of longitudinal investigations for the understanding of GTS. The findings corroborate known differences in the functional/structural brain organization in GTS and suggest an important role of theta band activity in these patients.

Inter-individual differences in urge-tic associations in Tourette syndrome

Premonitory urges are a cardinal feature in Tourette syndrome (GTS) and are commonly viewed as a driving force of tics. However, inter-individual differences in experimentally measured urges, tics and urge-tic associations, as well as possible relations to clinical characteristics and abnormal perception-action processing recently demonstrated in these patients have not been investigated in detail. Here, we analyze the temporal associations between urges and tics in 21 adult patients with GTS including inter-individual differences and the relation of such associations with clinical measures and experimentally tested perception-action coupling. At the group level, our results confirm known positive associations between subjective urges and tics, with increased tic frequency and tic intensity during periods of elevated urge. Inter-individual differences in the associations between urges and tics were, however, substantial. While most participants (57-66 % depending on the specific measure) showed positive associations as expected, several participants did not, and two even had negative associations with tic occurrence and intensity being reduced at times of increased urges. Subjective urge levels and tic occurrence correlated with corresponding clinical scores, providing converging evidence. Measures of the strength of urge-tic associations did not correlate with clinical measures nor the strength of perception-action coupling. Taken together, urge-tic associations in GTS are complex and heterogenous, casting doubt on the notion that tics are primarily driven by urges.

Perception-Action Integration Is Modulated by the Catecholaminergic System Depending on Learning Experience

BACKGROUND

The process underlying the integration of perception and action is a focal topic in neuroscientific research and cognitive frameworks such as the theory of event coding have been developed to explain the mechanisms of perception-action integration. The neurobiological underpinnings are poorly understood. While it has been suggested that the catecholaminergic system may play a role, there are opposing predictions regarding the effects of catecholamines on perception-action integration.

METHODS

Methylphenidate (MPH) is a compound commonly used to modulate the catecholaminergic system. In a double-blind, randomized crossover study design, we examined the effect of MPH (0.25 mg/kg) on perception-action integration using an established "event file coding" paradigm in a group of n = 45 healthy young adults.

RESULTS

The data reveal that, compared with the placebo, MPH attenuates binding effects based on the established associations between stimuli and responses, provided participants are already familiar with the task. However, without prior task experience, MPH did not modulate performance compared with the placebo.

CONCLUSIONS

Catecholamines and learning experience interactively modulate perception-action integration, especially when perception-action associations have to be reconfigured. The data suggest there is a gain control-based mechanism underlying the interactive effects of learning/task experience and catecholaminergic activity during perception-action integration.

Neural dynamics of stimulus-response representations during inhibitory control

The investigation of action control processes is one major field in cognitive neuroscience and several theoretical frameworks have been proposed. One established framework is the "Theory of Event Coding" (TEC). However, only rarely, this framework has been used in the context of response inhibition and how stimulus-response association or binding processes modulate response inhibition performance. Particularly the neural dynamics of stimulus-response representations during inhibitory control are elusive. To address this, we examined n = 40 healthy controls and combined temporal EEG signal decomposition with source localization and temporal generalization multivariate pattern analysis (MVPA). We show that overlaps in features of stimuli used to trigger either response execution or inhibition compromised task performance. According to TEC, this indicates that binding processes in event file representations impact response inhibition through partial repetition costs. In the EEG data, reconfiguration of event files modulated processes in time windows well-known to reflect distinct response inhibition mechanisms. Crucially, event file coding processes were only evident in a specific fraction of neurophysiological activity associated with the inferior parietal cortex (BA40). Within that specific fraction of neurophysiological activity, the decoding of the dynamics of event file representations using temporal generalization MVPA suggested that event file representations are stable across several hundred milliseconds, and that event file coding during inhibitory control is reflected by a sustained activation pattern of neural dynamics.NEW & NOTEWORTHY The "mental representation" of how stimulus input translate into the appropriate response is central for goal-directed behavior. However, little is known about the dynamics of such representations on the neurophysiological level when it comes to the inhibition of motor processes. This dynamic is shown in the current study.

Lower-level associations in Gilles de la Tourette syndrome: Convergence between hyperbinding of stimulus and response features and procedural hyperfunctioning theories

Gilles de la Tourette syndrome (GTS) can be characterized by enhanced cognitive functions related to creating, modifying and maintaining connections between stimuli and responses (S-R links). Specifically, two areas, procedural sequence learning and, as a novel finding, also event file binding, show converging evidence of hyperfunctioning in GTS. In this review, we describe how these two enhanced functions can be considered as cognitive mechanisms behind habitual behaviour, such as tics in GTS. Moreover, the presence of both procedural sequence learning and event file binding hyperfunctioning in the same disorder can be treated as evidence for their functional connections, even beyond GTS. Importantly though, we argue that hyperfunctioning of event file binding and procedural learning are not interchangeable: they have different time scales, different sensitivities to potential impairment in action sequencing and distinguishable contributions to the cognitive profile of GTS. An integrated theoretical account of hyperbinding and hyperlearning in GTS allows to formulate predictions for the emergence, activation and long-term persistence of tics in GTS.

Neurophysiological and functional neuroanatomical coding of statistical and deterministic rule information during sequence learning

Humans are capable of acquiring multiple types of information presented in the same information stream. It has been suggested that at least two parallel learning processes are important during learning of sequential patterns-statistical learning and rule-based learning. Yet, the neurophysiological underpinnings of these parallel learning processes are not fully understood. To differentiate between the simultaneous mechanisms at the single trial level, we apply a temporal EEG signal decomposition approach together with sLORETA source localization method to delineate whether distinct statistical and rule-based learning codes can be distinguished in EEG data and can be related to distinct functional neuroanatomical structures. We demonstrate that concomitant but distinct aspects of information coded in the N2 time window play a role in these mechanisms: mismatch detection and response control underlie statistical learning and rule-based learning, respectively, albeit with different levels of time-sensitivity. Moreover, the effects of the two learning mechanisms in the different temporally decomposed clusters of neural activity also differed from each other in neural sources. Importantly, the right inferior frontal cortex (BA44) was specifically implicated in visuomotor statistical learning, confirming its role in the acquisition of transitional probabilities. In contrast, visuomotor rule-based learning was associated with the prefrontal gyrus (BA6). The results show how simultaneous learning mechanisms operate at the neurophysiological level and are orchestrated by distinct prefrontal cortical areas. The current findings deepen our understanding on the mechanisms of how humans are capable of learning multiple types of information from the same stimulus stream in a parallel fashion.

Watching the Brain as It (Un)Binds: Beta Synchronization Relates to Distractor-Response Binding

Human action control relies on event files, that is, short-term stimulus-response bindings that result from the integration of perception and action. The present EEG study examined oscillatory brain activities related to the integration and disintegration of event files in the distractor-response binding (DRB) task, which relies on a sequential prime-probe structure with orthogonal variation of distractor and response relations between prime and probe. Behavioral results indicated a DRB effect in RTs, which was moderated by the duration of the response-stimulus interval (RSI) between prime response and probe stimulus onset. Indeed, a DRB effect was observed for a short RSI of 500 msec but not for a longer RSI of 2000 msec, indicating disintegration of event files over time. EEG results revealed a positive correlation between individual DRB in the RSI-2000 condition and postmovement beta synchronization after both prime and probe responses. Beamformer analysis localized this correlation effect to the middle occipital gyrus, which also showed highest coherency with precentral and inferior parietal brain regions. Together, these findings suggest that postmovement beta synchronization is a marker of event file disintegration, with the left middle occipital gyrus being a hub region for stimulus-response bindings in the visual DRB task.

Anodal tDCS modulates specific processing codes during conflict monitoring associated with superior and middle frontal cortices

Conflict monitoring processes are central for cognitive control. Neurophysiological correlates of conflict monitoring (i.e. the N2 ERP) likely represent a mixture of different cognitive processes. Based on theoretical considerations, we hypothesized that effects of anodal tDCS (atDCS) in superior frontal areas affect specific subprocesses in neurophysiological activity during conflict monitoring. To investigate this, young healthy adults performed a Simon task while EEG was recorded. atDCS and sham tDCS were applied in a single-blind, cross-over study design. Using temporal signal decomposition in combination with source localization analyses, we demonstrated that atDCS effects on cognitive control are very specific: the detrimental effect of atDCS on response speed was largest in case of response conflicts. This however only showed in aspects of the decomposed N2 component, reflecting stimulus-response translation processes. In contrast to this, stimulus-related aspects of the N2 as well as purely response-related processes were not modulated by atDCS. EEG source localization analyses revealed that the effect was likely driven by activity modulations in the superior frontal areas, including the supplementary motor cortex (BA6), as well as middle frontal (BA9) and medial frontal areas (BA32). atDCS did not modulate effects of proprioceptive information on hand position, even though this aspect is known to be processed within the same brain areas. Physiological effects of atDCS likely modulate specific aspects of information processing during cognitive control.

On the functional role of striatal and anterior cingulate GABA+ in stimulus-response binding

Successful response selection relies on constantly updating stimulus-response associations. The Theory of Event Coding (TEC) proposes that perception and action are conjointly coded in event files, for which fronto-striatal networks seem to play an important role. However, the exact neurobiochemical mechanism behind event file coding has remained unknown. We investigated the functional relevance of the striatal and anterior cingulate (ACC) GABAergic system using magnetic resonance spectroscopy (MRS). Specifically, the striatal and ACC concentrations of GABA+ referenced against N-acetylaspartate (NAA) were assessed in 35 young healthy males, who subsequently performed a standard event file task. As predicted by the TEC, the participants' responses were modulated by pre-established stimulus response bindings in event files. GABA+/NAA concentrations in the striatum and ACC were not correlated with the overall event binding effect. However, higher GABA+/NAA concentrations in the ACC were correlated with stronger event file binding processes in the early phase of the task. This association disappeared by the end of the task. Taken together, our findings show that striatal GABA+ levels does not seem to modulate event file binding, while ACC GABA+ seem to improve event file binding, but only as long as the participants have not yet gathered sufficient task experience. To the best of our knowledge, this is the first study providing direct evidence for the role of striatal and ACC GABA+ in stimulus-response bindings and thus insights into the brain structure-specific neurobiological aspects of the TEC.

Neurophysiological mechanisms underlying motor feature binding processes and representations

Coherent, voluntary action requires an integrated representation of these actions and their defining features. Although theories delineate how action integration requiring binding between different action features may be accomplished, the underlying neurophysiological mechanisms are largely elusive. The present study examined the neurophysiological mechanisms underlying binding processes in actions. To this end, we conducted EEG recordings and applied standard event-related potential analyses, temporal EEG signal decomposition and multivariate pattern analyses (MVPA). According to the code occupation account, an overlap between a planned and a to-be-performed action impairs performance. The level, to which performance is attenuated depends on the strength of binding of action features. This binding process then determines the representation of them, the so-called action files. We show that code occupation and bindings between action features specifically modulate processes preceding motor execution as showed by the stimulus-locked lateralized readiness potential (LRP). Conversely, motor execution processes reflected by the response-locked LRP were not modulated by action file binding. The temporal decomposition of the EEG signal, further distinguished between action file related processes: the planned response determining code occupation was reflected in general (voluntary) response selection but not in involuntary (response priming-related) activation. Moreover, MVPA on temporally decomposed neural signals indicated that action files are represented as a continuous chain of activations. Within this chain, inhibitory and response re-activation patterns can be distinguished. Taken together, the neurophysiological correlates of action file binding suggest that parallel, stimulus- and response-related pre-motor processes are responsible for the code occupation in the human motor system.

Neurophysiology of embedded response plans: age effects in action execution but not in feature integration from preadolescence to adulthood

Performing a goal-directed movement consists of a chain of complex preparatory mechanisms. Such planning especially requires integration (or binding) of various action features, a process that has been conceptualized in the "theory of event coding." Theoretical considerations and empirical research suggest that these processes are subject to developmental effects from adolescence to adulthood. The aim of the present study was to investigate age-related modulations in action feature binding processes and to shed light on underlying neurophysiological development from preadolescence to early adulthood. We examined a group of healthy participants (n = 61) between 10 and 30 yr of age, who performed a task that requires a series of bimanual response selections in an embedded paradigm. For an in-depth analysis of the underlying neural correlates, we applied EEG signal decomposition together with source localization analyses. Behavioral results across the whole group did not show binding effects in reaction times but in intraindividual response variability. From age 10 to 30 yr, there was a decrease in reaction times and reaction time variability but no age-related effect in action file binding. The latter were corroborated by Bayesian data analyses. On the brain level, the developmental effects on response selection were associated with activation modulations in the superior parietal cortex (BA7). The results show that mechanisms of action execution and speed, but not those of action feature binding, are subject to age-related changes between the age of 10 and 30 yr.NEW & NOTEWORTHY Different aspects of an action need to be integrated to allow smooth unfolding of behavior. We examine developmental effects in these processes and show that mechanisms of action execution and speed, but not those of action feature binding, are subject to age-related changes between the age of 10 and 30 yr.

Resting theta activity is associated with specific coding levels in event-related theta activity during conflict monitoring

Brain electrical activity in the theta frequency band is essential for cognitive control (e.g., during conflict monitoring), but is also evident in the resting state. The link between resting state theta activity and its relevance for theta-related neural mechanisms during cognitive control is still undetermined. Yet, theoretical considerations suggest that there may be a connection. To examine the link between resting state theta activity and conflict-related theta activity, we combined temporal EEG signal decomposition methods with time-frequency decomposition and beamforming methods in N = 86 healthy participants. Results indicate that resting state theta activity is closely associated with the strength of conflict-related neural activity at the level of ERPs and total theta power (consisting of phase-locked and nonphase-locked aspects of theta activity). The data reveal that resting state theta activity is related to a specific aspect of conflict-related theta activity, mainly in superior frontal regions and in the supplemental motor area (SMA, BA6) in particular. The signal decomposition showed that only stimulus-related, but not motor-response-related coding levels in the EEG signal and the event-related total theta activity were associated with resting theta activity. This specificity of effects may explain why the association between resting state theta activity and overt conflict monitoring performance may not be as strong as often assumed. The results suggest that resting state theta activity is particularly important to consider for input integration processes during cognitive control.