Bridging prediction and attention in current research on perception and action

Exploring neural dynamics in self-voice processing and perception: Implications for hallucination proneness

Altered sensory feedback processing and attention control are assumed to contribute to auditory verbal hallucinations, which are experienced by the general population and patients with psychosis, implying a continuum of hallucination proneness (HP). However, the interaction of altered sensory feedback processing and attention control along this HP continuum remains unclear. We tested this interaction using electroencephalography while forty participants varying on HP, self-generated (via a button-press) and passively listened to their own voices. These voices were created by first recording each participant's neutral and angry voice and then morphing them to create final five types of voice stimuli differing in voice quality per participant (100 % neutral, 60-40 % neutral-angry, 50-50 % neutral-angry, 40-60 % neutral-angry, 100 % angry). Regardless of the voice quality, the N100 and P200 suppression effects decreased with increase in HP. This may indicate increased error awareness and attention allocation in high HP individuals for self-voice generation stemming from altered sensory feedback processing, and/or attentional control. The current findings suggest that alterations of the sensory feedback processing and/or attentional control in self-voice production are fundamental characteristics of the continuum of HP, regardless of the clinical status of voice hearers.

Increased visual alpha-band activity during self-paced finger tapping does not affect early visual stimulus processing

Alpha-band activity is thought to be involved in orchestrating neural processing within and across brain regions relevant to various functions such as perception, cognition, and motor activity. Across different studies, attenuated alpha-band activity has been linked to increased neural excitability. Yet, there have been conflicting results concerning the consequences of alpha-band modulations for early sensory processing. We here examined whether movement-related alterations in visual alpha-band activity affected the early sensory processing of visual stimuli. For this purpose, in an EEG experiment, participants were engaged in a voluntary finger-tapping task while passively viewing flickering dots. We found extensive and expected movement-related amplitude modulations of motor alpha- and beta-band activity with event-related-desynchronization (ERD) before and during, and event-related-synchronization (ERS) after single voluntary finger taps. Crucially, while a visual alpha-band ERS accompanied the motor alpha-ERD before and during each finger tap, flicker-evoked Steady-State-Visually-Evoked-Potentials (SSVEPs), as a marker of early visual sensory gain, were not modulated in amplitude. As early sensory stimulus processing was unaffected by amplitude-modulated visual alpha-band activity, this argues against the idea that alpha-band activity represents a mechanism by which early sensory gain modulation is implemented. The distinct neural dynamics of visual alpha-band activity and early sensory processing may point to distinct and multiplexed neural selection processes in visual processing.

Distraction by unexpected sounds: comparing response repetition and response switching

Numerous studies using oddball tasks have shown that unexpected sounds presented in a predictable or repeated sequence (deviant vs. standard sounds) capture attention and negatively impact ongoing behavioral performance. Here, we examine an aspect of this effect that has gone relatively unnoticed: the impact of deviant sounds is stronger for response repetitions than for response switches. Our approach was two-fold. First, we carried out a simulation to estimate the likelihood that stimuli sequences used in past work may not have used balanced proportions of response repetition and switch trials. More specifically, we sought to determine whether the larger distraction effect for response repetitions may have reflected a rarer, and thereby more surprising, occurrence of such trials. To do so, we simulated 10,000 stimuli sets for a 2-AFC task with a proportion of deviant trial of 0.1 or 0.16. Second, we carried out a 2-AFC oddball task in which participants judged the duration of a tone (short vs. long). We carefully controlled the sequence of stimuli to ensure to balance the proportions of response repetitions and response switches across the standard and deviant conditions. The results of the stimuli simulation showed that, contrary to our concerns, response switches were more likely than response repetitions when left uncontrolled for. This suggests that the larger distraction found for response repetition in past work may in fact have been underestimated. In the tone duration judgment task, the results showed a large impact of the response type on distraction as measured by response times: Deviants sounds significantly delayed response repetitions but notably accelerated switches. These findings suggest that deviant sound hinder response repetition and encourage or bias the cognitive system towards a change of responses. We discuss these findings in relation to the adaptive nature of the involuntary detection of unexpected stimuli and in relation to the notion of partial repetition costs. We argue that results are in line with the binding account as well as with the signaling theory.

Hallucination Proneness Alters Sensory Feedback Processing in Self-voice Production

BACKGROUND

Sensory suppression occurs when hearing one's self-generated voice, as opposed to passively listening to one's own voice. Quality changes in sensory feedback to the self-generated voice can increase attentional control. These changes affect the self-other voice distinction and might lead to hearing voices in the absence of an external source (ie, auditory verbal hallucinations). However, it is unclear how changes in sensory feedback processing and attention allocation interact and how this interaction might relate to hallucination proneness (HP).

STUDY DESIGN

Participants varying in HP self-generated (via a button-press) and passively listened to their voice that varied in emotional quality and certainty of recognition-100% neutral, 60%-40% neutral-angry, 50%-50% neutral-angry, 40%-60% neutral-angry, 100% angry, during electroencephalography (EEG) recordings.

STUDY RESULTS

The N1 auditory evoked potential was more suppressed for self-generated than externally generated voices. Increased HP was associated with (1) an increased N1 response to the self- compared with externally generated voices, (2) a reduced N1 response for angry compared with neutral voices, and (3) a reduced N2 response to unexpected voice quality in sensory feedback (60%-40% neutral-angry) compared with neutral voices.

CONCLUSIONS

The current study highlights an association between increased HP and systematic changes in the emotional quality and certainty in sensory feedback processing (N1) and attentional control (N2) in self-voice production in a nonclinical population. Considering that voice hearers also display these changes, these findings support the continuum hypothesis.

Attention to audiovisual speech shapes neural processing through feedback-feedforward loops between different nodes of the speech network

Selective attention-related top-down modulation plays a significant role in separating relevant speech from irrelevant background speech when vocal attributes separating concurrent speakers are small and continuously evolving. Electrophysiological studies have shown that such top-down modulation enhances neural tracking of attended speech. Yet, the specific cortical regions involved remain unclear due to the limited spatial resolution of most electrophysiological techniques. To overcome such limitations, we collected both electroencephalography (EEG) (high temporal resolution) and functional magnetic resonance imaging (fMRI) (high spatial resolution), while human participants selectively attended to speakers in audiovisual scenes containing overlapping cocktail party speech. To utilise the advantages of the respective techniques, we analysed neural tracking of speech using the EEG data and performed representational dissimilarity-based EEG-fMRI fusion. We observed that attention enhanced neural tracking and modulated EEG correlates throughout the latencies studied. Further, attention-related enhancement of neural tracking fluctuated in predictable temporal profiles. We discuss how such temporal dynamics could arise from a combination of interactions between attention and prediction as well as plastic properties of the auditory cortex. EEG-fMRI fusion revealed attention-related iterative feedforward-feedback loops between hierarchically organised nodes of the ventral auditory object related processing stream. Our findings support models where attention facilitates dynamic neural changes in the auditory cortex, ultimately aiding discrimination of relevant sounds from irrelevant ones while conserving neural resources.

Attention and Prediction-Guided Motion Detection for Low-Contrast Small Moving Targets

Small target motion detection within complex natural environments is an extremely challenging task for autonomous robots. Surprisingly, the visual systems of insects have evolved to be highly efficient in detecting mates and tracking prey, even though targets occupy as small as a few degrees of their visual fields. The excellent sensitivity to small target motion relies on a class of specialized neurons, called small target motion detectors (STMDs). However, existing STMD-based models are heavily dependent on visual contrast and perform poorly in complex natural environments, where small targets generally exhibit extremely low contrast against neighboring backgrounds. In this article, we develop an attention-and-prediction-guided visual system to overcome this limitation. The developed visual system comprises three main subsystems, namely: 1) an attention module; 2) an STMD-based neural network; and 3) a prediction module. The attention module searches for potential small targets in the predicted areas of the input image and enhances their contrast against a complex background. The STMD-based neural network receives the contrast-enhanced image and discriminates small moving targets from background false positives. The prediction module foresees future positions of the detected targets and generates a prediction map for the attention module. The three subsystems are connected in a recurrent architecture, allowing information to be processed sequentially to activate specific areas for small target detection. Extensive experiments on synthetic and real-world datasets demonstrate the effectiveness and superiority of the proposed visual system for detecting small, low-contrast moving targets against complex natural environments.

Neuronal responses to omitted tones in the auditory brain: A neuronal correlate for predictive coding

Prediction provides key advantages for survival, and cognitive studies have demonstrated that the brain computes multilevel predictions. Evidence for predictions remains elusive at the neuronal level because of the complexity of separating neural activity into predictions and stimulus responses. We overcome this challenge by recording from single neurons from cortical and subcortical auditory regions in anesthetized and awake preparations, during unexpected stimulus omissions interspersed in a regular sequence of tones. We find a subset of neurons that responds reliably to omitted tones. In awake animals, omission responses are similar to anesthetized animals, but larger and more frequent, indicating that the arousal and attentional state levels affect the degree to which predictions are neuronally represented. Omission-sensitive neurons also responded to frequency deviants, with their omission responses getting emphasized in the awake state. Because omission responses occur in the absence of sensory input, they provide solid and empirical evidence for the implementation of a predictive process.

Individual neurophysiological signatures of spontaneous rhythm processing

When sensory input conveys rhythmic regularity, we can form predictions about the timing of upcoming events. Although rhythm processing capacities differ considerably between individuals, these differences are often obscured by participant- and trial-level data averaging procedures in M/EEG research. Here, we systematically assessed neurophysiological variability displayed by individuals listening to isochronous (1.54Hz) equitone sequences interspersed with unexpected (amplitude-attenuated) deviant tones. Our approach aimed at revealing time-varying adaptive neural mechanisms for sampling the acoustic environment at multiple timescales. Rhythm tracking analyses confirmed that individuals encode temporal regularities and form temporal expectations, as indicated in delta-band (1.54Hz) power and its anticipatory phase alignment to expected tone onsets. Zooming into tone- and participant-level data, we further characterized intra- and inter-individual variabilities in phase-alignment across auditory sequences. Further, individual modelling of beta-band tone-locked responses showed that a subset of auditory sequences was sampled rhythmically by superimposing binary (strong-weak; S-w), ternary (S-w-w) and mixed accentuation patterns. In these sequences, neural responses to standard and deviant tones were modulated by a binary accentuation pattern, thus pointing towards a mechanism of dynamic attending. Altogether, the current results point toward complementary roles of delta- and beta-band activity in rhythm processing and further highlight diverse and adaptive mechanisms to track and sample the acoustic environment at multiple timescales, even in the absence of task-specific instructions.

Top-down specific preparatory activations for selective attention and perceptual expectations

Proactive cognition brain models are mainstream nowadays. Within these, preparation is understood as an endogenous, top-down function that takes place prior to the actual perception of a stimulus and improves subsequent behavior. Neuroimaging has shown the existence of such preparatory activity separately in different cognitive domains, however no research to date has sought to uncover their potential similarities and differences. Two of these, often confounded in the literature, are Selective Attention (information relevance) and Perceptual Expectation (information probability). We used EEG to characterize the mechanisms that pre-activate specific contents in Attention and Expectation. In different blocks, participants were cued to the relevance or to the probability of target categories, faces vs. names, in a gender discrimination task. Multivariate Pattern (MVPA) and Representational Similarity Analyses (RSA) during the preparation window showed that both manipulations led to a significant, ramping-up prediction of the relevant or expected target category. However, classifiers trained with data from one condition did not generalize to the other, indicating the existence of unique anticipatory neural patterns. In addition, a Canonical Template Tracking procedure showed that there was stronger anticipatory perceptual reinstatement for relevance than for expectation blocks. Overall, the results indicate that preparation during attention and expectation acts through distinguishable neural mechanisms. These findings have important implications for current models of brain functioning, as they are a first step towards characterizing and dissociating the neural mechanisms involved in top-down anticipatory processing.

Distraction by violation of sensory predictions: Functional distinction between deviant sounds and unexpected silences

It has been established that participants performing a continuous categorization task respond significantly slower following the presentation of unexpected, task-irrelevant, auditory stimuli, compared to a repetitive (standard) sound. Evidence indicates that such distraction emerges because of the violation of sensory predictions. This has typically been studied by measuring the impact of replacing the repeated sound by a different sound on rare and unpredictable trials. Here, we examine the impact of a different type of violation: the mere omission of the standard sound. Capitalizing upon the recent finding that deviant sounds exert distinct effects on response times as a function of whether participants produced or withheld a response on the previous trial, we present the results of an experiment seeking to disentangle two potential effects of sound omission: deviance distraction and the removal of an unspecific warning signal. The results indicate that deviant sound and the unexpected omission of the standard sound impact response times through, at least partially, distinct mechanisms. Deviant sounds affect performance by triggering the orienting of attention towards a new sensory input. Sound omissions, in contrast, appear to affect performance in part because responses no longer benefit from an unspecific warning signal to prepare for action.

An ALE meta-analytic review of top-down and bottom-up processing of music in the brain

A remarkable feature of the human brain is its ability to integrate information from the environment with internally generated content. The integration of top-down and bottom-up processes during complex multi-modal human activities, however, is yet to be fully understood. Music provides an excellent model for understanding this since music listening leads to the urge to move, and music making entails both playing and listening at the same time (i.e., audio-motor coupling). Here, we conducted activation likelihood estimation (ALE) meta-analyses of 130 neuroimaging studies of music perception, production and imagery, with 2660 foci, 139 experiments, and 2516 participants. We found that music perception and production rely on auditory cortices and sensorimotor cortices, while music imagery recruits distinct parietal regions. This indicates that the brain requires different structures to process similar information which is made available either by an interaction with the environment (i.e., bottom-up) or by internally generated content (i.e., top-down).

Preparatory delta phase response is correlated with naturalistic speech comprehension performance

While human speech comprehension is thought to be an active process that involves top-down predictions, it remains unclear how predictive information is used to prepare for the processing of upcoming speech information. We aimed to identify the neural signatures of the preparatory processing of upcoming speech. Participants selectively attended to one of two competing naturalistic, narrative speech streams, and a temporal response function (TRF) method was applied to derive event-related-like neural responses from electroencephalographic data. The phase responses to the attended speech at the delta band (1-4 Hz) were correlated with the comprehension performance of individual participants, with a latency of - 200-0 ms relative to the onset of speech amplitude envelope fluctuations over the fronto-central and left-lateralized parietal electrodes. The phase responses to the attended speech at the alpha band also correlated with comprehension performance but with a latency of 650-980 ms post-onset over the fronto-central electrodes. Distinct neural signatures were found for the attentional modulation, taking the form of TRF-based amplitude responses at a latency of 240-320 ms post-onset over the left-lateralized fronto-central and occipital electrodes. Our findings reveal how the brain gets prepared to process an upcoming speech in a continuous, naturalistic speech context.

Real and imagined sensory feedback have comparable effects on action anticipation

The forward model monitors the success of sensory feedback to an action and links it to an efference copy originating in the motor system. The Readiness Potential (RP) of the electroencephalogram has been denoted as a neural signature of the efference copy. An open question is whether imagined sensory feedback works similarly to real sensory feedback. We investigated the RP to audible and imagined sounds in a button-press paradigm and assessed the role of sound complexity (vocal vs. non-vocal sound). Sensory feedback (both audible and imagined) in response to a voluntary action modulated the RP amplitude time-locked to the button press. The RP amplitude increase was larger for actions with expected sensory feedback (audible and imagined) than those without sensory feedback, and associated with N1 suppression for audible sounds. Further, the early RP phase was increased when actions elicited an imagined vocal (self-voice) compared to non-vocal sound. Our results support the notion that sensory feedback is anticipated before voluntary actions. This is the case for both audible and imagined sensory feedback and confirms a role of overt and covert feedback in the forward model.

Changes in motor preparation affect the sensory consequences of voice production in voice hearers

BACKGROUND

Auditory verbal hallucinations (AVH) are a cardinal symptom of psychosis but are also present in 6-13% of the general population. Alterations in sensory feedback processing are a likely cause of AVH, indicative of changes in the forward model. However, it is unknown whether such alterations are related to anomalies in forming an efference copy during action preparation, selective for voices, and similar along the psychosis continuum. By directly comparing psychotic and nonclinical voice hearers (NCVH), the current study specifies whether and how AVH proneness modulates both the efference copy (Readiness Potential) and sensory feedback processing for voices and tones (N1, P2) with event-related brain potentials (ERPs).

METHODS

Controls with low AVH proneness (n = 15), NCVH (n = 16) and first-episode psychotic patients with AVH (n = 16) engaged in a button-press task with two types of stimuli: self-initiated and externally generated self-voices or tones during EEG recordings.

RESULTS

Groups differed in sensory feedback processing of expected and actual feedback: NCVH displayed an atypically enhanced N1 to self-initiated voices, while N1 suppression was reduced in psychotic patients. P2 suppression for voices and tones was strongest in NCVH, but absent for voices in patients. Motor activity preceding the button press was reduced in NCVH and patients, specifically for sensory feedback to self-voice in NCVH.

CONCLUSIONS

These findings suggest that selective changes in sensory feedback to voice are core to AVH. These changes already show in preparatory motor activity, potentially reflecting changes in forming an efference copy. The results provide partial support for continuum models of psychosis.

Incidental or Intentional? Different Brain Responses to One's Own Action Sounds in Hurdling vs. Tap Dancing

Most human actions produce concomitant sounds. Action sounds can be either part of the action goal (GAS, goal-related action sounds), as for instance in tap dancing, or a mere by-product of the action (BAS, by-product action sounds), as for instance in hurdling. It is currently unclear whether these two types of action sounds-incidental or intentional-differ in their neural representation and whether the impact on the performance evaluation of an action diverges between the two. We here examined whether during the observation of tap dancing compared to hurdling, auditory information is a more important factor for positive action quality ratings. Moreover, we tested whether observation of tap dancing vs. hurdling led to stronger attenuation in primary auditory cortex, and a stronger mismatch signal when sounds do not match our expectations. We recorded individual point-light videos of newly trained participants performing tap dancing and hurdling. In the subsequent functional magnetic resonance imaging (fMRI) session, participants were presented with the videos that displayed their own actions, including corresponding action sounds, and were asked to rate the quality of their performance. Videos were either in their original form or scrambled regarding the visual modality, the auditory modality, or both. As hypothesized, behavioral results showed significantly lower rating scores in the GAS condition compared to the BAS condition when the auditory modality was scrambled. Functional MRI contrasts between BAS and GAS actions revealed higher activation of primary auditory cortex in the BAS condition, speaking in favor of stronger attenuation in GAS, as well as stronger activation of posterior superior temporal gyri and the supplementary motor area in GAS. Results suggest that the processing of self-generated action sounds depends on whether we have the intention to produce a sound with our action or not, and action sounds may be more prone to be used as sensory feedback when they are part of the explicit action goal. Our findings contribute to a better understanding of the function of action sounds for learning and controlling sound-producing actions.

Beat-based and Memory-based Temporal Expectations in Rhythm: Similar Perceptual Effects, Different Underlying Mechanisms

Predicting the timing of incoming information allows the brain to optimize information processing in dynamic environments. Behaviorally, temporal expectations have been shown to facilitate processing of events at expected time points, such as sounds that coincide with the beat in musical rhythm. Yet, temporal expectations can develop based on different forms of structure in the environment, not just the regularity afforded by a musical beat. Little is still known about how different types of temporal expectations are neurally implemented and affect performance. Here, we orthogonally manipulated the periodicity and predictability of rhythmic sequences to examine the mechanisms underlying beat-based and memory-based temporal expectations, respectively. Behaviorally and using EEG, we looked at the effects of beat-based and memory-based expectations on auditory processing when rhythms were task-relevant or task-irrelevant. At expected time points, both beat-based and memory-based expectations facilitated target detection and led to attenuation of P1 and N1 responses, even when expectations were task-irrelevant (unattended). For beat-based expectations, we additionally found reduced target detection and enhanced N1 responses for events at unexpected time points (e.g., off-beat), regardless of the presence of memory-based expectations or task relevance. This latter finding supports the notion that periodicity selectively induces rhythmic fluctuations in neural excitability and furthermore indicates that, although beat-based and memory-based expectations may similarly affect auditory processing of expected events, their underlying neural mechanisms may be different.

Challenges to the Modularity Thesis Under the Bayesian Brain Models

Modularity assumption is central to most theoretical and empirical approaches in cognitive science. The Bayesian Brain (BB) models are a class of neuro-computational models that aim to ground perception, cognition, and action under a single computational principle of prediction-error minimization. It is argued that the proposals of BB models contradict the modular nature of mind as the modularity assumption entails computational separation of individual modules. This review examines how BB models address the assumption of modularity. Empirical evidences of top-down influence on early sensory processes is often cited as a case against the modularity thesis. In the modularity thesis, such top-down effects are attributed to attentional modulation of the output of an early impenetrable stage of sensory processing. The attentional-mediation argument defends the modularity thesis. We analyse this argument using the novel conception of attention in the BB models. We attempt to reconcile classical bottom-up vs. top-down dichotomy of information processing, within the information passing scheme of the BB models. Theoretical considerations and empirical findings associated with BB models that address the modularity assumption is reviewed. Further, we examine the modularity of perceptual and motor systems.

Expectation Gates Neural Facilitation of Emotional Words in Early Visual Areas

The current study examined whether emotional expectations gate attention to emotional words in early visual cortex. Color cues informed about word valence and onset latency. We observed a stimulus-preceding negativity prior to the onset of cued words that was larger for negative than for neutral words. This indicates that in anticipation of emotional words more attention was allocated to them than to neutral words before target onset. During stimulus presentation the steady-state visual evoked potential (SSVEP), elicited by flickering words, was attenuated for cued compared to uncued words, indicating sharpened sensory activity, i.e., expectation suppression. Most importantly, the SSVEP was more enhanced for negative than neutral words when these were cued. Uncued conditions did not differ in SSVEP amplitudes, paralleling previous studies reporting lexico-semantic but not early visual effects of emotional words. We suggest that cueing mediates re-entrant engagement of visual resources by providing an early “affective gist” of an upcoming word. Consequently, visual single-word studies may have underestimated attentional effects of emotional words and their anticipation during reading.

Voice-selective prediction alterations in nonclinical voice hearers

Auditory verbal hallucinations (AVH) are a cardinal symptom of psychosis but also occur in 6–13% of the general population. Voice perception is thought to engage an internal forward model that generates predictions, preparing the auditory cortex for upcoming sensory feedback. Impaired processing of sensory feedback in vocalization seems to underlie the experience of AVH in psychosis, but whether this is the case in nonclinical voice hearers remains unclear. The current study used electroencephalography (EEG) to investigate whether and how hallucination predisposition (HP) modulates the internal forward model in response to self-initiated tones and self-voices. Participants varying in HP (based on the Launay-Slade Hallucination Scale) listened to self-generated and externally generated tones or self-voices. HP did not affect responses to self vs. externally generated tones. However, HP altered the processing of the self-generated voice: increased HP was associated with increased pre-stimulus alpha power and increased N1 response to the self-generated voice. HP did not affect the P2 response to voices. These findings confirm that both prediction and comparison of predicted and perceived feedback to a self-generated voice are altered in individuals with AVH predisposition. Specific alterations in the processing of self-generated vocalizations may establish a core feature of the psychosis continuum.

Additive and interactive effects of spatial attention and expectation on perceptual decisions

Spatial attention and expectation are two critical top-down mechanisms controlling perceptual inference. Based on previous research it remains unclear whether their influence on perceptual decisions is additive or interactive. We developed a novel multisensory approach that orthogonally manipulated spatial attention (i.e. task-relevance) and expectation (i.e. signal probability) selectively in audition and evaluated their effects on observers' responses in vision. Critically, while experiment 1 manipulated expectation directly via the probability of task-relevant auditory targets across hemifields, experiment 2 manipulated it indirectly via task-irrelevant auditory non-targets. Surprisingly, our results demonstrate that spatial attention and signal probability influence perceptual decisions either additively or interactively. These seemingly contradictory results can be explained parsimoniously by a model that combines spatial attention, general and spatially selective response probabilities as predictors with no direct influence of signal probability. Our model provides a novel perspective on how spatial attention and expectation facilitate effective interactions with the environment.

Emotional Oddball: A Review on Variants, Results, and Mechanisms

It is of the utmost importance for an organism to rapidly detect and react to changes in its environment. The oddball paradigm has repeatedly been used to explore the underlying cognitive and neurophysiological components of change detection. It is also used to investigate the special role of emotional content in perception and attention (emotional oddball paradigm; EOP). In this article, the EOP is systematically reviewed. The EOP is, for instance, used as a tool to address questions as to what degree emotional deviant stimuli trigger orientation reactions, which role the emotional context plays in the processing of deviant information, and how the processing of emotional deviant information differs interindividually (including clinical populations). Two main variants with regard to the emotionality of standards and deviants are defined. Most of the identified EOP studies report EEG data but an overview of behavioral data is also provided in this review. We integrate evidence from 99 EOP experiments and shape the EOP's theoretical background under the consideration of other paradigms’ mechanisms and theories.

The Cumulative Effects of Predictability on Synaptic Gain in the Auditory Processing Stream

Stimulus predictability can lead to substantial modulations of brain activity, such as shifts in sustained magnetic field amplitude, measured with magnetoencephalography (MEG). Here, we provide a mechanistic explanation of these effects using MEG data acquired from healthy human volunteers (N = 13, 7 female). In a source-level analysis of induced responses, we established the effects of orthogonal predictability manipulations of rapid tone-pip sequences (namely, sequence regularity and alphabet size) along the auditory processing stream. In auditory cortex, regular sequences with smaller alphabets induced greater gamma activity. Furthermore, sequence regularity shifted induced activity in frontal regions toward higher frequencies. To model these effects in terms of the underlying neurophysiology, we used dynamic causal modeling for cross-spectral density and estimated slow fluctuations in neural (postsynaptic) gain. Using the model-based parameters, we accurately explain the sensor-level sustained field amplitude, demonstrating that slow changes in synaptic efficacy, combined with sustained sensory input, can result in profound and sustained effects on neural responses to predictable sensory streams.

SIGNIFICANCE STATEMENT Brain activity can be strongly modulated by the predictability of stimuli it is currently processing. An example of such a modulation is a shift in sustained magnetic field amplitude, measured with magnetoencephalography. Here, we provide a mechanistic explanation of these effects. First, we establish the oscillatory neural correlates of independent predictability manipulations in hierarchically distinct areas of the auditory processing stream. Next, we use a biophysically realistic computational model to explain these effects in terms of the underlying neurophysiology. Finally, using the model-based parameters describing neural gain modulation, we can explain the previously unexplained effects observed at the sensor level. This demonstrates that slow modulations of synaptic gain can result in profound and sustained effects on neural activity.

Timing in Predictive Coding: The Roles of Task Relevance and Global Probability

Predictive coding models of attention propose that attention and prediction operate synergistically to optimize perception, as reflected in interactive effects on early sensory neural responses. It is yet unclear whether attention and prediction based on the temporal attributes of expected events operate in a similar fashion. We investigated how attention and prediction based on timing interact by manipulating the task relevance and a priori probability of auditory stimulus onset timing within a go/no-go task while recording EEG. Preparatory activity, as indexed via the contingent negative variation, reflected temporally specific anticipation as a function of both attention and prediction. Higher stimulus probability led to significant predictive N1 suppression; however, we failed to find an effect of task relevance on N1 amplitude and an interaction of task relevance with prediction. We suggest the predictability of sensory timing is the predominant influence on early sensory responses where a priori probabilities allow for strong prior beliefs. When this is the case, we find that the effects of temporal prediction on early sensory responses are independent of the task relevance of sensory stimuli. Our findings contribute to the expansion of predictive coding frameworks to include the role of timing in sensory processing.

Temporal variability in sung productions of adolescents who stutter

Singing has long been used as a technique to enhance and reeducate temporal aspects of articulation in speech disorders. In the present study, differences in temporal structure of sung versus spoken speech were investigated in stuttering. In particular, the question was examined if singing helps to reduce VOT variability of voiceless plosives, which would indicate enhanced temporal coordination of oral and laryngeal processes. Eight German adolescents who stutter and eight typically fluent peers repeatedly spoke and sang a simple German congratulation formula in which a disyllabic target word (e.g., /'ki:ta/) was repeated five times. Every trial, the first syllable of the word was varied starting equally often with one of the three voiceless German stops /p/, /t/, /k/. Acoustic analyses showed that mean VOT and stop gap duration reduced during singing compared to speaking while mean vowel and utterance duration was prolonged in singing in both groups. Importantly, adolescents who stutter significantly reduced VOT variability (measured as the Coefficient of Variation) during sung productions compared to speaking in word-initial stressed positions while the control group showed a slight increase in VOT variability. However, in unstressed syllables, VOT variability increased in both adolescents who do and do not stutter from speech to song. In addition, vowel and utterance durational variability decreased in both groups, yet, adolescents who stutter were still more variable in utterance duration independent of the form of vocalization. These findings shed new light on how singing alters temporal structure and in particular, the coordination of laryngeal-oral timing in stuttering. Future perspectives for investigating how rhythmic aspects could aid the management of fluent speech in stuttering are discussed.

LEARNING OUTCOMES

Readers will be able to describe (1) current perspectives on singing and its effects on articulation and fluency in stuttering and (2) acoustic parameters such as VOT variability which indicate the efficiency of control and coordination of laryngeal-oral movements. They will understand and be able to discuss (3) how singing reduces temporal variability in the productions of adolescents who do and do not stutter and 4) how this is linked to altered articulatory patterns in singing as well as to its rhythmic structure.

Modulation of Auditory Responses to Speech vs. Nonspeech Stimuli during Speech Movement Planning

Previously, we showed that the N100 amplitude in long latency auditory evoked potentials (LLAEPs) elicited by pure tone probe stimuli is modulated when the stimuli are delivered during speech movement planning as compared with no-speaking control conditions. Given that we probed the auditory system only with pure tones, it remained unknown whether the nature and magnitude of this pre-speech auditory modulation depends on the type of auditory stimulus. Thus, here, we asked whether the effect of speech movement planning on auditory processing varies depending on the type of auditory stimulus. In an experiment with nine adult subjects, we recorded LLAEPs that were elicited by either pure tones or speech syllables when these stimuli were presented prior to speech onset in a delayed-response speaking condition vs. a silent reading control condition. Results showed no statistically significant difference in pre-speech modulation of the N100 amplitude (early stages of auditory processing) for the speech stimuli as compared with the nonspeech stimuli. However, the amplitude of the P200 component (later stages of auditory processing) showed a statistically significant pre-speech modulation that was specific to the speech stimuli only. Hence, the overall results from this study indicate that, immediately prior to speech onset, modulation of the auditory system has a general effect on early processing stages but a speech-specific effect on later processing stages. This finding is consistent with the hypothesis that pre-speech auditory modulation may play a role in priming the auditory system for its role in monitoring auditory feedback during speech production.